
<ConMan> Console [soak-8] log opened at 2018-12-09 03:22:05 UTC.

<ConMan> Console [soak-8] connected to "ipmitool.exp" (pid 54315) at 12-09 03:22.
Connection established via ipmitool (pid 54710).
[119278.552959] Lustre: 22503:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[122877.893412] Lustre: 22503:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[126478.209620] Lustre: 25233:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[130077.532696] Lustre: 25233:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[133676.854639] Lustre: 22503:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[137277.169667] Lustre: 25258:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[140876.534694] Lustre: 22770:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[144476.867510] Lustre: 22770:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[148076.200688] Lustre: 25258:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[151676.520746] Lustre: 22727:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[155275.791811] Lustre: 25208:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[158876.095423] Lustre: 22502:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[162475.394999] Lustre: 22727:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[166075.695404] Lustre: 25208:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[169675.039831] Lustre: 22770:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[173275.375121] Lustre: 22770:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[176874.709526] Lustre: 25233:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[180474.045922] Lustre: 25258:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[184074.362465] Lustre: 25233:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[187673.671108] Lustre: 25233:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[189238.332347] Lustre: 22417:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544398018/real 0]  req@ffff918c66011b00 x1619230861163904/t0(0) o13->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544398025 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[189238.367000] Lustre: 22417:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
[189238.379303] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[189238.400624] Lustre: Skipped 1 previous similar message
[189241.828202] Lustre: soaked-OST000d-osc-MDT0000: Connection to soaked-OST000d (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[189241.850039] Lustre: Skipped 1 previous similar message
[189292.097575] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544398079/real 1544398079]  req@ffff918c83ed3f00 x1619230861166752/t0(0) o8->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544398090 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[189292.135234] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[189326.183635] LustreError: 22770:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[189326.196414] LustreError: 22770:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[189342.094461] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544398129/real 1544398129]  req@ffff918c83ed1200 x1619230861169296/t0(0) o8->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544398145 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[189342.132534] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[189442.088190] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544398229/real 1544398229]  req@ffff918c83ed4200 x1619230861173712/t0(0) o8->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544398255 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[189442.126817] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[189442.721980] Lustre: MGS: haven't heard from client 3e740984-00e5-a639-8bd5-795c1f9135b2 (at 192.168.1.105@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9190a2e86000, cur 1544398230 expire 1544398080 last 1544398003
[189531.591122] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 10 seconds
[189531.605112] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[189544.590247] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 3 seconds
[189602.961702] LNet: 214:0:(o2iblnd_cb.c:2405:kiblnd_passive_connect()) Conn stale 192.168.1.105@o2ib version 12/12 incarnation 1544398390565714/1544398390565714
[189602.987042] Lustre: MGS: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[189602.999047] Lustre: Skipped 9 previous similar messages
[189603.107622] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[189603.125946] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[189603.137099] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0009_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client[189603.586578] LNet: 22400:0:(o2iblnd_cb.c:1350:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.105@o2ib: connected

[189607.336493] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[189607.358624] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[189607.370140] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0001_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client
[189612.016702] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[189612.039936] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[189612.051718] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0005_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client
[189616.338617] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[189616.362183] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[189616.374064] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST000d_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client[189623.666421] Lustre: soaked-OST000d-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[189623.685046] Lustre: Skipped 1 previous similar message

[189641.347999] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[189641.378575] LustreError: Skipped 3 previous similar messages
[189666.349631] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[189666.349722] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[189666.349724] Lustre: Skipped 2 previous similar messages
[189666.391792] Lustre: Skipped 3 previous similar messages
[190802.965360] LustreError: 22578:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[190804.114558] LustreError: 22578:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[190804.128798] LustreError: 22578:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[190805.375900] LustreError: 22578:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[190805.390061] LustreError: 22578:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[191274.175299] Lustre: 22502:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[193511.136348] LustreError: 24804:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[193511.150411] LustreError: 24804:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[193513.809534] LustreError: 24804:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[194576.431357] LustreError: 22502:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[194577.676577] LustreError: 22727:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[194873.494502] Lustre: 25258:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[194877.379109] LustreError: 24804:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[194879.531956] LustreError: 24804:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[195947.938213] LustreError: 25258:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[195948.711651] LustreError: 25258:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[195948.725399] LustreError: 25258:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[195950.958697] LustreError: 25258:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[195950.972372] LustreError: 25258:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 5 previous similar messages
[196844.221319] LustreError: 25258:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[196846.969699] LustreError: 25258:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[198473.831707] Lustre: 25208:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[199091.808764] LustreError: 25233:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[199203.089146] LustreError: 22644:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[199504.210164] LustreError: 22578:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[199946.603704] LustreError: 22500:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[199946.617018] LustreError: 22500:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[199950.908547] LustreError: 22500:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[199950.921696] LustreError: 22500:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[199975.700278] LustreError: 22499:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[199975.713442] LustreError: 22499:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 6 previous similar messages
[201057.400344] LustreError: 25208:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[201057.413469] LustreError: 25208:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[201061.591658] LustreError: 24810:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[201061.604579] LustreError: 24810:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[201087.825905] LustreError: 22503:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[201112.308899] LustreError: 25258:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[201160.025142] LustreError: 25233:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[201202.036253] LustreError: 22729:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[201299.218401] LustreError: 22500:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[201299.231091] LustreError: 22500:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 7 previous similar messages
[201490.992802] LustreError: 22770:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[201491.005569] LustreError: 22770:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[201814.986415] LustreError: 25233:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[201814.999047] LustreError: 25233:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 5 previous similar messages
[202073.164518] Lustre: 25233:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[203412.517046] LustreError: 22503:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[203412.529729] LustreError: 22503:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[204553.175928] LustreError: 22578:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[204553.188589] LustreError: 22578:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 8 previous similar messages
[205459.897979] LustreError: 25208:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[205459.910649] LustreError: 25208:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[205463.182046] LustreError: 22502:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[205672.486670] Lustre: 22770:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[206867.420152] LustreError: 22498:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[206868.264608] LustreError: 22727:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[206868.277296] LustreError: 22727:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[206893.549997] LustreError: 25233:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[206893.562652] LustreError: 25233:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[206906.035929] LustreError: 22644:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[209272.806848] Lustre: 25208:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[212872.136733] Lustre: 25233:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[216472.457521] Lustre: 25258:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[220071.806811] Lustre: 25208:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[223672.182433] Lustre: 22578:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[227271.526382] Lustre: 25258:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[230871.873672] Lustre: 22502:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[234471.211675] Lustre: 22502:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[238070.550594] Lustre: 22502:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[241670.864696] Lustre: 25208:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[245270.190359] Lustre: 22502:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[245889.616650] LustreError: 22502:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[245890.332940] LustreError: 22500:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[245890.345322] LustreError: 22500:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[245891.546882] LustreError: 22502:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[245894.356894] LustreError: 22502:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[245916.010171] LustreError: 24810:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[245976.909957] LustreError: 22578:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[247117.048723] LustreError: 22727:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[247117.061101] LustreError: 22727:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[247945.550771] Lustre: 22417:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544456729/real 0]  req@ffff918c66013c00 x1619230864445328/t0(0) o400->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544456736 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[247945.586808] Lustre: 22417:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[247945.599462] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[247945.621422] Lustre: Skipped 1 previous similar message
[247995.626310] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544456786/real 1544456786]  req@ffff918c66014b00 x1619230864448816/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544456797 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[247995.664759] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[248045.623331] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544456836/real 1544456836]  req@ffff918c66010300 x1619230864451536/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544456852 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[248145.013618] Lustre: MGS: haven't heard from client 2bff7e0c-227c-c2f6-9e20-429a6a44edc7 (at 192.168.1.110@o2ib) in 233 seconds. I think it's dead, and I am evicting it. exp ffff918c667b9400, cur 1544456936 expire 1544456786 last 1544456703
[248146.265252] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0002-mdtlov_UUID (at 192.168.1.110@o2ib) in 234 seconds. I think it's dead, and I am evicting it. exp ffff918c6edf4800, cur 1544456937 expire 1544456787 last 1544456703
[248162.668351] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[248162.681187] Lustre: Skipped 3 previous similar messages
[248162.732020] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.111@o2ib, removing former export from 192.168.1.110@o2ib
[248171.615136] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544456936/real 0]  req@ffff918c66016300 x1619230864457264/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544456962 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[248171.653904] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[248197.044651] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds
[248197.058844] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[248220.630210] Lustre: soaked-MDT0002-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[248220.644529] Lustre: Skipped 1 previous similar message
[248221.179534] LustreError: 22578:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[248221.900163] LustreError: 22645:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[248245.611195] LustreError: 11-0: soaked-MDT0002-osp-MDT0000: operation obd_ping to node 192.168.1.111@o2ib failed: rc = -107
[248245.626521] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[248248.273907] LustreError: 22499:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[248248.287814] LustreError: 22499:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[248301.607308] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544457086/real 0]  req@ffff918c66012400 x1619230864465936/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544457092 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[248349.035504] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 3 seconds
[248417.129029] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[248462.727584] Lustre: soaked-MDT0002-osp-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[248462.742567] Lustre: Skipped 2 previous similar messages
[248870.526106] Lustre: 22502:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[249817.523354] LustreError: 22729:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[249817.537684] LustreError: 22729:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[249818.266788] LustreError: 22729:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[249843.574789] LustreError: 22498:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[249843.589015] LustreError: 22498:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 6 previous similar messages
[250987.683075] LustreError: 22645:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[250987.696944] LustreError: 22645:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[251798.049747] LustreError: 22727:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[251798.063896] LustreError: 22727:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[251798.705234] LustreError: 22727:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[252469.851322] Lustre: 22770:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[253100.669715] Lustre: MGS: Connection restored to 07a7737c-f8b5-4151-47c2-f539543cf668 (at 192.168.1.141@o2ib)
[253109.591649] Lustre: MGS: Connection restored to 0d8f3253-25bb-7c2b-bf52-ba3b862b04fc (at 192.168.1.120@o2ib)
[253109.605861] Lustre: Skipped 11 previous similar messages
[253125.946083] Lustre: MGS: Connection restored to 72579ea7-24be-c7c3-998e-a57c2351d836 (at 192.168.1.129@o2ib)
[253125.960320] Lustre: Skipped 21 previous similar messages
[253237.511591] Lustre: MGS: Connection restored to a75df623-a98d-9c97-d214-a0dac4f2805c (at 192.168.1.144@o2ib)
[253237.525804] Lustre: Skipped 3 previous similar messages
[255148.884805] LustreError: 40479:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[255148.897666] LustreError: 40479:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[255228.806667] LustreError: 25206:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[255471.421018] LustreError: 22502:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[256070.186882] Lustre: 40487:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[256369.579229] Lustre: 22420:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544465136/real 1544465161]  req@ffff918c6636bf00 x1619230882093808/t0(0) o400->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544465180 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[256369.620345] Lustre: 22420:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[256369.634070] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[256419.655149] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544465211/real 1544465211]  req@ffff918c6636ef00 x1619230882097760/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544465222 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[256419.696427] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[256519.649202] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544465311/real 1544465311]  req@ffff918c6636b900 x1619230882103600/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544465332 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[256519.690652] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[256544.437679] Lustre: MGS: haven't heard from client 5d70fb5d-7d48-8c31-1cd5-49aa3d442b82 (at 192.168.1.110@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff9190abd17400, cur 1544465336 expire 1544465186 last 1544465108
[256627.875673] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[256627.887936] Lustre: Skipped 1 previous similar message
[256628.186818] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[256628.265162] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[256628.276892] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0002_UUID (at 192.168.1.110@o2ib) because it is indicating it is a new client[256653.263742] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[256678.262129] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[256678.262243] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[256678.262246] Lustre: Skipped 1 previous similar message
[256678.302071] Lustre: Skipped 3 previous similar messages
[258176.550927] Lustre: 22421:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544466961/real 0]  req@ffff9189269f5100 x1619230885537168/t0(0) o400->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544466968 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[258176.589232] Lustre: 22421:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[258176.603495] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[258226.625575] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544467018/real 1544467018]  req@ffff9189269f1b00 x1619230885540720/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544467029 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[258226.668729] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[258276.622368] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544467068/real 1544467068]  req@ffff9189269f0f00 x1619230885543424/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544467084 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[258384.736327] Lustre: MGS: haven't heard from client 7e60c3e9-d3f8-7ca9-7417-e092a3fb0ecc (at 192.168.1.110@o2ib) in 232 seconds. I think it's dead, and I am evicting it. exp ffff918c8123d400, cur 1544467176 expire 1544467026 last 1544466944
[258402.614313] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544467168/real 0]  req@ffff9189269f5a00 x1619230885548864/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544467194 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[258402.656645] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[258435.426316] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 9 seconds
[258506.752964] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[258506.766057] Lustre: Skipped 2 previous similar messages
[258507.058732] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[258507.100886] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline

[258507.113230] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0002_UUID (at 192.168.1.110@o2ib) because it is indicating it is a new client[258532.099547] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[258557.097977] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[258557.117999] Lustre: Skipped 2 previous similar messages
[258582.096631] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[258607.094970] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[258607.095178] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[258607.129027] Lustre: Skipped 1 previous similar message
[259078.262176] Lustre: 22413:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544467863/real 0]  req@ffff918c72520c00 x1619230886772160/t0(0) o13->soaked-OST0004-osc-MDT0000@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544467870 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[259078.302840] Lustre: 22413:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[259078.317461] Lustre: soaked-OST0004-osc-MDT0000: Connection to soaked-OST0004 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[259078.870160] Lustre: soaked-OST0008-osc-MDT0000: Connection to soaked-OST0008 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[259291.855374] Lustre: MGS: haven't heard from client a99476db-b497-6c8d-85f4-b6121641a02d (at 192.168.1.104@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff918c667ba000, cur 1544468083 expire 1544467933 last 1544467855
[259333.247158] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.105@o2ib, removing former export from 192.168.1.104@o2ib
[259333.268120] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[259333.282324] Lustre: Skipped 2 previous similar messages
[259353.816727] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.105@o2ib, removing former export from 192.168.1.104@o2ib
[259353.837278] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[259360.830059] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544468121/real 0]  req@ffff918c6eb17200 x1619230886948272/t0(0) o8->soaked-OST000c-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544468152 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[259360.872461] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 23 previous similar messages
[259375.058154] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.105@o2ib, removing former export from 192.168.1.104@o2ib
[259375.078198] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[259381.368877] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 1 seconds
[259401.430581] Lustre: soaked-OST0008-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[259402.813545] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.105@o2ib, removing former export from 192.168.1.104@o2ib
[259418.645044] Lustre: soaked-OST0000-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[259418.660378] Lustre: Skipped 1 previous similar message
[259428.166677] Lustre: soaked-OST0004-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[259457.364214] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds
[259457.379508] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 3 previous similar messages
[259467.861209] Lustre: soaked-OST000c-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[259469.375355] LustreError: 40481:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[259485.154799] LustreError: 11-0: soaked-OST0008-osc-MDT0000: operation ost_destroy to node 192.168.1.105@o2ib failed: rc = -107
[259485.154912] Lustre: soaked-OST0008-osc-MDT0000: Connection to soaked-OST0008 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[259485.154914] Lustre: Skipped 2 previous similar messages
[259485.210091] LustreError: Skipped 7 previous similar messages
[259501.652178] Lustre: MGS: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[259513.812243] LustreError: 11-0: soaked-OST0000-osc-MDT0000: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107
[259513.828619] Lustre: soaked-OST0000-osc-MDT0000: Connection to soaked-OST0000 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[259528.339413] LustreError: 11-0: soaked-OST0004-osc-MDT0000: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107
[259528.355740] Lustre: soaked-OST0004-osc-MDT0000: Connection to soaked-OST0004 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[259537.986724] LustreError: 11-0: soaked-OST000c-osc-MDT0000: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107
[259538.003171] Lustre: soaked-OST000c-osc-MDT0000: Connection to soaked-OST000c (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[259611.399802] sd 7:0:1:1: attempting task abort! scmd(ffff918c6f23e680)
[259611.410512] sd 7:0:1:1: [sdi] CDB: Write(16) 8a 00 00 00 00 00 00 00 03 e8 00 00 00 20 00 00
[259611.423125] scsi target7:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[259611.434819] scsi target7:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[259611.626871] sd 7:0:1:1: task abort: SUCCESS scmd(ffff918c6f23e680)
[259611.637290] sd 7:0:1:1: attempting task abort! scmd(ffff918c6f23e840)
[259611.647558] sd 7:0:1:1: [sdi] CDB: Write(16) 8a 00 00 00 00 00 00 00 03 d0 00 00 00 10 00 00
[259611.659786] scsi target7:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[259611.671231] scsi target7:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[259612.137171] sd 7:0:1:1: task abort: SUCCESS scmd(ffff918c6f23e840)
[259612.147548] sd 7:0:1:1: attempting task abort! scmd(ffff918c6f23ea00)
[259612.158155] sd 7:0:1:1: [sdi] CDB: Write(16) 8a 00 00 00 00 00 00 00 03 b8 00 00 00 10 00 00
[259612.170813] scsi target7:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[259612.182425] scsi target7:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[259612.271215] sd 7:0:1:1: task abort: SUCCESS scmd(ffff918c6f23ea00)
[259612.280898] sd 7:0:1:1: attempting task abort! scmd(ffff918c6f23ebc0)
[259612.290446] sd 7:0:1:1: [sdi] CDB: Write(16) 8a 00 00 00 00 00 00 00 03 a0 00 00 00 08 00 00
[259612.302033] scsi target7:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[259612.312800] scsi target7:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[259612.870272] sd 7:0:1:1: task abort: SUCCESS scmd(ffff918c6f23ebc0)
[259612.878628] sd 7:0:1:1: attempting task abort! scmd(ffff918c6f23ed80)
[259612.887266] sd 7:0:1:1: [sdi] CDB: Write(16) 8a 00 00 00 00 00 00 00 03 78 00 00 00 20 00 00
[259612.898150] scsi target7:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[259612.908214] scsi target7:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[259613.156892] sd 7:0:1:1: task abort: SUCCESS scmd(ffff918c6f23ed80)
[259613.164999] sd 7:0:1:1: attempting task abort! scmd(ffff918c6f23ef40)
[259613.173384] sd 7:0:1:1: [sdi] CDB: Write(16) 8a 00 00 00 00 00 00 00 03 28 00 00 00 08 00 00
[259613.184003] scsi target7:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[259613.193913] scsi target7:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[259613.203409] sd 7:0:1:1: task abort: SUCCESS scmd(ffff918c6f23ef40)
[259669.512591] Lustre: 22578:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[260095.930062] LustreError: 25258:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[260097.285706] LustreError: 40941:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[260097.299320] LustreError: 40941:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[260098.504608] LustreError: 40484:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[260101.810420] LustreError: 40486:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[260101.823875] LustreError: 40486:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[260116.574126] LustreError: 22729:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[261389.279025] Lustre: 22413:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544470174/real 0]  req@ffff918c58a91e00 x1619230897188016/t0(0) o400->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544470181 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[261389.318418] Lustre: 22413:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
[261389.332040] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[261489.349427] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544470281/real 1544470281]  req@ffff918c58a97b00 x1619230897193936/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544470297 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[261489.389738] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[261563.573467] Lustre: MGS: haven't heard from client caf8a27a-d36c-79f7-ba51-a6fd2cd0f8f1 (at 192.168.1.110@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff91908c227c00, cur 1544470355 expire 1544470205 last 1544470128
[261612.123145] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[261612.134979] Lustre: Skipped 8 previous similar messages
[261612.374662] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[261612.471970] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[261612.483337] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0002_UUID (at 192.168.1.110@o2ib) because it is indicating it is a new client[261637.470261] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[261662.468687] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[261662.487205] Lustre: Skipped 2 previous similar messages
[261687.467304] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[261712.465810] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[261712.484627] Lustre: Skipped 1 previous similar message
[261737.464348] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[261762.462760] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[261762.462966] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[261762.495468] Lustre: Skipped 1 previous similar message
[263269.819636] Lustre: 40904:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[264106.422573] Lustre: 41033:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544472891/real 1544472891]  req@ffff918c39f30000 x1619230906887968/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544472898 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
[264106.463696] Lustre: 41033:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[264121.197670] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[264127.222347] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544472913/real 0]  req@ffff918c599dad00 x1619230906889488/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544472919 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[264127.264284] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[264159.222304] Lustre: 41033:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544472951/real 1544472951]  req@ffff918c39f30000 x1619230906887968/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544472958 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[264159.263366] Lustre: 41033:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 247939 previous similar messages
[264223.220423] Lustre: 41033:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544473015/real 1544473015]  req@ffff918c39f30000 x1619230906887968/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544473022 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[264223.256820] Lustre: 41033:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 626507 previous similar messages
[264299.777856] LNet: Service thread pid 40487 was inactive for 200.42s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[264299.804483] Pid: 40487, comm: mdt01_018 3.10.0-957.el7_lustre.x86_64 #1 SMP Fri Nov 30 18:46:05 UTC 2018
[264299.818847] Call Trace:

[264299.825027]  [<ffffffffc0e219f1>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[264299.839424]  [<ffffffffc0e23923>] ldlm_cli_enqueue_local+0x233/0x860 [ptlrpc]
[264299.850398]  [<ffffffffc12c58ec>] mdt_reint_rename_or_migrate.isra.39+0x67c/0x860 [mdt]
[264299.862132]  [<ffffffffc12c5b03>] mdt_reint_rename+0x13/0x20 [mdt]
[264299.871593]  [<ffffffffc12c9b43>] mdt_reint_rec+0x83/0x210 [mdt]
[264299.880702]  [<ffffffffc12ab37b>] mdt_reint_internal+0x5fb/0x9c0 [mdt]
[264299.890373]  [<ffffffffc12b6f17>] mdt_reint+0x67/0x140 [mdt]
[264299.898899]  [<ffffffffc0eba42a>] tgt_request_handle+0x92a/0x1370 [ptlrpc]
[264299.908726]  [<ffffffffc0e62e5b>] ptlrpc_server_handle_request+0x23b/0xaa0 [ptlrpc]
[264299.919378]  [<ffffffffc0e665a2>] ptlrpc_main+0xa92/0x1e40 [ptlrpc]
[264299.928332]  [<ffffffff972c1c31>] kthread+0xd1/0xe0
[264299.935600]  [<ffffffff97974c37>] ret_from_fork_nospec_end+0x0/0x39
[264299.944405]  [<ffffffffffffffff>] 0xffffffffffffffff
[264299.951678] LustreError: dumping log to /tmp/lustre-log.1544473092.40487
[264301.076605] LNet: Service thread pid 40532 was inactive for 201.72s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[264301.102138] Pid: 40532, comm: mdt00_022 3.10.0-957.el7_lustre.x86_64 #1 SMP Fri Nov 30 18:46:05 UTC 2018
[264301.115664] Call Trace:
[264301.121091]  [<ffffffffc0e219f1>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[264301.131562]  [<ffffffffc0e23923>] ldlm_cli_enqueue_local+0x233/0x860 [ptlrpc]
[264301.142134]  [<ffffffffc12c58ec>] mdt_reint_rename_or_migrate.isra.39+0x67c/0x860 [mdt]
[264301.153468]  [<ffffffffc12c5b03>] mdt_reint_rename+0x13/0x20 [mdt]
[264301.162531]  [<ffffffffc12c9b43>] mdt_reint_rec+0x83/0x210 [mdt]
[264301.171299]  [<ffffffffc12ab37b>] mdt_reint_internal+0x5fb/0x9c0 [mdt]
[264301.180589]  [<ffffffffc12b6f17>] mdt_reint+0x67/0x140 [mdt]
[264301.188773]  [<ffffffffc0eba42a>] tgt_request_handle+0x92a/0x1370 [ptlrpc]
[264301.198347]  [<ffffffffc0e62e5b>] ptlrpc_server_handle_request+0x23b/0xaa0 [ptlrpc]
[264301.208646]  [<ffffffffc0e665a2>] ptlrpc_main+0xa92/0x1e40 [ptlrpc]
[264301.217295]  [<ffffffff972c1c31>] kthread+0xd1/0xe0
[264301.224261]  [<ffffffff97974c37>] ret_from_fork_nospec_end+0x0/0x39
[264301.232753]  [<ffffffffffffffff>] 0xffffffffffffffff
[264326.880705] Lustre: MGS: haven't heard from client 585e631b-3571-0ad5-7a7f-d3e130e5d4e1 (at 192.168.1.111@o2ib) in 230 seconds. I think it's dead, and I am evicting it. exp ffff918c667ba400, cur 1544473119 expire 1544472969 last 1544472889
[264357.067417] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 2 seconds
[264364.080962] Lustre: 41033:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544473149/real 1544473149]  req@ffff918c39f30000 x1619230906887968/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544473156 ref 2 fl Rpc:X/2/ffffffff rc 0/-1
[264364.119581] Lustre: 41033:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 866815 previous similar messages
[264369.066728] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 14 seconds
[264382.065883] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 12 seconds
[264394.065240] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 24 seconds
[264394.079320] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[264399.348831] LustreError: 40487:0:(ldlm_request.c:130:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1544472891, 300s ago); not entering recovery in server code, just going back to sleep ns: mdt-soaked-MDT0000_UUID lock: ffff919080ce5a00/0xd144907e33b5f7b7 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2 rrc: 21 type: IBT flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 40487 timeout: 0 lvb_type: 0
[264399.349259] LustreError: dumping log to /tmp/lustre-log.1544473191.40532
[264399.369929] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[264399.369968] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[264399.369970] Lustre: Skipped 2 previous similar messages
[264399.450608] LustreError: 40487:0:(ldlm_request.c:130:ldlm_expired_completion_wait()) Skipped 1 previous similar message
[264407.064419] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 37 seconds
[264420.063664] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 50 seconds
[264445.062127] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 75 seconds
[264445.076424] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[264483.059843] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 12 seconds
[264483.074151] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[264559.055229] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 88 seconds
[264559.069549] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 6 previous similar messages
[264629.050961] Lustre: 41033:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544473414/real 1544473414]  req@ffff918c39f30000 x1619230906887968/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544473421 ref 2 fl Rpc:X/2/ffffffff rc 0/-1
[264629.090054] Lustre: 41033:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 22 previous similar messages
[264694.074012] Lustre: 41023:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
[264694.074012]   req@ffff918c39fdd400 x1619485722431392/t0(0) o103->ae2213f0-99c9-30d3-1cb6-ec3869aa24bf@192.168.1.120@o2ib:191/0 lens 328/224 e 24 to 0 dl 1544473491 ref 2 fl Interpret:H/0/0 rc 0/0
[264697.046893] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 51 seconds
[264697.061446] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 12 previous similar messages
[264700.356078] Lustre: soaked-MDT0000: Client 077d08eb-d447-a6a6-4a37-2b9dd1595095 (at 192.168.1.128@o2ib) reconnecting
[264700.356612] Lustre: soaked-MDT0000: Connection restored to 8b1d2414-fdf5-c0c4-6e9a-eb1e75d291f5 (at 192.168.1.135@o2ib)
[264700.356615] Lustre: Skipped 1 previous similar message
[264700.394169] Lustre: Skipped 1 previous similar message
[264701.673552] LNet: Service thread pid 41033 was inactive for 602.28s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[264701.698556] Pid: 41033, comm: ldlm_cn00_035 3.10.0-957.el7_lustre.x86_64 #1 SMP Fri Nov 30 18:46:05 UTC 2018
[264701.712704] Call Trace:
[264701.718377]  [<ffffffffc0e4a150>] ptlrpc_set_wait+0x4c0/0x920 [ptlrpc]
[264701.728719]  [<ffffffffc0e07e43>] ldlm_run_ast_work+0xd3/0x3a0 [ptlrpc]
[264701.738860]  [<ffffffffc0e0854e>] __ldlm_reprocess_all+0x10e/0x3a0 [ptlrpc]
[264701.749168]  [<ffffffffc0e087f0>] ldlm_reprocess_all+0x10/0x20 [ptlrpc]
[264701.758919]  [<ffffffffc0e2b7cd>] ldlm_request_cancel+0x46d/0x720 [ptlrpc]
[264701.768812]  [<ffffffffc0e31d0a>] ldlm_handle_cancel+0xba/0x250 [ptlrpc]
[264701.778454]  [<ffffffffc0e31fe1>] ldlm_cancel_handler+0x141/0x490 [ptlrpc]
[264701.788149]  [<ffffffffc0e62e5b>] ptlrpc_server_handle_request+0x23b/0xaa0 [ptlrpc]
[264701.798607]  [<ffffffffc0e665a2>] ptlrpc_main+0xa92/0x1e40 [ptlrpc]
[264701.807463]  [<ffffffff972c1c31>] kthread+0xd1/0xe0
[264701.814723]  [<ffffffff97974c37>] ret_from_fork_nospec_end+0x0/0x39
[264701.823451]  [<ffffffffffffffff>] 0xffffffffffffffff
[264701.830678] LustreError: dumping log to /tmp/lustre-log.1544473494.41033
[264736.437660] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.110@o2ib, removing former export from 192.168.1.111@o2ib
[264736.456450] LustreError: 22483:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff919034a7aa00 x1619230906923920/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
[264736.456509] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[264736.456512] Lustre: Skipped 2 previous similar messages
[264736.514305] Lustre: 40532:0:(service.c:2114:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (600:37s); client may timeout.  req@ffff918c599dc500 x1619485735009168/t25772757816(0) o36->077d08eb-d447-a6a6-4a37-2b9dd1595095@192.168.1.128@o2ib:191/0 lens 768/424 e 24 to 0 dl 1544473491 ref 1 fl Complete:/0/0 rc 0/0
[264736.530257] LNet: Service thread pid 40487 completed after 637.20s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
[264736.580062] Lustre: 40532:0:(service.c:2114:ptlrpc_server_handle_request()) Skipped 1 previous similar message
[264748.043958] Lustre: 41033:0:(service.c:2114:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (600:49s); client may timeout.  req@ffff918c39fdd400 x1619485722431392/t0(0) o103->ae2213f0-99c9-30d3-1cb6-ec3869aa24bf@192.168.1.120@o2ib:191/0 lens 328/192 e 24 to 0 dl 1544473491 ref 1 fl Complete:H/0/0 rc 0/0
[264748.085496] LNet: Service thread pid 41033 completed after 648.70s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
[264748.109999] LNet: Skipped 1 previous similar message
[264786.899640] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[264786.914391] Lustre: Skipped 1 previous similar message
[264811.477489] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[264821.180877] LustreError: 11-0: soaked-MDT0003-osp-MDT0000: operation obd_ping to node 192.168.1.110@o2ib failed: rc = -107
[264821.196408] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[264874.383977] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[264874.398795] Lustre: Skipped 2 previous similar messages
[266869.159027] Lustre: 22646:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[267513.503644] Lustre: 22417:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544476298/real 0]  req@ffff918c10eca100 x1619230939842064/t0(0) o6->soaked-OST000e-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 664/432 e 0 to 1 dl 1544476305 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[267513.503654] Lustre: soaked-OST0002-osc-MDT0000: Connection to soaked-OST0002 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[267513.567337] Lustre: 22417:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 35 previous similar messages
[267613.497683] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544476405/real 1544476405]  req@ffff918c8a760300 x1619230940494912/t0(0) o8->soaked-OST0006-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544476421 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[267613.539941] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 13 previous similar messages
[267711.710247] Lustre: MGS: haven't heard from client 50a89f19-c159-f266-a524-7374dc9a66b6 (at 192.168.1.106@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff918caa82a800, cur 1544476504 expire 1544476354 last 1544476276
[267762.114770] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[267762.132680] Lustre: Skipped 1 previous similar message
[267762.141201] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[267784.514996] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[267784.534636] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[267794.488026] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544476555/real 0]  req@ffff918c0a71d100 x1619230941919728/t0(0) o8->soaked-OST000e-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544476586 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[267794.531004] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
[267808.872552] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[267808.891531] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[267814.852774] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 1 seconds
[267814.867148] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 5 previous similar messages
[267829.879786] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[267853.990387] Lustre: soaked-OST000a-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[267854.005764] Lustre: Skipped 2 previous similar messages
[267900.930906] LustreError: 11-0: soaked-OST0002-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[267900.945830] Lustre: soaked-OST0002-osc-MDT0000: Connection to soaked-OST0002 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[267900.968697] Lustre: Skipped 3 previous similar messages
[267914.114023] LustreError: 11-0: soaked-OST000a-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[267914.129690] Lustre: soaked-OST000a-osc-MDT0000: Connection to soaked-OST000a (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[267919.689612] Lustre: soaked-OST0002-osc-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[267919.704882] Lustre: Skipped 5 previous similar messages
[267922.625411] LustreError: 11-0: soaked-OST0006-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[267922.640567] Lustre: soaked-OST0006-osc-MDT0000: Connection to soaked-OST0006 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[267928.114115] LustreError: 11-0: soaked-OST000e-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[267928.130538] Lustre: soaked-OST000e-osc-MDT0000: Connection to soaked-OST000e (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[267971.583812] perf: interrupt took too long (2532 > 2500), lowering kernel.perf_event_max_sample_rate to 78000
[268440.425075] Lustre: 22414:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544477207/real 1544477232]  req@ffff918c7762c200 x1619230962978064/t0(0) o400->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544477214 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[268440.425082] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[268440.491998] Lustre: 22414:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
[268599.258171] Lustre: MGS: haven't heard from client 54611972-4f39-8675-35cc-97cdb8682642 (at 192.168.1.110@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff91892603c000, cur 1544477391 expire 1544477241 last 1544477163
[268646.253731] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[268646.266817] Lustre: Skipped 5 previous similar messages
[268646.550273] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[268646.570256] Lustre: Skipped 1 previous similar message
[268646.668552] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[268646.680874] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0002_UUID (at 192.168.1.110@o2ib) because it is indicating it is a new client[268671.667905] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[268696.667387] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[268696.687610] Lustre: Skipped 2 previous similar messages
[268721.666663] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[268746.666077] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[268746.686081] Lustre: Skipped 1 previous similar message
[268771.665326] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[268796.664185] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[268796.684248] Lustre: Skipped 1 previous similar message
[268821.663351] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[268846.662279] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[268846.682369] Lustre: Skipped 1 previous similar message
[269647.353907] Lustre: 22420:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544478432/real 0]  req@ffff918925bf6300 x1619230990552768/t0(0) o400->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544478439 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[269647.395098] Lustre: 22420:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
[269647.409922] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[269669.790349] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[269672.434499] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[269676.292855] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.111@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[269681.166705] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.137@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[269688.477540] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[269688.504923] LustreError: Skipped 4 previous similar messages
[269698.119624] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.125@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[269698.146875] LustreError: Skipped 11 previous similar messages
[269718.710292] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.138@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[269718.738062] LustreError: Skipped 18 previous similar messages
[269747.430923] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544478539/real 1544478539]  req@ffff918fefb1a100 x1619230993026720/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544478555 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[269747.468406] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages

[269750.761093] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[269750.790052] LustreError: Skipped 41 previous similar messages
[269817.831845] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[269818.516438] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[269818.704218] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.138@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[269818.704301] LustreError: Skipped 46 previous similar messages
[269868.700969] Lustre: MGS: haven't heard from client f984eba9-a366-1ffb-cf4b-94ee013b529f (at 192.168.1.109@o2ib) in 231 seconds. I think it's dead, and I am evicting it. exp ffff918c667b9c00, cur 1544478661 expire 1544478511 last 1544478430
[269898.723455] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 1 seconds
[269898.740794] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 3 previous similar messages
[269948.729722] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.124@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[269948.757103] LustreError: Skipped 85 previous similar messages
[269978.416505] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544478739/real 1544478739]  req@ffff918c4ca3bc00 x1619230993879776/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544478770 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
[269978.459392] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[269985.702700] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[269985.715677] Lustre: Skipped 3 previous similar messages
[269986.023949] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.109@o2ib, removing former export from same NID
[269986.113036] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[269986.125467] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0001_UUID (at 192.168.1.109@o2ib) because it is indicating it is a new client
[270036.109341] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.109@o2ib, removing former export from same NID
[270036.133385] Lustre: Skipped 2 previous similar messages
[270036.142598] Lustre: soaked-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[270086.106383] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.109@o2ib, removing former export from same NID
[270088.811427] LustreError: 40486:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[270245.816839] Lustre: 22413:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544479030/real 0]  req@ffff918c723a8300 x1619230997155296/t0(0) o13->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544479037 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[270245.853360] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[270443.522855] Lustre: MGS: haven't heard from client d3cc1e6d-88ae-354d-b20a-5b1d8a36d993 (at 192.168.1.105@o2ib) in 230 seconds. I think it's dead, and I am evicting it. exp ffff91892833ac00, cur 1544479236 expire 1544479086 last 1544479006
[270469.478732] Lustre: 25208:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[270501.884081] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[270501.904868] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[270501.918916] Lustre: Skipped 2 previous similar messages
[270521.542426] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[270538.982924] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[270541.683725] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 3 seconds
[270554.682862] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 9 seconds
[270554.697949] LNet: 22400:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[270558.398908] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[270613.569417] LustreError: 11-0: soaked-OST0009-osc-MDT0000: operation ost_destroy to node 192.168.1.104@o2ib failed: rc = -107
[270613.589339] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[270613.614306] Lustre: Skipped 3 previous similar messages
[270628.905837] LustreError: 11-0: soaked-OST0001-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[270628.922211] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[270631.176749] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[270631.190659] Lustre: Skipped 9 previous similar messages
[270636.937353] LustreError: 11-0: soaked-OST0005-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[270639.625109] LustreError: 11-0: soaked-OST000d-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[272561.982991] LustreError: 40932:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[272561.996555] LustreError: 40932:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[272593.768888] perf: interrupt took too long (3167 > 3165), lowering kernel.perf_event_max_sample_rate to 63000
[274068.769128] Lustre: 40488:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[274217.509638] Lustre: 22419:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544482997/real 0]  req@ffff918915b78600 x1619231198212640/t0(0) o400->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544483010 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[274217.550968] Lustre: 22419:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 58 previous similar messages
[274217.565689] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[274217.591194] Lustre: Skipped 2 previous similar messages
[274234.631179] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.111@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[274234.654355] LustreError: Skipped 31 previous similar messages
[274267.254880] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.142@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[274267.280076] LustreError: Skipped 25 previous similar messages
[274317.593895] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544483110/real 1544483110]  req@ffff91892553fb00 x1619231203948128/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544483126 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[274317.637355] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[274332.992026] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.139@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[274333.018269] LustreError: Skipped 53 previous similar messages
[274402.749066] Lustre: MGS: haven't heard from client d8bc942f-9123-a7ad-2caf-988bd4e8836b (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff918c6cf1e000, cur 1544483195 expire 1544483045 last 1544482968
[274403.185682] LDISKFS-fs warning (device dm-2): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[274403.185682] 
[274454.460677] LDISKFS-fs (dm-2): recovery complete
[274454.498938] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[274458.645002] Lustre: soaked-MDT0000: Received LWP connection from 0@lo, removing former export from 192.168.1.109@o2ib
[274458.660695] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[274458.673171] Lustre: Skipped 6 previous similar messages
[274459.443990] Lustre: soaked-MDT0000: Received LWP connection from 0@lo, removing former export from 192.168.1.109@o2ib
[274459.483532] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900
[274459.575714] LustreError: 58500:0:(llog_osd.c:978:llog_osd_next_block()) soaked-MDT0003-osp-MDT0001: missed desired record? 3 > 1
[274459.594914] LustreError: 58500:0:(lod_dev.c:419:lod_sub_recovery_thread()) soaked-MDT0003-osp-MDT0001 getting update log failed: rc = -2
[274459.687257] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[274459.700195] Lustre: 58501:0:(ldlm_lib.c:2059:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[274459.929567] Lustre: soaked-MDT0001: disconnecting 29 stale clients
[274461.125660] Lustre: Failing over soaked-MDT0001
[274461.610667] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.131@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[274461.637318] LustreError: Skipped 111 previous similar messages
[274461.772907] Lustre: server umount soaked-MDT0001 complete
[274484.442839] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544483277/real 1544483277]  req@ffff918c5f27ef00 x1619231204539728/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544483308 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[274484.485699] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[274498.286715] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[274498.306260] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[274498.320054] Lustre: Skipped 1 previous similar message
[274719.778724] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.130@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[274719.805495] LustreError: Skipped 226 previous similar messages
[274784.424399] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544483577/real 1544483577]  req@ffff918c5f27c500 x1619231204556048/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544483632 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[274784.467250] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
[275232.936512] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.139@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[275232.963362] LustreError: Skipped 456 previous similar messages
[275334.390704] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544484127/real 1544484127]  req@ffff918c5f27bf00 x1619231204585968/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544484138 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[275334.433598] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 10 previous similar messages
[275833.559194] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[275833.586122] LustreError: Skipped 531 previous similar messages
[275984.351000] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544484777/real 1544484777]  req@ffff918c5f278f00 x1619231204621328/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544484833 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[275984.394072] Lustre: 22411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 12 previous similar messages
[276109.348425] sd 7:0:1:1: [sdi] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[276109.360752] sd 7:0:1:1: [sdi] Sense Key : Illegal Request [current] 
[276109.371423] sd 7:0:1:1: [sdi] <<vendor>>ASC=0x94 ASCQ=0x1 
[276109.381105] sd 7:0:1:1: [sdi] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00
[276109.394085] blk_update_request: 21 callbacks suppressed
[276109.403425] blk_update_request: I/O error, dev sdi, sector 11608952
[276109.413937] device-mapper: multipath: Failing path 8:128.
[276113.632687] device-mapper: multipath: Reinstating path 8:128.
[276142.339829] LNet: 22400:0:(o2iblnd_cb.c:1350:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.109@o2ib: connected
[276175.673392] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[276184.355093] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[276184.377767] LustreError: 40487:0:(osp_object.c:582:osp_attr_get()) soaked-MDT0001-osp-MDT0000:osp_attr_get update error [0x240004a50:0x1:0x0]: rc = -5
[276184.382627] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[276184.382630] Lustre: Skipped 2 previous similar messages
[276452.813409] LustreError: 24810:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[276452.827225] LustreError: 24810:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[276453.593148] LustreError: 22501:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[276453.607168] LustreError: 22501:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[276454.660048] LustreError: 40941:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[276454.674059] LustreError: 40941:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[276472.549325] LustreError: 25233:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[276472.563541] LustreError: 25233:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[276483.745272] LustreError: 40544:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[276483.759109] LustreError: 40544:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[276501.630397] LustreError: 40472:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [7m[4;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[4;79H[m[m[5;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [4;79H[22;1H   The selected entry will be started automatically in 5s.                     [4;79H[22;1H   The selected entry will be started automatically in 4s.                     [4;79H[22;1H   The selected entry will be started automatically in 3s.                     [4;79H[22;1H   The selected entry will be started automatically in 2s.                     [4;79H[22;1H   The selected entry will be started automatically in 1s.                     [4;79H[22;1H   The selected entry will be started automatically in 0s.                     [4;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-307-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Fri Nov 30 18:46:05 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x34b20000-0x36587fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 320MB of memory at 512MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffffa0422e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 6841488k/34603008k available (7664k kernel code, 1126748k absent, 1001116k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.438 MHz processor
[    0.000181] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.87 BogoMIPS (lpj=2693438)
[    0.012652] pid_max: default: 245760 minimum: 1920
[    0.019166] Security Framework initialized
[    0.024057] SELinux:  Initializing.
[    0.028586] Yama: becoming mindful.
[    0.038080] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.060386] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.074722] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.082817] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.093718] Initializing cgroup subsys memory
[    0.098958] Initializing cgroup subsys devices
[    0.104232] Initializing cgroup subsys freezer
[    0.109491] Initializing cgroup subsys net_cls
[    0.114762] Initializing cgroup subsys blkio
[    0.119830] Initializing cgroup subsys perf_event
[    0.125429] Initializing cgroup subsys hugetlb
[    0.130703] Initializing cgroup subsys pids
[    0.135677] Initializing cgroup subsys net_prio
[    0.141322] mce: CPU supports 20 MCE banks
[    0.146227] CPU0: Thermal monitoring enabled (TM1)
[    0.152017] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.158444] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.165062] tlb_flushall_shift: 6
[    0.169130] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.180392] FEATURE SPEC_CTRL Present
[    0.184778] FEATURE IBPB_SUPPORT Present
[    0.189763] Spectre V2 : Mitigation: Full retpoline
[    0.196551] Freeing SMP alternatives: 28k freed
[    0.208305] ACPI: Core revision 20130517
[    0.304330] ACPI: All ACPI Tables successfully acquired
[    0.332148] ftrace: allocating 29187 entries in 115 pages
[    0.394003] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.401688] Switched APIC routing to physical flat.
[    0.408161] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.425182] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.436434] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.449158] ... version:                3
[    0.458604] ... bit width:              48
[    0.463467] ... generic registers:      4
[    0.468232] ... value mask:             0000ffffffffffff
[    0.474458] ... max period:             00007fffffffffff
[    0.480683] ... fixed-purpose events:   3
[    0.485461] ... event mask:             000000070000000f
[    0.500283] smpboot: Booting Node   0, Processors  #1[    0.522105] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.578454] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.719621] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.762800] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.804307] Brought up 32 CPUs
[    0.808507] smpboot: Max logical packages: 15
[    0.813693] smpboot: Total of 32 processors activated (172572.67 BogoMIPS)
[    1.071558] node 0 initialised, 2813371 pages in 136ms
[    1.109308] node 1 initialised, 3595039 pages in 168ms
[    1.116588] devtmpfs: initialized
[    1.132833] EVM: security.selinux
[    1.136827] EVM: security.ima
[    1.140434] EVM: security.capability
[    1.144993] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.154366] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.167306] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.175290] pinctrl core: initialized pinctrl subsystem
[    1.181726] RTC time: 23:44:22, date: 12/10/18
[    1.187487] NET: Registered protocol family 16
[    1.193300] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.202268] ACPI: bus type PCI registered
[    1.207036] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.215174] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.226081] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.234006] PCI: Using configuration type 1 for base access
[    1.240587] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.261513] ACPI: Added _OSI(Module Device)
[    1.266481] ACPI: Added _OSI(Processor Device)
[    1.271737] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.277286] ACPI: Added _OSI(Processor Aggregator Device)
[    1.283610] ACPI: Added _OSI(Linux-Dell-Video)
[    1.328687] ACPI: Executed 1 blocks of module-level executable AML code
[    1.617552] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.651183] ACPI: Interpreter enabled
[    1.655607] ACPI: (supports S0 S1 S5)
[    1.659986] ACPI: Using IOAPIC for interrupt routing
[    1.665943] HEST: Table parsing has been initialized.
[    1.671884] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.682677] ACPI: GPE 0x1E active on init
[    1.687629] ACPI: GPE 0x24 active on init
[    1.692568] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.758724] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.765938] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.776118] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.785114] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.794170] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.804122] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.816298] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.831683] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.847459] PCI host bridge to bus 0000:00
[    1.852330] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.859534] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.868390] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.877257] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.886122] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.894988] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.903864] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.912735] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.921601] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.930454] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.939315] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.948183] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.957050] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.965912] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.974778] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.984413] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.991386] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.998307] pci 0000:00:01.1: System wakeup disabled by ACPI
[    2.005230] pci 0000:00:02.0: System wakeup disabled by ACPI
[    2.012142] pci 0000:00:02.2: System wakeup disabled by ACPI
[    2.019063] pci 0000:00:03.0: System wakeup disabled by ACPI
[    2.029552] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    2.036493] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    2.043412] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    2.050362] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.057207] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.064773] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.070781] acpiphp: Slot [2] registered
[    2.075760] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.086599] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.097776] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.108597] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.119774] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.130622] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.141803] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.152643] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.165487] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.171838] acpiphp: Slot [2-2] registered
[    2.179153] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.185188] acpiphp: Slot [2-3] registered
[    2.190097] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.196111] acpiphp: Slot [2-4] registered
[    2.201307] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.207490] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.220796] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.226764] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.233036] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.239730] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.245697] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.254966] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.263994] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.273008] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.282021] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.291025] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.300030] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.309045] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.318056] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.327273] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.334472] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.344385] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.353217] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.362280] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.372358] PCI host bridge to bus 0000:80
[    2.377227] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.385114] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.393000] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.401868] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.410738] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.420376] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.427024] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.433923] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.440814] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.447706] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.456844] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.462783] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.468714] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.474629] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.496185] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.503110] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.512815] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.522997] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.530295] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.540057] PCI host bridge to bus 0000:7f
[    2.544929] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.555859] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.562774] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.572474] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.582653] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.589954] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.599725] PCI host bridge to bus 0000:ff
[    2.604594] pci_bus 0000:ff: root bus resource [bus ff]
[    2.616111] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.625678] vgaarb: loaded
[    2.628987] vgaarb: bridge control possible 0000:09:00.0
[    2.635651] SCSI subsystem initialized
[    2.640187] ACPI: bus type USB registered
[    2.645000] usbcore: registered new interface driver usbfs
[    2.651439] usbcore: registered new interface driver hub
[    2.657951] usbcore: registered new device driver usb
[    2.664443] EDAC MC: Ver: 3.0.0
[    2.668793] PCI: Using ACPI for IRQ routing
[    2.681366] NetLabel: Initializing
[    2.685457] NetLabel:  domain hash size = 128
[    2.690613] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.696488] NetLabel:  unlabeled traffic allowed by default
[    2.703376] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.711360] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.720224] amd_nb: Cannot enumerate AMD northbridges
[    2.726370] Switched to clocksource hpet
[    2.745642] pnp: PnP ACPI init
[    2.749379] ACPI: bus type PNP registered
[    2.754446] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.761369] system 00:00: [io  0xffff] has been reserved
[    2.767604] system 00:00: [io  0xffff] has been reserved
[    2.773844] system 00:00: [io  0xffff] has been reserved
[    2.780081] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.787387] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.794307] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.801211] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.808127] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.815432] system 00:00: [io  0x0cf9] could not be reserved
[    2.822267] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.830729] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.838427] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.846130] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.853818] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.861513] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.869203] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.877290] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.885375] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.893462] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.901675] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.910281] pnp: PnP ACPI: found 7 devices
[    2.915154] ACPI: bus type PNP unregistered
[    2.929545] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.935416] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.941553] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.948656] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.956548] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.962397] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.970280] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.980218] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.986067] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.991909] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.999018] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    3.006910] pci 0000:00:11.0: PCI bridge to [bus 07]
[    3.012753] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    3.019863] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    3.027756] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    3.037700] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    3.043564] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    3.049411] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    3.057300] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    3.066466] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    3.072554] pci 0000:80:01.0: PCI bridge to [bus 81]
[    3.078415] pci 0000:80:02.0: PCI bridge to [bus 82]
[    3.084268] pci 0000:80:03.0: PCI bridge to [bus 83]
[    3.090122] pci 0000:80:03.2: PCI bridge to [bus 84]
[    3.096356] NET: Registered protocol family 2
[    3.103687] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.113358] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.121417] TCP: Hash tables configured (established 262144 bind 65536)
[    3.129210] TCP: reno registered
[    3.133270] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.140728] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.149702] NET: Registered protocol family 1
[    4.254385] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.362412] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.371228] Unpacking initramfs...
[    6.204984] Freeing initrd memory: 27040k freed
[    6.220995] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    6.228514] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffffa03eb73c7000-ffffa03ebb3c6fff]
[    6.240559] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    6.249917] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    6.256641] RAPL PMU: hw unit of domain package 2^-16 Joules
[    6.263280] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    6.282795] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    6.289919] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    6.304151] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    6.312726] Initialise system trusted keyring
[    6.318030] audit: initializing netlink socket (disabled)
[    6.324405] type=2000 audit(1544485463.824:1): initialized
[    6.386744] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.394145] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.404698] zpool: loaded
[    6.407933] zbud: loaded
[    6.412259] VFS: Disk quotas dquot_6.6.0
[    6.417451] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.426464] msgmni has been set to 32768
[    6.431543] Key type big_key registered
[    6.438751] NET: Registered protocol family 38
[    6.444047] Key type asymmetric registered
[    6.448934] Asymmetric key parser 'x509' registered
[    6.454839] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.463894] io scheduler noop registered
[    6.468602] io scheduler deadline registered (default)
[    6.474805] io scheduler cfq registered
[    6.479402] io scheduler mq-deadline registered
[    6.484776] io scheduler kyber registered
[    6.495454] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.503594] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.511691] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.519308] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.526912] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.534531] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.542166] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.550241] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.557876] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.566009] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.574105] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.581753] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.589853] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.597460] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.605108] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.613239] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.621337] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.628989] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.637101] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.645235] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.653370] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.661576] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.668140] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.675893] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.684501] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.693299] ACPI: Power Button [PWRF]
[    6.697786] ACPI: Requesting acpi_cpufreq
[    6.785903] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.794852] pstore: Registered erst as persistent store backend
[    6.802098] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.811114] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.839304] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.866730] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.874336] Non-volatile memory driver v1.3
[    6.879388] Linux agpgart interface v0.103
[    6.884716] crash memory driver: version 1.1
[    6.890287] rdac: device handler registered
[    6.895368] hp_sw: device handler registered
[    6.900469] emc: device handler registered
[    6.905662] alua: device handler registered
[    6.910747] libphy: Fixed MDIO Bus: probed
[    6.920605] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.928236] ehci-pci: EHCI PCI platform driver
[    6.933973] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.940243] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.949074] ehci-pci 0000:00:1a.0: debug port 2
[    6.958406] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.970460] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.977300] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.985201] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.993798] usb usb1: Product: EHCI Host Controller
[    6.999567] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.008255] usb usb1: SerialNumber: 0000:00:1a.0
[    7.013952] hub 1-0:1.0: USB hub found
[    7.018463] hub 1-0:1.0: 2 ports detected
[    7.023836] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    7.030078] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    7.038896] ehci-pci 0000:00:1d.0: debug port 2
[    7.048206] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    7.060455] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    7.067261] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    7.075164] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.083757] usb usb2: Product: EHCI Host Controller
[    7.089517] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.098205] usb usb2: SerialNumber: 0000:00:1d.0
[    7.103870] hub 2-0:1.0: USB hub found
[    7.108371] hub 2-0:1.0: 2 ports detected
[    7.113403] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    7.120634] ohci-pci: OHCI PCI platform driver
[    7.125963] uhci_hcd: USB Universal Host Controller Interface driver
[    7.133551] usbcore: registered new interface driver usbserial_generic
[    7.141186] usbserial: USB Serial support registered for generic
[    7.148291] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    7.278591] tsc: Refined TSC clocksource calibration: 2693.511 MHz
[    8.200995] i8042: No controller found
[    8.205534] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    8.205555] Switched to clocksource tsc
[    8.205670] mousedev: PS/2 mouse device common for all mice
[    8.205900] rtc_cmos 00:01: RTC can wake from S4
[    8.206117] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    8.206171] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    8.206291] intel_pstate: Intel P-state driver initializing
[    8.221638] cpuidle: using governor menu
[    8.223177] hidraw: raw HID events driver (C) Jiri Kosina
[    8.223436] usbcore: registered new interface driver usbhid
[    8.223436] usbhid: USB HID core driver
[    8.223665] drop_monitor: Initializing network drop monitor service
[    8.224204] TCP: cubic registered
[    8.224214] Initializing XFRM netlink socket
[    8.224905] NET: Registered protocol family 10
[    8.226496] NET: Registered protocol family 17
[    8.226510] mpls_gso: MPLS GSO support
[    8.229729] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    8.230058] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    8.230274] Loading compiled-in X.509 certificates
[    8.231354] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    8.232406] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    8.233453] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: c7aec20a70554693bf19667e4c28ac12c728bbb2'
[    8.233520] registered taskstats version 1
[    8.238158] Key type trusted registered
[    8.242248] Key type encrypted registered
[    8.242386] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    8.244063]   Magic number: 14:912:756
[    8.244265] acpi LNXCPU:4e: hash matches
[    8.245927] rtc_cmos 00:01: setting system clock to 2018-12-10 23:44:29 UTC (1544485469)
[    8.368515] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    8.381880] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    8.381884] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.382192] hub 1-1:1.0: USB hub found
[    8.382256] hub 1-1:1.0: 6 ports detected
[    8.440714] Freeing unused kernel memory: 1876k freed
[    8.447089] Write protecting the kernel read-only data: 12288k
[    8.455598] Freeing unused kernel memory: 516k freed
[    8.463066] Freeing unused kernel memory: 600k freed
[    8.476743] random: systemd: uninitialized urandom read (16 bytes read)
[    8.483789] random: fast init done
[    8.492950] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    8.494708] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.496170] systemd[1]: Detected architecture x86-64.
[    8.496176] systemd[1]: Running in initial RAM disk.
[    8.533420] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.533881] hub 2-1:1.0: USB hub found
[    8.534056] hub 2-1:1.0: 8 ports detected

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.561703] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.643043] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.654061] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.664791] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.675698] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[    8.688702] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.701740] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.715760] systemd[1]: Starting Setup Virtual Console...
         Starting Setup Virtual Console...
[    8.729095] systemd[1]: Starting Journal Service...
          StartinJournal Service...
[    8.750520] systemd[1]: Starting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.761671] systemd[1]: Reached target Sockets.
[[32m  OK  [0m] Reached target Sockets.
[    8.772582] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Starting Create list of required st... nodes for the current kernel...
[    8.793689] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.807699] systemd[1]: Starting dracut cmdline hook...
[    8.813845] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
          Startin    8.827575] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.837580] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.848115] systemd[1]: Started Journal Service.
[[32m  O K  [0m] Starte[[32m  OK  [0m] Started Setup Virtual Console.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
         Starting Create Static Device Nodes in /dev...
[[32m  O K  [0m] Startee Nodes in /dev.
[    8.924055] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
[    8.932042] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.940757] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.947175] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.947177] usb 2-1.4: SerialNumber: serial
[    8.949298] input: American Me gatrends Inc. Vces/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
[[32m  OK  [0m] Started dracut cmdline hook.
         Starting dracut pre-udev hook...
[    9.000166] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
[    9.019140] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
[    9.034471] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
[[32m  OK  [0m] Reached target System Initialization.
         Starting Show Plymouth Boot Screen...
         Starting dracut initqueue hook...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Reached target Basic System.
[    9.224859] dca service started, version 1.12.1
[    9.231038] mlx_compat: loading out-of-tree module taints kernel.
[    9.238474] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    9.238479] pps_core: LinuxPPS API ver. 1 registered
[    9.238480] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    9.267580] Compat-mlnx-ofed backport release: b4fdfac
[    9.273658] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    9.281362] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    9.288621] PTP clock support registered
[    9.323176] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    9.323734] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    9.323738] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    9.335148] scsi host0: ahci
[    9.335630] scsi host1: ahci
[    9.335835] scsi host2: ahci
[    9.336131] scsi host3: ahci
[    9.336316] scsi host4: ahci
[    9.336454] scsi host5: ahci
[    9.336535] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 38
[    9.336539] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 38
%G[    9.336542] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 38
[    9.336544] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 38
[    9.336546] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 38
[    9.336549] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 38
[    9.368067] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    9.368113] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.368128] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    9.368135] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    9.368138] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.368143] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.368268] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    9.368308] mlx4_core: Initializing 0000:04:00.0
[    9.368545] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.371090] scsi host6: isci
[    9.415443] igb: Copyright (c) 2007-2014 Intel Corporation.
[    9.416456] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    9.454338] igb 0000:02:00.0: added PHC on eth0
[    9.454341] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.454344] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    9.454422] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    9.454423] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
%G[    9.455445] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.472272] [TTM] Zone  kernel: Available graphics memory: 16252602 kiB
[    9.472273] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.472274] [TTM] Initializing pool allocator
[    9.472287] [TTM] Initializing DMA pool allocator
[    9.501193] igb 0000:02:00.1: added PHC on eth1
[    9.501194] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.501196] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.501269] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.501270] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.559185] igb 0000:02:00.2: added PHC on eth2
[    9.559187] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.559189] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.559263] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.559265] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.565660] fbcon: mgadrmfb (fb0) is primary device
[    9.616561] igb 0000:02:00.3: added PHC on eth3
[    9.616562] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.616564] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.616637] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.616639] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.641594] ata3: SATA link down (SStatus 0 SControl 300)
[    9.641613] ata4: SATA link down (SStatus 0 SControl 300)
[    9.641636] ata1: SATA link down (SStatus 0 SControl 300)
[    9.642613] ata2: SATA link down (SStatus 0 SControl 300)
[    9.642659] ata6: SATA link down (SStatus 0 SControl 300)
[    9.643725] ata5: SATA link down (SStatus 0 SControl 300)
[    9.802510] Console: switching to colour frame buffer device 128x48
[    9.826879] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.881600] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   11.045378] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   11.052230] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   11.061131] ata7.00: configured for UDMA/133
[   11.078167] scsi 6:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.900533] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.908143] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.915556] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.923346] mlx4_core: device is working in RoCE mode: Roce V1
[   15.930454] mlx4_core: UD QP Gid type is: V1
[   16.991212] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   17.277449] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   17.288909] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   17.297353] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   17.433539] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   17.441470] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   17.451443] ata8.00: configured for UDMA/133
[   17.458849] scsi 6:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.515754] sd 6:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.515908] sd 6:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.516101] sd 6:0:1:0: [sdb] Write Protect is off
[   17.516175] sd 6:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.519606]  sdb:
[   17.520225] sd 6:0:1:0: [sdb] Attached SCSI disk
[   17.564530] sd 6:0:0:0: [sda] Write Protect is off
[   17.571308] sd 6:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.604024]  sda: sda1 sda2
[   17.609158] sd 6:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
         Mounting /sysroot...
[   18.315450] random: crng init done
[   18.335939] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
[[32m  OK  [0m] Stopped target Timers.
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped target Local File Systems.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped udev Kernel[   18.825574] systemd-journald[282]: Received SIGTERM from PID 1 (systemd).
 Device Manager.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Closed udev Control Socket.
[[32m  OK  [0m] Closed udev Kernel Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.159066] SELinux:  Disabled at runtime.
[   19.224840] type=1404 audit(1544485480.478:2): selinux=0 auid=4294967295 ses=4294967295
[   19.464938] ip_tables: (C) 2000-2006 Netfilter Core Team
[   19.473299] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Listening on udev Control Socket.
         Starting Create list of required st... nodes for the current kernel...
         Starting Availability of block devices...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
         Starting Read and set NIS domainname from /etc/sysconfig/network...
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Stopped target Initrd Root File System.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Created slice User and Session Slice.
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Reached target Paths.
         Mounting Debug File System...
         Starting Kernel Module supporting RPCSEC_GSS...
         Starting Replay Read-Ahead Data...
         Mounting Huge Pages File System...
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the cu[   20.508265] EXT4-fs (sda1): re-mounted. Opts: (null)
rrent kernel.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
[[32m  OK  [0m] Started LVM2 metadata daemon.
[   20.681692] RPC: Registered named UNIX socket transport module.
[   20.681693] RPC: Registered udp transport module.
[   20.681694] RPC: Registered tcp transport module.
[   20.681694] RPC: Registered tcp NFSv4.1 backchannel transport module.
         Starting udev Coldplug all Devices...
         Starting Configure read-only root support...
         Starting Flush Journal to Persistent Storage...
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[   20.917637] systemd-journald[4366]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[   21.049532] device-mapper: uevent: version 1.0.3
[   21.056242] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started udev Kernel Device Manager.
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[   21.372933] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   21.385496] i801_smbus 0000:07:00.3: Enabling SMBus device
[   21.392837] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   21.400593] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   21.409269] igb 0000:02:00.0: DCA enabled
[   21.415033] igb 0000:02:00.1: DCA enabled
[   21.421931] igb 0000:02:00.2: DCA enabled
[   21.427595] igb 0000:02:00.3: DCA enabled
[   21.437963] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   21.468395] ipmi message handler version 39.2
[   21.478326] ipmi device interface
[   21.495588] IPMI System Interface driver.
[   21.501620] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   21.509482] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   21.517000] ipmi_si: Adding SMBIOS-specified kcs state machine
[   21.524701] ipmi_platform: probing via SPMI
[   21.524883] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.524885] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.556953] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   21.567207] (NULL device *): SPMI-specified kcs state machine: duplicate
[   21.567495] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   21.585109] sd 6:0:0:0: Attached scsi generic sg0 type 0
[   21.585301] sd 6:0:1:0: Attached scsi generic sg1 type 0
[   21.589956] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   21.627230] input: PC Speaker as /devices/platform/pcspkr/input/input3
[[32m  OK  [0m] Found device /dev/ttyS0.
[   21.651409] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   21.653648] mpt2sas version 20.103.01.00 loaded
[   21.655725] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[   21.657360] IPMI SSIF Interface driver
[   21.658708] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32505204 kB)
[   21.713855] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[   21.714968] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 168
[   21.714969] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 169
[   21.714970] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 170
[   21.714970] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 171
[   21.714971] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 172
[   21.714972] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 173
[   21.714973] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 174
[   21.714974] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 175
[   21.714975] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 176
[   21.714976] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 177
[   21.714977] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 178
[   21.714978] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 179
[   21.714979] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 180
[   21.714980] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 181
[   21.714981] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 182
[   21.714982] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 183
[   21.714984] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffbba6c3b60000), size(65536)
[   21.714985] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[   21.769862] mpt2sas_cm0: sending message unit reset !!
[   21.771368] mpt2sas_cm0: message unit reset: SUCCESS
[   21.782488] iTCO_vendor_support: vendor-support=0
[   21.835616] cryptd: max_cpu_qlen set to 1000
[   21.846202] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[   21.846203] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[   21.846204] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[   21.903248] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[   21.903249] mpt2sas_cm0: Protocol=(
[   21.903250] Initiator
[   21.903250] ,Target
[   21.903251] ), 
[   21.903251] Capabilities=(
[   21.903252] TLR
[   21.903253] ,EEDP
[   21.903253] ,Snapshot Buffer
[   21.903254] ,Diag Trace Buffer
[   21.903254] ,Task Set Full
[   21.903255] ,NCQ
[   21.903255] )
[   21.903305] scsi host7: Fusion MPT SAS Host
[   21.904036] mpt2sas_cm0: sending port enable !!
[   21.906939] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[   21.915848] mpt2sas_cm0: port enable: SUCCESS
[   21.916688] scsi 7:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   21.916695] scsi 7:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   21.916697] scsi 7:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   21.916701] scsi 7:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   21.929272] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   21.929331] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   21.934789] device-mapper: multipath round-robin: version 1.2.0 loaded
[   21.948889] AVX version of gcm_enc/dec engaged.
[   21.948889] AES CTR mode by8 optimization enabled
[   21.952013] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   21.952074] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.023237] kvm: disabled by bios
[   22.034664] intel_rapl: Found RAPL domain package
[   22.034679] intel_rapl: Found RAPL domain core
[   22.034689] intel_rapl: Found RAPL domain dram
[   22.034726] intel_rapl: Found RAPL domain package
[   22.034728] intel_rapl: Found RAPL domain core
[   22.034732] intel_rapl: Found RAPL domain dram
[   22.058712] scsi 7:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.058718] scsi 7:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.058721] scsi 7:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.058726] scsi 7:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.059935] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.060163] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.060164] EDAC sbridge:  Ver: 1.1.2 
[   22.280413] scsi 7:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.280423] scsi 7:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.280427] scsi 7:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.280434] scsi 7:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
%G%G[   22.463354] scsi 7:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.474014] scsi 7:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.487164] scsi 7:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.496813] scsi 7:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.519336] scsi 7:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   22.530090] scsi 7:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.543305] scsi 7:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.552861] scsi 7:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.599926] scsi 7:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.610306] scsi 7:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.623268] scsi 7:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.632471] scsi 7:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.669759] scsi 7:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.680648] scsi 7:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.694129] scsi 7:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.703902] scsi 7:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.729360] scsi 7:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.740381] scsi 7:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.753937] scsi 7:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.763776] scsi 7:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.813291] scsi 7:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.824073] scsi 7:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.837470] scsi 7:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.847079] scsi 7:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.881342] scsi 7:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   22.892082] scsi 7:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.905441] scsi 7:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.915065] scsi 7:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.941742] scsi 7:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   22.949167] sd 7:0:0:0: Attached scsi generic sg2 type 0
[   22.956536] sd 7:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   22.967445] sd 7:0:0:0: [sdc] Write Protect is off
[   22.967562] device-mapper: table: 253:1: multipath: error getting device
[   22.967562] device-mapper: ioctl: error adding target to table
[   22.967861] scsi 7:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   22.968096] sd 7:0:0:1: Attached scsi generic sg3 type 0
[   22.968192] sd 7:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   22.968948] scsi 7:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   22.969029] sd 7:0:0:1: [sdd] Write Protect is off
[   22.969121] sd 7:0:0:2: Attached scsi generic sg4 type 0
[   22.969271] sd 7:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   22.969308] sd 7:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   22.970191] scsi 7:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   22.970403] sd 7:0:0:3: Attached scsi generic sg5 type 0
[   22.970466] sd 7:0:0:2: [sde] Write Protect is off
[   22.970679] sd 7:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   22.970774] sd 7:0:0:7: Attached scsi generic sg6 type 0
[   22.970879] sd 7:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   22.971063] sd 7:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   22.971387] scsi 7:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   22.971611] sd 7:0:1:0: Attached scsi generic sg7 type 0
[   22.971662] sd 7:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   22.972024] sd 7:0:0:3: [sdf] Write Protect is off
[   22.972366] Dev sdd: unable to read RDB block 0
[   22.972376]  sdd: unable to read partition table
[   22.972414] scsi 7:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   22.972479] sd 7:0:0:7: [sdg] Write Protect is off
[   22.972481] sd 7:0:1:0: [sdh] Write Protect is off
[   22.972525] sd 7:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   22.972640] sd 7:0:1:1: Attached scsi generic sg8 type 0
[   22.972745] sd 7:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   22.972852] sd 7:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   22.973017] sd 7:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   22.973640] scsi 7:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   22.973866] sd 7:0:1:2: Attached scsi generic sg9 type 0
[   22.974217] sd 7:0:1:1: [sdi] Write Protect is off
[   22.974270] sd 7:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   22.974761] sd 7:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   22.974920] scsi 7:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   22.975157] sd 7:0:1:3: Attached scsi generic sg10 type 0
[   22.975535] sd 7:0:1:7: Attached scsi generic sg11 type 0
[   22.975612] sd 7:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   22.975673] sd 7:0:1:2: [sdj] Write Protect is off
[   22.975731] Dev sdf: unable to read RDB block 0
[   22.975739]  sdf: unable to read partition table
[   22.975959] Dev sdh: unable to read RDB block 0
[   22.975970]  sdh: unable to read partition table
[   22.976370] sd 7:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   22.976885] sd 7:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   22.976920]  sdg:
[   22.977147] sd 7:0:0:1: [sdd] Attached SCSI disk
[   22.977153] sd 7:0:0:2: [sde] Attached SCSI disk
[   22.977480] sd 7:0:1:3: [sdk] Write Protect is off
[   22.978053] sd 7:0:0:3: [sdf] Attached SCSI disk
[   22.978222] sd 7:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   22.978549] sd 7:0:0:7: [sdg] Attached SCSI disk
[   22.978848] sd 7:0:1:7: [sdl] Write Protect is off
[   22.979446] sd 7:0:1:0: [sdh] Attached SCSI disk
[   22.979506] sd 7:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   22.980466] Dev sdj: unable to read RDB block 0
[   22.980483]  sdj: unable to read partition table
[   22.981382] sd 7:0:1:1: [sdi] Attached SCSI disk
[   22.983028]  sdl:
[   22.983127] sd 7:0:1:2: [sdj] Attached SCSI disk
[   22.985396] sd 7:0:1:7: [sdl] Attached SCSI disk
[   22.985874] sd 7:0:1:3: [sdk] Attached SCSI disk
[   22.999751] blk_update_request: I/O error, dev sdd, sector 0
[   23.005609] blk_update_request: I/O error, dev sdd, sector 0
[   23.009169] blk_update_request: I/O error, dev sdf, sector 0
[   23.009599] blk_update_request: I/O error, dev sdh, sector 0
[   23.011156] blk_update_request: I/O error, dev sdd, sector 0
[   23.014257] blk_update_request: I/O error, dev sdj, sector 0
[   23.014404] blk_update_request: I/O error, dev sdf, sector 0
[   23.015461] blk_update_request: I/O error, dev sdh, sector 0
[   23.016839] blk_update_request: I/O error, dev sdd, sector 0
[   23.019150] blk_update_request: I/O error, dev sdj, sector 0
[   23.525935] sd 7:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.543659] sd 7:0:0:0: [sdc] Attached SCSI disk
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Preprocess NFS [   23.566923] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
configuration...
         Starting Import network configuration from initramfs...
         Star[   23.641630] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
ting Tell Plymouth To Write Out Runtime Data...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Import network configuration from initramfs.
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Mounting RPC Pipe File System...
         Starting Security Auditing Service...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[   24.083759] type=1305 audit(1544485485.336:3): audit_pid=9014 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting Dump dmesg to /var/log/dmesg...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting System Security Services Daemon...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting Machine Check Exception Logging Daemon...
         Starting GSSAPI Proxy Daemon...
         Starting Authorization Manager...
         Starting NTP client/server...
         Starting Load CPU microcode update...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started Load CPU microcode update.
[   25.211216] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[   25.405923] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   25.415440] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[   25.505398] card: mlx4_0, QP: 0x220, inline size: 120
[   25.515067] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Started Login Service.
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[   25.577023] ib0: enabling connected mode will cause multicast packet drops
[   25.577153] ib0: mtu > 4092 will cause multicast packet drops.
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[   25.803575] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   25.892914] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   25.895508] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   25.908590] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   25.991975] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   25.992009] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   25.998780] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.110050] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.127562] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.208469] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   26.218009] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   26.246896] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.281450] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.301174] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.310193] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   26.329467] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   26.877809] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   26.887615] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   27.498418] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   27.508646] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   28.375688] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   33.709648] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   33.756658] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   33.767446] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting Dynamic System Tuning Daemon...
         Starting OpenSSH server daemon...
         Starting MUNGE authentication service...
[   33.963983] FS-Cache: Loaded
         Starting Postfix Mail Transport Agent...
         Starting Xinetd A P[   34.001990] FS-Cache: Netfs 'nfs' registered for caching
owerful Replacement For Inetd...
[[32m  OK  [0m] Reached target Network is Online.
         Mounting /scratch...
         Starting NFS status monitor for NFSv2/3 locking....
         Starting System Logging Service...
         S[   34.010700] Key type dns_resolver registered
tarting Notify NFS peers of a restart...
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started Xinetd A P[   34.041262] NFS: Registering the id_resolver key type
owerful Replacem[   34.041269] Key type id_resolver registered
ent For Inetd.[   34.041270] Key type id_legacy registered

[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Automounts filesystems on demand...
         Starting Crash recovery kernel arming...
         Starting Permit User Sessions...
[[32m  OK  [0m] Started Permit User Sessions.
[[32m  OK  [0m] Started Job spooling tools.
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Command Scheduler.
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Created slice User Slice of root.
[[32m  OK  [0m] Started Session 1 of user root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-10T23:45:07+00:00] INFO: Forking chef instance to converge...
[2018-12-10T23:45:07+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-10T23:45:07+00:00] INFO: Chef-client pid: 10812
[2018-12-10T23:45:09+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-10T23:45:09+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-10T23:45:09+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-10T23:45:09+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-10T23:45:09+00:00] INFO: Running start handlers
[2018-12-10T23:45:09+00:00] INFO: Start handlers complete.
[2018-12-10T23:45:09+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-10T23:45:09+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-10T23:45:09+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-10T23:45:09+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-10T23:45:09+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181210234509.969383
[2018-12-10T23:45:09+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181205005710.140872
[2018-12-10T23:45:09+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-10T23:45:09+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-10T23:45:16+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-10T23:45:16+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-10T23:45:16+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-10T23:45:17+00:00] INFO: service[ntpd] started
[2018-12-10T23:45:17+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-10T23:45:17+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-10T23:45:17+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-10T23:45:17+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-10T23:45:17+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-10T23:45:17+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-10T23:45:17+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-10T23:45:17+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-10T23:45:17+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-10T23:45:18+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-10T23:45:18+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-10T23:45:18+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-10T23:45:18+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-10T23:45:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:18+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-10T23:45:18+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-10T23:45:19+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-10T23:45:19+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-10T23:45:19+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-10T23:45:19+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-10T23:45:20+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-10T23:45:20+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-10T23:45:20+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-10T23:45:20+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-10T23:45:20+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-10T23:45:20+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-10T23:45:20+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-10T23:45:21+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-10T23:45:21+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-10T23:45:21+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[   60.523464] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[2018-12-10T23:45:22+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-10T23:45:22+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-10T23:45:22+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-10T23:45:22+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-10T23:45:22+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-10T23:45:22+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-10T23:45:22+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-10T23:45:22+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-10T23:45:22+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-10T23:45:22+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-10T23:45:23+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-10T23:45:23+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-10T23:45:23+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-10T23:45:23+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181210234523.046765
[2018-12-10T23:45:23+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181205005930.222459
[2018-12-10T23:45:23+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-10T23:45:23+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-10T23:45:23+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-10T23:45:23+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181210234523.054073
[2018-12-10T23:45:23+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181205005930.230227
[2018-12-10T23:45:23+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-10T23:45:23+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-10T23:45:23+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-10T23:45:23+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:23+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-10T23:45:23+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:23+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-10T23:45:23+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-10T23:45:23+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-10T23:45:23+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:23+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-10T23:45:23+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:23+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-10T23:45:23+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:23+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-10T23:45:23+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:23+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-10T23:45:23+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:23+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-10T23:45:23+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:23+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-10T23:45:23+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:23+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-10T23:45:23+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:23+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:23+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-10T23:45:24+00:00] INFO: service[xinetd] started
[2018-12-10T23:45:24+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-10T23:45:24+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-10T23:45:24+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-10T23:45:24+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-10T23:45:25+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-10T23:45:25+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-10T23:45:25+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-10T23:45:25+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-10T23:45:25+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181210234525.463045
[2018-12-10T23:45:25+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-10T23:45:25+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-10T23:45:25+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-10T23:45:25+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:25+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-10T23:45:25+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-10T23:45:25+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-10T23:45:25+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:25+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:25+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-10T23:45:25+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-10T23:45:25+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:25+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:25+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-10T23:45:25+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:25+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:25+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:25+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:25+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-10T23:45:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:26+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:26+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-10T23:45:26+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:26+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:26+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-10T23:45:26+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:26+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:26+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-10T23:45:26+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-10T23:45:26+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-10T23:45:26+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-10T23:45:26+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-10T23:45:26+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-10T23:45:26+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-10T23:45:26+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-10T23:45:26+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-10T23:45:26+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-10T23:45:26+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-10T23:45:26+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-10T23:45:27+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-10T23:45:27+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-10T23:45:28+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-10T23:45:28+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-10T23:45:28+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-10T23:45:28+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-10T23:45:28+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-10T23:45:28+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-10T23:45:28+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-10T23:45:28+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-10T23:45:28+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-10T23:45:28+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-10T23:45:28+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-10T23:45:28+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-10T23:45:28+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-10T23:45:28+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-10T23:45:28+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-10T23:45:28+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-10T23:45:28+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-10T23:45:28+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-10T23:45:28+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-10T23:45:28+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-10T23:45:28+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-10T23:45:28+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-10T23:45:28+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[2018-12-10T23:45:31+00:00] INFO: service[kdump] restarted
[2018-12-10T23:45:31+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-10T23:45:31+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-10T23:45:31+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-10T23:45:31+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-10T23:45:31+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-10T23:45:31+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-10T23:45:31+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-10T23:45:31+00:00] INFO: Chef Run complete in 22.748471762 seconds
[2018-12-10T23:45:31+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-10T23:45:31+00:00] INFO: Running report handlers
[2018-12-10T23:45:31+00:00] INFO: Creating JSON run report
[2018-12-10T23:45:32+00:00] INFO: Report handlers complete
[  292.138037] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  292.148765] alg: No test for adler32 (adler32-zlib)
[  293.005294] Lustre: Lustre: Build Version: 2.10.6_RC3
[  293.289537] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  293.778020] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  294.578198] Lustre: MGS: Connection restored to f548a811-3b99-356b-7ef8-5b9bf8ba5fd5 (at 0@lo)
[  294.965490] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  300.682549] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect
[  300.693369] Lustre: soaked-MDT0000: Connection restored to ae2213f0-99c9-30d3-1cb6-ec3869aa24bf (at 192.168.1.120@o2ib)
[  318.300780] Lustre: MGS: Connection restored to 6f38266d-9e2b-8d56-87a7-b7a77061b96f (at 192.168.1.138@o2ib)
[  318.312051] Lustre: Skipped 1 previous similar message
[  321.558093] Lustre: soaked-MDT0000: Connection restored to ae2721f1-9285-2304-935f-be2723c27377 (at 192.168.1.139@o2ib)
[  321.570347] Lustre: Skipped 6 previous similar messages
[  325.751061] Lustre: MGS: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[  325.760400] Lustre: Skipped 36 previous similar messages
[  335.520293] Lustre: soaked-MDT0000: Connection restored to 8b1d2414-fdf5-c0c4-6e9a-eb1e75d291f5 (at 192.168.1.135@o2ib)
[  335.532517] Lustre: Skipped 15 previous similar messages
[  355.351129] Lustre: MGS: Connection restored to 9a424bc3-6e08-385b-175e-bbe0cb080f60 (at 192.168.1.119@o2ib)
[  355.362285] Lustre: Skipped 17 previous similar messages
[  355.424957] Lustre: soaked-MDT0000: Recovery over after 0:54, of 29 clients 29 recovered and 0 were evicted.
[  416.800361] LustreError: 12458:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[  667.841319] LustreError: 12371:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[  875.684292] LustreError: 12428:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[  875.695075] LustreError: 12428:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[  877.962150] LustreError: 12274:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[  877.972927] LustreError: 12274:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[  999.885294] Lustre: 12460:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 1033.556336] LustreError: 12369:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 1033.567098] LustreError: 12369:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[ 1780.216867] LustreError: 12382:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 3662.635330] Lustre: 12193:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544489117/real 0]  req@ffffa041ebe4ec00 x1619510770037552/t0(0) o6->soaked-OST0005-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 664/432 e 0 to 1 dl 1544489124 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 3662.650394] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 3662.685216] Lustre: 12193:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 3663.354316] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544489117/real 0]  req@ffffa041ebe4fb00 x1619510770037648/t0(0) o6->soaked-OST0005-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 664/432 e 0 to 1 dl 1544489124 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 3663.430376] Lustre: soaked-OST000d-osc-MDT0000: Connection to soaked-OST000d (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 3663.449098] Lustre: Skipped 2 previous similar messages
[ 3664.464323] Lustre: 12189:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544489118/real 0]  req@ffffa041b8fc8600 x1619510770060832/t0(0) o13->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544489125 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 3664.502114] Lustre: 12189:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 30 previous similar messages
[ 3669.456159] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544489124/real 0]  req@ffffa045d97a9b00 x1619510770266640/t0(0) o8->soaked-OST000d-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544489130 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 3707.139194] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 1 seconds
[ 3720.138875] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 14 seconds
[ 3720.153538] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 7 previous similar messages
[ 3732.138558] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 26 seconds
[ 3732.153133] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 7 previous similar messages
[ 3774.453390] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544489224/real 0]  req@ffffa046090b3600 x1619510770994048/t0(0) o8->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544489235 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 3774.494300] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 3829.451913] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544489274/real 0]  req@ffffa045c9b4b300 x1619510771802944/t0(0) o8->soaked-OST0001-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544489290 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 3829.492229] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 3875.667766] Lustre: MGS: haven't heard from client 83952edc-53b5-8f5a-2a60-01c8f66fc8ca (at 192.168.1.105@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffffa0422da62c00, cur 1544489337 expire 1544489187 last 1544489110
[ 3918.245192] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[ 3918.264894] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 3918.278397] Lustre: Skipped 1 previous similar message
[ 3934.449109] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544489374/real 0]  req@ffffa045cda6da00 x1619510771904736/t0(0) o8->soaked-OST0005-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544489395 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 3934.490114] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 3937.317457] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[ 3937.336238] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 3956.817619] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[ 3956.837602] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 3960.132385] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 3 seconds
[ 3960.147408] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 7 previous similar messages
[ 3972.132053] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 10 seconds
[ 3972.147024] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[ 3976.092534] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[ 3976.112811] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 4022.199205] Lustre: soaked-OST000d-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 4022.214297] Lustre: Skipped 3 previous similar messages
[ 4025.369693] LustreError: 11-0: soaked-OST0009-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[ 4025.385241] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 4039.240748] LustreError: 11-0: soaked-OST0001-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[ 4039.256690] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 4047.192535] LustreError: 11-0: soaked-OST0005-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[ 4047.208720] Lustre: soaked-OST0005-osc-MDT0000: Connection to soaked-OST0005 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 4057.272434] LustreError: 11-0: soaked-OST000d-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[ 4057.288831] Lustre: soaked-OST000d-osc-MDT0000: Connection to soaked-OST000d (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 4600.372272] Lustre: 12457:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 5901.115530] perf: interrupt took too long (2509 > 2500), lowering kernel.perf_event_max_sample_rate to 79000
[ 7478.516479] Lustre: 12204:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544492933/real 0]  req@ffffa0458ebd1800 x1619510861822768/t0(0) o400->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544492940 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 7478.558660] Lustre: 12204:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 7478.573184] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7484.598273] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544492940/real 0]  req@ffffa045bfa54e00 x1619510861838096/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544492946 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 7528.597602] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544492990/real 1544492990]  req@ffffa045c166c800 x1619510862064096/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544493001 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 7578.596320] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544493040/real 1544493040]  req@ffffa045c166a700 x1619510862113312/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544493056 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 7628.594718] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544493090/real 1544493090]  req@ffffa0458b602700 x1619510862139888/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544493111 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 7681.621076] Lustre: MGS: haven't heard from client 1063cfb9-d168-286e-3d4f-b659596980cc (at 192.168.1.110@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffffa0460fffb800, cur 1544493143 expire 1544492993 last 1544492916
[ 7683.429975] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0002-mdtlov_UUID (at 192.168.1.110@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffffa0463fc38000, cur 1544493145 expire 1544492995 last 1544492916
[ 7704.594105] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544493140/real 0]  req@ffffa0459c6b8000 x1619510862319280/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544493166 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 7713.480840] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 7713.495380] Lustre: Skipped 9 previous similar messages
[ 7713.574463] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.111@o2ib, removing former export from 192.168.1.110@o2ib
[ 7735.031354] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 6 seconds
[ 7735.046869] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[ 7814.569612] Lustre: soaked-MDT0002-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 7814.585034] Lustre: Skipped 1 previous similar message
[ 7828.588891] LustreError: 11-0: soaked-MDT0002-osp-MDT0000: operation obd_ping to node 192.168.1.111@o2ib failed: rc = -107
[ 7828.604048] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7884.587108] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544493340/real 0]  req@ffffa045c9bbce00 x1619510863799440/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544493346 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 7937.025659] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 8 seconds
[ 8038.022808] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 9 seconds
[ 8110.505642] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[ 8153.587353] Lustre: soaked-MDT0002-osp-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[ 8153.602708] Lustre: Skipped 2 previous similar messages
[ 8199.822832] Lustre: 12389:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 9663.266601] perf: interrupt took too long (3231 > 3136), lowering kernel.perf_event_max_sample_rate to 61000
[11135.508285] Lustre: 12207:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544496590/real 0]  req@ffffa04528ad0600 x1619510977735248/t0(0) o400->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544496597 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[11135.550473] Lustre: 12207:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[11135.565222] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[11143.999459] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.120@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11144.026816] LustreError: Skipped 1 previous similar message
[11145.095265] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11145.122668] LustreError: Skipped 4 previous similar messages
[11147.548474] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.116@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11152.709246] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.124@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11160.589959] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[11160.615755] LustreError: Skipped 6 previous similar messages
[11168.727541] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11168.754892] LustreError: Skipped 12 previous similar messages
[11193.998225] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.120@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11194.024261] LustreError: Skipped 16 previous similar messages
[11196.588554] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544496647/real 0]  req@ffffa03e94e69200 x1619510977925776/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544496658 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[11196.630689] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[11229.099340] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.135@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11229.126274] LustreError: Skipped 35 previous similar messages
[11293.995667] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.120@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11294.022862] LustreError: Skipped 51 previous similar messages
[11301.585511] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544496747/real 0]  req@ffffa04529231b00 x1619510978062112/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544496763 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[11318.723823] Lustre: MGS: haven't heard from client 8d632e57-0662-3d20-1f1d-a7c4a45af08f (at 192.168.1.109@o2ib) in 231 seconds. I think it's dead, and I am evicting it. exp ffffa0460ffffc00, cur 1544496780 expire 1544496630 last 1544496549
[11321.645175] LDISKFS-fs warning (device dm-2): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[11321.645175] 
[11322.544111] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib) in 235 seconds. I think it's dead, and I am evicting it. exp ffffa046107dfc00, cur 1544496784 expire 1544496634 last 1544496549
[11332.928702] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds
[11372.883142] LDISKFS-fs (dm-2): recovery complete
[11372.890311] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[11373.781792] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[11373.880961] Lustre: soaked-MDT0000: Received LWP connection from 0@lo, removing former export from 192.168.1.109@o2ib
[11373.882397] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900
[11373.930255] LustreError: 28057:0:(llog_osd.c:978:llog_osd_next_block()) soaked-MDT0003-osp-MDT0001: missed desired record? 3 > 1
[11373.946343] LustreError: 28057:0:(lod_dev.c:419:lod_sub_recovery_thread()) soaked-MDT0003-osp-MDT0001 getting update log failed: rc = -2
[11373.982354] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[11373.982363] Lustre: 28059:0:(ldlm_lib.c:2059:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[11374.170550] Lustre: soaked-MDT0001: disconnecting 29 stale clients
[11375.437015] Lustre: Failing over soaked-MDT0001
[11376.000876] Lustre: server umount soaked-MDT0001 complete
[11423.895778] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[11423.914406] LustreError: 12372:0:(osp_object.c:582:osp_attr_get()) soaked-MDT0001-osp-MDT0000:osp_attr_get update error [0x2400059f0:0x2:0x0]: rc = -5
[11423.914408] LustreError: 12376:0:(osp_object.c:582:osp_attr_get()) soaked-MDT0001-osp-MDT0000:osp_attr_get update error [0x2400059f0:0x1:0x0]: rc = -5
[11423.916296] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[11423.916297] Lustre: Skipped 4 previous similar messages
[11424.624303] LustreError: 12381:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[11424.636672] LustreError: 12381:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[11442.690389] LustreError: 12372:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[11451.199285] LustreError: 12381:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[11602.772512] LustreError: 12461:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[11602.786217] LustreError: 12461:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[11611.926107] LustreError: 12459:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[11611.939968] LustreError: 12459:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 6 previous similar messages
[11778.305309] LustreError: 16570:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[11800.284266] Lustre: 12275:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[12028.344539] LustreError: 12396:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[12028.357761] LustreError: 12396:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[12664.053127] Lustre: 12201:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544498118/real 0]  req@ffffa0415ff47500 x1619510995054560/t0(0) o13->soaked-OST0008-osc-MDT0000@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544498125 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[12664.093592] Lustre: 12201:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[12664.107932] Lustre: soaked-OST0008-osc-MDT0000: Connection to soaked-OST0008 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[12665.367096] Lustre: soaked-OST000c-osc-MDT0000: Connection to soaked-OST000c (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[12667.989047] Lustre: soaked-OST0004-osc-MDT0000: Connection to soaked-OST0004 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[12668.013513] Lustre: Skipped 1 previous similar message
[12700.471046] Lustre: 12214:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544498115/real 0]  req@ffffa0459c76e900 x1619510995035360/t0(0) o6->soaked-OST0004-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 664/432 e 0 to 1 dl 1544498162 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[12700.511868] Lustre: 12214:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 15 previous similar messages
[12708.888809] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 5 seconds
[12720.888457] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 17 seconds
[12720.903230] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 7 previous similar messages
[12733.888126] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 30 seconds
[12733.902831] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 4 previous similar messages
[12745.887820] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 42 seconds
[12745.902433] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 4 previous similar messages
[12771.887029] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 12 seconds
[12771.901569] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[12779.018841] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544498229/real 0]  req@ffffa03e94dcb900 x1619510995745968/t0(0) o8->soaked-OST0008-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544498240 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[12779.059304] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 23 previous similar messages
[12873.491729] Lustre: MGS: haven't heard from client c4a2ae66-68c9-5f3a-0b8d-bf7e5aee6b5e (at 192.168.1.104@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffffa0422b4fcc00, cur 1544498335 expire 1544498185 last 1544498106
[12909.015064] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544498354/real 0]  req@ffffa03e83df9e00 x1619510995811648/t0(0) o8->soaked-OST000c-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544498370 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[12909.055161] Lustre: 12185:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
[12947.882032] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 4 seconds
[12947.896586] LNet: 12174:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[12961.718630] Lustre: MGS: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[12968.866678] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID
[12968.882490] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[12968.894042] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0008_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client[12983.040412] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID
[12983.059563] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline

[12983.071324] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0000_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client[12991.629246] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID
[12991.648623] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[12991.660219] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0004_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client[12994.213960] Lustre: soaked-OST0008-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)

[13000.022876] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID
[13000.022983] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[13000.022986] LustreError: Skipped 67 previous similar messages
[13000.076766] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[13000.087925] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST000c_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client[13025.030754] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID
[13025.030941] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[13037.640062] Lustre: soaked-OST0000-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[13050.030024] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID
[13050.044239] Lustre: Skipped 1 previous similar message
[13075.029350] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID
[13075.029553] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[13075.029555] LustreError: Skipped 3 previous similar messages
[13075.076446] Lustre: Skipped 1 previous similar message
[13125.028222] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID
[13125.044167] Lustre: Skipped 3 previous similar messages
[13150.027765] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[13150.054955] LustreError: Skipped 6 previous similar messages
[13200.026193] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID
[13200.042646] Lustre: Skipped 5 previous similar messages
[13300.023632] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[13300.046767] LustreError: Skipped 11 previous similar messages
[13350.022376] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID
[13350.038580] Lustre: Skipped 11 previous similar messages
[13375.021741] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[13375.035918] Lustre: Skipped 2 previous similar messages
[13400.021172] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[13400.034848] Lustre: Skipped 1 previous similar message
[13575.016478] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[13575.039485] LustreError: Skipped 21 previous similar messages
[14100.003366] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[14100.030312] LustreError: Skipped 39 previous similar messages
[14350.792493] LustreError: 24661:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[14350.806427] LustreError: 24661:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 47 previous similar messages
[14374.888044] LustreError: 12272:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[14374.902386] LustreError: 12272:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 31 previous similar messages
[14544.053738] perf: interrupt took too long (4044 > 4038), lowering kernel.perf_event_max_sample_rate to 49000
[14724.988226] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[14725.011696] LustreError: Skipped 48 previous similar messages
[15349.976178] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[15350.001202] LustreError: Skipped 47 previous similar messages
[15399.732796] Lustre: 23665:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[11;01H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [02;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [7m[4;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[4;79H[m[m[5;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [4;79H[22;1H   The selected entry will be started automatically in 5s.                     [4;79H[22;1H   The selected entry will be started automatically in 4s.                     [4;79H[22;1H   The selected entry will be started automatically in 3s.                     [4;79H[22;1H   The selected entry will be started automatically in 2s.                     [4;79H[22;1H   The selected entry will be started automatically in 1s.                     [4;79H[22;1H   The selected entry will be started automatically in 0s.                     [4;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-307-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Fri Nov 30 18:46:05 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x34b20000-0x36587fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 320MB of memory at 512MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff991d6e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 6841488k/34603008k available (7664k kernel code, 1126748k absent, 1001116k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.294 MHz processor
[    0.000181] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.58 BogoMIPS (lpj=2693294)
[    0.012647] pid_max: default: 245760 minimum: 1920
[    0.019165] Security Framework initialized
[    0.024055] SELinux:  Initializing.
[    0.028530] Yama: becoming mindful.
[    0.038217] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.060483] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.074814] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.082888] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.093712] Initializing cgroup subsys memory
[    0.099027] Initializing cgroup subsys devices
[    0.104303] Initializing cgroup subsys freezer
[    0.109559] Initializing cgroup subsys net_cls
[    0.114816] Initializing cgroup subsys blkio
[    0.119883] Initializing cgroup subsys perf_event
[    0.125477] Initializing cgroup subsys hugetlb
[    0.130762] Initializing cgroup subsys pids
[    0.135741] Initializing cgroup subsys net_prio
[    0.141385] mce: CPU supports 20 MCE banks
[    0.146289] CPU0: Thermal monitoring enabled (TM1)
[    0.152018] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.158450] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.165115] tlb_flushall_shift: 6
[    0.169185] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.180445] FEATURE SPEC_CTRL Present
[    0.184843] FEATURE IBPB_SUPPORT Present
[    0.189835] Spectre V2 : Mitigation: Full retpoline
[    0.196801] Freeing SMP alternatives: 28k freed
[    0.208544] ACPI: Core revision 20130517
[    0.304666] ACPI: All ACPI Tables successfully acquired
[    0.327713] ftrace: allocating 29187 entries in 115 pages
[    0.389667] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.397361] Switched APIC routing to physical flat.
[    0.403823] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.420843] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.432101] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.444817] ... version:                3
[    0.454249] ... bit width:              48
[    0.459111] ... generic registers:      4
[    0.463875] ... value mask:             0000ffffffffffff
[    0.470100] ... max period:             00007fffffffffff
[    0.476316] ... fixed-purpose events:   3
[    0.481081] ... event mask:             000000070000000f
[    0.495823] smpboot: Booting Node   0, Processors  #1[    0.517628] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.574034] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.715115] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.758355] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.799764] Brought up 32 CPUs
[    0.803949] smpboot: Max logical packages: 15
[    0.809125] smpboot: Total of 32 processors activated (172556.48 BogoMIPS)
[    1.066846] node 0 initialised, 2813371 pages in 137ms
[    1.104797] node 1 initialised, 3595039 pages in 169ms
[    1.112076] devtmpfs: initialized
[    1.127219] EVM: security.selinux
[    1.131210] EVM: security.ima
[    1.134816] EVM: security.capability
[    1.139385] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.148767] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.161715] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.169699] pinctrl core: initialized pinctrl subsystem
[    1.176133] RTC time:  4:21:26, date: 12/11/18
[    1.181894] NET: Registered protocol family 16
[    1.187706] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.196673] ACPI: bus type PCI registered
[    1.201441] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.209580] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.220485] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.228402] PCI: Using configuration type 1 for base access
[    1.234984] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.255935] ACPI: Added _OSI(Module Device)
[    1.260902] ACPI: Added _OSI(Processor Device)
[    1.266150] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.271693] ACPI: Added _OSI(Processor Aggregator Device)
[    1.278017] ACPI: Added _OSI(Linux-Dell-Video)
[    1.323115] ACPI: Executed 1 blocks of module-level executable AML code
[    1.612324] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.645942] ACPI: Interpreter enabled
[    1.650356] ACPI: (supports S0 S1 S5)
[    1.654745] ACPI: Using IOAPIC for interrupt routing
[    1.660704] HEST: Table parsing has been initialized.
[    1.666647] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.677426] ACPI: GPE 0x1E active on init
[    1.682377] ACPI: GPE 0x24 active on init
[    1.687315] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.753269] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.760484] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.770652] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.779638] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.788695] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.798642] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.810815] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.826201] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.841964] PCI host bridge to bus 0000:00
[    1.846832] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.854031] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.862891] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.871750] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.880608] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.889468] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.898338] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.907206] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.916069] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.924933] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.933792] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.942651] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.951518] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.960379] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.969240] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.978884] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.985851] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.992773] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.999698] pci 0000:00:02.0: System wakeup disabled by ACPI
[    2.006608] pci 0000:00:02.2: System wakeup disabled by ACPI
[    2.013528] pci 0000:00:03.0: System wakeup disabled by ACPI
[    2.024043] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    2.030983] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    2.037887] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    2.044837] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.051672] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.059242] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.065267] acpiphp: Slot [2] registered
[    2.070230] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.081065] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.092245] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.103081] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.114250] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.125087] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.136260] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.147106] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.160946] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.167307] acpiphp: Slot [2-2] registered
[    2.174621] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.180647] acpiphp: Slot [2-3] registered
[    2.185553] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.191561] acpiphp: Slot [2-4] registered
[    2.196750] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.202940] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.216246] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.222214] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.228483] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.235179] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.241142] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.250424] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.259467] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.268494] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.277521] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.286552] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.295585] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.304612] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.313643] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.322882] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.330090] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.340015] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.348850] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.357908] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.367982] PCI host bridge to bus 0000:80
[    2.372853] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.380736] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.388618] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.397471] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.406332] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.415976] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.422626] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.429520] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.436409] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.443294] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.452409] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.458346] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.464277] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.470193] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.491743] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.498661] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.508364] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.518541] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.525837] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.535601] PCI host bridge to bus 0000:7f
[    2.540470] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.551388] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.558306] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.568006] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.578190] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.585478] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.595255] PCI host bridge to bus 0000:ff
[    2.600125] pci_bus 0000:ff: root bus resource [bus ff]
[    2.611660] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.621229] vgaarb: loaded
[    2.624537] vgaarb: bridge control possible 0000:09:00.0
[    2.631191] SCSI subsystem initialized
[    2.635731] ACPI: bus type USB registered
[    2.640538] usbcore: registered new interface driver usbfs
[    2.646981] usbcore: registered new interface driver hub
[    2.653506] usbcore: registered new device driver usb
[    2.659999] EDAC MC: Ver: 3.0.0
[    2.664345] PCI: Using ACPI for IRQ routing
[    2.676949] NetLabel: Initializing
[    2.681038] NetLabel:  domain hash size = 128
[    2.686197] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.692072] NetLabel:  unlabeled traffic allowed by default
[    2.698939] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.706939] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.715803] amd_nb: Cannot enumerate AMD northbridges
[    2.721939] Switched to clocksource hpet
[    2.741316] pnp: PnP ACPI init
[    2.745056] ACPI: bus type PNP registered
[    2.750134] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.757052] system 00:00: [io  0xffff] has been reserved
[    2.763295] system 00:00: [io  0xffff] has been reserved
[    2.769529] system 00:00: [io  0xffff] has been reserved
[    2.775766] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.783074] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.789991] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.796908] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.803827] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.811126] system 00:00: [io  0x0cf9] could not be reserved
[    2.817974] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.826436] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.834132] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.841822] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.849520] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.857221] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.864917] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.872992] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.881073] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.889160] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.897378] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.906002] pnp: PnP ACPI: found 7 devices
[    2.910871] ACPI: bus type PNP unregistered
[    2.925259] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.931130] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.937262] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.944365] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.952261] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.958112] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.965996] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.975941] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.981792] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.987637] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.994746] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    3.002650] pci 0000:00:11.0: PCI bridge to [bus 07]
[    3.008493] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    3.015606] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    3.023497] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    3.033433] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    3.039288] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    3.045129] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    3.053018] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    3.062179] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    3.068257] pci 0000:80:01.0: PCI bridge to [bus 81]
[    3.074107] pci 0000:80:02.0: PCI bridge to [bus 82]
[    3.079959] pci 0000:80:03.0: PCI bridge to [bus 83]
[    3.085811] pci 0000:80:03.2: PCI bridge to [bus 84]
[    3.092049] NET: Registered protocol family 2
[    3.099404] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.109076] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.117127] TCP: Hash tables configured (established 262144 bind 65536)
[    3.124917] TCP: reno registered
[    3.128980] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.136440] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.145432] NET: Registered protocol family 1
[    4.251046] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.359123] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.367936] Un packing initram[    6.202211] Freeing initrd memory: 27040k freed
[    6.218230] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    6.225755] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff9919f73c7000-ffff9919fb3c6fff]
[    6.237813] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    6.247172] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    6.253899] RAPL PMU: hw unit of domain package 2^-16 Joules
[    6.260519] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    6.280083] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    6.287231] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    6.301485] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    6.310023] Initialise system trusted keyring
[    6.315333] audit: initializing netlink socket (disabled)
[    6.321728] type=2000 audit(1544502086.829:1): initialized
[    6.384099] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.391502] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.402066] zpool: loaded
[    6.405315] zbud: loaded
[    6.409640] VFS: Disk quotas dquot_6.6.0
[    6.414839] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.423846] msgmni has been set to 32768
[    6.428926] Key type big_key registered
[    6.436112] NET: Registered protocol family 38
[    6.441395] Key type asymmetric registered
[    6.446283] Asymmetric key parser 'x509' registered
[    6.452213] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.461270] io scheduler noop registered
[    6.465962] io scheduler deadline registered (default)
[    6.472168] io scheduler cfq registered
[    6.476758] io scheduler mq-deadline registered
[    6.482131] io scheduler kyber registered
[    6.492834] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.500974] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.509065] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.516684] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.524290] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.531911] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.539548] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.547639] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.555293] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.563442] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.571533] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.579188] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.587284] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.594886] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.602544] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.610676] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.618768] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.626421] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.634564] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.642702] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.650836] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.659033] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.665604] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.673352] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.681962] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.690768] ACPI: Power Button [PWRF]
[    6.695259] ACPI: Requesting acpi_cpufreq
[    6.783174] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.792120] pstore: Registered erst as persistent store backend
[    6.799376] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.808395] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.836580] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.864023] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.871636] Non-volatile memory driver v1.3
[    6.876695] Linux agpgart interface v0.103
[    6.882010] crash memory driver: version 1.1
[    6.887597] rdac: device handler registered
[    6.892670] hp_sw: device handler registered
[    6.897767] emc: device handler registered
[    6.902944] alua: device handler registered
[    6.908033] libphy: Fixed MDIO Bus: probed
[    6.917839] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.925476] ehci-pci: EHCI PCI platform driver
[    6.931219] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.937490] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.946321] ehci-pci 0000:00:1a.0: debug port 2
[    6.955659] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.968257] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.975095] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.982992] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.991585] usb usb1: Product: EHCI Host Controller
[    6.997334] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.006017] usb usb1: SerialNumber: 0000:00:1a.0
[    7.011711] hub 1-0:1.0: USB hub found
[    7.016215] hub 1-0:1.0: 2 ports detected
[    7.021576] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    7.027820] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    7.036628] ehci-pci 0000:00:1d.0: debug port 2
[    7.045957] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    7.058257] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    7.065073] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    7.072958] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.081541] usb usb2: Product: EHCI Host Controller
[    7.087298] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.095966] usb usb2: SerialNumber: 0000:00:1d.0
[    7.101634] hub 2-0:1.0: USB hub found
[    7.106139] hub 2-0:1.0: 2 ports detected
[    7.111166] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    7.118399] ohci-pci: OHCI PCI platform driver
[    7.123725] uhci_hcd: USB Universal Host Controller Interface driver
[    7.131296] usbcore: registered new interface driver usbserial_generic
[    7.138936] usbserial: USB Serial support registered for generic
[    7.146048] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    7.274404] tsc: Refined TSC clocksource calibration: 2693.508 MHz
[    8.198826] i8042: No controller found
[    8.203374] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    8.203407] Switched to clocksource tsc
[    8.203491] mousedev: PS/2 mouse device common for all mice
[    8.211135] rtc_cmos 00:01: RTC can wake from S4
[    8.211374] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    8.211430] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    8.211555] intel_pstate: Intel P-state driver initializing
[    8.224029] cpuidle: using governor menu
[    8.225573] hidraw: raw HID events driver (C) Jiri Kosina
[    8.225831] usbcore: registered new interface driver usbhid
[    8.225832] usbhid: USB HID core driver
[    8.226051] drop_monitor: Initializing network drop monitor service
[    8.226649] TCP: cubic registered
[    8.226659] Initializing XFRM netlink socket
[    8.227349] NET: Registered protocol family 10
[    8.228935] NET: Registered protocol family 17
[    8.228948] mpls_gso: MPLS GSO support
[    8.234681] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    8.234999] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    8.235214] Loading compiled-in X.509 certificates
[    8.236305] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    8.237352] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    8.238422] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: c7aec20a70554693bf19667e4c28ac12c728bbb2'
[    8.238457] registered taskstats version 1
[    8.242553] Key type trusted registered
[    8.246137] Key type encrypted registered
[    8.246275] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    8.247963]   Magic number: 14:108:363
[    8.247969] machinecheck machinecheck19: hash matches
[    8.248120] msr msr2: hash matches
[    8.250281] rtc_cmos 00:01: setting system clock to 2018-12-11 04:21:33 UTC (1544502093)
[    8.366382] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    8.379708] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    8.379711] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.380025] hub 1-1:1.0: USB hub found
[    8.380088] hub 1-1:1.0: 6 ports detected
[    8.443824] Freeing unused kernel memory: 1876k freed
[    8.450220] Write protecting the kernel read-only data: 12288k
[    8.458744] Freeing unused kernel memory: 516k freed
[    8.466212] Freeing unused kernel memory: 600k freed
[    8.478742] random: fast init done
[    8.486348] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.508885] systemd[1]: Detected architecture x86-64.
[    8.514865] systemd[1]: Running in initial RAM disk.

Welcome to [0[    8.521093] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
;34mCentOS Linux[    8.530413] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
 7 (Core) dracut[    8.540654] hub 2-1:1.0: USB hub found
-033-554.el7 (In[    8.546339] hub 2-1:1.0: 8 ports detected
itramfs)[0m!

[    8.555539] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.637030] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.647862] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.658607] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.671658] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.682525] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.692605] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.706610] systemd[1]: Starting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.719446] systemd[1]: Starting dracut cmdline hook...
         Starting dracut cmdline hook...
[    8.731255] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    8.743277] systemd[1]: Starting Setup Virtual Console...
         Starting Setup Virtual Console...
[    8.755338] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Starting Create list of required st... nodes for the current kernel...
[    8.784501] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[    8.797464] systemd[1]: Reached target Sockets.
[[32m  OK  [0m] Reached target Sockets.
[    8.807457] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.817454] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Syst[    8.827388] usb 2-1.4: new full-speed USB device number 3 using ehci-p ci
ems.
[     Journal Service.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started dracut cmdline hook.
[[32m  OK  [0m] Started Setup Virtual Console.
[[32m  OK  [0m] Started Create  list of requirel.
         Starting Create Static Device Nodes in /dev...
         Starting dracut pre-udev hook...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[    8.938793] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
[    8.946792] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.955459] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.961904] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.961906] usb 2-1.4: SerialNumber: serial
[    8.963766] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/inpu t1
[[32m  OK dev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
[    9.015072] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
         Starting udev Coldplug all Devices...
[    9.038183] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
[    9.054379] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting dracut initqueue hook...
[[32m  OK  [0m] Reached target System Initialization.
         Starting Show Plymouth Boot Screen...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Started Forward Password Requ[    9.178108] mlx_compat: loading out-of-tree module taints kernel.
ests to Plymouth[    9.187299] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
 Directory Watch.
[[32m  OK  [    9.200513] dca service started, version 1.12.1
[0m] Reached ta[    9.200532] Compat-mlnx-ofed backport release: b4fdfac
rget Basic Syste[    9.200532] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
m.
[    9.200533] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    9.233293] pps_core: LinuxPPS API ver. 1 registered
[    9.239147] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    9.259357] PTP clock support registered
[    9.278929] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    9.285882] mlx4_core: Initializing 0000:04:00.0
[    9.288496] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    9.288500] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    9.301720] scsi host0: ahci
[    9.304639] scsi host1: ahci
[    9.306740] scsi host2: ahci
[    9.309929] scsi host3: ahci
[    9.310451] scsi host4: ahci
[    9.312027] scsi host5: ahci
[    9.312145] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 38
%G[    9.312149] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 38
[    9.312152] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 38
[    9.312154] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 38
[    9.312157] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 38
[    9.312160] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 38
[    9.314442] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    9.358250] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.358262] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    9.358269] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    9.358274] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.358279] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.358333] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    9.358333] igb: Copyright (c) 2007-2014 Intel Corporation.
[    9.359261] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.359728] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    9.362054] scsi host6: isci
[    9.377151] [TTM] Zone  kernel: Available graphics memory: 16252602 kiB
[    9.377152] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.377153] [TTM] Initializing pool allocator
[    9.377156] [TTM] Initializing DMA pool allocator
[    9.397243] igb 0000:02:00.0: added PHC on eth0
[    9.397245] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.397246] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
%G[    9.397325] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    9.397326] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.397919] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.434979] igb 0000:02:00.1: added PHC on eth1
[    9.434980] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.434982] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.435055] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.435057] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.472409] fbcon: mgadrmfb (fb0) is primary device
[    9.491047] igb 0000:02:00.2: added PHC on eth2
[    9.491049] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.491051] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.491124] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.491126] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.548740] igb 0000:02:00.3: added PHC on eth3
[    9.548742] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.548743] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.548817] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.548819] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.616526] ata1: SATA link down (SStatus 0 SControl 300)
[    9.617518] ata2: SATA link down (SStatus 0 SControl 300)
[    9.618526] ata5: SATA link down (SStatus 0 SControl 300)
[    9.618554] ata4: SATA link down (SStatus 0 SControl 300)
[    9.618581] ata3: SATA link down (SStatus 0 SControl 300)
[    9.618608] ata6: SATA link down (SStatus 0 SControl 300)
[    9.708971] Console: switching to colour frame buffer device 128x48
[    9.733039] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.745525] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   11.035485] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   11.043544] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   11.053601] ata7.00: configured for UDMA/133
[   11.071508] scsi 6:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.892744] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.900414] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.907880] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.915733] mlx4_core: device is working in RoCE mode: Roce V1
[   15.922913] mlx4_core: UD QP Gid type is: V1
[   16.990337] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   17.258636] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   17.270294] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   17.278779] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   17.413141] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   17.421149] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   17.431298] ata8.00: configured for UDMA/133
[   17.449059] scsi 6:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.498900] sd 6:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.498990] sd 6:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.499159] sd 6:0:1:0: [sdb] Write Protect is off
[   17.499288] sd 6:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.509695]  sdb:
[   17.510461] sd 6:0:1:0: [sdb] Attached SCSI disk
[   17.545027] sd 6:0:0:0: [sda] Write Protect is off
[   17.551411] sd 6:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.577826]  sda: sda1 sda2
[   17.582293] sd 6:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   18.405510] random: crng init done
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
         Mounting /sysroot...
[   18.524247] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
[[32m  OK  [0m] Stopped target Timers.
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Local File Systems.
         Stopping udev [   18.992340] systemd-journald[284]: Received SIGTERM from PID 1 (systemd).
Kernel Device Manager...
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Closed udev Kernel Socket.
[[32m  OK  [0m] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.316341] SELinux:  Disabled at runtime.
[   19.364258] type=1404 audit(1544502104.613:2): selinux=0 auid=4294967295 ses=4294967295
[   19.604982] ip_tables: (C) 2000-2006 Netfilter Core Team
[   19.613221] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd Root File System.
[[32m  OK  [0m] Listening on udev Control Socket.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
         Starting Availability of block devices...
         Starting Create list of required st... nodes for the current kernel...
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
         Starting Kernel Module supporting RPCSEC_GSS...
         Mounting Huge Pages File System...
         Mounting Debug File System...
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Reached target RPC Port Mapper.
         Mounting POSIX Message Queue File System...
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m[   20.563839] RPC: Registered named UNIX socket transport module.
] Mounted Debug [   20.563839] RPC: Registered udp transport module.
File System.
[[   20.563840] RPC: Registered tcp transport module.
[32m  OK  [0m][   20.563841] RPC: Registered tcp NFSv4.1 backchannel transport module.
 Mounted Huge Pages File System.
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Create Static Device Nodes in /dev...
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
[[32m  OK  [0m] Started Kernel Module supporting[   20.684250] EXT4-fs (sda1): re-mounted. Opts: (null)
 RPCSEC_GSS.
[[32m  OK  [0m] Started LVM2 metadata daemon.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting Configure read-only root support...
         Starting udev Coldplug all Devices...
         Starting Flush Journal to Persistent Storage...
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[   20.904756] systemd-journald[4363]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started udev Kernel Device Manager.
[   21.404641] device-mapper: uevent: version 1.0.3
[   21.410723] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[   21.493957] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   21.497077] i801_smbus 0000:07:00.3: Enabling SMBus device
[   21.497188] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   21.525883] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   21.527401] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.527403] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.528835] igb 0000:02:00.0: DCA enabled
[   21.528945] igb 0000:02:00.1: DCA enabled
[   21.529905] igb 0000:02:00.2: DCA enabled
[   21.529986] igb 0000:02:00.3: DCA enabled
[   21.532842] ipmi message handler version 39.2
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[   21.535638] ipmi device interface
[   21.546438] IPMI System Interface driver.
[   21.546470] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   21.546473] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   21.546474] ipmi_si: Adding SMBIOS-specified kcs state machine
[   21.546525] ipmi_platform: probing via SPMI
[   21.546527] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   21.546529] (NULL device *): SPMI-specified kcs state machine: duplicate
[   21.546616] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   21.599112] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   21.644541] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   21.644824] mpt2sas version 20.103.01.00 loaded
[   21.650859] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[   21.651216] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32505204 kB)
[   21.807215] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   21.821225] IPMI SSIF Interface driver
[   21.826699] sd 6:0:0:0: Attached scsi generic sg0 type 0
[   21.827366] sd 6:0:1:0: Attached scsi generic sg1 type 0
[   21.833819] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   21.835445] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[   21.836783] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 168
[   21.836785] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 169
[   21.836787] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 170
[   21.836788] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 171
[   21.836790] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 172
[   21.836791] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 173
[   21.836792] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 174
[   21.836794] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 175
[   21.836795] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 176
[   21.836796] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 177
[   21.836798] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 178
[   21.836799] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 179
[   21.836801] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 180
[   21.836802] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 181
[   21.836803] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 182
[   21.836805] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 183
[   21.836808] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffbd2f43c40000), size(65536)
[   21.836810] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[   21.890956] mpt2sas_cm0: sending message unit reset !!
[   21.892431] mpt2sas_cm0: message unit reset: SUCCESS
[   21.974350] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[   21.974352] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[   21.974353] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[   22.014039] cryptd: max_cpu_qlen set to 1000
[   22.029953] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[   22.029954] mpt2sas_cm0: Protocol=(
[   22.029955] Initiator
[   22.029955] ,Target
[   22.029955] ), 
[   22.029956] Capabilities=(
[   22.029956] TLR
[   22.029957] ,EEDP
[   22.029957] ,Snapshot Buffer
[   22.029957] ,Diag Trace Buffer
[   22.029958] ,Task Set Full
[   22.029958] ,NCQ
[   22.029958] )
[   22.030007] scsi host7: Fusion MPT SAS Host
[   22.030302] mpt2sas_cm0: sending port enable !!
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Found device /dev/ttyS0.
%G%G[   22.032910] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[   22.041448] mpt2sas_cm0: port enable: SUCCESS
[   22.042234] scsi 7:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.042240] scsi 7:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.042243] scsi 7:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.042247] scsi 7:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.121701] device-mapper: multipath round-robin: version 1.2.0 loaded
[   22.135754] iTCO_vendor_support: vendor-support=0
[   22.137887] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.137962] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.146036] AVX version of gcm_enc/dec engaged.
[   22.146037] AES CTR mode by8 optimization enabled
[   22.149117] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.149162] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.233066] kvm: disabled by bios
[   22.241022] intel_rapl: Found RAPL domain package
[   22.241028] intel_rapl: Found RAPL domain core
[   22.241035] intel_rapl: Found RAPL domain dram
[   22.241066] intel_rapl: Found RAPL domain package
[   22.241068] intel_rapl: Found RAPL domain core
[   22.241074] intel_rapl: Found RAPL domain dram
[   22.251904] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.252068] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.252068] EDAC sbridge:  Ver: 1.1.2 
[   22.377469] scsi 7:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.377474] scsi 7:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.377476] scsi 7:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.377480] scsi 7:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.564936] scsi 7:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.575838] scsi 7:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.588839] scsi 7:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.598036] scsi 7:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.628035] scsi 7:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.638032] scsi 7:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.650709] scsi 7:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.659594] scsi 7:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.690856] scsi 7:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   22.700795] scsi 7:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.713987] scsi 7:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.723442] scsi 7:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.757355] scsi 7:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.767502] scsi 7:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.780272] scsi 7:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.789320] scsi 7:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.821339] scsi 7:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.831562] scsi 7:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.844476] scsi 7:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.853609] scsi 7:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.881890] scsi 7:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.892211] scsi 7:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.905203] scsi 7:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.914506] scsi 7:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.940954] scsi 7:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.951319] scsi 7:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.964794] scsi 7:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.974512] scsi 7:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.003082] scsi 7:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   23.013565] scsi 7:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.026614] scsi 7:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.035918] scsi 7:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.063278] scsi 7:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   23.070619] sd 7:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.081162] sd 7:0:0:0: Attached scsi generic sg2 type 0
[   23.081733] sd 7:0:0:0: [sdc] Write Protect is off
[   23.081963] sd 7:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.090279] sd 7:0:0:0: [sdc] Attached SCSI disk
[   23.113887] scsi 7:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   23.121132] sd 7:0:0:1: Attached scsi generic sg3 type 0
[   23.128310] sd 7:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.128947] scsi 7:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   23.129164] sd 7:0:0:2: Attached scsi generic sg4 type 0
[   23.129304] sd 7:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.164870] scsi 7:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   23.172252] sd 7:0:0:2: [sde] Write Protect is off
[   23.172543] sd 7:0:0:3: Attached scsi generic sg5 type 0
[   23.172682] sd 7:0:0:1: [sdd] Write Protect is off
[   23.172793] sd 7:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.172890] sd 7:0:0:7: Attached scsi generic sg6 type 0
[   23.173002] sd 7:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.173326] sd 7:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.173558] scsi 7:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   23.173868] sd 7:0:0:3: [sdf] Write Protect is off
[   23.173905] sd 7:0:1:0: Attached scsi generic sg7 type 0
[   23.174007] sd 7:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.174270] sd 7:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.174404] sd 7:0:0:7: [sdg] Write Protect is off
[   23.174779] sd 7:0:1:0: [sdh] Write Protect is off
[   23.174929] sd 7:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.174933] scsi 7:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   23.175081] sd 7:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.175194] sd 7:0:1:1: Attached scsi generic sg8 type 0
[   23.175568] sd 7:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.175967] Dev sdd: unable to read RDB block 0
[   23.175975]  sdd: unable to read partition table
[   23.176089] scsi 7:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   23.176323] sd 7:0:1:2: Attached scsi generic sg9 type 0
[   23.176565] sd 7:0:1:1: [sdi] Write Protect is off
[   23.176718] sd 7:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.177057] sd 7:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.177076] Dev sdf: unable to read RDB block 0
[   23.177084]  sdf: unable to read partition table
[   23.177592] scsi 7:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   23.177915] sd 7:0:1:3: Attached scsi generic sg10 type 0
[   23.177939] Dev sdh: unable to read RDB block 0
[   23.177949]  sdh: unable to read partition table
[   23.178099] sd 7:0:1:2: [sdj] Write Protect is off
[   23.178230] sd 7:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.178271] sd 7:0:1:7: Attached scsi generic sg11 type 0
[   23.178410] sd 7:0:0:1: [sdd] Attached SCSI disk
[   23.178646] sd 7:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.178676] sd 7:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.178973] sd 7:0:0:3: [sdf] Attached SCSI disk
[   23.179750] sd 7:0:1:3: [sdk] Write Protect is off
[   23.180370] sd 7:0:1:7: [sdl] Write Protect is off
[   23.180507] sd 7:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.181174] sd 7:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.181259] sd 7:0:1:0: [sdh] Attached SCSI disk
[   23.182462] Dev sdj: unable to read RDB block 0
[   23.182473]  sdj: unable to read partition table
[   23.184916] sd 7:0:1:2: [sdj] Attached SCSI disk
[   23.185997] sd 7:0:1:3: [sdk] Attached SCSI disk
[   23.190055] sd 7:0:1:1: [sdi] Attached SCSI disk
[   23.202656] blk_update_request: I/O error, dev sdd, sector 0
[   23.204047] blk_update_request: I/O error, dev sdf, sector 0
[   23.205021] blk_update_request: I/O error, dev sdh, sector 0
[   23.206063] blk_update_request: I/O error, dev sdj, sector 0
[   23.207906] blk_update_request: I/O error, dev sdd, sector 0
[   23.208187] blk_update_request: I/O error, dev sdf, sector 0
[   23.209618] blk_update_request: I/O error, dev sdh, sector 0
[   23.210528] blk_update_request: I/O error, dev sdj, sector 0
[   23.212433] blk_update_request: I/O error, dev sdd, sector 0
[   23.212713] blk_update_request: I/O error, dev sdf, sector 0
[   23.420667]  sdg:
[   23.421921] sd 7:0:0:7: [sdg] Attached SCSI disk
[   23.597315]  sdl:
[   23.598543] sd 7:0:1:7: [sdl] Attached SCSI disk
[   23.627596] sd 7:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.641140] sd 7:0:0:2: [sde] Attached SCSI disk
[   23.648864] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   24.137639] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   24.147902] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   24.320054] device-mapper: table: 253:5: multipath: error getting device
[   24.328668] device-mapper: ioctl: error adding target to table
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Import network configuration from initramfs...
         Starting Preprocess NFS configuration...
         Starting Tell Plymouth To Write Out Runtime Data...
[[32m  OK  [0m] Started Import network configuration from initramfs.
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...[   24.685220] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS

         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Reached target Swap.
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Starting Security Auditing Service...
         Mounting RPC Pipe File System...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   24.943950] type=1305 audit(1544502110.192:3): audit_pid=9100 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting Machine Check Exception Logging Daemon...
         Starting NTP client/server...
         Starting Load CPU microcode update...
         Starting System Security Services Daemon...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Authorization Manager...
         Starting Network Manager...
         Starting Dump dmesg to /var/log/dmesg...
         Starting GSSAPI Proxy Daemon...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[   26.341983] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[   26.453064] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   26.542826] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   26.543226] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   26.552908] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.620708] card: mlx4_0, QP: 0x220, inline size: 120
[   26.634543] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.642514] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   26.659365] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.660953] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
[   26.785370] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.797348] ib0: enabling connected mode will cause multicast packet drops
[   26.805915] ib0: mtu > 4092 will cause multicast packet drops.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[   26.813609] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.925860] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   27.008910] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   27.028871] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   27.040248] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   27.059217] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[   27.503856] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   27.514226] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   28.214858] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   28.225112] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   28.907435] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   28.917831] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   29.498120] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   34.416668] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.464370] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.475248] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting OpenSSH server daemon...
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting Dynamic System Tuning Daemon...
         Starting Postfix Mail Transport Agent...
         Starting MUNGE authentication service...
[[32m  OK  [0m] Re[   34.668493] FS-Cache: Loaded
ached target Network is Online.
         Starting NFS status monitor for NFSv2/3 locking....
[   34.705818] FS-Cache: Netfs 'nfs' registered for caching
[   34.709895] Key type dns_resolver registered
[   34.739722] NFS: Registering the id_resolver key type
[   34.739726] Key type id_resolver registered
[   34.739727] Key type id_legacy registered
         Mounting /scratch...
         Starting Notify NFS peers of a restart...
         Starting System Logging Service...
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Crash recovery kernel arming...
         Starting Automounts filesystems on demand...
         Starting Permit User Sessions...
[[32m  OK  [0m] Started Permit User Sessions.
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Job spooling tools.
[[32m  OK  [0m] Started Command Scheduler.
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Created slice User Slice of root.
[[32m  OK  [0m] Started Session 1 of user root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-11T04:22:12+00:00] INFO: Forking chef instance to converge...
[2018-12-11T04:22:12+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-11T04:22:12+00:00] INFO: Chef-client pid: 10833
[2018-12-11T04:22:13+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-11T04:22:13+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-11T04:22:13+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-11T04:22:13+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-11T04:22:13+00:00] INFO: Running start handlers
[2018-12-11T04:22:13+00:00] INFO: Start handlers complete.
[2018-12-11T04:22:14+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-11T04:22:14+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T04:22:14+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T04:22:14+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-11T04:22:14+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181211042214.540224
[2018-12-11T04:22:14+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181206011152.684483
[2018-12-11T04:22:14+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-11T04:22:14+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-11T04:22:19+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-11T04:22:19+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-11T04:22:19+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-11T04:22:19+00:00] INFO: service[ntpd] started
[2018-12-11T04:22:19+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-11T04:22:20+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-11T04:22:20+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-11T04:22:20+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-11T04:22:20+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-11T04:22:20+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-11T04:22:20+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-11T04:22:20+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-11T04:22:20+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-11T04:22:20+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-11T04:22:21+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-11T04:22:21+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-11T04:22:21+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-11T04:22:21+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:21+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:21+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-11T04:22:21+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-11T04:22:22+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-11T04:22:22+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-11T04:22:22+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-11T04:22:22+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-11T04:22:23+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-11T04:22:23+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-11T04:22:23+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-11T04:22:23+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-11T04:22:23+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-11T04:22:23+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-11T04:22:23+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-11T04:22:24+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-11T04:22:24+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-11T04:22:24+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-11T04:22:24+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-11T04:22:24+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-11T04:22:24+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-11T04:22:24+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-11T04:22:24+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-11T04:22:24+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-11T04:22:24+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-11T04:22:24+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-11T04:22:24+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-11T04:22:25+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[   60.077316] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[2018-12-11T04:22:25+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-11T04:22:25+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-11T04:22:25+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-11T04:22:25+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211042225.645878
[2018-12-11T04:22:25+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181206011204.366288
[2018-12-11T04:22:25+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-11T04:22:25+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-11T04:22:25+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-11T04:22:25+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211042225.659978
[2018-12-11T04:22:25+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181206011204.382907
[2018-12-11T04:22:25+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-11T04:22:25+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-11T04:22:25+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-11T04:22:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:25+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-11T04:22:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:25+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-11T04:22:25+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-11T04:22:25+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-11T04:22:25+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-11T04:22:25+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T04:22:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:25+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T04:22:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:25+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T04:22:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:25+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T04:22:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:25+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:25+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T04:22:25+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:26+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:26+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T04:22:26+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:26+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:26+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T04:22:26+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:26+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:26+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T04:22:26+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:26+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:26+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-11T04:22:26+00:00] INFO: service[xinetd] started
[2018-12-11T04:22:26+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-11T04:22:26+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-11T04:22:26+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-11T04:22:26+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-11T04:22:27+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-11T04:22:27+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-11T04:22:27+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-11T04:22:27+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-11T04:22:27+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181211042227.881220
[2018-12-11T04:22:27+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-11T04:22:27+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-11T04:22:27+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-11T04:22:27+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-11T04:22:27+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-11T04:22:27+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:27+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:27+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-11T04:22:27+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-11T04:22:27+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-11T04:22:27+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-11T04:22:28+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T04:22:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T04:22:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-11T04:22:28+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-11T04:22:28+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-11T04:22:28+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-11T04:22:28+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-11T04:22:28+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-11T04:22:28+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-11T04:22:29+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-11T04:22:29+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-11T04:22:30+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-11T04:22:30+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-11T04:22:30+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-11T04:22:30+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-11T04:22:30+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-11T04:22:30+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-11T04:22:30+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-11T04:22:30+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-11T04:22:30+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-11T04:22:30+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-11T04:22:30+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-11T04:22:30+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-11T04:22:30+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-11T04:22:30+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-11T04:22:30+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-11T04:22:30+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-11T04:22:30+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-11T04:22:30+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-11T04:22:30+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-11T04:22:31+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-11T04:22:31+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-11T04:22:31+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-11T04:22:31+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-11T04:22:31+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[2018-12-11T04:22:34+00:00] INFO: service[kdump] restarted
[2018-12-11T04:22:34+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-11T04:22:34+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-11T04:22:34+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-11T04:22:34+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-11T04:22:34+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-11T04:22:34+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-11T04:22:34+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-11T04:22:34+00:00] INFO: Chef Run complete in 20.601172958 seconds
[2018-12-11T04:22:34+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-11T04:22:34+00:00] INFO: Running report handlers
[2018-12-11T04:22:34+00:00] INFO: Creating JSON run report
[2018-12-11T04:22:34+00:00] INFO: Report handlers complete
[  210.027603] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  210.037935] alg: No test for adler32 (adler32-zlib)
[  210.861191] Lustre: Lustre: Build Version: 2.10.6_RC3
[  211.075342] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  211.177623] LDISKFS-fs warning (device dm-2): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[  211.177623] 
[  261.901542] LDISKFS-fs (dm-2): recovery complete
[  261.907238] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  264.829934] Lustre: MGS: Connection restored to 8c3502d2-59c8-caf7-4b02-efb46d4ab67d (at 0@lo)
[  265.463770] LustreError: 11-0: soaked-MDT0003-osp-MDT0000: operation mds_connect to node 192.168.1.111@o2ib failed: rc = -114
[  266.157037] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  273.088041] Lustre: MGS: Connection restored to ef9f6e56-cd60-6cfa-7b40-eddca70d4bf2 (at 192.168.1.125@o2ib)
[  275.463133] Lustre: soaked-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[  277.634351] Lustre: MGS: Connection restored to 6515bc9f-525e-0e2d-8558-82c5ecd77025 (at 192.168.1.139@o2ib)
[  277.645447] Lustre: Skipped 1 previous similar message
[  279.243273] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect
[  281.845770] Lustre: MGS: Connection restored to 2bdd81d8-5a92-b910-3510-b7a89726a872 (at 192.168.1.117@o2ib)
[  281.856878] Lustre: Skipped 15 previous similar messages
[  290.231848] Lustre: MGS: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[  290.241190] Lustre: Skipped 20 previous similar messages
[  291.102655] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  309.908946] Lustre: soaked-MDT0000: Connection restored to b35e0c93-4783-ff00-6ac2-902ea529f1e0 (at 192.168.1.126@o2ib)
[  309.921144] Lustre: Skipped 17 previous similar messages
[  316.103455] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  316.116205] LustreError: Skipped 1 previous similar message
[  341.104058] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  353.481913] Lustre: MGS: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[  353.491241] Lustre: Skipped 17 previous similar messages
[  366.128977] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  391.105200] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  416.106023] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  441.106632] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  446.421326] Lustre: 12378:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  466.107355] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  491.107968] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  506.436905] Lustre: 12378:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  506.458026] Lustre: 12378:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 1 previous similar message
[  516.200078] Lustre: soaked-MDT0000: Recovery over after 3:57, of 29 clients 29 recovered and 0 were evicted.
[ 1248.907657] LustreError: 12396:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 1271.663069] LustreError: 12487:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 1271.676498] LustreError: 12487:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 5 previous similar messages
[ 1272.725139] LustreError: 12393:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[ 2377.144173] Lustre: 12520:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 2479.500641] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544504551/real 0]  req@ffff99214a0db000 x1619528139214688/t0(0) o400->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544504564 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2479.542525] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 2485.567772] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544504564/real 0]  req@ffff9921489ab300 x1619528139593296/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544504570 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2488.750488] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2490.626786] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.116@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2490.653369] LustreError: Skipped 2 previous similar messages
[ 2493.507425] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.142@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2499.532058] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2499.559757] LustreError: Skipped 7 previous similar messages
[ 2509.627398] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.106@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2509.654223] LustreError: Skipped 6 previous similar messages
[ 2525.784568] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.119@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2525.811611] LustreError: Skipped 14 previous similar messages
[ 2540.569333] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544504614/real 0]  req@ffff99214aa1c800 x1619528139797328/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544504625 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2559.628609] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.106@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2559.655829] LustreError: Skipped 23 previous similar messages
[ 2625.587862] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.122@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2625.614910] LustreError: Skipped 56 previous similar messages
[ 2645.572197] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544504714/real 0]  req@ffff991d066df200 x1619528139803024/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544504730 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2652.421629] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 2652.977074] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 2652.991161] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 2653.519127] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 2653.533097] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 2654.052377] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 2654.066264] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 2654.603588] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 2654.617493] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 2655.133317] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 2655.147205] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 2655.653637] sd 7:0:1:1: [sdi] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 2655.660508] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 2655.660521] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 2655.687932] sd 7:0:1:1: [sdi] Sense Key : Illegal Request [current] 
[ 2655.696924] sd 7:0:1:1: [sdi] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 2655.704882] sd 7:0:1:1: [sdi] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00
[ 2655.716132] blk_update_request: 14 callbacks suppressed
[ 2655.723753] blk_update_request: I/O error, dev sdi, sector 11608952
[ 2655.733337] device-mapper: multipath: Failing path 8:128.
[ 2656.161097] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 2656.174564] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 2656.687195] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 2656.700579] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 2657.220367] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 2657.233683] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 2657.248065] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[ 2657.259375] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[ 2657.272738] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[ 2660.472306] device-mapper: multipath: Reinstating path 8:128.
[ 2660.650136] sd 7:0:0:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 2660.660339] sd 7:0:0:1: [sdd] Sense Key : Illegal Request [current] 
[ 2660.668945] sd 7:0:0:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 2660.676528] sd 7:0:0:1: [sdd] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00
[ 2660.687407] blk_update_request: I/O error, dev sdd, sector 11608952
[ 2660.695861] device-mapper: multipath: Failing path 8:48.
[ 2666.151473] LDISKFS-fs warning (device dm-3): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[ 2666.151473] 
[ 2666.484105] device-mapper: multipath: Reinstating path 8:48.
[ 2676.183454] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff992157ecb400, cur 1544504761 expire 1544504611 last 1544504534
[ 2679.132114] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds
[ 2714.295180] LDISKFS-fs (dm-3): recovery complete
[ 2714.303166] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[ 2715.392481] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[ 2715.403690] Lustre: Skipped 5 previous similar messages
[ 2715.467807] Lustre: soaked-MDT0000: Received LWP connection from 0@lo, removing former export from 192.168.1.109@o2ib
[ 2715.469464] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900
[ 2715.505524] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[ 2715.521225] LustreError: 12869:0:(llog_osd.c:978:llog_osd_next_block()) soaked-MDT0003-osp-MDT0001: missed desired record? 3 > 1
[ 2715.538043] LustreError: 12869:0:(lod_dev.c:419:lod_sub_recovery_thread()) soaked-MDT0003-osp-MDT0001 getting update log failed: rc = -2
[ 2715.636006] Lustre: 12870:0:(ldlm_lib.c:2059:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[ 2715.636420] Lustre: soaked-MDT0001: disconnecting 28 stale clients
[ 2716.903950] Lustre: Failing over soaked-MDT0001
[ 2717.539186] Lustre: server umount soaked-MDT0001 complete
[ 2725.467380] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544504789/real 1544504805]  req@ffff992140b80300 x1619528139807072/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544504810 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2765.469253] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[ 2765.490726] LustreError: 12470:0:(osp_object.c:582:osp_attr_get()) soaked-MDT0001-osp-MDT0000:osp_attr_get update error [0x240006991:0x1:0x0]: rc = -5
[ 2765.495815] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 2765.495818] Lustre: Skipped 5 previous similar messages
[ 2765.535240] LustreError: 12470:0:(osp_object.c:582:osp_attr_get()) Skipped 5 previous similar messages
[ 2784.885376] LustreError: 12468:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 2784.898792] LustreError: 12468:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 6 previous similar messages
[ 3136.512927] LustreError: 12294:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 3201.073683] LustreError: 12440:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 3201.087576] LustreError: 12440:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 15 previous similar messages
[ 3821.834958] LustreError: 12447:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 3821.848694] LustreError: 12447:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[ 5193.885310] Lustre: 12274:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544507271/real 0]  req@ffff992155269e00 x1619528150648592/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544507278 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 5193.885315] Lustre: 12411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544507271/real 0]  req@ffff99210d3f2100 x1619528150648608/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544507278 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 5193.885323] Lustre: 12411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 5193.978292] Lustre: 12274:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 5219.197003] Lustre: 12411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544507296/real 1544507296]  req@ffff99210d3f2100 x1619528150648608/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544507303 ref 2 fl Rpc:X/2/ffffffff rc 0/-1
[ 5219.197008] Lustre: 13010:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544507296/real 1544507296]  req@ffff99213efa9800 x1619528150648640/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544507303 ref 2 fl Rpc:X/2/ffffffff rc 0/-1
[ 5219.197015] Lustre: 13010:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 5219.292242] Lustre: 12411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 5222.540115] Lustre: 12216:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544507300/real 0]  req@ffff99210afb5a00 x1619528150650352/t0(0) o400->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544507307 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 5222.580909] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 5228.606289] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544507307/real 0]  req@ffff99210afb5400 x1619528150650640/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544507313 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 5242.205685] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 5 seconds
[ 5254.206034] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 17 seconds
[ 5254.220852] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 7 previous similar messages
[ 5261.234237] Lustre: 13034:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544507339/real 1544507339]  req@ffff992145553900 x1619528150648656/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544507346 ref 2 fl Rpc:X/2/ffffffff rc 0/-1
[ 5261.274906] Lustre: 13034:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 5267.206426] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 30 seconds
[ 5267.221303] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 7 previous similar messages
[ 5280.206771] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 43 seconds
[ 5280.221551] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 7 previous similar messages
[ 5287.234960] Lustre: 13010:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544507365/real 1544507365]  req@ffff99213efa9800 x1619528150648640/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544507372 ref 2 fl Rpc:X/2/ffffffff rc 0/-1
[ 5287.275272] Lustre: 13010:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 6 previous similar messages
[ 5292.207147] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 55 seconds
[ 5292.221893] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 7 previous similar messages
[ 5305.207495] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 68 seconds
[ 5305.222226] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 7 previous similar messages
[ 5325.208068] Lustre: 12411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544507403/real 1544507403]  req@ffff99210d3f2100 x1619528150648608/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544507410 ref 2 fl Rpc:X/2/ffffffff rc 0/-1
[ 5325.248788] Lustre: 12411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
[ 5330.208192] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 93 seconds
[ 5330.223134] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 12 previous similar messages
[ 5368.209287] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 131 seconds
[ 5368.224228] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 18 previous similar messages
[ 5391.361534] Lustre: MGS: haven't heard from client d8a30074-76f3-e504-e94d-24682a24e9cd (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff99216bff5c00, cur 1544507476 expire 1544507326 last 1544507249
[ 5391.391638] Lustre: Skipped 1 previous similar message
[ 5400.210186] Lustre: 12983:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544507478/real 1544507478]  req@ffff992144b6e600 x1619528150648688/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544507485 ref 2 fl Rpc:X/2/ffffffff rc 0/-1
[ 5400.251011] Lustre: 12983:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 25 previous similar messages
[ 5413.624862] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffff992157ecbc00, cur 1544507498 expire 1544507348 last 1544507269
[ 5413.655584] LustreError: 12276:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff991cf1946900 x1619528150665600/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
[ 5431.211281] Lustre: 12411:0:(service.c:2114:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (243:5s); client may timeout.  req@ffff992145afce00 x1619498968732928/t0(0) o103->soaked-MDT0003-mdtlov_UUID@192.168.1.111@o2ib:236/0 lens 328/192 e 9 to 0 dl 1544507511 ref 1 fl Complete:H/0/0 rc 0/0
[ 5431.252568] Lustre: 12411:0:(service.c:2114:ptlrpc_server_handle_request()) Skipped 4 previous similar messages
[ 5444.211475] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 99 seconds
[ 5444.226478] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 43 previous similar messages
[ 5578.616292] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544507632/real 0]  req@ffff99210afb5700 x1619528150678320/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544507663 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 5578.657481] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 8 previous similar messages
[ 5595.215786] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 2 seconds
[ 5595.230696] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 8 previous similar messages
[ 5693.128816] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[ 5693.369121] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.110@o2ib, removing former export from 192.168.1.111@o2ib
[ 5795.543000] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[ 5795.558022] Lustre: Skipped 1 previous similar message
[ 5804.750207] LustreError: 12275:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff991cbcceda00 x1619528150734800/t0(0) o105->soaked-MDT0000@192.168.1.110@o2ib:15/16 lens 304/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
[ 5804.781187] LustreError: 12275:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 6 previous similar messages
[ 5815.848433] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 5822.623802] LustreError: 11-0: soaked-MDT0003-osp-MDT0000: operation obd_ping to node 192.168.1.110@o2ib failed: rc = -107
[ 5822.639741] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 5872.625334] LustreError: 167-0: soaked-MDT0003-osp-MDT0000: This client was evicted by soaked-MDT0003; in progress operations using this service will fail.
[ 5872.647978] LustreError: 13042:0:(osp_object.c:582:osp_attr_get()) soaked-MDT0003-osp-MDT0000:osp_attr_get update error [0x2c00059fd:0x3:0x0]: rc = -5
[ 5872.652081] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 5872.652083] Lustre: Skipped 2 previous similar messages
[ 5872.694346] LustreError: 13042:0:(osp_object.c:582:osp_attr_get()) Skipped 4 previous similar messages
[ 5976.784322] Lustre: 12404:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 7019.796878] Lustre: 12198:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544509097/real 0]  req@ffff991ce0a0a400 x1619528154923184/t0(0) o13->soaked-OST000d-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544509104 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 7019.838770] Lustre: 12198:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 7019.852879] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7023.756990] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7023.783067] Lustre: Skipped 1 previous similar message
[ 7055.445916] Lustre: 12204:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544509089/real 1544509089]  req@ffff99213e4f4800 x1619528154922688/t0(0) o6->soaked-OST0009-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 664/432 e 0 to 1 dl 1544509140 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
[ 7055.488810] Lustre: 12204:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[ 7122.259827] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 1 seconds
[ 7122.274992] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[ 7164.889036] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544509233/real 0]  req@ffff99213f8fd700 x1619528154930048/t0(0) o8->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544509249 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 7164.930906] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 10 previous similar messages
[ 7198.262010] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 2 seconds
[ 7198.277107] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[ 7226.737994] Lustre: MGS: haven't heard from client d95313b3-a0ef-af0e-93ed-645d56f249aa (at 192.168.1.105@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff99215720ec00, cur 1544509311 expire 1544509161 last 1544509084
[ 7349.894367] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544509408/real 0]  req@ffff99213f8fda00 x1619528154937600/t0(0) o8->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544509434 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 7349.936269] Lustre: 12197:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[ 7375.267106] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 4 seconds
[ 7375.282281] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[ 7551.272187] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 6 seconds
[ 7551.287003] LNet: 12186:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 7 previous similar messages
[ 7616.819530] LNet: 13302:0:(o2iblnd_cb.c:2405:kiblnd_passive_connect()) Conn stale 192.168.1.105@o2ib version 12/12 incarnation 1544509701373750/1544509701373750
[ 7616.849376] Lustre: MGS: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 7617.138059] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 7617.154362] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 7617.166482] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0009_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client[ 7617.274054] LNet: 12186:0:(o2iblnd_cb.c:1350:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.105@o2ib: connected
[ 7622.325220] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 7622.341233] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline

[ 7622.352750] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0001_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client[ 7627.187432] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 7627.207445] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 7627.219611] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0005_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client
[ 7632.028646] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 7632.048693] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 7632.060472] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST000d_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client[ 7657.036821] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7657.063856] LustreError: Skipped 77 previous similar messages
[ 7665.202056] Lustre: soaked-OST0005-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 7672.192641] Lustre: soaked-OST000d-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 7672.207675] Lustre: Skipped 1 previous similar message
[ 7682.037506] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 7682.037508] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 7682.069811] Lustre: Skipped 2 previous similar messages
[ 7693.941298] Lustre: soaked-OST0009-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 7707.038327] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7707.038329] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7707.086151] LustreError: Skipped 2 previous similar messages
[ 7732.038768] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 7732.053317] Lustre: Skipped 1 previous similar message
[ 7757.039470] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7757.062775] LustreError: Skipped 1 previous similar message
[ 7782.040254] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 7782.040255] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 7782.040257] Lustre: Skipped 2 previous similar messages
[ 7832.067741] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7832.067742] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7832.067744] LustreError: Skipped 4 previous similar messages
[ 7882.043231] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 7882.057562] Lustre: Skipped 7 previous similar messages
[ 8032.047422] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID
[ 8032.047491] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 8032.076767] Lustre: Skipped 11 previous similar messages
[ 8082.049123] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 8082.061848] Lustre: Skipped 2 previous similar messages
[ 8107.049774] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8107.073963] LustreError: Skipped 21 previous similar messages
[ 9576.434661] Lustre: 12480:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[2J[1;1HCopyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
[2J[1;1HCopyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [7m[4;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[4;79H[m[m[5;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [4;79H[22;1H   The selected entry will be started automatically in 5s.                     [4;79H[22;1H   The selected entry will be started automatically in 4s.                     [4;79H[22;1H   The selected entry will be started automatically in 3s.                     [4;79H[22;1H   The selected entry will be started automatically in 2s.                     [4;79H[22;1H   The selected entry will be started automatically in 1s.                     [4;79H[22;1H   The selected entry will be started automatically in 0s.                     [4;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-307-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Fri Nov 30 18:46:05 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x34b20000-0x36587fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd6000-0x83fffcfff]
[    0.000000] Reserving 320MB of memory at 512MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff8bd12e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 6822680k/34603008k available (7664k kernel code, 1126748k absent, 1001124k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration failed
[    0.000000] tsc: PIT calibration matches HPET. 1 loops
[    0.000000] tsc: Detected 2693.510 MHz processor
[    0.000177] Calibrating delay loop (skipped), value calculated using timer frequency.. 5387.02 BogoMIPS (lpj=2693510)
[    0.012637] pid_max: default: 245760 minimum: 1920
[    0.019129] Security Framework initialized
[    0.024011] SELinux:  Initializing.
[    0.028488] Yama: becoming mindful.
[    0.038128] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.060411] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.074722] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.082792] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.093594] Initializing cgroup subsys memory
[    0.098808] Initializing cgroup subsys devices
[    0.104175] Initializing cgroup subsys freezer
[    0.109435] Initializing cgroup subsys net_cls
[    0.114693] Initializing cgroup subsys blkio
[    0.119756] Initializing cgroup subsys perf_event
[    0.125351] Initializing cgroup subsys hugetlb
[    0.130610] Initializing cgroup subsys pids
[    0.135577] Initializing cgroup subsys net_prio
[    0.141213] mce: CPU supports 20 MCE banks
[    0.146116] CPU0: Thermal monitoring enabled (TM1)
[    0.151841] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.158265] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.164944] tlb_flushall_shift: 6
[    0.169011] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.180265] FEATURE SPEC_CTRL Present
[    0.184649] FEATURE IBPB_SUPPORT Present
[    0.189623] Spectre V2 : Mitigation: Full retpoline
[    0.195788] Freeing SMP alternatives: 28k freed
[    0.207324] ACPI: Core revision 20130517
[    0.303385] ACPI: All ACPI Tables successfully acquired
[    0.323655] ftrace: allocating 29187 entries in 115 pages
[    0.384513] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.392198] Switched APIC routing to physical flat.
[    0.398660] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.415664] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.426882] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.444184] ... version:                3
[    0.448950] ... bit width:              48
[    0.453810] ... generic registers:      4
[    0.458575] ... value mask:             0000ffffffffffff
[    0.464802] ... max period:             00007fffffffffff
[    0.471024] ... fixed-purpose events:   3
[    0.475789] ... event mask:             000000070000000f
[    0.490474] smpboot: Booting Node   0, Processors  #1[    0.512149] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.568448] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.709593] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.753015] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.794638] Brought up 32 CPUs
[    0.798822] smpboot: Max logical packages: 15
[    0.803990] smpboot: Total of 32 processors activated (172578.11 BogoMIPS)
[    1.062257] node 0 initialised, 2813371 pages in 136ms
[    1.100017] node 1 initialised, 3599739 pages in 168ms
[    1.107287] devtmpfs: initialized
[    1.122795] EVM: security.selinux
[    1.126789] EVM: security.ima
[    1.130388] EVM: security.capability
[    1.134951] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.144323] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.157202] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.165188] pinctrl core: initialized pinctrl subsystem
[    1.171602] RTC time:  7:04:56, date: 12/11/18
[    1.177352] NET: Registered protocol family 16
[    1.183153] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.192118] ACPI: bus type PCI registered
[    1.196888] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.205005] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.215915] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.223826] PCI: Using configuration type 1 for base access
[    1.230400] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.251329] ACPI: Added _OSI(Module Device)
[    1.256299] ACPI: Added _OSI(Processor Device)
[    1.261555] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.267101] ACPI: Added _OSI(Processor Aggregator Device)
[    1.273425] ACPI: Added _OSI(Linux-Dell-Video)
[    1.318503] ACPI: Executed 1 blocks of module-level executable AML code
[    1.607633] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.641031] ACPI: Interpreter enabled
[    1.645443] ACPI: (supports S0 S1 S5)
[    1.649820] ACPI: Using IOAPIC for interrupt routing
[    1.655780] HEST: Table parsing has been initialized.
[    1.661720] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.672496] ACPI: GPE 0x1E active on init
[    1.677438] ACPI: GPE 0x24 active on init
[    1.682376] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.748403] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.755617] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.765784] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.774780] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.783842] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.793774] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.805950] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.821330] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.837086] PCI host bridge to bus 0000:00
[    1.841956] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.849156] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.858017] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.866879] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.875740] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.884604] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.893467] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.902329] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.911190] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.920049] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.928912] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.937775] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.946635] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.955500] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.964364] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.974006] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.980963] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.987886] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.994810] pci 0000:00:02.0: System wakeup disabled by ACPI
[    2.001711] pci 0000:00:02.2: System wakeup disabled by ACPI
[    2.008633] pci 0000:00:03.0: System wakeup disabled by ACPI
[    2.019129] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    2.026072] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    2.032982] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    2.039934] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.046787] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.054366] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.060391] acpiphp: Slot [2] registered
[    2.065354] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.076189] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.087374] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.098201] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.109377] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.120214] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.131396] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.142229] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.155066] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.161415] acpiphp: Slot [2-2] registered
[    2.168727] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.174755] acpiphp: Slot [2-3] registered
[    2.179654] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.185674] acpiphp: Slot [2-4] registered
[    2.190873] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.197066] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.210370] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.216353] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.222643] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.229337] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.235302] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.244611] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.253650] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.262685] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.271712] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.280734] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.289760] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.298774] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.307799] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.317027] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.324236] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.334154] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.342988] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.352037] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.362108] PCI host bridge to bus 0000:80
[    2.366980] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.374861] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.382742] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.391606] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.400469] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.410108] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.416763] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.423667] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.430562] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.437458] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.446590] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.452529] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.458457] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.469072] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.485938] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.492857] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.502553] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.512733] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.520031] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.529804] PCI host bridge to bus 0000:7f
[    2.534676] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.545621] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.552538] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.562234] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.572414] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.579710] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.589483] PCI host bridge to bus 0000:ff
[    2.594354] pci_bus 0000:ff: root bus resource [bus ff]
[    2.605903] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.615471] vgaarb: loaded
[    2.618777] vgaarb: bridge control possible 0000:09:00.0
[    2.625433] SCSI subsystem initialized
[    2.629965] ACPI: bus type USB registered
[    2.634777] usbcore: registered new interface driver usbfs
[    2.641219] usbcore: registered new interface driver hub
[    2.647737] usbcore: registered new device driver usb
[    2.654221] EDAC MC: Ver: 3.0.0
[    2.658560] PCI: Using ACPI for IRQ routing
[    2.671136] NetLabel: Initializing
[    2.675232] NetLabel:  domain hash size = 128
[    2.680389] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.686259] NetLabel:  unlabeled traffic allowed by default
[    2.693132] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.701123] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.709986] amd_nb: Cannot enumerate AMD northbridges
[    2.716132] Switched to clocksource hpet
[    2.735335] pnp: PnP ACPI init
[    2.739064] ACPI: bus type PNP registered
[    2.744124] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.751039] system 00:00: [io  0xffff] has been reserved
[    2.757268] system 00:00: [io  0xffff] has been reserved
[    2.763497] system 00:00: [io  0xffff] has been reserved
[    2.769728] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.777027] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.783938] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.790851] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.797763] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.805068] system 00:00: [io  0x0cf9] could not be reserved
[    2.811907] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.820377] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.828077] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.835769] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.843461] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.851151] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.858839] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.866916] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.874993] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.883076] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.891282] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.899892] pnp: PnP ACPI: found 7 devices
[    2.904766] ACPI: bus type PNP unregistered
[    2.919147] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.925006] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.931141] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.938253] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.946145] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.951988] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.959874] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.969811] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.975664] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.981508] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.988615] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.996509] pci 0000:00:11.0: PCI bridge to [bus 07]
[    3.002352] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    3.009462] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    3.017351] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    3.027288] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    3.033147] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    3.038992] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    3.046880] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    3.056036] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    3.062107] pci 0000:80:01.0: PCI bridge to [bus 81]
[    3.067965] pci 0000:80:02.0: PCI bridge to [bus 82]
[    3.073817] pci 0000:80:03.0: PCI bridge to [bus 83]
[    3.079670] pci 0000:80:03.2: PCI bridge to [bus 84]
[    3.085892] NET: Registered protocol family 2
[    3.093223] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.102902] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.110941] TCP: Hash tables configured (established 262144 bind 65536)
[    3.118722] TCP: reno registered
[    3.122776] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.130248] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.139242] NET: Registered protocol family 1
[    4.244087] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.352086] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.360885] Un packing initram[    6.194586] Freeing initrd memory: 27040k freed
[    6.210585] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    6.218106] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff8bcdb73c7000-ffff8bcdbb3c6fff]
[    6.230137] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    6.239516] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    6.246243] RAPL PMU: hw unit of domain package 2^-16 Joules
[    6.252877] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    6.272369] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    6.279505] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    6.293747] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    6.302316] Initialise system trusted keyring
[    6.307627] audit: initializing netlink socket (disabled)
[    6.313991] type=2000 audit(1544511897.831:1): initialized
[    6.376124] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.383526] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.394110] zpool: loaded
[    6.397337] zbud: loaded
[    6.401660] VFS: Disk quotas dquot_6.6.0
[    6.406854] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.415865] msgmni has been set to 32768
[    6.420918] Key type big_key registered
[    6.428128] NET: Registered protocol family 38
[    6.433422] Key type asymmetric registered
[    6.438306] Asymmetric key parser 'x509' registered
[    6.444232] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.453313] io scheduler noop registered
[    6.458025] io scheduler deadline registered (default)
[    6.464226] io scheduler cfq registered
[    6.468830] io scheduler mq-deadline registered
[    6.474216] io scheduler kyber registered
[    6.484842] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.492981] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.501077] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.508671] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.516285] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.523890] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.531544] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.539623] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.547260] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.555393] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.563489] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.571142] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.579232] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.586843] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.594482] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.602620] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.610715] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.618370] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.626507] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.634640] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.642774] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.650997] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.657541] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.665303] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.673908] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.682686] ACPI: Power Button [PWRF]
[    6.687179] ACPI: Requesting acpi_cpufreq
[    6.775415] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.784323] pstore: Registered erst as persistent store backend
[    6.791587] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.800587] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.828771] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.856206] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.863836] Non-volatile memory driver v1.3
[    6.868902] Linux agpgart interface v0.103
[    6.874223] crash memory driver: version 1.1
[    6.879807] rdac: device handler registered
[    6.884882] hp_sw: device handler registered
[    6.889982] emc: device handler registered
[    6.895170] alua: device handler registered
[    6.905093] libphy: Fixed MDIO Bus: probed
[    6.910084] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.917711] ehci-pci: EHCI PCI platform driver
[    6.923462] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.929720] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.938535] ehci-pci 0000:00:1a.0: debug port 2
[    6.947863] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.960095] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.966911] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.974821] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.983415] usb usb1: Product: EHCI Host Controller
[    6.989174] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.997848] usb usb1: SerialNumber: 0000:00:1a.0
[    7.003534] hub 1-0:1.0: USB hub found
[    7.008038] hub 1-0:1.0: 2 ports detected
[    7.013403] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    7.019668] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    7.028480] ehci-pci 0000:00:1d.0: debug port 2
[    7.037814] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    7.050096] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    7.056899] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    7.064789] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.073392] usb usb2: Product: EHCI Host Controller
[    7.079140] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.087826] usb usb2: SerialNumber: 0000:00:1d.0
[    7.093494] hub 2-0:1.0: USB hub found
[    7.097993] hub 2-0:1.0: 2 ports detected
[    7.103013] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    7.110244] ohci-pci: OHCI PCI platform driver
[    7.115576] uhci_hcd: USB Universal Host Controller Interface driver
[    7.123161] usbcore: registered new interface driver usbserial_generic
[    7.130799] usbserial: USB Serial support registered for generic
[    7.137903] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    7.268213] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    8.190661] i8042: No controller found
[    8.195204] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    8.195246] Switched to clocksource tsc
[    8.195325] mousedev: PS/2 mouse device common for all mice
[    8.195537] rtc_cmos 00:01: RTC can wake from S4
[    8.195777] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    8.195834] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    8.195971] intel_pstate: Intel P-state driver initializing
[    8.211294] cpuidle: using governor menu
[    8.212831] hidraw: raw HID events driver (C) Jiri Kosina
[    8.213098] usbcore: registered new interface driver usbhid
[    8.213099] usbhid: USB HID core driver
[    8.213325] drop_monitor: Initializing network drop monitor service
[    8.213863] TCP: cubic registered
[    8.213873] Initializing XFRM netlink socket
[    8.214571] NET: Registered protocol family 10
[    8.216182] NET: Registered protocol family 17
[    8.216196] mpls_gso: MPLS GSO support
[    8.219369] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    8.219706] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    8.219929] Loading compiled-in X.509 certificates
[    8.221027] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    8.222085] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    8.223130] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: c7aec20a70554693bf19667e4c28ac12c728bbb2'
[    8.223166] registered taskstats version 1
[    8.228064] Key type trusted registered
[    8.232096] Key type encrypted registered
[    8.232233] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    8.233883]   Magic number: 14:117:66
[    8.234240] memory memory227: hash matches
[    8.234269] memory memory94: hash matches
[    8.235554] rtc_cmos 00:01: setting system clock to 2018-12-11 07:05:03 UTC (1544511903)
[    8.364101] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    8.376417] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    8.376420] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.376731] hub 1-1:1.0: USB hub found
[    8.376795] hub 1-1:1.0: 6 ports detected
[    8.435517] Freeing unused kernel memory: 1876k freed
[    8.442012] Write protecting the kernel read-only data: 12288k
[    8.451507] Freeing unused kernel memory: 516k freed
[    8.460043] Freeing unused kernel memory: 600k freed
[    8.473735] random: systemd: uninitialized urandom read (16 bytes read)
[    8.476168] random: fast init done
[    8.489466] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    8.491101] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.492545] systemd[1]: Detected architecture x86-64.
[    8.492549] systemd[1]: Running in initial RAM disk.
[    8.530003] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.530396] hub 2-1:1.0: USB hub found
[    8.530582] hub 2-1:1.0: 8 ports detected

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.558285] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.638797] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.649642] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.660329] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.673235] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.683231] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.696350] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.707267] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[    8.720325] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[     8.733532] s
[    8.745358] systemd[1]: Starting dracut cmdline hook...
         Starting dracut cmdline hook...
[    8.756186] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.767132] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Starting Create list of required st... nodes for the current kernel...
[    8.788849] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    8.799946] systemd[1]: Starting Setup Virtual Console...
[     8.806304] using ehci-pci
         Starting Setup Virtual Console...
[    8.819804] systemd[1]: Starting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.840707] systemd[1]: Started Create list of required static device nodes for the current kernel.
[[32m  OK  [0m] Started Create list of  required sta...[    8.861649] systemd[1]: Started Apply Kernel Variables.
[[32m  OK  [0m] Started Apply Kernel Variables.
[    8.874307] systemd[1]: Started Journal Servic e.
[[32m  OK rnal Service.
[[32m  OK  [0m] Started dracut cmdline hook.
[ [32m  OK  [0ml e.
         Std racut pre-udev g Create Static Device Nodes in [    8.909286] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
/dev...
[    8.918578] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.928119] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.934543] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.941252] usb 2-1.4: SerialNumber: serial
[    8.942764] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut pre-udev hook.
          Startiv Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Startin[    8.994399] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
g udev Coldplug all Devices...
[    9.014986] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
         Mountin[    9.034952] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
g Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting dracut initqueue hook...
[[32m  OK  [0m] Reached target System Initialization.
         Starting Show Plymouth Boot Screen...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Reached target Basic System.
[    9.141388] dca service started, version 1.12.1
[    9.147815] mlx_compat: loading out-of-tree module taints kernel.
[    9.155260] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    9.155294] pps_core: LinuxPPS API ver. 1 registered
[    9.155295] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    9.184541] Compat-mlnx-ofed backport release: b4fdfac
[    9.190615] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    9.198317] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    9.206026] PTP clock support registered
[    9.235593] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    9.243725] igb: Copyright (c) 2007-2014 Intel Corporation.
[    9.251220] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    9.260525] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    9.268054] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.275358] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    9.290642] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
%G[    9.297887] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.297892] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.297920] igb 0000:02:00.0: added PHC on eth0
[    9.297921] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.297923] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    9.297997] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    9.297998] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.298067] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.298666] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.300565] scsi host0: isci
[    9.327547] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    9.327577] mlx4_core: Initializing 0000:04:00.0
[    9.327954] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    9.327957] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    9.335696] igb 0000:02:00.1: added PHC on eth1
[    9.335697] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.335698] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.335771] igb 0000:02:00.1: eth1: PBA No: 100000-000
%G[    9.335772] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.339775] scsi host1: ahci
[    9.339910] scsi host2: ahci
[    9.340006] scsi host3: ahci
[    9.340110] scsi host4: ahci
[    9.340196] scsi host5: ahci
[    9.340289] scsi host6: ahci
[    9.340336] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 60
[    9.340338] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 60
[    9.340341] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 60
[    9.340344] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 60
[    9.340347] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 60
[    9.340350] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 60
[    9.379947] [TTM] Zone  kernel: Available graphics memory: 16252598 kiB
[    9.379948] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.379949] [TTM] Initializing pool allocator
[    9.379954] [TTM] Initializing DMA pool allocator
[    9.414474] igb 0000:02:00.2: added PHC on eth2
[    9.414475] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.414476] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.414549] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.414550] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.442098] fbcon: mgadrmfb (fb0) is primary device
[    9.472689] igb 0000:02:00.3: added PHC on eth3
[    9.472690] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.472691] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.472764] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.472765] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.645147] ata6: SATA link down (SStatus 0 SControl 300)
[    9.645176] ata5: SATA link down (SStatus 0 SControl 300)
[    9.645203] ata4: SATA link down (SStatus 0 SControl 300)
[    9.645229] ata2: SATA link down (SStatus 0 SControl 300)
[    9.645259] ata3: SATA link down (SStatus 0 SControl 300)
[    9.645284] ata1: SATA link down (SStatus 0 SControl 300)
[    9.673263] Console: switching to colour frame buffer device 128x48
[    9.706487] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.738147] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   10.974001] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   10.981732] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   10.991545] ata7.00: configured for UDMA/133
[   11.009124] scsi 0:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.858370] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.865954] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.873272] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.880938] mlx4_core: device is working in RoCE mode: Roce V1
[   15.887917] mlx4_core: UD QP Gid type is: V1
[   16.960556] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   17.243308] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   17.254656] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   17.262863] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   17.386120] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   17.393934] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   17.403998] ata8.00: configured for UDMA/133
[   17.422111] scsi 0:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.475160] sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.475279] sd 0:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.475373] sd 0:0:1:0: [sdb] Write Protect is off
[   17.475400] sd 0:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.483719]  sdb:
[   17.484302] sd 0:0:1:0: [sdb] Attached SCSI disk
[   17.519247] sd 0:0:0:0: [sda] Write Protect is off
[   17.526279] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.557220]  sda: sda1 sda2
[   17.562481] sd 0:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   18.384930] random: crng init done
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
         Mounting /sysroot...
[   18.736703] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped target Timers.
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Swap.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).[   19.202646] systemd-journald[297]: Received SIGTERM from PID 1 (systemd).

[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Closed udev Control Socket.
[[32m  OK  [0m] Closed udev Kernel Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.537299] SELinux:  Disabled at runtime.
[   19.585095] type=1404 audit(1544511914.849:2): selinux=0 auid=4294967295 ses=4294967295
[   19.834895] ip_tables: (C) 2000-2006 Netfilter Core Team
[   19.843099] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Created slice system-getty.slice.
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
         Mounting Debug File System...
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
         Starting Create list of required st... nodes for the current kernel...
         Mounting Huge Pages File System...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd Root File System.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Reached target Paths.
[   20.839901] EXT4-fs (sda1): re-mounted. Opts: (null)
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
         Starting Kernel Module supporting RPCSEC_GSS...
         Starting Availability of block devices...
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Create Static Device Nodes in /dev...
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
[[32m  OK  [0m[   20.986575] systemd-journald[4366]: Received request to flush runtime journal from PID 1
[   20.998846] RPC: Registered named UNIX socket transport module.
[   20.998847] RPC: Registered udp transport module.
[   20.998848] RPC: Registered tcp transport module.
[   20.998848] RPC: Registered tcp NFSv4.1 backchannel transport module.
] Started Remount Root and Kernel File Systems.
         Starting Configure read-only root support...
         Starting udev Coldplug all Devices...
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started Journal Service.
         Starting Flush Journal to Persistent Storage...
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started LVM2 metadata daemon.
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[   21.505698] device-mapper: uevent: version 1.0.3
[   21.512558] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Started udev Kernel Device Manager.
[   21.759051] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   21.767460] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   21.769850] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   21.771850] i801_smbus 0000:07:00.3: Enabling SMBus device
[   21.771890] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   21.798803] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.799550] igb 0000:02:00.0: DCA enabled
[   21.799577] igb 0000:02:00.1: DCA enabled
[   21.800328] igb 0000:02:00.2: DCA enabled
[   21.800356] igb 0000:02:00.3: DCA enabled
[   21.833521] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.851988] mpt2sas version 20.103.01.00 loaded
[   21.859413] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[   21.881103] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32505196 kB)
[   21.893088] ipmi message handler version 39.2
[   21.902451] ipmi device interface
[   21.918731] IPMI System Interface driver.
[   21.924637] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   21.932654] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   21.940546] ipmi_si: Adding SMBIOS-specified kcs state machine
[   21.948491] ipmi_platform: probing via SPMI
[   21.954470] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   21.954750] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[   21.955525] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 168
[   21.955526] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 169
[   21.955527] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 170
[   21.955528] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 171
[   21.955529] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 172
[   21.955530] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 173
[   21.955530] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 174
[   21.955531] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 175
[   21.955532] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 176
[   21.955533] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 177
[   21.955534] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 178
[   21.955535] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 179
[   21.955536] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 180
[   21.955536] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 181
[   21.955537] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 182
[   21.955538] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 183
[   21.955540] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffb84903b40000), size(65536)
[   21.955541] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[   21.987275] (NULL device *): SPMI-specified kcs state machine: duplicate
[   21.987362] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   22.010074] mpt2sas_cm0: sending message unit reset !!
[   22.011665] mpt2sas_cm0: message unit reset: SUCCESS
[   22.014336] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   22.053342] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   22.078043] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[   22.078044] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[   22.078045] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[   22.099339] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   22.122450] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[   22.122451] mpt2sas_cm0: Protocol=(
[   22.122451] Initiator
[   22.122452] ,Target
[   22.122452] ), 
[   22.122452] Capabilities=(
[   22.122453] TLR
[   22.122453] ,EEDP
[   22.122454] ,Snapshot Buffer
[   22.122454] ,Diag Trace Buffer
[   22.122454] ,Task Set Full
[   22.122455] ,NCQ
[   22.122455] )
[   22.122499] scsi host7: Fusion MPT SAS Host
[   22.122813] sd 0:0:0:0: Attached scsi generic sg0 type 0
[   22.122842] mpt2sas_cm0: sending port enable !!
[   22.122890] sd 0:0:1:0: Attached scsi generic sg1 type 0
[   22.125351] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[   22.133067] mpt2sas_cm0: port enable: SUCCESS
[   22.133669] scsi 7:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.133673] scsi 7:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.133675] scsi 7:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.133678] scsi 7:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.225866] iTCO_vendor_support: vendor-support=0
[   22.225890] IPMI SSIF Interface driver
[   22.313235] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.313277] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[[32m  OK  [0m] Found device /dev/ttyS0.
[   22.375323] device-mapper: multipath round-robin: version 1.2.0 loaded
[   22.388639] cryptd: max_cpu_qlen set to 1000
[   22.417315] AVX version of gcm_enc/dec engaged.
[   22.417316] AES CTR mode by8 optimization enabled
[   22.420769] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.420800] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.481992] kvm: disabled by bios
[   22.501958] intel_rapl: Found RAPL domain package
[   22.501960] intel_rapl: Found RAPL domain core
[   22.501965] intel_rapl: Found RAPL domain dram
[   22.501987] intel_rapl: Found RAPL domain package
[   22.501989] intel_rapl: Found RAPL domain core
[   22.501994] intel_rapl: Found RAPL domain dram
[   22.507540] scsi 7:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.507546] scsi 7:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.507548] scsi 7:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.507551] scsi 7:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.511329] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.511485] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.511486] EDAC sbridge:  Ver: 1.1.2 
%G%G[   22.680555] scsi 7:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.690348] scsi 7:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.702763] scsi 7:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.711436] scsi 7:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.740418] scsi 7:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.750210] scsi 7:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.762678] scsi 7:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.771382] scsi 7:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.798535] scsi 7:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   22.808524] scsi 7:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.821085] scsi 7:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.829921] scsi 7:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.877156] scsi 7:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.887088] scsi 7:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.899694] scsi 7:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.908546] scsi 7:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.942853] scsi 7:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.952840] scsi 7:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.965532] scsi 7:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.974515] scsi 7:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.998504] scsi 7:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.008707] scsi 7:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.021516] scsi 7:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.030548] scsi 7:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.070679] scsi 7:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.080709] scsi 7:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.093903] scsi 7:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.103326] scsi 7:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.131451] scsi 7:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   23.141448] scsi 7:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.154198] scsi 7:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.163159] scsi 7:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.187970] scsi 7:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   23.195150] sd 7:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.195419] sd 7:0:0:0: Attached scsi generic sg2 type 0
[   23.196042] scsi 7:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   23.196284] sd 7:0:0:1: Attached scsi generic sg3 type 0
[   23.196529] sd 7:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.197077] scsi 7:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   23.197307] sd 7:0:0:2: Attached scsi generic sg4 type 0
[   23.197356] sd 7:0:0:1: [sdd] Write Protect is off
[   23.197654] sd 7:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.197693] sd 7:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.198370] scsi 7:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   23.198582] sd 7:0:0:3: Attached scsi generic sg5 type 0
[   23.198764] sd 7:0:0:2: [sde] Write Protect is off
[   23.198812] sd 7:0:0:7: Attached scsi generic sg6 type 0
[   23.198913] sd 7:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.199184] sd 7:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.199209] sd 7:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.199408] scsi 7:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   23.199664] sd 7:0:1:0: Attached scsi generic sg7 type 0
[   23.199861] sd 7:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.200275] sd 7:0:0:3: [sdf] Write Protect is off
[   23.200559] sd 7:0:0:7: [sdg] Write Protect is off
[   23.200565] sd 7:0:1:0: [sdh] Write Protect is off
[   23.200781] sd 7:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.200816] Dev sdd: unable to read RDB block 0
[   23.200839]  sdd: unable to read partition table
[   23.200879] sd 7:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.200925] scsi 7:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   23.201101] sd 7:0:1:1: Attached scsi generic sg8 type 0
[   23.201148] sd 7:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.201406] sd 7:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.201928] scsi 7:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   23.202305] sd 7:0:1:2: Attached scsi generic sg9 type 0
[   23.202486] sd 7:0:1:1: [sdi] Write Protect is off
[   23.202601] sd 7:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.203011] sd 7:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.203626] sd 7:0:0:1: [sdd] Attached SCSI disk
[   23.203918] scsi 7:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   23.204361] sd 7:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.204402] sd 7:0:1:2: [sdj] Write Protect is off
[   23.204507] Dev sdh: unable to read RDB block 0
[   23.204518]  sdh: unable to read partition table
[   23.204569] sd 7:0:1:3: Attached scsi generic sg10 type 0
[   23.204781] Dev sdf: unable to read RDB block 0
[   23.204791]  sdf: unable to read partition table
[   23.205116] sd 7:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.205492] sd 7:0:0:2: [sde] Attached SCSI disk
[   23.205993] sd 7:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.206564] sd 7:0:1:3: [sdk] Write Protect is off
[   23.206593] sd 7:0:0:3: [sdf] Attached SCSI disk
[   23.206979] sd 7:0:1:7: Attached scsi generic sg11 type 0
[   23.206980] sd 7:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.207367] sd 7:0:1:7: [sdl] Write Protect is off
[   23.207904] sd 7:0:1:0: [sdh] Attached SCSI disk
[   23.207983] sd 7:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.210117] Dev sdj: unable to read RDB block 0
[   23.210128]  sdj: unable to read partition table
[   23.210642] sd 7:0:1:1: [sdi] Attached SCSI disk
[   23.212198] sd 7:0:1:2: [sdj] Attached SCSI disk
[   23.216794] sd 7:0:1:3: [sdk] Attached SCSI disk
[   23.231057] blk_update_request: I/O error, dev sdd, sector 0
[   23.234223] blk_update_request: I/O error, dev sdj, sector 0
[   23.234838] blk_update_request: I/O error, dev sdh, sector 0
[   23.234961] blk_update_request: I/O error, dev sdf, sector 0
[   23.235446] blk_update_request: I/O error, dev sdd, sector 0
[   23.238591] blk_update_request: I/O error, dev sdj, sector 0
[   23.239247] blk_update_request: I/O error, dev sdf, sector 0
[   23.239249] blk_update_request: I/O error, dev sdh, sector 0
[   23.239701] blk_update_request: I/O error, dev sdd, sector 0
[   23.242754] blk_update_request: I/O error, dev sdj, sector 0
[   23.268127] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   23.449973]  sdg:
[   23.451196] sd 7:0:0:7: [sdg] Attached SCSI disk
[   23.611384] device-mapper: table: 253:5: multipath: error getting device
[   23.611386] device-mapper: ioctl: error adding target to table
[   23.627912]  sdl:
[   23.629237] sd 7:0:1:7: [sdl] Attached SCSI disk
[   23.765218] sd 7:0:0:0: [sdc] Write Protect is off
[   23.771505] sd 7:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.785250] sd 7:0:0:0: [sdc] Attached SCSI disk
[   23.964422] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   23.973838] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Tell Plymouth To Write Out Runtime Data...
         Starting Import network configuration from initramfs...
         Starting Preprocess NFS configuration...
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Import network configuration from initramfs.
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...
         Starting Create Volatile Files and Directories...
[   24.282719] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Starting Security Auditing Service...
         Mounting RPC Pipe File System...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   24.456820] type=1305 audit(1544511919.720:3): audit_pid=9052 old=0 auid=4294967295 ses=4294967295 res=1
[   24.605872] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.616224] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Authorization Manager...
         Starting Machine Check Exception Logging Daemon...
         Starting Load CPU microcode update...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting Dump dmesg to /var/log/dmesg...
         Starting System Security Services Daemon...
         Starting GSSAPI Proxy Daemon...
         Starting NTP client/server...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
[   25.565262] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
[   25.893509] card: mlx4_0, QP: 0x220, inline size: 120
[   25.911746] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[   25.964283] ib0: enabling connected mode will cause multicast packet drops
[   25.972824] ib0: mtu > 4092 will cause multicast packet drops.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[   26.215950] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   26.305641] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   26.306634] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   26.318492] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.400202] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.407459] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   26.420815] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.540053] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.551343] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.669551] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.702618] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.722779] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.731685] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   26.751175] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   27.494295] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   27.504039] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   28.219629] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   28.229656] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   28.851674] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   28.861782] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   29.510112] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   34.097308] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.140189] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.150555] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting Dynamic System Tuning Daemon...
         Starting Postfix Mail Transport Agent...
[[32m  OK  [0m] Reached target Network is Online.
         Starting NFS status monitor for NFSv2/3 locking....
         Mounting /scratch...
         Starting Notify NFS peers of a restart...
[   34.359742] FS-Cache: Loaded
         Starting System Logging Service...
         Starting Xinetd A Powerfu[   34.398563] FS-Cache: Netfs 'nfs' registered for caching
l Replacement For Inetd...
         Starting OpenSSH server daemon...
         Starting MUNGE authentication service...
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locki[   34.408084] Key type dns_resolver registered
ng..
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[   34.438683] NFS: Registering the id_resolver key type
[   34.438688] Key type id_resolver registered
[   34.438688] Key type id_legacy registered
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Permit User Sessions...
         Starting Automounts filesystems on demand...
         Starting Crash recovery kernel arming...
[[32m  OK  [0m] Started Permit User Sessions.
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Job spooling tools.
[[32m  OK  [0m] Started Command Scheduler.
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Created slice User Slice of root.
[[32m  OK  [0m] Started Session 1 of user root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-11T07:05:41+00:00] INFO: Forking chef instance to converge...
[2018-12-11T07:05:42+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-11T07:05:42+00:00] INFO: Chef-client pid: 10847
[2018-12-11T07:05:43+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-11T07:05:43+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-11T07:05:43+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-11T07:05:43+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-11T07:05:43+00:00] INFO: Running start handlers
[2018-12-11T07:05:43+00:00] INFO: Start handlers complete.
[2018-12-11T07:05:44+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-11T07:05:44+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T07:05:44+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T07:05:44+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-11T07:05:44+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181211070544.243628
[2018-12-11T07:05:44+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181207040644.994149
[2018-12-11T07:05:44+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-11T07:05:44+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-11T07:05:48+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-11T07:05:48+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-11T07:05:48+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-11T07:05:49+00:00] INFO: service[ntpd] started
[2018-12-11T07:05:49+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-11T07:05:49+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-11T07:05:49+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-11T07:05:49+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-11T07:05:49+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-11T07:05:49+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-11T07:05:49+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-11T07:05:49+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-11T07:05:49+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-11T07:05:50+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-11T07:05:50+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-11T07:05:50+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-11T07:05:50+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-11T07:05:50+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:50+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:50+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-11T07:05:51+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-11T07:05:51+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-11T07:05:51+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-11T07:05:51+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-11T07:05:52+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-11T07:05:52+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-11T07:05:52+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-11T07:05:52+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-11T07:05:52+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-11T07:05:52+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-11T07:05:52+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-11T07:05:53+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-11T07:05:53+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-11T07:05:53+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-11T07:05:53+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-11T07:05:54+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-11T07:05:54+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-11T07:05:54+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-11T07:05:54+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-11T07:05:54+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-11T07:05:54+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-11T07:05:54+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-11T07:05:54+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-11T07:05:54+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-11T07:05:54+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-11T07:05:55+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-11T07:05:55+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-11T07:05:55+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-11T07:05:55+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211070555.321017
[2018-12-11T07:05:55+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181207040656.171958
[2018-12-11T07:05:55+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-11T07:05:55+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-11T07:05:55+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-11T07:05:55+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211070555.327401
[2018-12-11T07:05:55+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181207040656.177712
[2018-12-11T07:05:55+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-11T07:05:55+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-11T07:05:55+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-11T07:05:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-11T07:05:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-11T07:05:55+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-11T07:05:55+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:05:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:05:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:05:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:05:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:05:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:05:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:05:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:05:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:55+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-11T07:05:56+00:00] INFO: service[xinetd] started
[2018-12-11T07:05:56+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-11T07:05:56+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-11T07:05:56+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-11T07:05:56+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[   61.793605] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[2018-12-11T07:05:57+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-11T07:05:57+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-11T07:05:57+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-11T07:05:57+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-11T07:05:57+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181211070557.923777
[2018-12-11T07:05:57+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181207040658.956352
[2018-12-11T07:05:57+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-11T07:05:57+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-11T07:05:57+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-11T07:05:57+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-11T07:05:57+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-11T07:05:57+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:57+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:57+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-11T07:05:57+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-11T07:05:57+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-11T07:05:58+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-11T07:05:58+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:05:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:05:58+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-11T07:05:58+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-11T07:05:58+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-11T07:05:58+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-11T07:05:58+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-11T07:05:58+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-11T07:05:58+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-11T07:05:59+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-11T07:05:59+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-11T07:06:00+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-11T07:06:00+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-11T07:06:00+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-11T07:06:00+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-11T07:06:00+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-11T07:06:00+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-11T07:06:00+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-11T07:06:00+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-11T07:06:00+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-11T07:06:00+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-11T07:06:00+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-11T07:06:00+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-11T07:06:00+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-11T07:06:00+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-11T07:06:00+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-11T07:06:00+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-11T07:06:00+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-11T07:06:00+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-11T07:06:00+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-11T07:06:01+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-11T07:06:01+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-11T07:06:01+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-11T07:06:01+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-11T07:06:01+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[2018-12-11T07:06:04+00:00] INFO: service[kdump] restarted
[2018-12-11T07:06:04+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-11T07:06:04+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-11T07:06:04+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-11T07:06:04+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-11T07:06:04+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-11T07:06:04+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-11T07:06:04+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-11T07:06:04+00:00] INFO: Chef Run complete in 20.804046454 seconds
[2018-12-11T07:06:04+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-11T07:06:04+00:00] INFO: Running report handlers
[2018-12-11T07:06:04+00:00] INFO: Creating JSON run report
[2018-12-11T07:06:04+00:00] INFO: Report handlers complete
[  282.779013] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  282.791864] alg: No test for adler32 (adler32-zlib)
[  283.647207] Lustre: Lustre: Build Version: 2.10.6_RC3
[  283.878104] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  283.972150] LDISKFS-fs warning (device dm-1): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[  283.972150] 
[  331.694532] LDISKFS-fs (dm-1): recovery complete
[  331.700137] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  332.610942] Lustre: MGS: Connection restored to 46349802-9e3b-6b88-3fbd-224d3bc73543 (at 0@lo)
[  332.934270] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  332.967986] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  333.662240] Lustre: MGS: Connection restored to c4bbd906-80e7-ec3e-177a-8e9234ae034e (at 192.168.1.118@o2ib)
[  335.343106] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[  337.496122] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect
[  337.496145] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[  337.496148] Lustre: Skipped 1 previous similar message
[  342.443165] Lustre: MGS: Connection restored to 72579ea7-24be-c7c3-998e-a57c2351d836 (at 192.168.1.129@o2ib)
[  342.454243] Lustre: Skipped 6 previous similar messages
[  350.452201] Lustre: soaked-MDT0000: Connection restored to e6f84035-0ad0-60f2-8be1-27d059cf19a6 (at 192.168.1.131@o2ib)
[  350.464361] Lustre: Skipped 11 previous similar messages
[  357.959953] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  367.345308] Lustre: soaked-MDT0000: Connection restored to 9a424bc3-6e08-385b-175e-bbe0cb080f60 (at 192.168.1.119@o2ib)
[  367.357606] Lustre: Skipped 11 previous similar messages
[  382.972106] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  382.984931] LustreError: Skipped 2 previous similar messages
[  401.646529] Lustre: MGS: Connection restored to a5bf3c57-9993-6ae9-d6f4-1637a8088e36 (at 192.168.1.142@o2ib)
[  401.657619] Lustre: Skipped 34 previous similar messages
[  407.952907] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  432.949548] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  432.962332] LustreError: Skipped 1 previous similar message
[  457.946080] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  482.967500] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  482.980538] LustreError: Skipped 1 previous similar message
[  507.940716] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  512.983087] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  532.937481] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  532.954367] LustreError: Skipped 1 previous similar message
[  557.935022] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  572.990856] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  573.012100] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  582.932797] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  582.948945] LustreError: Skipped 1 previous similar message
[  607.930012] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  632.952276] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  632.968222] LustreError: Skipped 1 previous similar message
[  633.019990] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  633.041698] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  657.925415] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  682.923834] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  682.940267] LustreError: Skipped 1 previous similar message
[  693.051418] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  693.073298] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  707.922394] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  753.083911] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  753.105974] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  782.918128] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  782.935740] LustreError: Skipped 3 previous similar messages
[  807.916284] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  807.942312] LustreError: Skipped 1 previous similar message
[  813.116403] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  813.138438] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  873.149414] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  873.171425] Lustre: 12392:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  883.305677] Lustre: soaked-MDT0000: Recovery over after 9:06, of 29 clients 29 recovered and 0 were evicted.
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [02;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [02;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [7m[4;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[4;79H[m[m[5;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [4;79H[22;1H   The selected entry will be started automatically in 5s.                     [4;79H[22;1H   The selected entry will be started automatically in 4s.                     [4;79H[22;1H   The selected entry will be started automatically in 3s.                     [4;79H[22;1H   The selected entry will be started automatically in 2s.                     [4;79H[22;1H   The selected entry will be started automatically in 1s.                     [4;79H[22;1H   The selected entry will be started automatically in 0s.                     [4;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-307-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Fri Nov 30 18:46:05 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x34b20000-0x36587fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 320MB of memory at 512MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff8ad02e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 6841488k/34603008k available (7664k kernel code, 1126748k absent, 1001116k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.648 MHz processor
[    0.000181] Calibrating delay loop (skipped), value calculated using timer frequency.. 5387.29 BogoMIPS (lpj=2693648)
[    0.012649] pid_max: default: 245760 minimum: 1920
[    0.019159] Security Framework initialized
[    0.024051] SELinux:  Initializing.
[    0.028543] Yama: becoming mindful.
[    0.038202] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.060491] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.074813] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.082889] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.093712] Initializing cgroup subsys memory
[    0.098992] Initializing cgroup subsys devices
[    0.104265] Initializing cgroup subsys freezer
[    0.109533] Initializing cgroup subsys net_cls
[    0.114791] Initializing cgroup subsys blkio
[    0.119853] Initializing cgroup subsys perf_event
[    0.125455] Initializing cgroup subsys hugetlb
[    0.130733] Initializing cgroup subsys pids
[    0.135713] Initializing cgroup subsys net_prio
[    0.141357] mce: CPU supports 20 MCE banks
[    0.146267] CPU0: Thermal monitoring enabled (TM1)
[    0.152001] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.158427] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.165116] tlb_flushall_shift: 6
[    0.169180] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.180444] FEATURE SPEC_CTRL Present
[    0.184836] FEATURE IBPB_SUPPORT Present
[    0.189815] Spectre V2 : Mitigation: Full retpoline
[    0.197622] Freeing SMP alternatives: 28k freed
[    0.209372] ACPI: Core revision 20130517
[    0.305475] ACPI: All ACPI Tables successfully acquired
[    0.325200] ftrace: allocating 29187 entries in 115 pages
[    0.387057] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.394748] Switched APIC routing to physical flat.
[    0.401220] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.418240] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.429492] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.442214] ... version:                3
[    0.451658] ... bit width:              48
[    0.456525] ... generic registers:      4
[    0.461288] ... value mask:             0000ffffffffffff
[    0.467513] ... max period:             00007fffffffffff
[    0.473726] ... fixed-purpose events:   3
[    0.478496] ... event mask:             000000070000000f
[    0.493157] smpboot: Booting Node   0, Processors  #1[    0.514882] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.571281] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.712382] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.755598] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.797101] Brought up 32 CPUs
[    0.801299] smpboot: Max logical packages: 15
[    0.806463] smpboot: Total of 32 processors activated (172595.74 BogoMIPS)
[    1.063024] node 0 initialised, 2813371 pages in 136ms
[    1.100792] node 1 initialised, 3595039 pages in 168ms
[    1.108070] devtmpfs: initialized
[    1.123414] EVM: security.selinux
[    1.127409] EVM: security.ima
[    1.131011] EVM: security.capability
[    1.135579] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.144957] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.157890] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.165891] pinctrl core: initialized pinctrl subsystem
[    1.172321] RTC time:  7:48:35, date: 12/11/18
[    1.178081] NET: Registered protocol family 16
[    1.183895] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.192860] ACPI: bus type PCI registered
[    1.197633] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.205773] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.216682] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.224598] PCI: Using configuration type 1 for base access
[    1.231182] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.251117] ACPI: Added _OSI(Module Device)
[    1.256082] ACPI: Added _OSI(Processor Device)
[    1.261337] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.266882] ACPI: Added _OSI(Processor Aggregator Device)
[    1.273203] ACPI: Added _OSI(Linux-Dell-Video)
[    1.318263] ACPI: Executed 1 blocks of module-level executable AML code
[    1.607421] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.640846] ACPI: Interpreter enabled
[    1.645262] ACPI: (supports S0 S1 S5)
[    1.649641] ACPI: Using IOAPIC for interrupt routing
[    1.655600] HEST: Table parsing has been initialized.
[    1.661542] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.672317] ACPI: GPE 0x1E active on init
[    1.677268] ACPI: GPE 0x24 active on init
[    1.682201] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.748218] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.755422] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.765589] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.774585] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.783640] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.793582] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.805755] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.821140] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.836911] PCI host bridge to bus 0000:00
[    1.841780] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.848982] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.857842] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.866711] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.875573] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.884439] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.893313] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.902174] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.911033] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.919897] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.928756] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.937617] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.946484] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.955350] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.964215] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.973862] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.980826] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.987746] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.994674] pci 0000:00:02.0: System wakeup disabled by ACPI
[    2.001586] pci 0000:00:02.2: System wakeup disabled by ACPI
[    2.008509] pci 0000:00:03.0: System wakeup disabled by ACPI
[    2.019015] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    2.025954] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    2.032856] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    2.039805] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.046649] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.054216] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.060240] acpiphp: Slot [2] registered
[    2.065210] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.076060] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.087248] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.098089] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.109261] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.120099] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.131274] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.142108] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.154943] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.161292] acpiphp: Slot [2-2] registered
[    2.168598] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.174638] acpiphp: Slot [2-3] registered
[    2.179544] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.185566] acpiphp: Slot [2-4] registered
[    2.190765] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.196965] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.210267] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.216235] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.222508] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.229201] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.235169] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.244450] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.253496] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.262525] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.271552] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.280577] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.289605] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.298629] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.307652] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.316877] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.324085] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.333997] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.342825] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.351881] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.361959] PCI host bridge to bus 0000:80
[    2.366831] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.374716] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.382602] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.391470] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.400340] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.409980] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.416624] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.423521] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.430411] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.437306] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.446442] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.452380] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.458307] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.464224] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.485799] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.492713] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.502411] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.512586] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.519885] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.529649] PCI host bridge to bus 0000:7f
[    2.534522] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.545460] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.552376] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.562074] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.572253] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.579548] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.589319] PCI host bridge to bus 0000:ff
[    2.594188] pci_bus 0000:ff: root bus resource [bus ff]
[    2.605724] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.615290] vgaarb: loaded
[    2.618602] vgaarb: bridge control possible 0000:09:00.0
[    2.625268] SCSI subsystem initialized
[    2.629794] ACPI: bus type USB registered
[    2.634605] usbcore: registered new interface driver usbfs
[    2.641042] usbcore: registered new interface driver hub
[    2.647560] usbcore: registered new device driver usb
[    2.654052] EDAC MC: Ver: 3.0.0
[    2.658399] PCI: Using ACPI for IRQ routing
[    2.671005] NetLabel: Initializing
[    2.675097] NetLabel:  domain hash size = 128
[    2.680253] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.686129] NetLabel:  unlabeled traffic allowed by default
[    2.693008] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.701006] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.709866] amd_nb: Cannot enumerate AMD northbridges
[    2.716001] Switched to clocksource hpet
[    2.735258] pnp: PnP ACPI init
[    2.738995] ACPI: bus type PNP registered
[    2.744064] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.750981] system 00:00: [io  0xffff] has been reserved
[    2.757218] system 00:00: [io  0xffff] has been reserved
[    2.763462] system 00:00: [io  0xffff] has been reserved
[    2.769696] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.777002] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.783920] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.790829] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.797747] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.805055] system 00:00: [io  0x0cf9] could not be reserved
[    2.811900] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.820369] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.828064] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.835759] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.843453] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.851146] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.858834] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.866919] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.875001] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.883085] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.891293] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.899894] pnp: PnP ACPI: found 7 devices
[    2.904767] ACPI: bus type PNP unregistered
[    2.919148] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.925026] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.931159] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.938274] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.946165] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.952012] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.959898] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.969836] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.975696] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.981537] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.988645] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.996538] pci 0000:00:11.0: PCI bridge to [bus 07]
[    3.002379] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    3.009488] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    3.017375] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    3.027321] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    3.033177] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    3.039023] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    3.046910] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    3.056071] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    3.062157] pci 0000:80:01.0: PCI bridge to [bus 81]
[    3.068015] pci 0000:80:02.0: PCI bridge to [bus 82]
[    3.073867] pci 0000:80:03.0: PCI bridge to [bus 83]
[    3.079719] pci 0000:80:03.2: PCI bridge to [bus 84]
[    3.085959] NET: Registered protocol family 2
[    3.093261] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.102925] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.110988] TCP: Hash tables configured (established 262144 bind 65536)
[    3.118778] TCP: reno registered
[    3.122834] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.130294] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.139284] NET: Registered protocol family 1
[    4.243891] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.351830] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.360645] Un packing initram[    6.194662] Freeing initrd memory: 27040k freed
[    6.210674] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    6.218203] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff8accb73c7000-ffff8accbb3c6fff]
[    6.230262] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    6.239641] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    6.246368] RAPL PMU: hw unit of domain package 2^-16 Joules
[    6.253004] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    6.272516] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    6.279653] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    6.293878] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    6.302442] Initialise system trusted keyring
[    6.307747] audit: initializing netlink socket (disabled)
[    6.314125] type=2000 audit(1544514516.823:1): initialized
[    6.376187] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.383590] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.394180] zpool: loaded
[    6.397409] zbud: loaded
[    6.401740] VFS: Disk quotas dquot_6.6.0
[    6.406944] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.415962] msgmni has been set to 32768
[    6.421046] Key type big_key registered
[    6.428273] NET: Registered protocol family 38
[    6.433563] Key type asymmetric registered
[    6.438442] Asymmetric key parser 'x509' registered
[    6.444352] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.453407] io scheduler noop registered
[    6.458103] io scheduler deadline registered (default)
[    6.464306] io scheduler cfq registered
[    6.468910] io scheduler mq-deadline registered
[    6.474289] io scheduler kyber registered
[    6.484963] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.493103] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.501199] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.508813] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.516419] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.524032] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.531666] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.539754] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.547398] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.555530] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.563620] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.571270] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.579364] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.586968] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.594619] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.602740] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.610832] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.618465] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.626604] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.634739] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.642877] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.651080] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.657642] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.665387] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.674014] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.682813] ACPI: Power Button [PWRF]
[    6.687301] ACPI: Requesting acpi_cpufreq
[    6.775432] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.784378] pstore: Registered erst as persistent store backend
[    6.791636] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.800661] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.828859] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.856294] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.863904] Non-volatile memory driver v1.3
[    6.868960] Linux agpgart interface v0.103
[    6.874280] crash memory driver: version 1.1
[    6.879874] rdac: device handler registered
[    6.884946] hp_sw: device handler registered
[    6.890041] emc: device handler registered
[    6.895223] alua: device handler registered
[    6.900316] libphy: Fixed MDIO Bus: probed
[    6.910144] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.917781] ehci-pci: EHCI PCI platform driver
[    6.923524] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.929803] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.938625] ehci-pci 0000:00:1a.0: debug port 2
[    6.947974] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.959750] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.966598] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.974494] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.983098] usb usb1: Product: EHCI Host Controller
[    6.988869] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.997556] usb usb1: SerialNumber: 0000:00:1a.0
[    7.003248] hub 1-0:1.0: USB hub found
[    7.007756] hub 1-0:1.0: 2 ports detected
[    7.013125] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    7.019364] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    7.028187] ehci-pci 0000:00:1d.0: debug port 2
[    7.037512] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    7.049742] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    7.056565] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    7.064465] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.073063] usb usb2: Product: EHCI Host Controller
[    7.078820] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.087505] usb usb2: SerialNumber: 0000:00:1d.0
[    7.093172] hub 2-0:1.0: USB hub found
[    7.097675] hub 2-0:1.0: 2 ports detected
[    7.102703] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    7.109929] ohci-pci: OHCI PCI platform driver
[    7.115252] uhci_hcd: USB Universal Host Controller Interface driver
[    7.122832] usbcore: registered new interface driver usbserial_generic
[    7.130477] usbserial: USB Serial support registered for generic
[    7.137581] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    7.267879] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    8.190780] i8042: No controller found
[    8.195321] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    8.195341] Switched to clocksource tsc
[    8.195471] mousedev: PS/2 mouse device common for all mice
[    8.195702] rtc_cmos 00:01: RTC can wake from S4
[    8.195932] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    8.195988] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    8.196113] intel_pstate: Intel P-state driver initializing
[    8.211358] cpuidle: using governor menu
[    8.212891] hidraw: raw HID events driver (C) Jiri Kosina
[    8.213152] usbcore: registered new interface driver usbhid
[    8.213153] usbhid: USB HID core driver
[    8.213373] drop_monitor: Initializing network drop monitor service
[    8.213946] TCP: cubic registered
[    8.213956] Initializing XFRM netlink socket
[    8.214640] NET: Registered protocol family 10
[    8.216227] NET: Registered protocol family 17
[    8.216240] mpls_gso: MPLS GSO support
[    8.219509] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    8.219842] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    8.220059] Loading compiled-in X.509 certificates
[    8.221148] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    8.222199] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    8.223243] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: c7aec20a70554693bf19667e4c28ac12c728bbb2'
[    8.223289] registered taskstats version 1
[    8.228282] Key type trusted registered
[    8.232405] Key type encrypted registered
[    8.232545] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    8.234217]   Magic number: 14:391:824
[    8.235713] rtc_cmos 00:01: setting system clock to 2018-12-11 07:48:42 UTC (1544514522)
[    8.358688] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    8.371078] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    8.371081] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.371392] hub 1-1:1.0: USB hub found
[    8.371451] hub 1-1:1.0: 6 ports detected
[    8.425913] Freeing unused kernel memory: 1876k freed
[    8.432303] Write protecting the kernel read-only data: 12288k
[    8.440790] Freeing unused kernel memory: 516k freed
[    8.448273] Freeing unused kernel memory: 600k freed
[    8.462095] random: systemd: uninitialized urandom read (16 bytes read)
[    8.472734] random: systemd: uninitialized urandom read (16 bytes read)
[    8.480520] random: systemd: uninitialized urandom read (16 bytes read)
[    8.484115] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    8.484119] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.484546] hub 2-1:1.0: USB hub found
[    8.484739] hub 2-1:1.0: 8 ports detected
[    8.515799] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.537792] systemd[1]: Detected architecture x86-64.
[    8.543744] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.559851] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.628066] random: systemd: uninitialized urandom read (16 bytes read)
[    8.635867] random: systemd: uninitialized urandom read (16 bytes read)
[    8.643644] random: systemd: uninitialized urandom read (16 bytes read)
[    8.651501] random: systemd: uninitialized urandom read (16 bytes read)
[    8.660516] random: systemd: uninitialized urandom read (16 bytes read)
[    8.668544] random: systemd: uninitialized urandom read (16 bytes read)
[    8.676898] random: systemd: uninitialized urandom read (16 bytes read)
[     8.692216] stems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.705788] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.716064] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.726878] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.739852] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.752908] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice [    8.761709] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
Syst em Slice.
[   ting Setup Virtual Console...
         Starting Setup Virtual Console...
[    8.785957] systemd[1]: Starting Create list of required static device nodes for the current kernel...
          Startin... nodes for the current kernel...
[    8.817689] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    8.828767] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.838811] systemd[1]: Listening on udev Kernel Socke t.
[[32m  OK on udev Kernel Socket.
[    8.851818] systemd[1]: Reached target Sockets.
[ [32m  OK  [0m[     8.862636] sVariables...
          Startin[    8.875757] systemd[1]: Reached target Timers.
[    8.881026] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
[    8.889012] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.889015] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.889017] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.889019] usb 2-1.4: SerialNumber:  serial
[    8.Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
[[32m  OK  [0m] Reached target Timers.
[    8.938145] systemd[1]: Starting dracut cmdline hook...
[    8.944690] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
         Startin[    8.963644] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
g dracut cmdline[    8.979281] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
 hook...
[    8.999463] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Setup Virtual Console.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Apply Kernel Variables.
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut cmdline hook.
         Starting dracut pre-udev hook...
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Show Plymouth Boot Screen...
[[32m  OK  [0m] Reached target System Initialization.
         Starting dracut initqueue hook...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Di[    9.309519] random: fast init done
rectory Watch.
[[32m  OK  [0m] Reached target Basic System.[    9.320085] dca service started, version 1.12.1

[    9.327409] mlx_compat: loading out-of-tree module taints kernel.
[    9.334947] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    9.346742] pps_core: LinuxPPS API ver. 1 registered
[    9.352596] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    9.364611] Compat-mlnx-ofed backport release: b4fdfac
[    9.370634] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    9.378317] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    9.385554] PTP clock support registered
[    9.415401] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    9.423497] igb: Copyright (c) 2007-2014 Intel Corporation.
[    9.431031] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    9.439994] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    9.447578] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.454943] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    9.464599] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    9.474131] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
%G[    9.477816] igb 0000:02:00.0: added PHC on eth0
[    9.477818] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.477820] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    9.477894] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    9.477896] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.511343] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    9.511350] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.511356] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.511542] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.511677] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    9.511705] mlx4_core: Initializing 0000:04:00.0
[    9.511950] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.514075] scsi host0: isci
[    9.515204] scsi host1: ahci
[    9.515296] scsi host2: ahci
[    9.515371] scsi host3: ahci
[    9.515449] scsi host4: ahci
[    9.515542] scsi host5: ahci
[    9.515702] scsi host6: ahci
[    9.515756] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 48
[    9.515761] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 48
[    9.515768] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 48
[    9.515775] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 48
%G[    9.515781] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 48
[    9.515783] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 48
[    9.549345] igb 0000:02:00.1: added PHC on eth1
[    9.549347] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.549348] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.549421] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.549422] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.604645] igb 0000:02:00.2: added PHC on eth2
[    9.604647] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.604648] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.604721] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.604722] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.618767] [TTM] Zone  kernel: Available graphics memory: 16252602 kiB
[    9.618776] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.618777] [TTM] Initializing pool allocator
[    9.618780] [TTM] Initializing DMA pool allocator
[    9.650582] fbcon: mgadrmfb (fb0) is primary device
[    9.661242] igb 0000:02:00.3: added PHC on eth3
[    9.661244] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.661245] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.661318] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.661319] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.820674] ata6: SATA link down (SStatus 0 SControl 300)
[    9.820703] ata1: SATA link down (SStatus 0 SControl 300)
[    9.820728] ata3: SATA link down (SStatus 0 SControl 300)
[    9.820753] ata5: SATA link down (SStatus 0 SControl 300)
[    9.820789] ata4: SATA link down (SStatus 0 SControl 300)
[    9.820806] ata2: SATA link down (SStatus 0 SControl 300)
[    9.887424] Console: switching to colour frame buffer device 128x48
[    9.941229] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.966650] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   11.187502] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   11.195422] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   11.205507] ata7.00: configured for UDMA/133
[   11.223558] scsi 0:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   16.042805] mlx4_core 0000:04:00.0: Old device ETS support detected
[   16.050464] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   16.057939] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   16.065821] mlx4_core: device is working in RoCE mode: Roce V1
[   16.073004] mlx4_core: UD QP Gid type is: V1
[   17.140063] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   17.408421] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   17.420678] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   17.430117] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   17.591107] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   17.599145] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   17.609119] ata8.00: configured for UDMA/133
[   17.616643] scsi 0:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.669539] sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.669637] sd 0:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.669740] sd 0:0:0:0: [sda] Write Protect is off
[   17.669773] sd 0:0:1:0: [sdb] Write Protect is off
[   17.669793] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.669832] sd 0:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.679112]  sdb:
[   17.680093] sd 0:0:1:0: [sdb] Attached SCSI disk
[   17.687396]  sda: sda1 sda2
[   17.688501] sd 0:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   18.565851] random: crng init done
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
         Mounting /sysroot...
[   18.694264] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
[[32m  OK  [0m] Stopped target Timers.
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target System Initialization.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[   19.153203] systemd-journald[286]: Received SIGTERM from PID 1 (systemd).
[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Closed udev Control Socket.
[[32m  OK  [0m] Closed udev Kernel Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.500669] SELinux:  Disabled at runtime.
[   19.550117] type=1404 audit(1544514533.815:2): selinux=0 auid=4294967295 ses=4294967295
[   19.801380] ip_tables: (C) 2000-2006 Netfilter Core Team
[   19.810002] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
         Mounting Debug File System...
         Mounting Huge Pages File System...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd Root File System.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Created slice system-getty.slice.
         Starting Create list of required st... nodes for the current kernel...
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Reached target Paths.
         Starting Availability of block devices...
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[   20.847767] RPC: Registered named UNIX socket transport module.
[   20.847768] RPC: Registered udp transport module.
[   20.847769] RPC: Registered tcp transport module.
[   20.847770] RPC: Registered tcp NFSv4.1 backchannel transport module.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
[[32m  OK  [0m] Started LVM2 metadata daemon.
         Starting Apply Kernel Variables...
         Starting Remount Root and Kernel File Systems...
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[   21.398949] EXT4-fs (sda1): re-mounted. Opts: (null)
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting Flush Journal to Persistent Storage...
         Starting Configure read-only root support...
[   21.449094] systemd-journald[4367]: Received request to flush runtime journal from PID 1
         Starting udev Coldplug all Devices...
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started udev Kernel Device Manager.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[   21.579488] device-mapper: uevent: version 1.0.3
[   21.585573] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[   21.720491] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   21.723894] i801_smbus 0000:07:00.3: Enabling SMBus device
[   21.723934] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   21.748538] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.748548] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.749275] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   21.801372] igb 0000:02:00.0: DCA enabled
[   21.801499] igb 0000:02:00.1: DCA enabled
[   21.803091] igb 0000:02:00.2: DCA enabled
[   21.803202] igb 0000:02:00.3: DCA enabled
[   21.811635] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   21.861138] ipmi message handler version 39.2
[   21.871542] ipmi device interface
[   21.892066] IPMI System Interface driver.
[   21.897973] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   21.905753] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   21.913606] ipmi_si: Adding SMBIOS-specified kcs state machine
[   21.922138] mpt2sas version 20.103.01.00 loaded
[   21.924512] ipmi_platform: probing via SPMI
[   21.924515] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   21.924517] (NULL device *): SPMI-specified kcs state machine: duplicate
[   21.924637] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   21.963231] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[   21.974623] sd 0:0:0:0: Attached scsi generic sg0 type 0
[   21.977916] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32505204 kB)
[[32m  OK  [0m] Found device /dev/ttyS0.
[   21.994441] sd 0:0:1:0: Attached scsi generic sg1 type 0
[   21.995082] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   22.009878] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   22.034486] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[   22.035446] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 168
[   22.035447] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 169
[   22.035448] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 170
[   22.035449] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 171
[   22.035450] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 172
[   22.035451] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 173
[   22.035452] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 174
[   22.035453] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 175
[   22.035455] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 176
[   22.035456] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 177
[   22.035457] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 178
[   22.035458] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 179
[   22.035459] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 180
[   22.035460] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 181
[   22.035461] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 182
[   22.035462] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 183
[   22.035465] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffae3f03b80000), size(65536)
[   22.035466] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[   22.087332] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   22.089957] mpt2sas_cm0: sending message unit reset !!
[   22.091467] mpt2sas_cm0: message unit reset: SUCCESS
[   22.122886] IPMI SSIF Interface driver
[   22.164237] cryptd: max_cpu_qlen set to 1000
[   22.164938] iTCO_vendor_support: vendor-support=0
[   22.168010] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.168093] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.169290] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[   22.169291] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[   22.169292] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[   22.173711] device-mapper: multipath round-robin: version 1.2.0 loaded
[   22.179815] AVX version of gcm_enc/dec engaged.
[   22.179816] AES CTR mode by8 optimization enabled
[   22.183835] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.183891] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.214869] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[   22.214872] mpt2sas_cm0: Protocol=(
[   22.214873] Initiator
[   22.214874] ,Target
[   22.214874] ), 
[   22.214875] Capabilities=(
[   22.214876] TLR
[   22.214876] ,EEDP
[   22.214877] ,Snapshot Buffer
[   22.214878] ,Diag Trace Buffer
[   22.214878] ,Task Set Full
[   22.214879] ,NCQ
[   22.214879] )
[   22.214931] scsi host7: Fusion MPT SAS Host
[   22.215392] mpt2sas_cm0: sending port enable !!
[   22.218501] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[   22.229651] mpt2sas_cm0: port enable: SUCCESS
[   22.236979] scsi 7:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.236986] scsi 7:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.236988] scsi 7:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.236991] scsi 7:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.257772] kvm: disabled by bios
[   22.263905] intel_rapl: Found RAPL domain package
[   22.263907] intel_rapl: Found RAPL domain core
[   22.263914] intel_rapl: Found RAPL domain dram
[   22.263940] intel_rapl: Found RAPL domain package
[   22.263943] intel_rapl: Found RAPL domain core
[   22.263949] intel_rapl: Found RAPL domain dram
[   22.274550] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.274707] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.274708] EDAC sbridge:  Ver: 1.1.2 
[   22.433704] scsi 7:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.433710] scsi 7:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.433712] scsi 7:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.433715] scsi 7:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
%G%G[   22.723399] scsi 7:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.734262] scsi 7:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.747467] scsi 7:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.756965] scsi 7:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.782419] scsi 7:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.792911] scsi 7:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.805991] scsi 7:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.815327] scsi 7:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.840371] scsi 7:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   22.850937] scsi 7:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.864071] scsi 7:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.873473] scsi 7:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.899190] scsi 7:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.909877] scsi 7:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.923056] scsi 7:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.932523] scsi 7:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.957061] scsi 7:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.967892] scsi 7:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.981315] scsi 7:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.991044] scsi 7:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.016430] scsi 7:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.027584] scsi 7:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.041299] scsi 7:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.051357] scsi 7:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.093395] scsi 7:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.104625] scsi 7:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.118355] scsi 7:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.128376] scsi 7:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.154508] scsi 7:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   23.165759] scsi 7:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.179547] scsi 7:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.189616] scsi 7:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.217800] scsi 7:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   23.225955] sd 7:0:0:0: Attached scsi generic sg2 type 0
[   23.225962] sd 7:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.245083] sd 7:0:0:0: [sdc] Write Protect is off
[   23.252649] sd 7:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.264473] scsi 7:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   23.272445] sd 7:0:0:1: Attached scsi generic sg3 type 0
[   23.280219] sd 7:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.281121] scsi 7:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   23.281424] sd 7:0:0:2: Attached scsi generic sg4 type 0
[   23.281563] sd 7:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.282372] scsi 7:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   23.282697] sd 7:0:0:3: Attached scsi generic sg5 type 0
[   23.282698] sd 7:0:0:2: [sde] Write Protect is off
[   23.282944] sd 7:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.283058] sd 7:0:0:7: Attached scsi generic sg6 type 0
[   23.283138] sd 7:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.283501] sd 7:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.283740] scsi 7:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   23.284027] sd 7:0:1:0: Attached scsi generic sg7 type 0
[   23.284060] sd 7:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.284235] sd 7:0:0:3: [sdf] Write Protect is off
[   23.284714] sd 7:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.284777] sd 7:0:0:7: [sdg] Write Protect is off
[   23.284799] scsi 7:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   23.284825] sd 7:0:0:0: [sdc] Attached SCSI disk
[   23.284978] sd 7:0:1:0: [sdh] Write Protect is off
[   23.285139] sd 7:0:1:1: Attached scsi generic sg8 type 0
[   23.285210] sd 7:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.285248] sd 7:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.285335] sd 7:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.286232] scsi 7:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   23.286325] sd 7:0:1:1: [sdi] Write Protect is off
[   23.286470] sd 7:0:1:2: Attached scsi generic sg9 type 0
[   23.286690] sd 7:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.286721] sd 7:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.287673] Dev sdf: unable to read RDB block 0
[   23.287713]  sdf: unable to read partition table
[   23.287918] scsi 7:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   23.288212] sd 7:0:1:2: [sdj] Write Protect is off
[   23.288285] sd 7:0:1:3: Attached scsi generic sg10 type 0
[   23.288602] Dev sdh: unable to read RDB block 0
[   23.288613]  sdh: unable to read partition table
[   23.288732] sd 7:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.288891] sd 7:0:0:2: [sde] Attached SCSI disk
[   23.289212] sd 7:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.289422] sd 7:0:1:7: Attached scsi generic sg11 type 0
[   23.289596] sd 7:0:0:3: [sdf] Attached SCSI disk
[   23.289989] sd 7:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.290051] sd 7:0:1:3: [sdk] Write Protect is off
[   23.290750] sd 7:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.291653] sd 7:0:1:7: [sdl] Write Protect is off
[   23.292157] sd 7:0:1:0: [sdh] Attached SCSI disk
[   23.292216] sd 7:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.293292] Dev sdj: unable to read RDB block 0
[   23.293303]  sdj: unable to read partition table
[   23.293994] sd 7:0:1:1: [sdi] Attached SCSI disk
[   23.296864] sd 7:0:1:2: [sdj] Attached SCSI disk
[   23.297131] sd 7:0:1:3: [sdk] Attached SCSI disk
[   23.315738] blk_update_request: I/O error, dev sdf, sector 0
[   23.320087] blk_update_request: I/O error, dev sdf, sector 0
[   23.320163] blk_update_request: I/O error, dev sdh, sector 0
[   23.320946] blk_update_request: I/O error, dev sdj, sector 0
[   23.324568] blk_update_request: I/O error, dev sdh, sector 0
[   23.324580] blk_update_request: I/O error, dev sdf, sector 0
[   23.325066] blk_update_request: I/O error, dev sdj, sector 0
[   23.328691] blk_update_request: I/O error, dev sdh, sector 0
[   23.329465] blk_update_request: I/O error, dev sdj, sector 0
[   23.329624] blk_update_request: I/O error, dev sdf, sector 0
[   23.346464] device-mapper: table: 253:1: multipath: error getting device
[   23.346465] device-mapper: ioctl: error adding target to table
[   23.544100]  sdg:
[   23.545358] sd 7:0:0:7: [sdg] Attached SCSI disk
[   23.715633]  sdl:
[   23.716947] sd 7:0:1:7: [sdl] Attached SCSI disk
[   23.781054] sd 7:0:0:1: [sdd] Write Protect is off
[   23.788148] sd 7:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.800986] Dev sdd: unable to read RDB block 0
[   23.807642]  sdd: unable to read partition table
[   23.815775] sd 7:0:0:1: [sdd] Attached SCSI disk
[   23.835943] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Preprocess NFS configuration...
         Starting Tell Plymouth To Write Out Runtime Data...
         Starting Import network configuration from initramfs...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...
[   24.302924] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Mounting RPC Pipe File System...
         Starting Security Auditing Service...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   24.495206] type=1305 audit(1544514538.760:3): audit_pid=9007 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting Load CPU microcode update...
         Starting System Security Services Daemon...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Machine Check Exception Logging Daemon...
         Starting Dump dmesg to /var/log/dmesg...
         Starting GSSAPI Proxy Daemon...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting NTP client/server...
         Starting Authorization Manager...
         Starting Network Manager...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[   25.480306] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[[32m  OK  [0m] Started Login Service.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
[   25.759949] card: mlx4_0, QP: 0x220, inline size: 120
[   25.777675] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
         Starting Network Manage[   25.823522] ib0: enabling connected mode will cause multicast packet drops
r Script Dispatc[   25.823868] ib0: mtu > 4092 will cause multicast packet drops.
her Service...
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[   26.137120] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   26.227033] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   26.230292] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   26.241389] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.322946] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.330176] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   26.343290] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.462046] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.473270] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.592110] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.622194] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.641111] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.650454] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   26.670204] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   34.028660] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.075350] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.077778] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting Dynamic System Tuning Daemon...
         Starting Postfix Mail Transport Agent...
         Starting OpenSSH server daemon...
         Starting MUNGE authentication service...
[[32m  OK  [0m] Reached target Network is Online.
         Starting NFS status monitor for NFSv2/3 locking....
         Starting Notify NFS peers of a restart...
         Mounting /scratch.[   34.310424] FS-Cache: Loaded
..
         Starting System Logging Service...
[   34.345550] FS-Cache: Netfs 'nfs' registered for caching
[   34.349424] Key type dns_resolver registered
[   34.379484] NFS: Registering the id_resolver key type
[   34.379491] Key type id_resolver registered
[   34.379492] Key type id_legacy registered
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Permit User Sessions...
         Starting Crash recovery kernel arming...
         Starting Automounts filesystems on demand...
[[32m  OK  [0m] Started Permit User Sessions.
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Started Command Scheduler.
[[32m  OK  [0m] Started Job spooling tools.
         Starting Wait for Plymouth Boot Screen to Quit...

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-11T07:49:20+00:00] INFO: Forking chef instance to converge...
[2018-12-11T07:49:20+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-11T07:49:20+00:00] INFO: Chef-client pid: 10605
[2018-12-11T07:49:22+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-11T07:49:22+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-11T07:49:22+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-11T07:49:22+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-11T07:49:22+00:00] INFO: Running start handlers
[2018-12-11T07:49:22+00:00] INFO: Start handlers complete.
[2018-12-11T07:49:23+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-11T07:49:23+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T07:49:23+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T07:49:23+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-11T07:49:23+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181211074923.277514
[2018-12-11T07:49:23+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181207082859.049217
[2018-12-11T07:49:23+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-11T07:49:23+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-11T07:49:27+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-11T07:49:27+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-11T07:49:27+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-11T07:49:28+00:00] INFO: service[ntpd] started
[2018-12-11T07:49:28+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[   54.225314] sd 7:0:0:7: attempting task abort! scmd(ffff8ad42a08e840)
[   54.232604] sd 7:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 9f f8 00 00 08 00
[   54.240222] scsi target7:0:0: handle(0x000a), sas_address(0x50080e52ffd82000), phy(4)
[   54.248996] scsi target7:0:0: enclosure logical id(0x500605b005d6e9a0), slot(7) 
[   54.259265] sd 7:0:0:7: task abort: SUCCESS scmd(ffff8ad42a08e840)
[   54.266206] sd 7:0:1:7: attempting task abort! scmd(ffff8ad03feeabc0)
[   54.273432] sd 7:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 08 00 00 08 00
[   54.281044] scsi target7:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[   54.289836] scsi target7:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[   54.304868] sd 7:0:1:7: task abort: SUCCESS scmd(ffff8ad03feeabc0)
[2018-12-11T07:49:28+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-11T07:49:28+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-11T07:49:28+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-11T07:49:28+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-11T07:49:28+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-11T07:49:28+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-11T07:49:28+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-11T07:49:28+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-11T07:49:29+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-11T07:49:29+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-11T07:49:29+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-11T07:49:29+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default lin[   55.621373] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
e 64)
[2018-12-[   55.630134] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
11T07:49:29+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:29+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:29+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-11T07:49:30+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[   56.256868] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   56.265657] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[2018-12-11T07:49:30+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-11T07:49:30+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-11T07:49:30+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[   56.875336] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   56.884126] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[2018-12-11T07:49:31+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[   57.510355] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[2018-12-11T07:49:31+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-11T07:49:31+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-11T07:49:31+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-11T07:49:31+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-11T07:49:31+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-11T07:49:31+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-11T07:49:32+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-11T07:49:32+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-11T07:49:32+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-11T07:49:32+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-11T07:49:33+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-11T07:49:33+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-11T07:49:33+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-11T07:49:33+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-11T07:49:33+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-11T07:49:33+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-11T07:49:33+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-11T07:49:33+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-11T07:49:33+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-11T07:49:33+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-11T07:49:34+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-11T07:49:34+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-11T07:49:34+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-11T07:49:34+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211074934.333138
[2018-12-11T07:49:34+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181207082910.166893
[2018-12-11T07:49:34+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-11T07:49:34+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-11T07:49:34+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-11T07:49:34+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211074934.339359
[2018-12-11T07:49:34+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181207082910.183279
[2018-12-11T07:49:34+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-11T07:49:34+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-11T07:49:34+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-11T07:49:34+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:34+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-11T07:49:34+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:34+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-11T07:49:34+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-11T07:49:34+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:49:34+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:34+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:49:34+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:34+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:49:34+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:34+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:49:34+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:34+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:49:34+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:34+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:49:34+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:34+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:49:34+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:34+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T07:49:34+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:34+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:34+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-11T07:49:35+00:00] INFO: service[xinetd] started
[2018-12-11T07:49:35+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-11T07:49:36+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-11T07:49:36+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-11T07:49:36+00:00] INFO: Processing service[sshd] action start (ssh::ser[   61.600772] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
ver line 19)
[2018-12-11T07:49:36+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-11T07:49:36+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-11T07:49:36+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-11T07:49:36+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-11T07:49:37+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181211074936.994138
[2018-12-11T07:49:37+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181207082913.070193
[2018-12-11T07:49:37+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-11T07:49:37+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-11T07:49:37+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-11T07:49:37+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-11T07:49:37+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T07:49:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T07:49:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-11T07:49:37+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-11T07:49:37+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-11T07:49:37+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-11T07:49:37+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-11T07:49:37+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-11T07:49:37+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-11T07:49:38+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-11T07:49:38+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-11T07:49:39+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-11T07:49:39+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-11T07:49:39+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-11T07:49:39+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-11T07:49:39+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-11T07:49:39+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-11T07:49:39+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-11T07:49:39+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-11T07:49:39+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-11T07:49:39+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-11T07:49:39+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-11T07:49:39+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-11T07:49:39+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-11T07:49:39+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-11T07:49:39+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-11T07:49:39+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-11T07:49:39+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-11T07:49:39+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-11T07:49:39+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-11T07:49:40+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-11T07:49:40+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-11T07:49:40+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-11T07:49:40+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-11T07:49:40+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[2018-12-11T07:49:43+00:00] INFO: service[kdump] restarted
[2018-12-11T07:49:43+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-11T07:49:43+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-11T07:49:43+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-11T07:49:43+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-11T07:49:43+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-11T07:49:43+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-11T07:49:43+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-11T07:49:43+00:00] INFO: Chef Run complete in 20.979170858 seconds
[2018-12-11T07:49:43+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-11T07:49:43+00:00] INFO: Running report handlers
[2018-12-11T07:49:43+00:00] INFO: Creating JSON run report
[2018-12-11T07:49:43+00:00] INFO: Report handlers complete
[  107.135135] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  107.145598] alg: No test for adler32 (adler32-zlib)
[  107.975136] Lustre: Lustre: Build Version: 2.10.6_RC3
[  108.219454] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  108.314528] LDISKFS-fs warning (device dm-4): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[  108.314528] 
[  154.475777] LDISKFS-fs (dm-4): recovery complete
[  154.481373] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  155.311258] Lustre: MGS: Connection restored to ba026314-1ed3-fbca-2a6c-a9e0dcef3059 (at 0@lo)
[  155.533672] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.137@o2ib (not set up)
[  155.668618] LustreError: 11-0: soaked-MDT0002-osp-MDT0000: operation mds_connect to node 192.168.1.110@o2ib failed: rc = -114
[  155.704638] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  155.955272] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect
[  155.965943] Lustre: soaked-MDT0000: Connection restored to e1702f8d-a049-831e-9835-f5fd475eb364 (at 192.168.1.131@o2ib)
[  157.290300] Lustre: soaked-MDT0000: Connection restored to b35e0c93-4783-ff00-6ac2-902ea529f1e0 (at 192.168.1.126@o2ib)
[  162.084817] Lustre: soaked-MDT0000: Connection restored to 122115ee-d5c8-3882-d623-ece31ee81b76 (at 192.168.1.144@o2ib)
[  162.097002] Lustre: Skipped 3 previous similar messages
[  166.780823] Lustre: soaked-MDT0000: Connection restored to 19125282-9ba3-d605-7c0d-fee95de08d9f (at 192.168.1.119@o2ib)
[  166.792987] Lustre: Skipped 10 previous similar messages
[  175.933877] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[  175.943192] Lustre: Skipped 19 previous similar messages
[  180.698373] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  192.010653] Lustre: MGS: Connection restored to f2ded533-e6a3-f4ba-0452-0792e05479f8 (at 192.168.1.136@o2ib)
[  192.024153] Lustre: Skipped 17 previous similar messages
[  205.710793] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  205.726030] LustreError: Skipped 2 previous similar messages
[  225.928712] Lustre: soaked-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[  225.941712] Lustre: Skipped 17 previous similar messages
[  230.693078] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  254.665662] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544514745/real 1544514769]  req@ffff8ad40fb84500 x1619540964658208/t0(0) o400->soaked-OST0000-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 224/224 e 0 to 1 dl 1544514771 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[  254.665696] Lustre: soaked-OST000c-osc-MDT0000: Connection to soaked-OST000c (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[  254.730832] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[  260.743193] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544514769/real 0]  req@ffff8ad40fb82a00 x1619540964658528/t0(0) o8->soaked-OST0000-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544514775 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[  279.758302] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  279.774018] LustreError: Skipped 2 previous similar messages
[  290.187153] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 9 seconds
[  304.740151] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  329.737952] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  329.754174] LustreError: Skipped 1 previous similar message
[  335.717513] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  340.761977] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544514844/real 0]  req@ffff8ad40fa2b300 x1619540964659696/t0(0) o8->soaked-OST000c-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544514855 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[  340.803216] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[  354.734957] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  366.179379] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 11 seconds
[  366.194460] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 3 previous similar messages
[  378.178140] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 8 seconds
[  379.732574] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  379.748705] LustreError: Skipped 1 previous similar message
[  395.732374] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  395.753944] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  404.729759] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  420.728840] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544514919/real 0]  req@ffff8ad40fa2a700 x1619540964660560/t0(0) o8->soaked-OST0008-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544514935 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[  420.770861] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[  429.172894] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 6 seconds
[  429.188036] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[  429.752133] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  429.768454] LustreError: Skipped 1 previous similar message
[  441.171663] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 11 seconds
[  441.186987] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544514944/real 1544514955]  req@ffff8ad40fa2b000 x1619540964660928/t0(0) o8->soaked-OST000c-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544514960 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[  441.230618] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[  447.831928] Lustre: MGS: haven't heard from client d5f8541b-3eae-2ddc-d7a9-f23111a1ed3e (at 192.168.1.104@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff8acfe5af6400, cur 1544514962 expire 1544514812 last 1544514734
[  454.724629] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  454.750340] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544514969/real 1544514969]  req@ffff8ad40fa2f800 x1619540964661184/t0(0) o8->soaked-OST0008-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544514990 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[  455.762250] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  455.784232] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  479.722329] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  479.739010] LustreError: Skipped 1 previous similar message
[  487.439900] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.105@o2ib, removing former export from 192.168.1.104@o2ib
[  487.459779] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[  487.473133] Lustre: Skipped 9 previous similar messages
[  501.411516] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544514994/real 0]  req@ffff8ad40fb7c200 x1619540964661584/t0(0) o8->soaked-OST000c-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544515015 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[  504.719538] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  506.137801] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.105@o2ib, removing former export from 192.168.1.104@o2ib
[  515.792053] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  515.814014] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  523.651469] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.105@o2ib, removing former export from 192.168.1.104@o2ib
[  529.717197] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  529.733706] LustreError: Skipped 1 previous similar message
[  530.162549] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 7 seconds
[  530.177805] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[  539.427687] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.105@o2ib, removing former export from 192.168.1.104@o2ib
[  554.714611] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  555.160035] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 10 seconds
[  555.175355] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[  575.821890] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  575.843911] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  605.184458] LustreError: 11-0: soaked-OST0000-osc-MDT0000: operation obd_ping to node 192.168.1.105@o2ib failed: rc = -107
[  605.184485] Lustre: soaked-OST0004-osc-MDT0000: Connection to soaked-OST0004 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[  605.184489] Lustre: Skipped 3 previous similar messages
[  605.235552] LustreError: Skipped 5 previous similar messages
[  618.932806] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[  618.946893] Lustre: Skipped 13 previous similar messages
[  627.499394] Lustre: soaked-OST000c-osc-MDT0000: Connection to soaked-OST000c (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[  627.525528] Lustre: Skipped 2 previous similar messages
[  635.851724] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  635.873478] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  655.179375] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  655.205072] LustreError: Skipped 1 previous similar message
[  695.881555] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  695.903213] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  755.911434] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  755.933034] Lustre: 12372:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  780.414950] Lustre: soaked-MDT0000: Recovery over after 10:25, of 29 clients 29 recovered and 0 were evicted.
[  780.440703] Lustre: 12288:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 1183.489526] LustreError: 12547:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 1857.556409] LustreError: 12390:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 1858.216318] LustreError: 12470:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 1858.230089] LustreError: 12470:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[ 1879.908372] LustreError: 12289:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[ 1879.921124] LustreError: 12289:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[ 2042.514969] Lustre: 12330:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544516550/real 0]  req@ffff8ad3f68d5a00 x1619541047992176/t0(0) o1000->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 488/4320 e 0 to 1 dl 1544516557 ref 3 fl Rpc:X/0/ffffffff rc 0/-1
[ 2042.552868] Lustre: 12330:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 2042.566083] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 2048.587350] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544516557/real 0]  req@ffff8ad3f3a25a00 x1619541048202368/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544516563 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2103.581815] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544516607/real 0]  req@ffff8ad3de4f1b00 x1619541048920656/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544516618 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2208.571123] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544516707/real 0]  req@ffff8ad3de4f3c00 x1619541048926800/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544516723 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2238.267509] Lustre: MGS: haven't heard from client 9b272475-a3fa-2efe-2d90-ab300fd881b6 (at 192.168.1.111@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff8acfe5bc8800, cur 1544516753 expire 1544516603 last 1544516525
[ 2258.632528] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffff8acfe799d000, cur 1544516773 expire 1544516623 last 1544516544
[ 2313.560502] Lustre: 12194:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544516807/real 0]  req@ffff8ad410b41500 x1619541048932176/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544516828 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2348.977868] LNet: 12183:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 9 seconds
[ 2362.533660] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[ 2362.547514] Lustre: Skipped 2 previous similar messages
[ 2362.622886] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.110@o2ib, removing former export from 192.168.1.111@o2ib
[ 2392.553030] LustreError: 11-0: soaked-MDT0003-osp-MDT0000: operation obd_ping to node 192.168.1.110@o2ib failed: rc = -107
[ 2392.568960] LustreError: Skipped 7 previous similar messages
[ 2392.578504] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 2442.571837] LustreError: 167-0: soaked-MDT0003-osp-MDT0000: This client was evicted by soaked-MDT0003; in progress operations using this service will fail.
[ 2442.599699] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 2442.614812] Lustre: Skipped 5 previous similar messages
[ 2466.713263] LustreError: 12528:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 2475.025042] LustreError: 12552:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 2475.039042] LustreError: 12552:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[ 2487.002711] LustreError: 12390:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 2487.016422] LustreError: 12390:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[ 2503.496060] LustreError: 12552:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 2503.510022] LustreError: 12552:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 10 previous similar messages
[ 2539.961098] LustreError: 12387:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 2539.975239] LustreError: 12387:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 9 previous similar messages
[ 2618.525695] LustreError: 12550:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 2618.539552] LustreError: 12550:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 15 previous similar messages
[ 2942.246544] LustreError: 12518:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 2942.260742] LustreError: 12518:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 90 previous similar messages
[ 3238.800919] LustreError: 12462:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 3238.814746] LustreError: 12462:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 7 previous similar messages
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [7m[4;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[4;79H[m[m[5;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [4;79H[22;1H   The selected entry will be started automatically in 5s.                     [4;79H[22;1H   The selected entry will be started automatically in 4s.                     [4;79H[22;1H   The selected entry will be started automatically in 3s.                     [4;79H[22;1H   The selected entry will be started automatically in 2s.                     [4;79H[22;1H   The selected entry will be started automatically in 1s.                     [4;79H[22;1H   The selected entry will be started automatically in 0s.                     [4;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-307-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Fri Nov 30 18:46:05 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x34b20000-0x36587fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd6000-0x83fffcfff]
[    0.000000] Reserving 320MB of memory at 512MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff9f21ee000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 6822680k/34603008k available (7664k kernel code, 1126748k absent, 1001124k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.346 MHz processor
[    0.000177] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.69 BogoMIPS (lpj=2693346)
[    0.012646] pid_max: default: 245760 minimum: 1920
[    0.019157] Security Framework initialized
[    0.024041] SELinux:  Initializing.
[    0.028617] Yama: becoming mindful.
[    0.038110] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.060385] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.074686] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.082759] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.093657] Initializing cgroup subsys memory
[    0.098882] Initializing cgroup subsys devices
[    0.104143] Initializing cgroup subsys freezer
[    0.109400] Initializing cgroup subsys net_cls
[    0.114657] Initializing cgroup subsys blkio
[    0.119722] Initializing cgroup subsys perf_event
[    0.125319] Initializing cgroup subsys hugetlb
[    0.130578] Initializing cgroup subsys pids
[    0.135544] Initializing cgroup subsys net_prio
[    0.141184] mce: CPU supports 20 MCE banks
[    0.146085] CPU0: Thermal monitoring enabled (TM1)
[    0.151981] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.158409] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.165026] tlb_flushall_shift: 6
[    0.169090] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.180335] FEATURE SPEC_CTRL Present
[    0.184718] FEATURE IBPB_SUPPORT Present
[    0.189683] Spectre V2 : Mitigation: Full retpoline
[    0.196138] Freeing SMP alternatives: 28k freed
[    0.207657] ACPI: Core revision 20130517
[    0.303723] ACPI: All ACPI Tables successfully acquired
[    0.339101] ftrace: allocating 29187 entries in 115 pages
[    0.399890] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.407574] Switched APIC routing to physical flat.
[    0.414037] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.431044] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.442266] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.454915] ... version:                3
[    0.464370] ... bit width:              48
[    0.469231] ... generic registers:      4
[    0.473997] ... value mask:             0000ffffffffffff
[    0.480225] ... max period:             00007fffffffffff
[    0.486452] ... fixed-purpose events:   3
[    0.491221] ... event mask:             000000070000000f
[    0.505952] smpboot: Booting Node   0, Processors  #1[    0.527632] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.583747] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.724836] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.767960] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.809490] Brought up 32 CPUs
[    0.813679] smpboot: Max logical packages: 15
[    0.818847] smpboot: Total of 32 processors activated (172570.68 BogoMIPS)
[    1.076324] node 0 initialised, 2813371 pages in 136ms
[    1.114117] node 1 initialised, 3599739 pages in 168ms
[    1.121383] devtmpfs: initialized
[    1.136891] EVM: security.selinux
[    1.140885] EVM: security.ima
[    1.144487] EVM: security.capability
[    1.149043] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.158418] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.171303] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.179287] pinctrl core: initialized pinctrl subsystem
[    1.185701] RTC time:  8:46:00, date: 12/11/18
[    1.191447] NET: Registered protocol family 16
[    1.197238] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.206203] ACPI: bus type PCI registered
[    1.210971] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.219099] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.230012] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.237925] PCI: Using configuration type 1 for base access
[    1.244502] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.265438] ACPI: Added _OSI(Module Device)
[    1.270408] ACPI: Added _OSI(Processor Device)
[    1.275662] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.281207] ACPI: Added _OSI(Processor Aggregator Device)
[    1.287531] ACPI: Added _OSI(Linux-Dell-Video)
[    1.332633] ACPI: Executed 1 blocks of module-level executable AML code
[    1.622104] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.655532] ACPI: Interpreter enabled
[    1.659948] ACPI: (supports S0 S1 S5)
[    1.664327] ACPI: Using IOAPIC for interrupt routing
[    1.670287] HEST: Table parsing has been initialized.
[    1.676229] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.687011] ACPI: GPE 0x1E active on init
[    1.691972] ACPI: GPE 0x24 active on init
[    1.696904] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.763171] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.770384] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.780558] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.789551] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.798613] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.808551] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.820735] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.836118] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.851897] PCI host bridge to bus 0000:00
[    1.856768] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.863969] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.872835] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.881700] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.890563] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.899425] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.908291] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.917145] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.926004] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.934867] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.943727] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.952589] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.961452] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.970321] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.979185] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.988828] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.995783] pci 0000:00:01.0: System wakeup disabled by ACPI
[    2.002711] pci 0000:00:01.1: System wakeup disabled by ACPI
[    2.009649] pci 0000:00:02.0: System wakeup disabled by ACPI
[    2.016575] pci 0000:00:02.2: System wakeup disabled by ACPI
[    2.023505] pci 0000:00:03.0: System wakeup disabled by ACPI
[    2.034027] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    2.040979] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    2.047882] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    2.054840] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.061698] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.069281] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.075306] acpiphp: Slot [2] registered
[    2.080277] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.091109] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.102287] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.113110] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.124285] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.135119] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.146295] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.157130] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.169962] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.176314] acpiphp: Slot [2-2] registered
[    2.183651] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.189686] acpiphp: Slot [2-3] registered
[    2.194594] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.200623] acpiphp: Slot [2-4] registered
[    2.205832] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.212032] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.225351] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.231334] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.237621] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.244330] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.250288] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.259562] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.268599] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.277623] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.286641] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.295664] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.304682] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.313695] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.322708] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.331925] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.339132] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.349054] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.357883] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.366939] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.377018] PCI host bridge to bus 0000:80
[    2.381889] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.389771] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.397651] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.406513] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.415377] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.425018] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.431691] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.438611] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.445521] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.452419] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.461558] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.467497] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.473433] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.479363] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.500988] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.507902] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.517603] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.527781] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.535080] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.544842] PCI host bridge to bus 0000:7f
[    2.549717] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.560624] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.567538] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.577241] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.587423] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.594724] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.604493] PCI host bridge to bus 0000:ff
[    2.609366] pci_bus 0000:ff: root bus resource [bus ff]
[    2.620878] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.630452] vgaarb: loaded
[    2.633763] vgaarb: bridge control possible 0000:09:00.0
[    2.640418] SCSI subsystem initialized
[    2.644955] ACPI: bus type USB registered
[    2.649763] usbcore: registered new interface driver usbfs
[    2.656208] usbcore: registered new interface driver hub
[    2.662716] usbcore: registered new device driver usb
[    2.669198] EDAC MC: Ver: 3.0.0
[    2.673541] PCI: Using ACPI for IRQ routing
[    2.686114] NetLabel: Initializing
[    2.690207] NetLabel:  domain hash size = 128
[    2.695357] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.701228] NetLabel:  unlabeled traffic allowed by default
[    2.708097] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.716091] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.725959] amd_nb: Cannot enumerate AMD northbridges
[    2.732097] Switched to clocksource hpet
[    2.751331] pnp: PnP ACPI init
[    2.755061] ACPI: bus type PNP registered
[    2.760130] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.767053] system 00:00: [io  0xffff] has been reserved
[    2.773288] system 00:00: [io  0xffff] has been reserved
[    2.779518] system 00:00: [io  0xffff] has been reserved
[    2.785750] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.793056] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.799970] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.806879] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.813796] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.821100] system 00:00: [io  0x0cf9] could not be reserved
[    2.827928] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.836395] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.844096] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.851789] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.859483] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.867179] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.874868] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.882947] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.891029] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.899110] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.907318] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.915929] pnp: PnP ACPI: found 7 devices
[    2.920803] ACPI: bus type PNP unregistered
[    2.935168] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.941028] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.947164] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.954276] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.962167] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.968003] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.975889] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.985831] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.991682] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.997523] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    3.004631] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    3.012525] pci 0000:00:11.0: PCI bridge to [bus 07]
[    3.018369] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    3.025476] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    3.033363] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    3.043303] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    3.049163] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    3.055009] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    3.062895] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    3.072058] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    3.078140] pci 0000:80:01.0: PCI bridge to [bus 81]
[    3.083995] pci 0000:80:02.0: PCI bridge to [bus 82]
[    3.089850] pci 0000:80:03.0: PCI bridge to [bus 83]
[    3.095694] pci 0000:80:03.2: PCI bridge to [bus 84]
[    3.101918] NET: Registered protocol family 2
[    3.109250] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.118919] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.126965] TCP: Hash tables configured (established 262144 bind 65536)
[    3.134755] TCP: reno registered
[    3.138813] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.146282] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.155283] NET: Registered protocol family 1
[    4.260159] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.368226] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.377024] Unpacking initramfs...
[    6.210943] Freeing initrd memory: 27040k freed
[    6.226925] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    6.234445] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff9f1e773c7000-ffff9f1e7b3c6fff]
[    6.246478] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    6.255832] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    6.262548] RAPL PMU: hw unit of domain package 2^-16 Joules
[    6.269182] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    6.288627] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    6.295758] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    6.309980] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    6.318557] Initialise system trusted keyring
[    6.323857] audit: initializing netlink socket (disabled)
[    6.330211] type=2000 audit(1544517961.825:1): initialized
[    6.392601] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.400007] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.410572] zpool: loaded
[    6.413807] zbud: loaded
[    6.418133] VFS: Disk quotas dquot_6.6.0
[    6.423342] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.432360] msgmni has been set to 32768
[    6.437449] Key type big_key registered
[    6.444678] NET: Registered protocol family 38
[    6.449962] Key type asymmetric registered
[    6.454849] Asymmetric key parser 'x509' registered
[    6.460786] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.469861] io scheduler noop registered
[    6.474545] io scheduler deadline registered (default)
[    6.480734] io scheduler cfq registered
[    6.485328] io scheduler mq-deadline registered
[    6.490706] io scheduler kyber registered
[    6.501375] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.509525] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.517627] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.525246] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.532858] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.540488] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.548133] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.556222] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.563863] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.572009] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.580111] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.587775] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.595879] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.603496] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.611157] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.619315] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.627420] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.635071] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.643210] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.651347] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.659477] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.667686] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.674259] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.682010] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.690618] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.699422] ACPI: Power Button [PWRF]
[    6.703908] ACPI: Requesting acpi_cpufreq
[    6.792128] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.801075] pstore: Registered erst as persistent store backend
[    6.808329] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.817361] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.845560] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.872997] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.880634] Non-volatile memory driver v1.3
[    6.885685] Linux agpgart interface v0.103
[    6.891007] crash memory driver: version 1.1
[    6.896588] rdac: device handler registered
[    6.901661] hp_sw: device handler registered
[    6.906761] emc: device handler registered
[    6.911943] alua: device handler registered
[    6.917024] libphy: Fixed MDIO Bus: probed
[    6.926868] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.934499] ehci-pci: EHCI PCI platform driver
[    6.940237] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.946495] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.955320] ehci-pci 0000:00:1a.0: debug port 2
[    6.964672] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.977334] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.984162] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.992048] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.000641] usb usb1: Product: EHCI Host Controller
[    7.006408] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.015099] usb usb1: SerialNumber: 0000:00:1a.0
[    7.020785] hub 1-0:1.0: USB hub found
[    7.025285] hub 1-0:1.0: 2 ports detected
[    7.030643] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    7.036905] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    7.045719] ehci-pci 0000:00:1d.0: debug port 2
[    7.055048] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    7.067326] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    7.074153] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    7.082055] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.090654] usb usb2: Product: EHCI Host Controller
[    7.096406] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.105088] usb usb2: SerialNumber: 0000:00:1d.0
[    7.110761] hub 2-0:1.0: USB hub found
[    7.115262] hub 2-0:1.0: 2 ports detected
[    7.120281] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    7.127520] ohci-pci: OHCI PCI platform driver
[    7.132829] uhci_hcd: USB Universal Host Controller Interface driver
[    7.140410] usbcore: registered new interface driver usbserial_generic
[    7.148047] usbserial: USB Serial support registered for generic
[    7.155152] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    7.284462] tsc: Refined TSC clocksource calibration: 2693.507 MHz
[    8.208151] i8042: No controller found
[    8.212683] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    8.212727] Switched to clocksource tsc
[    8.212835] mousedev: PS/2 mouse device common for all mice
[    8.213047] rtc_cmos 00:01: RTC can wake from S4
[    8.213287] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    8.213343] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    8.213489] intel_pstate: Intel P-state driver initializing
[    8.228759] cpuidle: using governor menu
[    8.230309] hidraw: raw HID events driver (C) Jiri Kosina
[    8.230580] usbcore: registered new interface driver usbhid
[    8.230581] usbhid: USB HID core driver
[    8.230806] drop_monitor: Initializing network drop monitor service
[    8.231399] TCP: cubic registered
[    8.231410] Initializing XFRM netlink socket
[    8.232100] NET: Registered protocol family 10
[    8.233713] NET: Registered protocol family 17
[    8.233726] mpls_gso: MPLS GSO support
[    8.236858] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    8.237192] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    8.237420] Loading compiled-in X.509 certificates
[    8.238520] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    8.239558] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    8.240607] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: c7aec20a70554693bf19667e4c28ac12c728bbb2'
[    8.240642] registered taskstats version 1
[    8.245671] Key type trusted registered
[    8.249763] Key type encrypted registered
[    8.249897] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    8.251497]   Magic number: 14:944:775
[    8.253046] rtc_cmos 00:01: setting system clock to 2018-12-11 08:46:07 UTC (1544517967)
[    8.376417] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    8.388818] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    8.388822] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.389134] hub 1-1:1.0: USB hub found
[    8.389194] hub 1-1:1.0: 6 ports detected
[    8.443339] Freeing unused kernel memory: 1876k freed
[    8.449867] Write protecting the kernel read-only data: 12288k
[    8.458381] Freeing unused kernel memory: 516k freed
[    8.465871] Freeing unused kernel memory: 600k freed
[    8.479648] random: systemd: uninitialized urandom read (16 bytes read)
[    8.490244] random: systemd: uninitialized urandom read (16 bytes read)
[    8.498004] random: systemd: uninitialized urandom read (16 bytes read)
[    8.500871] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    8.500875] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.501304] hub 2-1:1.0: USB hub found
[    8.501494] hub 2-1:1.0: 8 ports detected
[    8.534150] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.556516] systemd[1]: Detected architecture x86-64.
[    8.562473] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.578596] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.648560] random: systemd: uninitialized urandom read (16 bytes read)
[    8.656316] random: systemd: uninitialized urandom read (16 bytes read)
[    8.664106] random: systemd: uninitialized urandom read (16 bytes read)
[    8.671937] random: systemd: uninitialized urandom read (16 bytes read)
[    8.680934] random: systemd: uninitialized urandom read (16 bytes read)
[    8.688980] random: systemd: uninitialized urandom read (16 bytes read)
[    8.697331] random: systemd: uninitialized urandom read (16 bytes read)
[     8.712265] seached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.722818] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.733630] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.746673] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.757602] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socke[    8.768486] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
t.
 [    8.778576] ocal File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.791581] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.801658] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.815427] systemd[1]: Starting Setup Virtual Console...
         Starting Setup Virtual Console...
[    8.826551] systemd[1]: Reached target Sockets.
[[32m  OK  [0m] Reached target Sockets.
[     8.849534] srting Create list of required static device nodes for the current kernel...
         Starting Create list of required st... nodes for the current kernel...
[    8.871677] systemd[1]: Starting dracut cmdline hook...
          Startin  8.882515] systemd[1]: Reached target Slices.
[ [32m  OK  [0m[     8.893225] s Variables...
         Startin[    8.901231] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
g Apply Kernel V[    8.909378] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
ariables...
[    8.919596] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.919598] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.919600] usb 2-1.4: SerialNumber: serial
[    8.921392] input: American  Megatrends Inc.ces/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
[    8.954790] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    8.966016] systemd[1]: Started Setup Virtual Console.
[[32m  OK  [0m[    8.972450] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
] Started Setup [    8.992448] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
Virtual Console.[    9.008128] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1

[    9.029501] systemd[1]: Started Create list of required static device nodes for the current kernel.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[    9.050916] systemd[1]: Started dracut cmdline hook.
[[32m  OK  [0m] Started dracut cmdline hook.
[    9.063884] systemd[1]: Started Apply Kernel Variables.
[[32m  OK  [0m] Started Apply Kernel Variables.
[    9.076813] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
         Starting dracut pre-udev hook...
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
[[32m  OK  [0m] Reached target System Initialization.
         Starting Show Plymouth Boot Screen...
         Starting dracut initqueue hook...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [    9.308350] random: fast init done
[0m] Reached target Basic Syste[    9.316329] mlx_compat: loading out-of-tree module taints kernel.
m.
[    9.324607] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    9.336345] dca service started, version 1.12.1
[    9.342941] Compat-mlnx-ofed backport release: b4fdfac
[    9.348982] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    9.356680] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    9.364006] pps_core: LinuxPPS API ver. 1 registered
[    9.369881] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    9.385417] PTP clock support registered
[    9.412792] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    9.417535] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    9.417539] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    9.430642] scsi host0: ahci
[    9.431373] scsi host1: ahci
[    9.431800] scsi host2: ahci
[    9.433655] scsi host3: ahci
[    9.434255] scsi host4: ahci
[    9.434762] scsi host5: ahci
[    9.434854] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 38
[    9.434856] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 38
%G[    9.434858] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 38
[    9.434861] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 38
[    9.434864] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 38
[    9.434866] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 38
[    9.486799] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.486819] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    9.486824] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    9.486827] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.486832] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.487007] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    9.487008] igb: Copyright (c) 2007-2014 Intel Corporation.
[    9.487124] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.487806] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    9.487890] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    9.487921] mlx4_core: Initializing 0000:04:00.0
[    9.489853] scsi host6: isci
[    9.525781] igb 0000:02:00.0: added PHC on eth0
[    9.525783] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.525785] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    9.525858] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    9.525859] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
%G[    9.526508] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.563632] [TTM] Zone  kernel: Available graphics memory: 16252598 kiB
[    9.563633] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.563634] [TTM] Initializing pool allocator
[    9.563659] [TTM] Initializing DMA pool allocator
[    9.572968] igb 0000:02:00.1: added PHC on eth1
[    9.572970] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.572971] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.573044] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.573045] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.623374] fbcon: mgadrmfb (fb0) is primary device
[    9.635177] igb 0000:02:00.2: added PHC on eth2
[    9.635179] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.635181] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.635254] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.635255] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.692094] igb 0000:02:00.3: added PHC on eth3
[    9.692095] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.692097] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.692171] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.692172] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.739539] ata4: SATA link down (SStatus 0 SControl 300)
[    9.739561] ata5: SATA link down (SStatus 0 SControl 300)
[    9.740518] ata3: SATA link down (SStatus 0 SControl 300)
[    9.740571] ata6: SATA link down (SStatus 0 SControl 300)
[    9.740591] ata2: SATA link down (SStatus 0 SControl 300)
[    9.741556] ata1: SATA link down (SStatus 0 SControl 300)
[    9.861138] Console: switching to colour frame buffer device 128x48
[    9.915433] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.943556] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   11.163385] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   11.170231] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   11.179128] ata7.00: configured for UDMA/133
[   11.185086] scsi 6:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   16.019166] mlx4_core 0000:04:00.0: Old device ETS support detected
[   16.026746] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   16.034132] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   16.041913] mlx4_core: device is working in RoCE mode: Roce V1
[   16.048994] mlx4_core: UD QP Gid type is: V1
[   17.109659] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   17.391587] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   17.403324] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   17.411660] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   17.548887] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   17.556789] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   17.566737] ata8.00: configured for UDMA/133
[   17.574166] scsi 6:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.635476] sd 6:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.635502] sd 6:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.635556] sd 6:0:1:0: [sdb] Write Protect is off
[   17.635581] sd 6:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.635728] sd 6:0:0:0: [sda] Write Protect is off
[   17.635822] sd 6:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.641268]  sdb:
[   17.641513] sd 6:0:1:0: [sdb] Attached SCSI disk
[   17.657473]  sda: sda1 sda2
[   17.658447] sd 6:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   18.467080] random: crng init done
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
         Mounting /sysroot...
[   18.744776] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped target Timers.
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped Apply Ke[   19.196469] systemd-journald[327]: Received SIGTERM from PID 1 (systemd).
rnel Variables.
[[32m  OK  [0m] Stopped target Local File Systems.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Closed udev Control Socket.
[[32m  OK  [0m] Closed udev Kernel Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.571032] SELinux:  Disabled at runtime.
[   19.621100] type=1404 audit(1544517978.868:2): selinux=0 auid=4294967295 ses=4294967295
[   19.851940] ip_tables: (C) 2000-2006 Netfilter Core Team
[   19.860488] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
         Mounting Debug File System...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Listening on udev Control Socket.
         Starting Availability of block devices...
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Listening on udev Kernel Socket.
         Mounting POSIX Message Queue File System...
         Starting Create list of required st... nodes for the current kernel...
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Reached target RPC Port Mapper.
         Mounting Huge Pages File System...
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Stopped target Initrd Root File System.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
[   20.853609] RPC: Registered named UNIX socket transport module.
[   20.853610] RPC: Registered udp transport module.
[   20.853611] RPC: Registered tcp transport module.
[   20.853611] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   20.859384] EXT4-fs (sda1): re-mounted. Opts: (null)
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
         Starting Create Static Device Nodes in /dev...
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
[[32m  OK  [0m] Started Apply Kernel Variables.
         Starting Configure read-only root support...
         Starting udev Coldplug all Devices...
         Starting Flush Journal to Persistent Storage...
[[32m  OK  [0m] Started LVM2 metadata daemon.
[   21.085789] systemd-journald[4366]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
[   21.477981] device-mapper: uevent: version 1.0.3
[   21.484825] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[   21.702373] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   21.715166] i801_smbus 0000:07:00.3: Enabling SMBus device
[   21.715310] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   21.716373] igb 0000:02:00.0: DCA enabled
[   21.716461] igb 0000:02:00.1: DCA enabled
[   21.717245] igb 0000:02:00.2: DCA enabled
[   21.717280] igb 0000:02:00.3: DCA enabled
[   21.753145] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   21.761406] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   21.772725] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.786050] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.800248] mpt2sas version 20.103.01.00 loaded
[   21.807755] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[   21.817386] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32505196 kB)
[   21.828203] ipmi message handler version 39.2
[   21.833091] ipmi device interface
[   21.840724] sd 6:0:0:0: Attached scsi generic sg0 type 0
[   21.840826] sd 6:0:1:0: Attached scsi generic sg1 type 0
[   21.843517] IPMI System Interface driver.
[   21.843540] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   21.843543] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   21.843544] ipmi_si: Adding SMBIOS-specified kcs state machine
[   21.843581] ipmi_platform: probing via SPMI
[   21.843583] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   21.843585] (NULL device *): SPMI-specified kcs state machine: duplicate
[   21.843665] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   21.902980] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   21.905204] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   21.955216] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[[32m  OK  [0m] Found device /dev/ttyS0.
[   21.966625] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 168
[   21.966626] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 169
[   21.966627] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 170
[   21.966628] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 171
[   21.966628] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 172
[   21.966629] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 173
[   21.966630] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 174
[   21.966631] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 175
[   21.966632] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 176
[   21.966632] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 177
[   21.966633] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 178
[   21.966634] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 179
[   21.966635] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 180
[   21.966636] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 181
[   21.966636] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 182
[   21.966637] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 183
[   21.966639] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffb408c3be0000), size(65536)
[   21.966640] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[   22.009244] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   22.039211] mpt2sas_cm0: sending message unit reset !!
[   22.040720] mpt2sas_cm0: message unit reset: SUCCESS
[   22.043586] IPMI SSIF Interface driver
[   22.044466] iTCO_vendor_support: vendor-support=0
[   22.044468] device-mapper: multipath round-robin: version 1.2.0 loaded
[   22.046416] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.046491] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.048046] cryptd: max_cpu_qlen set to 1000
[   22.059318] AVX version of gcm_enc/dec engaged.
[   22.059319] AES CTR mode by8 optimization enabled
[   22.069064] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.069119] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.132170] kvm: disabled by bios
[   22.139489] intel_rapl: Found RAPL domain package
[   22.139490] intel_rapl: Found RAPL domain core
[   22.139493] intel_rapl: Found RAPL domain dram
[   22.139525] intel_rapl: Found RAPL domain package
[   22.139527] intel_rapl: Found RAPL domain core
[   22.139534] intel_rapl: Found RAPL domain dram
[   22.146980] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[   22.146981] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[   22.146982] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[   22.149418] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.149579] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.149580] EDAC sbridge:  Ver: 1.1.2 
[   22.192852] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[   22.192854] mpt2sas_cm0: Protocol=(
[   22.192854] Initiator
[   22.192855] ,Target
[   22.192855] ), 
[   22.192856] Capabilities=(
[   22.192856] TLR
[   22.192857] ,EEDP
[   22.192857] ,Snapshot Buffer
[   22.192858] ,Diag Trace Buffer
[   22.192859] ,Task Set Full
[   22.192859] ,NCQ
[   22.192859] )
[   22.192962] scsi host7: Fusion MPT SAS Host
[   22.193482] mpt2sas_cm0: sending port enable !!
[   22.196894] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[   22.204218] mpt2sas_cm0: port enable: SUCCESS
[   22.205019] scsi 7:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.205025] scsi 7:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.205027] scsi 7:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.205030] scsi 7:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.391066] scsi 7:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.391072] scsi 7:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.391073] scsi 7:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.391076] scsi 7:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
%G%G[   22.667741] scsi 7:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.678758] scsi 7:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.692119] scsi 7:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.701808] scsi 7:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.724750] scsi 7:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.735273] scsi 7:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.748382] scsi 7:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.757738] scsi 7:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.786686] scsi 7:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   22.797059] scsi 7:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.810029] scsi 7:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.819235] scsi 7:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.866366] scsi 7:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.876514] scsi 7:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.889298] scsi 7:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.898388] scsi 7:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.922092] scsi 7:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.932590] scsi 7:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.945663] scsi 7:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.955044] scsi 7:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.977719] scsi 7:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.988292] scsi 7:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.001472] scsi 7:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.010908] scsi 7:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.033778] scsi 7:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.033785] scsi 7:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.033804] scsi 7:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.033808] scsi 7:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.106651] scsi 7:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   23.116992] scsi 7:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.130015] scsi 7:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.139327] scsi 7:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.165098] scsi 7:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   23.172468] sd 7:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.172677] sd 7:0:0:0: Attached scsi generic sg2 type 0
[   23.173287] scsi 7:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   23.173524] sd 7:0:0:1: Attached scsi generic sg3 type 0
[   23.173592] sd 7:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.174322] scsi 7:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   23.174427] sd 7:0:0:1: [sdd] Write Protect is off
[   23.174571] sd 7:0:0:2: Attached scsi generic sg4 type 0
[   23.174703] sd 7:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.174775] sd 7:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.175522] scsi 7:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   23.175750] sd 7:0:0:2: [sde] Write Protect is off
[   23.175793] sd 7:0:0:3: Attached scsi generic sg5 type 0
[   23.176047] sd 7:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.176108] sd 7:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.176195] sd 7:0:0:7: Attached scsi generic sg6 type 0
[   23.176538] sd 7:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.176917] scsi 7:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   23.177181] sd 7:0:1:0: Attached scsi generic sg7 type 0
[   23.177240] sd 7:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.177332] sd 7:0:0:3: [sdf] Write Protect is off
[   23.177809] sd 7:0:0:7: [sdg] Write Protect is off
[   23.177857] sd 7:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.177970] Dev sdd: unable to read RDB block 0
[   23.177982]  sdd: unable to read partition table
[   23.178022] sd 7:0:1:0: [sdh] Write Protect is off
[   23.178061] scsi 7:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   23.178275] sd 7:0:1:1: Attached scsi generic sg8 type 0
[   23.178289] sd 7:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.178409] sd 7:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.178692] sd 7:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.179203] scsi 7:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   23.179472] sd 7:0:1:2: Attached scsi generic sg9 type 0
[   23.179643] sd 7:0:1:1: [sdi] Write Protect is off
[   23.179804] sd 7:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.180141] sd 7:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.180885] sd 7:0:0:1: [sdd] Attached SCSI disk
[   23.181043] scsi 7:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   23.181204] Dev sdf: unable to read RDB block 0
[   23.181207] Dev sdh: unable to read RDB block 0
[   23.181216]  sdf: unable to read partition table
[   23.181217]  sdh: unable to read partition table
[   23.181433] sd 7:0:1:2: [sdj] Write Protect is off
[   23.181524] sd 7:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.181544] sd 7:0:1:3: Attached scsi generic sg10 type 0
[   23.181902] sd 7:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.182317] sd 7:0:0:2: [sde] Attached SCSI disk
[   23.182998] sd 7:0:1:3: [sdk] Write Protect is off
[   23.183111] sd 7:0:1:7: Attached scsi generic sg11 type 0
[   23.183523] sd 7:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.183565] sd 7:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.184120] sd 7:0:0:3: [sdf] Attached SCSI disk
[   23.184443] sd 7:0:1:0: [sdh] Attached SCSI disk
[   23.184937] sd 7:0:1:7: [sdl] Write Protect is off
[   23.186140] Dev sdj: unable to read RDB block 0
[   23.186150]  sdj: unable to read partition table
[   23.186286] sd 7:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.187922] sd 7:0:1:1: [sdi] Attached SCSI disk
[   23.188768] sd 7:0:1:2: [sdj] Attached SCSI disk
[   23.192140] sd 7:0:1:3: [sdk] Attached SCSI disk
[   23.210311] blk_update_request: I/O error, dev sdf, sector 0
[   23.210519] blk_update_request: I/O error, dev sdd, sector 0
[   23.213320] blk_update_request: I/O error, dev sdj, sector 0
[   23.214946] blk_update_request: I/O error, dev sdd, sector 0
[   23.215160] blk_update_request: I/O error, dev sdh, sector 0
[   23.216059] blk_update_request: I/O error, dev sdf, sector 0
[   23.217863] blk_update_request: I/O error, dev sdj, sector 0
[   23.219364] blk_update_request: I/O error, dev sdd, sector 0
[   23.219577] blk_update_request: I/O error, dev sdh, sector 0
[   23.220631] blk_update_request: I/O error, dev sdf, sector 0
[   23.248833] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   23.342887] device-mapper: table: 253:5: multipath: error getting device
[   23.342889] device-mapper: ioctl: error adding target to table
[   23.445697]  sdg:
[   23.446982] sd 7:0:0:7: [sdg] Attached SCSI disk
[   23.615671]  sdl:
[   23.616914] sd 7:0:1:7: [sdl] Attached SCSI disk
[   23.742082] sd 7:0:0:0: [sdc] Write Protect is off
[   23.750165] sd 7:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.764867] sd 7:0:0:0: [sdc] Attached SCSI disk
[   23.930521] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   23.940625] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Preprocess NFS configuration...
         Starting Import network configuration from initramfs...
         Starting Tell Plymouth To Write Out Runtime Data...
[   24.265357] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Import network configuration from initramfs.
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Mounting RPC Pipe File System...
         Starting Security Auditing Service...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   24.616092] type=1305 audit(1544517983.862:3): audit_pid=8999 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting GSSAPI Proxy Daemon...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting System Security Services Daemon...
         Starting Authorization Manager...
         Starting Load CPU microcode update...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Dump dmesg to /var/log/dmesg...
         Starting Network Manager...
         Starting NTP client/server...
         Starting Machine Check Exception Logging Daemon...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started Authorization Manager.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started NTP client/server.
[   25.551588] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   25.561746] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[[32m  OK  [0m] Started Network Manager.
[   25.664160] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[   25.969871] card: mlx4_0, QP: 0x220, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.[   25.988844] card: mlx4_0, QP: 0x300, inline size: 120
[   26.025385] ib0: enabling connected mode will cause multicast packet drops
[   26.025654] ib0: mtu > 4092 will cause multicast packet drops.

[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
[[32m  OK  [0m] Started mln[   26.080189] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
x_interface_mgr - configure ib1.
[   26.161826] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   26.163016] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   26.171027] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[   26.252897] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.260979] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   26.268400] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   26.268414] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   26.292970] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.411707] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.423347] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.541760] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.570427] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.592705] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.603892] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   26.626232] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   26.961523] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   26.971896] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   27.573887] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   33.988793] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.035494] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.038805] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting OpenSSH server daemon...
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting Postfix Mail Transport Agent...
[   34.249511] FS-Cache: Loaded
         Starting Dynamic System Tuning Daemon...
[[32m  OK  [0m] Reached target Network is [   34.282199] FS-Cache: Netfs 'nfs' registered for caching
Online.
      [   34.286016] Key type dns_resolver registered
   Starting NFS status monitor for NFSv2/3 locking....
         Starting Notify NFS peers of a restart...
         Mounting /scratch...
         Starting System Logging Service...
         Starting MUNGE authentication service...
[   34.316239] NFS: Registering the id_resolver key type
[[32m  OK  [0m[   34.316244] Key type id_resolver registered
] Started OpenSS[   34.316245] Key type id_legacy registered
H server daemon.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Crash recovery kernel arming...
         Starting Permit User Sessions...
         Starting Automounts filesystems on demand...
[[32m  OK  [0m] Started Permit User Sessions.
[[32m  OK  [0m] Started Command Scheduler.
         Starting Terminate Plymouth Boot Screen...
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Job spooling tools.
[[32m  OK  [0m] Created slice User Slice of root.
[[32m  OK  [0m] Started Session 1 of user root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-11T08:46:45+00:00] INFO: Forking chef instance to converge...
[2018-12-11T08:46:45+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-11T08:46:45+00:00] INFO: Chef-client pid: 10792
[2018-12-11T08:46:47+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-11T08:46:47+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-11T08:46:47+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-11T08:46:47+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-11T08:46:47+00:00] INFO: Running start handlers
[2018-12-11T08:46:47+00:00] INFO: Start handlers complete.
[2018-12-11T08:46:48+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-11T08:46:48+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T08:46:48+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T08:46:48+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-11T08:46:48+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181211084648.063089
[2018-12-11T08:46:48+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181207185345.286818
[2018-12-11T08:46:48+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-11T08:46:48+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-11T08:46:52+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-11T08:46:52+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-11T08:46:52+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-11T08:46:53+00:00] INFO: service[ntpd] started
[2018-12-11T08:46:53+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-11T08:46:53+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-11T08:46:53+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-11T08:46:53+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-11T08:46:53+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-11T08:46:53+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-11T08:46:53+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-11T08:46:53+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-11T08:46:53+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-11T08:46:54+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-11T08:46:54+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-11T08:46:54+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-11T08:46:54+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-11T08:46:54+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:54+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:54+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-11T08:46:55+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-11T08:46:55+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-11T08:46:55+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-11T08:46:55+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-11T08:46:55+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-11T08:46:56+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-11T08:46:56+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-11T08:46:56+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-11T08:46:56+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-11T08:46:56+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-11T08:46:56+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-11T08:46:57+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-11T08:46:57+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-11T08:46:57+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-11T08:46:57+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-11T08:46:57+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-11T08:46:57+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-11T08:46:57+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-11T08:46:57+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-11T08:46:57+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-11T08:46:58+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-11T08:46:58+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-11T08:46:58+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-11T08:46:58+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-11T08:46:58+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-11T08:46:58+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-11T08:46:58+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-11T08:46:58+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-11T08:46:58+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211084658.962631
[2018-12-11T08:46:58+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181207185356.363854
[2018-12-11T08:46:58+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-11T08:46:58+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-11T08:46:58+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-11T08:46:58+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211084658.978060
[2018-12-11T08:46:58+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181207185356.370312
[2018-12-11T08:46:58+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-11T08:46:58+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-11T08:46:58+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-11T08:46:58+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-11T08:46:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-11T08:46:59+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-11T08:46:59+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T08:46:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T08:46:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T08:46:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T08:46:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T08:46:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T08:46:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T08:46:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T08:46:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:46:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:46:59+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-11T08:46:59+00:00] INFO: service[xinetd] started
[2018-12-11T08:47:00+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-11T08:47:00+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-11T08:47:00+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-11T08:47:00+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-11T08:47:01+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-11T08:47:01+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-11T08:47:01+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-11T08:47:01+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-11T08:47:01+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181211084701.788120
[2018-12-11T08:47:01+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181207185358.896552
[2018-12-11T08:47:01+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-11T08:47:01+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-11T08:47:01+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-11T08:47:01+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-11T08:47:01+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-11T08:47:01+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:01+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:01+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-11T08:47:01+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-11T08:47:01+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-11T08:47:01+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-11T08:47:01+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-11T08:47:01+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:01+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:01+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-11T08:47:01+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-11T08:47:02+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[   62.647133] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[2018-12-11T08:47:02+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-11T08:47:02+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-11T08:47:02+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T08:47:02+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T08:47:02+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T08:47:02+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T08:47:02+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T08:47:02+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T08:47:02+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T08:47:02+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T08:47:02+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T08:47:02+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-11T08:47:02+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-11T08:47:02+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-11T08:47:02+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-11T08:47:02+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-11T08:47:02+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-11T08:47:02+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-11T08:47:03+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-11T08:47:03+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-11T08:47:04+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-11T08:47:04+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-11T08:47:04+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-11T08:47:04+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-11T08:47:04+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-11T08:47:04+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-11T08:47:04+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-11T08:47:04+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-11T08:47:04+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-11T08:47:04+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-11T08:47:04+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-11T08:47:04+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-11T08:47:04+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-11T08:47:04+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-11T08:47:04+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-11T08:47:04+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-11T08:47:04+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-11T08:47:04+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-11T08:47:04+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-11T08:47:05+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-11T08:47:05+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-11T08:47:05+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-11T08:47:05+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-11T08:47:05+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[2018-12-11T08:47:07+00:00] INFO: service[kdump] restarted
[2018-12-11T08:47:07+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-11T08:47:08+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-11T08:47:08+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-11T08:47:08+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-11T08:47:08+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-11T08:47:08+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-11T08:47:08+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-11T08:47:08+00:00] INFO: Chef Run complete in 20.894420023 seconds
[2018-12-11T08:47:08+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-11T08:47:08+00:00] INFO: Running report handlers
[2018-12-11T08:47:08+00:00] INFO: Creating JSON run report
[2018-12-11T08:47:08+00:00] INFO: Report handlers complete
[  310.000602] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  310.011215] alg: No test for adler32 (adler32-zlib)
[  310.875449] Lustre: Lustre: Build Version: 2.10.6_RC3
[  311.112446] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  311.225966] LDISKFS-fs warning (device dm-1): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[  311.225966] 
[  362.364256] LDISKFS-fs (dm-1): recovery complete
[  362.370013] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  364.641968] Lustre: MGS: Connection restored to 3dbd1a5f-a1f2-ad24-7306-f67a894398fb (at 0@lo)
[  365.264042] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  365.698456] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  366.134795] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect
[  366.145572] Lustre: soaked-MDT0000: Connection restored to 8f1f8b6a-ed5e-f64f-2e90-ea8d797ac991 (at 192.168.1.124@o2ib)
[  367.956957] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[  372.178236] Lustre: soaked-MDT0000: Connection restored to f3a3e702-a107-eabf-3cee-2496a5fe405a (at 192.168.1.117@o2ib)
[  372.190425] Lustre: Skipped 5 previous similar messages
[  377.080360] Lustre: soaked-MDT0000: Connection restored to e1702f8d-a049-831e-9835-f5fd475eb364 (at 192.168.1.131@o2ib)
[  377.092640] Lustre: Skipped 7 previous similar messages
[  385.559622] Lustre: soaked-MDT0000: Connection restored to a5bf3c57-9993-6ae9-d6f4-1637a8088e36 (at 192.168.1.142@o2ib)
[  385.571797] Lustre: Skipped 10 previous similar messages
[  390.664521] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  402.288412] Lustre: soaked-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[  402.298817] Lustre: Skipped 16 previous similar messages
[  415.665156] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  415.677922] LustreError: Skipped 2 previous similar messages
[  440.665144] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  440.683062] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[  440.683065] Lustre: Skipped 25 previous similar messages
[  465.665455] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  465.678349] LustreError: Skipped 2 previous similar messages
[  485.941228] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  490.665389] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  515.682265] LustreError: 11-0: soaked-MDT0003-osp-MDT0000: operation mds_connect to node 192.168.1.111@o2ib failed: rc = -114
[  515.695102] LustreError: Skipped 2 previous similar messages
[  540.665769] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  545.956468] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  565.666335] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  565.682436] LustreError: Skipped 1 previous similar message
[  590.666385] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  605.977015] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  605.998462] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  615.666781] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  615.683084] LustreError: Skipped 1 previous similar message
[  640.666658] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  665.667175] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  665.683664] LustreError: Skipped 1 previous similar message
[  666.012505] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  666.034163] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  690.667141] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  715.667597] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  715.684014] LustreError: Skipped 1 previous similar message
[  726.049055] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  726.071004] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  740.667600] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  786.085549] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  786.107546] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  815.693862] LustreError: 11-0: soaked-MDT0003-osp-MDT0000: operation mds_connect to node 192.168.1.111@o2ib failed: rc = -114
[  815.710618] LustreError: Skipped 3 previous similar messages
[  840.668533] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  840.694540] LustreError: Skipped 1 previous similar message
[  846.122076] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  846.144109] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  906.158604] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  906.180723] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  965.695207] LustreError: 11-0: soaked-MDT0003-osp-MDT0000: operation mds_connect to node 192.168.1.111@o2ib failed: rc = -114
[  965.712006] LustreError: Skipped 7 previous similar messages
[ 1026.195774] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[ 1026.217737] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages
[ 1206.233826] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[ 1206.255724] Lustre: 12341:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 8 previous similar messages
[ 1265.788683] Lustre: soaked-MDT0000: disconnecting 1 stale clients
[ 1265.799389] Lustre: 12341:0:(ldlm_lib.c:1619:abort_req_replay_queue()) @@@ aborted:  req@ffff9f25dda00450 x1619531205362800/t0(47251094883) o1000->soaked-MDT0001-mdtlov_UUID@192.168.1.109@o2ib:644/0 lens 2656/0 e 34 to 0 dl 1544519244 ref 1 fl Complete:/4/ffffffff rc 0/-1
[ 1265.839250] Lustre: 12341:0:(ldlm_lib.c:2049:target_recovery_overseer()) soaked-MDT0000 recovery is aborted by hard timeout
[ 1265.839261] Lustre: 12341:0:(ldlm_lib.c:2059:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[ 1265.854190] Lustre: soaked-MDT0000: Denying connection for new client soaked-MDT0002-mdtlov_UUID(at 192.168.1.110@o2ib), waiting for 29 known clients (25 recovered, 0 in progress, and 4 evicted) to recover in 0:01
[ 1265.893223] Lustre: soaked-MDT0000: Recovery over after 15:00, of 29 clients 25 recovered and 4 were evicted.
[ 1265.909517] Lustre: 12366:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 1290.691068] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[ 1290.705078] Lustre: Skipped 12 previous similar messages
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;01H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [7m[4;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[4;79H[m[m[5;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [4;79H[22;1H   The selected entry will be started automatically in 5s.                     [4;79H[22;1H   The selected entry will be started automatically in 4s.                     [4;79H[22;1H   The selected entry will be started automatically in 3s.                     [4;79H[22;1H   The selected entry will be started automatically in 2s.                     [4;79H[22;1H   The selected entry will be started automatically in 1s.                     [4;79H[22;1H   The selected entry will be started automatically in 0s.                     [4;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-307-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Fri Nov 30 18:46:05 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x34b20000-0x36587fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 320MB of memory at 512MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff8b1cee000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 6841488k/34603008k available (7664k kernel code, 1126748k absent, 1001116k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.294 MHz processor
[    0.000179] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.58 BogoMIPS (lpj=2693294)
[    0.012661] pid_max: default: 245760 minimum: 1920
[    0.019181] Security Framework initialized
[    0.024083] SELinux:  Initializing.
[    0.028627] Yama: becoming mindful.
[    0.038131] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.060411] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.074730] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.082819] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.093750] Initializing cgroup subsys memory
[    0.098980] Initializing cgroup subsys devices
[    0.104256] Initializing cgroup subsys freezer
[    0.109519] Initializing cgroup subsys net_cls
[    0.114777] Initializing cgroup subsys blkio
[    0.119847] Initializing cgroup subsys perf_event
[    0.125459] Initializing cgroup subsys hugetlb
[    0.130733] Initializing cgroup subsys pids
[    0.135710] Initializing cgroup subsys net_prio
[    0.141359] mce: CPU supports 20 MCE banks
[    0.146257] CPU0: Thermal monitoring enabled (TM1)
[    0.152024] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.158459] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.165078] tlb_flushall_shift: 6
[    0.169156] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.180423] FEATURE SPEC_CTRL Present
[    0.184810] FEATURE IBPB_SUPPORT Present
[    0.189804] Spectre V2 : Mitigation: Full retpoline
[    0.197720] Freeing SMP alternatives: 28k freed
[    0.209455] ACPI: Core revision 20130517
[    0.305379] ACPI: All ACPI Tables successfully acquired
[    0.329255] ftrace: allocating 29187 entries in 115 pages
[    0.391223] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.398917] Switched APIC routing to physical flat.
[    0.405399] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.422422] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.433670] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.446392] ... version:                3
[    0.455829] ... bit width:              48
[    0.460694] ... generic registers:      4
[    0.465461] ... value mask:             0000ffffffffffff
[    0.471686] ... max period:             00007fffffffffff
[    0.477913] ... fixed-purpose events:   3
[    0.482683] ... event mask:             000000070000000f
[    0.497499] smpboot: Booting Node   0, Processors  #1[    0.519520] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.575913] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.717000] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.760247] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.801745] Brought up 32 CPUs
[    0.805940] smpboot: Max logical packages: 15
[    0.811129] smpboot: Total of 32 processors activated (172563.07 BogoMIPS)
[    1.069294] node 0 initialised, 2813371 pages in 136ms
[    1.107087] node 1 initialised, 3595039 pages in 168ms
[    1.114363] devtmpfs: initialized
[    1.130249] EVM: security.selinux
[    1.134246] EVM: security.ima
[    1.137840] EVM: security.capability
[    1.142409] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.151784] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.164744] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.172737] pinctrl core: initialized pinctrl subsystem
[    1.179157] RTC time:  9:30:29, date: 12/11/18
[    1.184920] NET: Registered protocol family 16
[    1.190749] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.199721] ACPI: bus type PCI registered
[    1.204493] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.212625] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.223541] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.231469] PCI: Using configuration type 1 for base access
[    1.238050] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.257982] ACPI: Added _OSI(Module Device)
[    1.262953] ACPI: Added _OSI(Processor Device)
[    1.268213] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.273759] ACPI: Added _OSI(Processor Aggregator Device)
[    1.280086] ACPI: Added _OSI(Linux-Dell-Video)
[    1.325182] ACPI: Executed 1 blocks of module-level executable AML code
[    1.614316] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.647698] ACPI: Interpreter enabled
[    1.652114] ACPI: (supports S0 S1 S5)
[    1.656509] ACPI: Using IOAPIC for interrupt routing
[    1.662483] HEST: Table parsing has been initialized.
[    1.668427] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.679215] ACPI: GPE 0x1E active on init
[    1.684174] ACPI: GPE 0x24 active on init
[    1.689117] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.755188] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.762405] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.772574] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.781566] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.790623] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.800563] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.812761] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.828152] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.843921] PCI host bridge to bus 0000:00
[    1.848794] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.856001] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.864870] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.873735] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.882606] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.891475] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.900348] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.909213] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.918081] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.926946] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.935810] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.944672] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.953537] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.962403] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.971262] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.980904] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.987866] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.994787] pci 0000:00:01.1: System wakeup disabled by ACPI
[    2.001719] pci 0000:00:02.0: System wakeup disabled by ACPI
[    2.008635] pci 0000:00:02.2: System wakeup disabled by ACPI
[    2.015561] pci 0000:00:03.0: System wakeup disabled by ACPI
[    2.026059] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    2.033002] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    2.039902] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    2.046855] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.053701] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.061270] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.067288] acpiphp: Slot [2] registered
[    2.072248] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.083074] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.094252] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.105079] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.116255] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.127099] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.138285] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.149129] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.161969] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.168322] acpiphp: Slot [2-2] registered
[    2.175636] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.181676] acpiphp: Slot [2-3] registered
[    2.186586] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.192610] acpiphp: Slot [2-4] registered
[    2.197816] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.204027] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.217327] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.223297] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.229570] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.236264] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.242235] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.251540] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.260601] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.269633] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.278671] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.287718] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.296752] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.305784] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.314813] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.324040] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.331250] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.341170] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.349998] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.359067] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.369140] PCI host bridge to bus 0000:80
[    2.374014] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.381903] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.389789] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.398658] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.407522] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.417163] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.423812] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.430715] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.437610] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.444503] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.453633] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.459575] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.465497] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.471414] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.492974] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.499891] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.509595] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.519779] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.527080] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.536846] PCI host bridge to bus 0000:7f
[    2.541719] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.552627] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.559545] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.569250] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.579434] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.586739] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.596512] PCI host bridge to bus 0000:ff
[    2.601383] pci_bus 0000:ff: root bus resource [bus ff]
[    2.612894] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.622465] vgaarb: loaded
[    2.625775] vgaarb: bridge control possible 0000:09:00.0
[    2.632451] SCSI subsystem initialized
[    2.636990] ACPI: bus type USB registered
[    2.641806] usbcore: registered new interface driver usbfs
[    2.648247] usbcore: registered new interface driver hub
[    2.654761] usbcore: registered new device driver usb
[    2.661251] EDAC MC: Ver: 3.0.0
[    2.665643] PCI: Using ACPI for IRQ routing
[    2.678246] NetLabel: Initializing
[    2.682340] NetLabel:  domain hash size = 128
[    2.687491] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.693367] NetLabel:  unlabeled traffic allowed by default
[    2.700239] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.708229] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.717093] amd_nb: Cannot enumerate AMD northbridges
[    2.723237] Switched to clocksource hpet
[    2.742456] pnp: PnP ACPI init
[    2.746202] ACPI: bus type PNP registered
[    2.751278] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.758200] system 00:00: [io  0xffff] has been reserved
[    2.764438] system 00:00: [io  0xffff] has been reserved
[    2.770686] system 00:00: [io  0xffff] has been reserved
[    2.776925] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.784231] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.791152] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.798066] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.804983] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.812290] system 00:00: [io  0x0cf9] could not be reserved
[    2.819121] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.827590] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.835292] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.842991] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.850690] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.858385] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.866079] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.874170] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.882254] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.890334] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.898551] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.907170] pnp: PnP ACPI: found 7 devices
[    2.912046] ACPI: bus type PNP unregistered
[    2.926425] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.932297] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.938436] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.945555] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.953446] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.959287] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.967174] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.977116] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.982971] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.988815] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.995926] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    3.003819] pci 0000:00:11.0: PCI bridge to [bus 07]
[    3.009670] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    3.016787] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    3.024681] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    3.034624] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    3.040485] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    3.046331] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    3.054222] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    3.063376] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    3.069453] pci 0000:80:01.0: PCI bridge to [bus 81]
[    3.075309] pci 0000:80:02.0: PCI bridge to [bus 82]
[    3.081164] pci 0000:80:03.0: PCI bridge to [bus 83]
[    3.087010] pci 0000:80:03.2: PCI bridge to [bus 84]
[    3.093250] NET: Registered protocol family 2
[    3.100571] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.110248] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.118305] TCP: Hash tables configured (established 262144 bind 65536)
[    3.126101] TCP: reno registered
[    3.130166] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.137623] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.146631] NET: Registered protocol family 1
[    4.252331] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.360417] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.369226] Un packing initram[    6.203822] Freeing initrd memory: 27040k freed
[    6.219844] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    6.227373] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff8b19773c7000-ffff8b197b3c6fff]
[    6.239417] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    6.248784] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    6.255513] RAPL PMU: hw unit of domain package 2^-16 Joules
[    6.262151] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    6.281611] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    6.288753] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    6.303018] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    6.311567] Initialise system trusted keyring
[    6.316887] audit: initializing netlink socket (disabled)
[    6.323283] type=2000 audit(1544520629.826:1): initialized
[    6.385278] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.392685] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.403232] zpool: loaded
[    6.406470] zbud: loaded
[    6.410789] VFS: Disk quotas dquot_6.6.0
[    6.415991] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.425017] msgmni has been set to 32768
[    6.430097] Key type big_key registered
[    6.437306] NET: Registered protocol family 38
[    6.442602] Key type asymmetric registered
[    6.447477] Asymmetric key parser 'x509' registered
[    6.453406] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.462466] io scheduler noop registered
[    6.467165] io scheduler deadline registered (default)
[    6.473369] io scheduler cfq registered
[    6.477972] io scheduler mq-deadline registered
[    6.483351] io scheduler kyber registered
[    6.494043] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.502181] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.510267] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.517883] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.525487] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.533106] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.540743] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.548829] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.556473] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.564602] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.572702] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.580354] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.588442] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.596050] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.603705] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.611835] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.619933] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.627590] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.635732] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.643869] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.652004] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.660209] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.666758] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.674514] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.683132] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.691943] ACPI: Power Button [PWRF]
[    6.696423] ACPI: Requesting acpi_cpufreq
[    6.784372] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.793322] pstore: Registered erst as persistent store backend
[    6.800597] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.809628] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.837821] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.865261] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.872885] Non-volatile memory driver v1.3
[    6.877944] Linux agpgart interface v0.103
[    6.883265] crash memory driver: version 1.1
[    6.888861] rdac: device handler registered
[    6.893934] hp_sw: device handler registered
[    6.899037] emc: device handler registered
[    6.904219] alua: device handler registered
[    6.909314] libphy: Fixed MDIO Bus: probed
[    6.919165] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.926807] ehci-pci: EHCI PCI platform driver
[    6.932571] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.938829] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.947664] ehci-pci 0000:00:1a.0: debug port 2
[    6.956996] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.969557] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.976400] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.984298] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.992904] usb usb1: Product: EHCI Host Controller
[    6.998675] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.007376] usb usb1: SerialNumber: 0000:00:1a.0
[    7.013073] hub 1-0:1.0: USB hub found
[    7.017581] hub 1-0:1.0: 2 ports detected
[    7.022949] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    7.029205] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    7.038030] ehci-pci 0000:00:1d.0: debug port 2
[    7.047349] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    7.059552] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    7.066370] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    7.074272] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.082872] usb usb2: Product: EHCI Host Controller
[    7.088635] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.097315] usb usb2: SerialNumber: 0000:00:1d.0
[    7.102985] hub 2-0:1.0: USB hub found
[    7.107489] hub 2-0:1.0: 2 ports detected
[    7.112523] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    7.119755] ohci-pci: OHCI PCI platform driver
[    7.125085] uhci_hcd: USB Universal Host Controller Interface driver
[    7.132672] usbcore: registered new interface driver usbserial_generic
[    7.140310] usbserial: USB Serial support registered for generic
[    7.147417] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    7.276681] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    8.200410] i8042: No controller found
[    8.204946] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    8.204971] Switched to clocksource tsc
[    8.205092] mousedev: PS/2 mouse device common for all mice
[    8.205306] rtc_cmos 00:01: RTC can wake from S4
[    8.205537] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    8.205593] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    8.205727] intel_pstate: Intel P-state driver initializing
[    8.221030] cpuidle: using governor menu
[    8.222570] hidraw: raw HID events driver (C) Jiri Kosina
[    8.222842] usbcore: registered new interface driver usbhid
[    8.222843] usbhid: USB HID core driver
[    8.223064] drop_monitor: Initializing network drop monitor service
[    8.223619] TCP: cubic registered
[    8.223638] Initializing XFRM netlink socket
[    8.224319] NET: Registered protocol family 10
[    8.225849] NET: Registered protocol family 17
[    8.225862] mpls_gso: MPLS GSO support
[    8.229145] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    8.229487] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    8.229730] Loading compiled-in X.509 certificates
[    8.230812] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    8.231855] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    8.232922] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: c7aec20a70554693bf19667e4c28ac12c728bbb2'
[    8.232960] registered taskstats version 1
[    8.237943] Key type trusted registered
[    8.242241] Key type encrypted registered
[    8.242390] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    8.244123]   Magic number: 14:294:525
[    8.244308] pci 0000:07:00.3: hash matches
[    8.244364] acpi device:119: hash matches
[    8.245336] rtc_cmos 00:01: setting system clock to 2018-12-11 09:30:36 UTC (1544520636)
[    8.368672] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    8.381050] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    8.381053] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.381365] hub 1-1:1.0: USB hub found
[    8.381429] hub 1-1:1.0: 6 ports detected
[    8.445252] Freeing unused kernel memory: 1876k freed
[    8.451646] Write protecting the kernel read-only data: 12288k
[    8.460170] Freeing unused kernel memory: 516k freed
[    8.467611] Freeing unused kernel memory: 600k freed
[    8.481456] random: systemd: uninitialized urandom read (16 bytes read)
[    8.482833] random: fast init done
[    8.493109] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    8.493113] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.493545] hub 2-1:1.0: USB hub found
[    8.493685] hub 2-1:1.0: 8 ports detected
[    8.523494] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.545932] systemd[1]: Detected architecture x86-64.
[    8.551904] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.567848] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.649932] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.662832] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.672810] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.683120] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.693943] systemd[1]: Created slice System Slice.
[ [32m  OK  [0m
[[32m  OK  [0m] Reached target Slices.
[    8.714878] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[    8.727889] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.740915] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.753800] systemd[1]: Reached target Sockets.
[[32m  OK  [0m] Reached target Sockets.
[    8.764679] systemd[1]: Starting Setup Virtual Console...
         Startin[    8.772725] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
g  Setup Virtual [    8.784748] systemd[1]: Starting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.804611] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    8.816646] systemd[1]: Starting dracut cmdline hook...
         Starting  dracut cmdline8] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Starting Create list of required  st... nodes foernel...
[    8.849311] systemd[1]: Started Apply Kernel Variables.
[ [32m  OK  [0m[     8.862213] ste list of required static device nodes for the current kernel.
[ [32m  OK  [0m sta...ce nodes for the current[    8.879581] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
 kernel.
[    8.888857] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.898474] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.898607] systemd[1]: Started Setup Virtual Console.
[    8.910958] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.910959] usb 2-1.4: SerialNumber: serial
[    8.912539] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
[[32m  OK  [0m] Started Setup V irtual Console.emd[1]: Started dracut cmdline hook.
[[32m  OK  [0m] Started dracut cmdline hook.
[    8.957151] systemd[1]: Started Journal Service.
[[32m  OK  [0m[    8.963101] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
] Started Journa[    8.983383] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
l Service.
[    8.999211] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
         Starting dracut pre-udev hook...
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
[[32m  OK  [0m] Reached target System Initialization.
         Starting Show Plymouth Boot Screen...
         Starting dracut initqueue hook...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Reached target Basic System.
[    9.237546] dca service started, version 1.12.1
[    9.243656] mlx_compat: loading out-of-tree module taints kernel.
[    9.251170] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    9.262964] pps_core: LinuxPPS API ver. 1 registered
[    9.268823] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    9.280437] Compat-mlnx-ofed backport release: b4fdfac
[    9.286492] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    9.294204] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    9.303517] PTP clock support registered
[    9.333087] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    9.341170] igb: Copyright (c) 2007-2014 Intel Corporation.
[    9.341792] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    9.341796] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    9.353618] scsi host0: ahci
[    9.353963] scsi host1: ahci
[    9.354351] scsi host2: ahci
[    9.355061] scsi host3: ahci
[    9.355938] scsi host4: ahci
[    9.356156] scsi host5: ahci
[    9.356274] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 38
%G[    9.356277] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 38
[    9.356280] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 38
[    9.356283] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 38
[    9.356286] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 38
[    9.356289] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 38
[    9.370416] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    9.370460] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.370477] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    9.370484] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    9.370488] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.370493] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.371236] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.373759] scsi host6: isci
[    9.414361] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    9.414414] mlx4_core: Initializing 0000:04:00.0
[    9.415371] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    9.452739] igb 0000:02:00.0: added PHC on eth0
[    9.452741] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.452743] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    9.452816] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    9.452818] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
%G[    9.453370] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.490243] igb 0000:02:00.1: added PHC on eth1
[    9.490245] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.490246] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.490319] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.490320] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.502468] [TTM] Zone  kernel: Available graphics memory: 16252602 kiB
[    9.502470] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.502471] [TTM] Initializing pool allocator
[    9.502489] [TTM] Initializing DMA pool allocator
[    9.545945] igb 0000:02:00.2: added PHC on eth2
[    9.545946] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.545948] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.546021] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.546022] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.574602] fbcon: mgadrmfb (fb0) is primary device
[    9.603000] igb 0000:02:00.3: added PHC on eth3
[    9.603002] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.603004] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.603076] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.603078] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.660884] ata2: SATA link down (SStatus 0 SControl 300)
[    9.661069] ata1: SATA link down (SStatus 0 SControl 300)
[    9.661886] ata3: SATA link down (SStatus 0 SControl 300)
[    9.664882] ata4: SATA link down (SStatus 0 SControl 300)
[    9.665076] ata5: SATA link down (SStatus 0 SControl 300)
[    9.666886] ata6: SATA link down (SStatus 0 SControl 300)
[    9.805966] Console: switching to colour frame buffer device 128x48
[    9.830652] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.878824] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   11.048630] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   11.055508] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   11.064415] ata7.00: configured for UDMA/133
[   11.081468] scsi 6:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.946930] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.954566] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.961983] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.969790] mlx4_core: device is working in RoCE mode: Roce V1
[   15.976902] mlx4_core: UD QP Gid type is: V1
[   17.042967] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   17.308546] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   17.320108] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   17.328604] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   17.488314] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   17.496269] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   17.506260] ata8.00: configured for UDMA/133
[   17.513590] scsi 6:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.570611] sd 6:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.570646] sd 6:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.570912] sd 6:0:1:0: [sdb] Write Protect is off
[   17.570999] sd 6:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.574581]  sdb:
[   17.575081] sd 6:0:1:0: [sdb] Attached SCSI disk
[   17.616383] sd 6:0:0:0: [sda] Write Protect is off
[   17.622727] sd 6:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.655281]  sda: sda1 sda2
[   17.660881] sd 6:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   18.407092] random: crng init done
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
         Mounting /sysroot...
[   18.676184] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped target Timers.
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target System Initialization.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped Create S[   19.175074] systemd-journald[286]: Received SIGTERM from PID 1 (systemd).
tatic Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Closed udev Kernel Socket.
[[32m  OK  [0m] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.493827] SELinux:  Disabled at runtime.
[   19.540583] type=1404 audit(1544520647.794:2): selinux=0 auid=4294967295 ses=4294967295
[   19.783186] ip_tables: (C) 2000-2006 Netfilter Core Team
[   19.791615] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
         Starting Availability of block devices...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
         Starting Replay Read-Ahead Data...
         Starting Kernel Module supporting RPCSEC_GSS...
         Mounting Debug File System...
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
         Starting Create list of required st... nodes for the current kernel...
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd Root File System.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
         Mounting Huge Pages File System...
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Listening on udev Control Socket.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
         Starting Create Static Device Nodes in /dev...
[   20.892865] RPC: Registered named UNIX socket transport module.
[   20.900872] RPC: Registered udp transport module.
[   20.907450] RPC: Registered tcp transport module.
[   20.913984] RPC: Registered tcp NFSv4.1 backchannel transport module.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[   21.119615] EXT4-fs (sda1): re-mounted. Opts: (null)
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started LVM2 metadata daemon.
         Starting udev Coldplug all Devices...
         Starting Configure read-only root support...
[   21.211247] systemd-journald[4363]: Received request to flush runtime journal from PID 1
         Starting Flush Journal to Persistent Storage...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
[   21.450788] device-mapper: uevent: version 1.0.3
[   21.457494] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[   21.597066] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   21.607865] i801_smbus 0000:07:00.3: Enabling SMBus device
[   21.615241] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   21.624351] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   21.632996] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.633670] igb 0000:02:00.0: DCA enabled
[   21.633703] igb 0000:02:00.1: DCA enabled
[   21.634480] igb 0000:02:00.2: DCA enabled
[   21.634511] igb 0000:02:00.3: DCA enabled
[   21.644531] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   21.668859] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[[32m  OK  [0m] Started Configure read-only root support.
[   21.691761] ipmi message handler version 39.2
[   21.694407] ipmi device interface
[   21.724533] IPMI System Interface driver.
[   21.724590] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   21.724592] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   21.724594] ipmi_si: Adding SMBIOS-specified kcs state machine
[   21.724639] ipmi_platform: probing via SPMI
[   21.724641] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   21.724643] (NULL device *): SPMI-specified kcs state machine: duplicate
[   21.724667] mpt2sas version 20.103.01.00 loaded
[   21.724716] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   21.724774] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[   21.725178] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32505204 kB)
[   21.843695] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   21.872753] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[   21.873864] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 168
[   21.873865] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 169
[   21.873866] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 170
[   21.873867] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 171
[   21.873868] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 172
[   21.873869] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 173
[   21.873869] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 174
[   21.873870] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 175
[   21.873871] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 176
[   21.873872] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 177
[   21.873873] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 178
[   21.873874] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 179
[   21.873875] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 180
[   21.873876] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 181
[   21.873877] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 182
[   21.873878] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 183
[   21.873880] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffa50a83cc0000), size(65536)
[   21.873881] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[   21.909202] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   21.935735] mpt2sas_cm0: sending message unit reset !!
[   21.937249] mpt2sas_cm0: message unit reset: SUCCESS
[   21.948143] sd 6:0:0:0: Attached scsi generic sg0 type 0
[   21.948240] sd 6:0:1:0: Attached scsi generic sg1 type 0
[   21.951605] IPMI SSIF Interface driver
[   21.952038] input: PC Speaker as /devices/platform/pcspkr/input/input3
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Found device /dev/ttyS0.
[   22.198440] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[   22.206887] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[   22.217894] mpt2sas_cm0: Scatter Gather Elements per IO(128)
%G[   22.243851] iTCO_vendor_support: vendor-support=0
[   22.245466] cryptd: max_cpu_qlen set to 1000
[   22.246592] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.246678] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.271658] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[   22.271660] mpt2sas_cm0: Protocol=(
[   22.271661] Initiator
[   22.271661] ,Target
[   22.271661] ), 
[   22.271662] Capabilities=(
[   22.271662] TLR
[   22.271663] ,EEDP
[   22.271663] ,Snapshot Buffer
[   22.271664] ,Diag Trace Buffer
[   22.271664] ,Task Set Full
[   22.271664] ,NCQ
[   22.271664] )
[   22.271712] scsi host7: Fusion MPT SAS Host
[   22.272113] mpt2sas_cm0: sending port enable !!
[   22.274715] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[   22.282757] mpt2sas_cm0: port enable: SUCCESS
[   22.283510] scsi 7:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.283515] scsi 7:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.283517] scsi 7:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.283520] scsi 7:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.307680] device-mapper: multipath round-robin: version 1.2.0 loaded
[   22.307706] AVX version of gcm_enc/dec engaged.
[   22.307707] AES CTR mode by8 optimization enabled
[   22.311276] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.311326] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.462367] kvm: disabled by bios
[   22.469642] intel_rapl: Found RAPL domain package
[   22.469645] intel_rapl: Found RAPL domain core
[   22.469651] intel_rapl: Found RAPL domain dram
[   22.469678] intel_rapl: Found RAPL domain package
[   22.469680] intel_rapl: Found RAPL domain core
[   22.469684] intel_rapl: Found RAPL domain dram
%G[   22.480897] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.481134] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.481135] EDAC sbridge:  Ver: 1.1.2 
[   22.581628] scsi 7:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.581634] scsi 7:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.581635] scsi 7:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.581639] scsi 7:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.731221] scsi 7:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.742113] scsi 7:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.755079] scsi 7:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.764263] scsi 7:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.812237] scsi 7:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.822446] scsi 7:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.835288] scsi 7:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.844354] scsi 7:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.875166] scsi 7:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   22.885011] scsi 7:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.898072] scsi 7:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.907394] scsi 7:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.933908] scsi 7:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.944171] scsi 7:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.957088] scsi 7:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.966296] scsi 7:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.992696] scsi 7:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.003435] scsi 7:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.016768] scsi 7:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.026412] scsi 7:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.049291] scsi 7:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.060056] scsi 7:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.073414] scsi 7:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.083132] scsi 7:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.111247] scsi 7:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.121866] scsi 7:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.135131] scsi 7:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.144594] scsi 7:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.167313] scsi 7:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   23.178148] scsi 7:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.191545] scsi 7:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.201248] scsi 7:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.233716] scsi 7:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   23.241227] sd 7:0:0:0: Attached scsi generic sg2 type 0
[   23.248815] sd 7:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.249431] scsi 7:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   23.249631] sd 7:0:0:1: Attached scsi generic sg3 type 0
[   23.249724] sd 7:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.250380] scsi 7:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   23.250521] sd 7:0:0:1: [sdd] Write Protect is off
[   23.250576] sd 7:0:0:2: Attached scsi generic sg4 type 0
[   23.250760] sd 7:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.250812] sd 7:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.251587] scsi 7:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   23.251788] sd 7:0:0:3: Attached scsi generic sg5 type 0
[   23.251929] sd 7:0:0:2: [sde] Write Protect is off
[   23.252034] sd 7:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.252100] sd 7:0:0:7: Attached scsi generic sg6 type 0
[   23.252335] sd 7:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.252450] sd 7:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.252684] scsi 7:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   23.252900] sd 7:0:1:0: Attached scsi generic sg7 type 0
[   23.252965] sd 7:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.253389] sd 7:0:0:3: [sdf] Write Protect is off
[   23.253715] sd 7:0:1:0: [sdh] Write Protect is off
[   23.253843] scsi 7:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   23.253848] sd 7:0:0:7: [sdg] Write Protect is off
[   23.253890] sd 7:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.254002] Dev sdd: unable to read RDB block 0
[   23.254010]  sdd: unable to read partition table
[   23.254015] sd 7:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.254136] sd 7:0:1:1: Attached scsi generic sg8 type 0
[   23.254405] sd 7:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.254513] sd 7:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.255077] scsi 7:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   23.255338] sd 7:0:1:2: Attached scsi generic sg9 type 0
[   23.255559] sd 7:0:1:1: [sdi] Write Protect is off
[   23.255782] sd 7:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.256087] sd 7:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.256527] scsi 7:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   23.256739] sd 7:0:1:3: Attached scsi generic sg10 type 0
[   23.256765] Dev sdf: unable to read RDB block 0
[   23.256778]  sdf: unable to read partition table
[   23.256788] Dev sdh: unable to read RDB block 0
[   23.256796]  sdh: unable to read partition table
[   23.257017] sd 7:0:1:7: Attached scsi generic sg11 type 0
[   23.257078] sd 7:0:1:2: [sdj] Write Protect is off
[   23.257198] sd 7:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.257449] sd 7:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.257487] sd 7:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.258420] sd 7:0:1:3: [sdk] Write Protect is off
[   23.258816] sd 7:0:1:7: [sdl] Write Protect is off
[   23.258954] sd 7:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.259590] sd 7:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.260897] sd 7:0:0:1: [sdd] Attached SCSI disk
[   23.260935] sd 7:0:0:3: [sdf] Attached SCSI disk
[   23.261030] sd 7:0:0:2: [sde] Attached SCSI disk
[   23.261329] Dev sdj: unable to read RDB block 0
[   23.261337]  sdj: unable to read partition table
[   23.261857] sd 7:0:1:0: [sdh] Attached SCSI disk
[   23.264204] sd 7:0:1:2: [sdj] Attached SCSI disk
[   23.264766] sd 7:0:1:3: [sdk] Attached SCSI disk
[   23.271023] sd 7:0:1:1: [sdi] Attached SCSI disk
[   23.306432] device-mapper: table: 253:1: multipath: error getting device
[   23.306433] device-mapper: ioctl: error adding target to table
[   23.445001]  sdg:
[   23.446282] sd 7:0:0:7: [sdg] Attached SCSI disk
[   23.605415]  sdl:
[   23.606632] sd 7:0:1:7: [sdl] Attached SCSI disk
[   23.733248] sd 7:0:0:0: [sdc] Write Protect is off
[   23.740538] sd 7:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.755157] sd 7:0:0:0: [sdc] Attached SCSI disk
[   23.813984] blk_update_request: I/O error, dev sdf, sector 0
[   23.814013] blk_update_request: I/O error, dev sdh, sector 0
[   23.814790] blk_update_request: I/O error, dev sdj, sector 0
[   23.815219] blk_update_request: I/O error, dev sdd, sector 0
[   23.818139] blk_update_request: I/O error, dev sdh, sector 0
[   23.819557] blk_update_request: I/O error, dev sdj, sector 0
[   23.819718] blk_update_request: I/O error, dev sdd, sector 0
[   23.822325] blk_update_request: I/O error, dev sdh, sector 0
[   23.823825] blk_update_request: I/O error, dev sdj, sector 0
[   23.824031] blk_update_request: I/O error, dev sdd, sector 0
[   23.904665] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   24.343756] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.353837] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Import network configuration from initramfs...
         Starting Preprocess NFS configuration...
         Starting Tell Plymouth To Write Out Runtime Data...
[[32m  OK  [0m] Started Import network configuration from initramfs.
[[32m  OK  [0m] Started Preprocess NFS configuration.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...[   24.601833] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS

[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Starting Security Auditing Service...
         Mounting RPC Pipe File System...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   24.955659] type=1305 audit(1544520653.208:3): audit_pid=9040 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting Load CPU microcode update...
         Starting Machine Check Exception Logging Daemon...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting NTP client/server...
         Starting Authorization Manager...
         Starting GSSAPI Proxy Daemon...
         Starting System Security Services Daemon...
         Starting Dump dmesg to /var/log/dmesg...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[   26.253481] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[   26.343597] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   26.432105] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   26.432657] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   26.442705] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.523885] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.531081] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   26.544488] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.560282] card: mlx4_0, QP: 0x220, inline size: 120
[   26.665585] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.678623] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.681821] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
[   26.804301] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.816283] ib0: enabling connected mode will cause multicast packet drops
[   26.824864] ib0: mtu > 4092 will cause multicast packet drops.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[   26.883395] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.902775] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.914080] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   26.933029] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   34.297890] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.344811] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.355547] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting MUNGE authentication service...
         Starting Dynamic System Tuning Daemon...
         Starting Postfix Mail Transport Agent...[   34.550336] FS-Cache: Loaded

         Starting OpenSSH server daemon...
[[32m  OK  [0m] Reached target Network is Online.
[   34.585974] FS-Cache: Netfs 'nfs' registered for caching
[   34.590010] Key type dns_resolver registered
[   34.621026] NFS: Registering the id_resolver key type
[   34.621031] Key type id_resolver registered
[   34.621032] Key type id_legacy registered
         Mounting /scratch...
         Starting System Logging Service...
         Starting Notify NFS peers of a restart...
         Starting NFS status monitor for NFSv2/3 locking....
         Starting Xinetd A Powerful Replacement For Inetd...
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Automounts filesystems on demand...
         Starting Crash recovery kernel arming...
         Starting Permit User Sessions...
[[32m  OK  [0m] Started Permit User Sessions.
[[32m  OK  [0m] Started Command Scheduler.
         Starting Terminate Plymouth Boot Screen...
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Job spooling tools.
[   37.531147] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   37.541080] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   38.205891] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   38.216054] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   38.845109] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   38.855279] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   39.476870] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   39.487022] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   40.083577] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-11T09:31:15+00:00] INFO: Forking chef instance to converge...
[2018-12-11T09:31:15+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-11T09:31:15+00:00] INFO: Chef-client pid: 10796
[2018-12-11T09:31:16+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-11T09:31:16+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-11T09:31:16+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-11T09:31:16+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-11T09:31:16+00:00] INFO: Running start handlers
[2018-12-11T09:31:16+00:00] INFO: Start handlers complete.
[2018-12-11T09:31:17+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-11T09:31:17+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T09:31:17+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T09:31:17+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-11T09:31:17+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181211093117.612604
[2018-12-11T09:31:17+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181210234509.969383
[2018-12-11T09:31:17+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-11T09:31:17+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-11T09:31:22+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-11T09:31:22+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-11T09:31:22+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-11T09:31:22+00:00] INFO: service[ntpd] started
[2018-12-11T09:31:22+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-11T09:31:23+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-11T09:31:23+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-11T09:31:23+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-11T09:31:23+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-11T09:31:23+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-11T09:31:23+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-11T09:31:23+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-11T09:31:23+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-11T09:31:23+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-11T09:31:24+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-11T09:31:24+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-11T09:31:24+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-11T09:31:24+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:24+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:24+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-11T09:31:24+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-11T09:31:25+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-11T09:31:25+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-11T09:31:25+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-11T09:31:25+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-11T09:31:25+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-11T09:31:25+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-11T09:31:25+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-11T09:31:25+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-11T09:31:25+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-11T09:31:25+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-11T09:31:26+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-11T09:31:26+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-11T09:31:26+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-11T09:31:26+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-11T09:31:27+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-11T09:31:27+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-11T09:31:27+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-11T09:31:27+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-11T09:31:27+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-11T09:31:27+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-11T09:31:27+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-11T09:31:27+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-11T09:31:27+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-11T09:31:28+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[   60.287546] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[2018-12-11T09:31:28+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-11T09:31:28+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-11T09:31:28+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-11T09:31:28+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211093128.595559
[2018-12-11T09:31:28+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181210234523.046765
[2018-12-11T09:31:28+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-11T09:31:28+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-11T09:31:28+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-11T09:31:28+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211093128.602624
[2018-12-11T09:31:28+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181210234523.054073
[2018-12-11T09:31:28+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-11T09:31:28+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-11T09:31:28+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-11T09:31:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:28+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-11T09:31:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:28+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-11T09:31:28+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-11T09:31:28+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-11T09:31:28+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-11T09:31:28+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T09:31:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:28+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T09:31:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:28+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T09:31:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:28+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T09:31:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:28+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T09:31:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:28+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T09:31:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:28+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:28+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T09:31:28+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:29+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:29+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T09:31:29+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:29+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:29+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-11T09:31:29+00:00] INFO: service[xinetd] started
[2018-12-11T09:31:29+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-11T09:31:29+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-11T09:31:29+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-11T09:31:29+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-11T09:31:30+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-11T09:31:30+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-11T09:31:30+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-11T09:31:30+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-11T09:31:30+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181211093130.690286
[2018-12-11T09:31:30+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181210234525.463045
[2018-12-11T09:31:30+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-11T09:31:30+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-11T09:31:30+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-11T09:31:30+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-11T09:31:30+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-11T09:31:30+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:30+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:30+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-11T09:31:30+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-11T09:31:30+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-11T09:31:30+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-11T09:31:30+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-11T09:31:30+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:30+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:30+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-11T09:31:30+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:30+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-11T09:31:30+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-11T09:31:31+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:31+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:31+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:31+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:31+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:31+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:31+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:31+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:31+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:31+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T09:31:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T09:31:31+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-11T09:31:31+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-11T09:31:31+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-11T09:31:31+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-11T09:31:31+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-11T09:31:31+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-11T09:31:31+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-11T09:31:32+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-11T09:31:32+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-11T09:31:33+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-11T09:31:33+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-11T09:31:33+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-11T09:31:33+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-11T09:31:33+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-11T09:31:33+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-11T09:31:33+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-11T09:31:33+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-11T09:31:33+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-11T09:31:33+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-11T09:31:33+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-11T09:31:33+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-11T09:31:33+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-11T09:31:33+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-11T09:31:33+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-11T09:31:33+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-11T09:31:33+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-11T09:31:33+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-11T09:31:33+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-11T09:31:34+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-11T09:31:34+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-11T09:31:34+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-11T09:31:34+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-11T09:31:34+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[2018-12-11T09:31:37+00:00] INFO: service[kdump] restarted
[2018-12-11T09:31:37+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-11T09:31:37+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-11T09:31:37+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-11T09:31:37+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-11T09:31:37+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-11T09:31:37+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-11T09:31:37+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-11T09:31:37+00:00] INFO: Chef Run complete in 20.417497576 seconds
[2018-12-11T09:31:37+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-11T09:31:37+00:00] INFO: Running report handlers
[2018-12-11T09:31:37+00:00] INFO: Creating JSON run report
[2018-12-11T09:31:37+00:00] INFO: Report handlers complete
[  214.774161] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  214.785060] alg: No test for adler32 (adler32-zlib)
[  215.632090] Lustre: Lustre: Build Version: 2.10.6_RC3
[  215.866655] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  216.603888] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  217.523860] Lustre: MGS: Connection restored to 37203529-9f06-3161-bce0-a446d8d5cb52 (at 0@lo)
[  217.945374] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  218.650245] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect
[  218.661025] Lustre: soaked-MDT0000: Connection restored to e4766e54-8480-0b3f-b947-f19131a37234 (at 192.168.1.118@o2ib)
[  221.665238] Lustre: soaked-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[  223.844532] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[  223.854943] Lustre: Skipped 1 previous similar message
[  228.686788] Lustre: soaked-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[  228.697243] Lustre: Skipped 3 previous similar messages
[  238.081872] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[  238.092303] Lustre: Skipped 11 previous similar messages
[  254.172063] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[  254.181409] Lustre: Skipped 31 previous similar messages
[  260.119295] Lustre: soaked-MDT0000: Recovery over after 0:41, of 29 clients 29 recovered and 0 were evicted.
[  479.870294] LustreError: 12445:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[  688.728497] LustreError: 12400:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[  688.739254] LustreError: 12400:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[  690.525650] LustreError: 12294:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[  690.536456] LustreError: 12294:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[  708.753029] LustreError: 12397:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[  708.763826] LustreError: 12397:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[  817.334692] LustreError: 12440:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[  825.874550] LustreError: 12397:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[  825.885286] LustreError: 12397:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[  843.416521] LustreError: 12396:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[  843.427278] LustreError: 12396:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[  879.256910] LustreError: 12295:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[  879.267671] LustreError: 12295:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 7 previous similar messages
[  997.130277] LustreError: 12446:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[  997.141009] LustreError: 12446:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 11 previous similar messages
[ 1127.770734] LustreError: 12446:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 1127.781512] LustreError: 12446:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 54 previous similar messages
[ 1669.467698] LustreError: 12445:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 1669.478454] LustreError: 12445:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 48 previous similar messages
[ 1834.046043] Lustre: 12295:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 1911.896251] Lustre: 12213:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544522532/real 0]  req@ffff8b1ca5c35700 x1619547530911808/t0(0) o13->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544522539 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 1911.934035] Lustre: soaked-OST000b-osc-MDT0000: Connection to soaked-OST000b (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1913.232328] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544522534/real 0]  req@ffff8b20b5ee6000 x1619547530927872/t0(0) o13->soaked-OST0003-osc-MDT0000@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544522541 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 1913.267545] Lustre: soaked-OST0003-osc-MDT0000: Connection to soaked-OST0003 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1915.040374] Lustre: 12215:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544522535/real 0]  req@ffff8b1ca6eaec00 x1619547530944432/t0(0) o13->soaked-OST000f-osc-MDT0000@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544522542 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 1915.078726] Lustre: 12215:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 1915.092195] Lustre: soaked-OST000f-osc-MDT0000: Connection to soaked-OST000f (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1915.115755] Lustre: Skipped 1 previous similar message
[ 1918.123441] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544522539/real 0]  req@ffff8b1ca79f6000 x1619547530962288/t0(0) o8->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544522545 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 1965.125170] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544522592/real 1544522592]  req@ffff8b1ca6a71800 x1619547532096912/t0(0) o8->soaked-OST000f-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544522603 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 1965.166170] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 2015.126641] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544522642/real 1544522642]  req@ffff8b1ca69b0600 x1619547532235760/t0(0) o8->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544522658 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 2015.167794] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 2065.128152] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544522692/real 1544522692]  req@ffff8b1ca62c9500 x1619547532293328/t0(0) o8->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544522713 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 2065.169367] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 2108.857331] Lustre: MGS: haven't heard from client 29c54722-b7b4-0a38-f6fc-9a12ae3f418a (at 192.168.1.107@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff8b1cad114400, cur 1544522736 expire 1544522586 last 1544522509
[ 2115.129452] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544522742/real 1544522742]  req@ffff8b1ca62ca100 x1619547532316912/t0(0) o8->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544522768 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 2115.171906] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 2196.131359] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544522792/real 0]  req@ffff8b1ca62cd400 x1619547532319120/t0(0) o8->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544522823 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2196.172941] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 2215.911925] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 2 seconds
[ 2316.914689] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 3 seconds
[ 2316.929793] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 3 previous similar messages
[ 2406.137163] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544522992/real 0]  req@ffff8b1ca62d4500 x1619547532327680/t0(0) o8->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544523033 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 2406.179244] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[ 2417.917517] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 4 seconds
[ 2417.932659] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 3 previous similar messages
[ 2440.835795] Lustre: MGS: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 2440.848784] Lustre: Skipped 30 previous similar messages
[ 2441.293725] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2441.309976] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 2441.322009] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST000b_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client[ 2446.850554] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2446.870275] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline

[ 2446.882287] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0003_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client[ 2451.819313] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2451.839144] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 2451.851197] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST000f_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client
[ 2456.845638] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2456.865322] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 2456.877053] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0007_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client[ 2476.108232] Lustre: soaked-OST000f-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 2481.854126] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2481.881147] LustreError: Skipped 3 previous similar messages
[ 2485.814870] Lustre: soaked-OST000b-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 2506.854422] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2506.868711] Lustre: Skipped 1 previous similar message
[ 2531.855154] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2531.878050] LustreError: Skipped 1 previous similar message

[ 2556.855975] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2556.874960] Lustre: Skipped 3 previous similar messages
[ 2556.879233] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2579.325873] LustreError: 12296:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 2579.339374] LustreError: 12296:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 13 previous similar messages
[ 2581.857711] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2581.857853] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2581.898195] LustreError: Skipped 2 previous similar messages
[ 2631.859076] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2631.859103] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2631.898038] Lustre: Skipped 3 previous similar messages
[ 2681.860634] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2681.887547] LustreError: Skipped 6 previous similar messages
[ 2706.861231] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2706.861233] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2706.861239] Lustre: Skipped 4 previous similar messages
[ 2706.902602] Lustre: Skipped 1 previous similar message
[ 2731.861947] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2731.886967] LustreError: Skipped 3 previous similar messages
[ 2781.864499] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2781.889924] LustreError: Skipped 3 previous similar messages
[ 2881.867414] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2881.892184] LustreError: Skipped 5 previous similar messages
[ 2981.870420] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2981.885755] Lustre: Skipped 19 previous similar messages
[ 3031.871724] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 3031.896161] LustreError: Skipped 11 previous similar messages
[ 3211.833036] Lustre: 12216:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544523815/real 1544523839]  req@ffff8b1ca5b28f00 x1619547551297440/t0(0) o103->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:17/18 lens 328/224 e 0 to 1 dl 1544523859 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 3211.833072] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 3211.901458] Lustre: 12216:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 138 previous similar messages
[ 3306.879758] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 3306.906414] LustreError: Skipped 21 previous similar messages
[ 3383.345775] LNet: Service thread pid 12484 was inactive for 200.36s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[ 3383.370999] Pid: 12484, comm: mdt00_018 3.10.0-957.el7_lustre.x86_64 #1 SMP Fri Nov 30 18:46:05 UTC 2018
[ 3383.385039] Call Trace:
[ 3383.390889]  [<ffffffffc104c150>] ptlrpc_set_wait+0x4c0/0x920 [ptlrpc]
[ 3383.401440]  [<ffffffffc104c62d>] ptlrpc_queue_wait+0x7d/0x220 [ptlrpc]
[ 3383.411838]  [<ffffffffc16b6193>] osp_remote_sync+0xd3/0x200 [osp]
[ 3383.421435]  [<ffffffffc16b2b40>] osp_md_index_lookup+0x2f0/0x830 [osp]
[ 3383.431298]  [<ffffffffc15daf6b>] lod_lookup+0x2b/0x40 [lod]
[ 3383.440161]  [<ffffffffc1642902>] __mdd_lookup.isra.17+0x272/0x450 [mdd]
[ 3383.449942]  [<ffffffffc1642b8f>] mdd_lookup+0xaf/0x170 [mdd]
[ 3383.458512]  [<ffffffffc150c382>] mdt_lookup_version_check+0x72/0x2f0 [mdt]
[ 3383.468398]  [<ffffffffc1510d4f>] mdt_reint_unlink+0x23f/0x11d0 [mdt]
[ 3383.477564]  [<ffffffffc1514b43>] mdt_reint_rec+0x83/0x210 [mdt]
[ 3383.486127]  [<ffffffffc14f637b>] mdt_reint_internal+0x5fb/0x9c0 [mdt]
[ 3383.495241]  [<ffffffffc1501f17>] mdt_reint+0x67/0x140 [mdt]
[ 3383.503263]  [<ffffffffc10bc42a>] tgt_request_handle+0x92a/0x1370 [ptlrpc]
[ 3383.512682]  [<ffffffffc1064e5b>] ptlrpc_server_handle_request+0x23b/0xaa0 [ptlrpc]
[ 3383.522860]  [<ffffffffc10685a2>] ptlrpc_main+0xa92/0x1e40 [ptlrpc]
[ 3383.531402]  [<ffffffffbacc1c31>] kthread+0xd1/0xe0
[ 3383.538277]  [<ffffffffbb374c37>] ret_from_fork_nospec_end+0x0/0x39
[ 3383.546685]  [<ffffffffffffffff>] 0xffffffffffffffff
[ 3383.553643] LustreError: dumping log to /tmp/lustre-log.1544524011.12484
[ 3401.311828] Lustre: MGS: haven't heard from client 2e8e5f5b-5e07-b8ca-fceb-eb3dad5c8e14 (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff8b1cea6eb400, cur 1544524029 expire 1544523879 last 1544523802
[ 3409.306125] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff8b1cae6ba400, cur 1544524037 expire 1544523887 last 1544523810
[ 3466.947138] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 5 seconds
[ 3466.961534] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 3 previous similar messages
[ 3506.885329] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 3506.900875] Lustre: Skipped 42 previous similar messages
[ 3567.949997] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 8 seconds
[ 3668.952846] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 9 seconds
[ 3736.118368] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 3736.130455] Lustre: Skipped 2 previous similar messages
[ 3736.613973] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 3736.624977] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0003_UUID (at 192.168.1.111@o2ib) because it is indicating it is a new client[ 3752.848226] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544524339/real 1544524339]  req@ffff8b20ac320900 x1619547551337552/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544524380 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
[ 3752.888631] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 12 previous similar messages
[ 3778.012939] Lustre: 12401:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
[ 3778.012939]   req@ffff8b20c0c9b000 x1619486055083840/t0(0) o36->b35e0c93-4783-ff00-6ac2-902ea529f1e0@192.168.1.126@o2ib:525/0 lens 624/3128 e 23 to 0 dl 1544524410 ref 2 fl Interpret:/0/0 rc 0/0
[ 3784.015517] Lustre: soaked-MDT0000: Client b35e0c93-4783-ff00-6ac2-902ea529f1e0 (at 192.168.1.126@o2ib) reconnecting
[ 3784.030180] Lustre: soaked-MDT0000: Connection restored to 8b6778b0-2e9f-bb0d-68b8-dce001b836e5 (at 192.168.1.126@o2ib)
[ 3784.045051] Lustre: Skipped 1 previous similar message
[ 3831.895639] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 3831.921113] LustreError: Skipped 42 previous similar messages
[ 4131.904146] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 4131.919910] Lustre: Skipped 56 previous similar messages
[ 4385.177771] Lustre: soaked-MDT0000: Client b35e0c93-4783-ff00-6ac2-902ea529f1e0 (at 192.168.1.126@o2ib) reconnecting
[ 4385.192568] Lustre: soaked-MDT0000: Connection restored to 8b6778b0-2e9f-bb0d-68b8-dce001b836e5 (at 192.168.1.126@o2ib)
[ 4456.913516] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4456.939452] LustreError: Skipped 47 previous similar messages
[ 4486.636093] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 4517.000326] LustreError: 11-0: soaked-MDT0003-osp-MDT0000: operation out_update to node 192.168.1.111@o2ib failed: rc = -107
[ 4536.885576] LustreError: 167-0: soaked-MDT0003-osp-MDT0000: This client was evicted by soaked-MDT0003; in progress operations using this service will fail.
[ 4536.907994] Lustre: 12484:0:(service.c:2114:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (600:754s); client may timeout.  req@ffff8b20c0c9b000 x1619486055083840/t0(0) o36->b35e0c93-4783-ff00-6ac2-902ea529f1e0@192.168.1.126@o2ib:525/0 lens 624/424 e 23 to 0 dl 1544524410 ref 1 fl Complete:/0/0 rc -5/-5
[ 4536.915092] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 4536.965782] LNet: Service thread pid 12484 completed after 1353.95s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
[ 4541.956802] LustreError: 12374:0:(llog_cat.c:795:llog_cat_cancel_records()) soaked-MDT0003-osp-MDT0000: fail to cancel 1 of 1 llog-records: rc = -116
[ 4656.918883] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 4731.922078] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 4731.938383] Lustre: Skipped 53 previous similar messages
[ 4756.922796] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 4756.936690] Lustre: Skipped 1 previous similar message
[ 5056.932564] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 5056.959573] LustreError: Skipped 45 previous similar messages
[ 5433.698931] Lustre: 12461:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 7023.439628] Lustre: 12208:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544527644/real 0]  req@ffff8b1c9a03a400 x1619547622432240/t0(0) o13->soaked-OST0006-osc-MDT0000@192.168.1.106@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544527651 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 7023.481939] Lustre: soaked-OST0006-osc-MDT0000: Connection to soaked-OST0006 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7025.278691] Lustre: soaked-OST0002-osc-MDT0000: Connection to soaked-OST0002 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7125.443071] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544527753/real 1544527753]  req@ffff8b20c809dd00 x1619547622629104/t0(0) o8->soaked-OST000e-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544527769 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 7125.486691] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 35 previous similar messages
[ 7220.588444] Lustre: MGS: haven't heard from client ff940d05-485e-ff7a-e019-350100ba4ce5 (at 192.168.1.106@o2ib) in 230 seconds. I think it's dead, and I am evicting it. exp ffff8b1cecca3c00, cur 1544527848 expire 1544527698 last 1544527618
[ 7276.053991] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 7276.074818] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 7276.088908] Lustre: Skipped 1 previous similar message
[ 7279.055990] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 53 seconds
[ 7279.071431] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544527903/real 1544527906]  req@ffff8b20c809ef00 x1619547622635680/t0(0) o8->soaked-OST000e-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544527934 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 7279.114983] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
[ 7297.799788] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 7297.820814] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 7317.057080] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 0 seconds
[ 7318.258607] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 7329.057410] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 3 seconds
[ 7329.074928] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[ 7338.811084] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 7338.831505] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 7338.845367] Lustre: Skipped 1 previous similar message
[ 7380.058825] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 1 seconds
[ 7404.155856] Lustre: soaked-OST000e-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 7404.171099] Lustre: Skipped 3 previous similar messages
[ 7419.347788] LustreError: 11-0: soaked-OST0002-osc-MDT0000: operation ost_destroy to node 192.168.1.107@o2ib failed: rc = -19
[ 7419.348406] Lustre: soaked-OST0002-osc-MDT0000: Connection to soaked-OST0002 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7419.348408] Lustre: Skipped 2 previous similar messages
[ 7419.391712] LustreError: Skipped 5 previous similar messages
[ 7443.438053] LustreError: 11-0: soaked-OST000a-osc-MDT0000: operation ost_create to node 192.168.1.107@o2ib failed: rc = -107
[ 7443.454466] Lustre: soaked-OST000a-osc-MDT0000: Connection to soaked-OST000a (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7443.478571] LustreError: 12357:0:(osp_precreate.c:642:osp_precreate_send()) soaked-OST000a-osc-MDT0000: can't precreate: rc = -107
[ 7449.205953] LustreError: 11-0: soaked-OST0006-osc-MDT0000: operation ost_create to node 192.168.1.107@o2ib failed: rc = -107
[ 7449.222117] Lustre: soaked-OST0006-osc-MDT0000: Connection to soaked-OST0006 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7449.246783] LustreError: 12349:0:(osp_precreate.c:642:osp_precreate_send()) soaked-OST0006-osc-MDT0000: can't precreate: rc = -107
[ 7459.270438] LustreError: 11-0: soaked-OST000e-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[ 7459.286928] Lustre: soaked-OST000e-osc-MDT0000: Connection to soaked-OST000e (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 9034.358421] Lustre: 12399:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 9571.528813] LustreError: 12462:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 9571.542867] LustreError: 12462:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[ 9915.613382] LustreError: 13093:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 9915.625805] LustreError: 13093:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 7 previous similar messages
[10264.177417] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544530882/real 0]  req@ffff8b20cd4c6000 x1619547654906288/t0(0) o400->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544530889 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[10264.219282] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
[10264.233729] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[10279.028204] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[10279.055117] LustreError: Skipped 25 previous similar messages
[10314.260327] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544530941/real 1544530941]  req@ffff8b20c666aa00 x1619547654911312/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544530952 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[10314.303543] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[10371.442943] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.111@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[10371.469811] LustreError: Skipped 87 previous similar messages
[10414.263211] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544531041/real 1544531041]  req@ffff8b20c666a400 x1619547654916752/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544531062 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[10414.306435] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[10433.477846] sd 7:0:1:1: [sdi] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[10433.490086] sd 7:0:1:1: [sdi] Sense Key : Illegal Request [current] 
[10433.500711] sd 7:0:1:1: [sdi] <<vendor>>ASC=0x94 ASCQ=0x1 
[10433.510314] sd 7:0:1:1: [sdi] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00
[10433.523202] blk_update_request: 14 callbacks suppressed
[10433.532448] blk_update_request: I/O error, dev sdi, sector 11608952
[10433.543178] device-mapper: multipath: Failing path 8:128.
[10434.581919] sd 7:0:0:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[10434.581932] sd 7:0:0:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[10434.581942] sd 7:0:0:1: [sdd] Sense Key : Illegal Request [current] 
[10434.581950] sd 7:0:0:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[10434.581956] sd 7:0:0:1: [sdd] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00
[10434.581959] blk_update_request: I/O error, dev sdd, sector 6986547072
[10434.581974] device-mapper: multipath: Failing path 8:48.
[10434.657796] sd 7:0:0:1: [sdd] Sense Key : Illegal Request [current] 
[10434.668056] sd 7:0:0:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[10434.677304] sd 7:0:0:1: [sdd] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00
[10434.689787] blk_update_request: I/O error, dev sdd, sector 11608952
[10437.699141] device-mapper: multipath: Reinstating path 8:128.
[10438.709733] device-mapper: multipath: Reinstating path 8:48.
[10451.681804] Lustre: MGS: haven't heard from client d8083e10-a279-1469-8f6a-f4d5bd075af0 (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff8b1cea6e8000, cur 1544531079 expire 1544530929 last 1544530852
[10472.243248] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff8b1cae6ba000, cur 1544531099 expire 1544530949 last 1544530872
[10522.117781] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.142@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[10522.143568] LustreError: Skipped 117 previous similar messages
[10531.137255] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[10531.149502] Lustre: Skipped 9 previous similar messages
[10543.901097] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.109@o2ib, removing former export from same NID
[10543.916510] Lustre: Skipped 4 previous similar messages
[10543.925268] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline

[10543.936748] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0001_UUID (at 192.168.1.109@o2ib) because it is indicating it is a new client[10570.267138] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544531166/real 1544531166]  req@ffff8b20c666f200 x1619547654923536/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544531197 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
[10570.307980] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[10643.903911] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.109@o2ib, removing former export from same NID
[10643.919543] Lustre: Skipped 1 previous similar message
[10843.910121] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.109@o2ib, removing former export from same NID
[10843.925765] Lustre: Skipped 3 previous similar messages
[11143.919752] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.109@o2ib, removing former export from same NID
[11143.935364] Lustre: Skipped 5 previous similar messages
[11620.297224] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544532241/real 0]  req@ffff8b208250c800 x1619547654982256/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544532247 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[11639.298113] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[11639.322581] LustreError: Skipped 23 previous similar messages
[11664.298992] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544532291/real 1544532291]  req@ffff8b208250b600 x1619547654984976/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544532302 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[11677.005071] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.127@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11677.031320] LustreError: Skipped 31 previous similar messages
[11754.069475] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11754.095954] LustreError: Skipped 67 previous similar messages
[11764.301811] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544532391/real 1544532391]  req@ffff8b208250a700 x1619547654990416/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544532412 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[11764.344717] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[11808.981044] LDISKFS-fs warning (device dm-4): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[11808.981044] 
[11820.653787] Lustre: MGS: haven't heard from client 2da682a2-3411-9938-b06a-8e6d4a78d762 (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff8b1caab45800, cur 1544532448 expire 1544532298 last 1544532221
[11851.432889] LDISKFS-fs (dm-4): recovery complete
[11851.440099] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[11852.389301] Lustre: soaked-MDT0000: Received LWP connection from 0@lo, removing former export from 192.168.1.109@o2ib
[11852.404744] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[11852.416320] Lustre: Skipped 2 previous similar messages
[11852.426299] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900
[11852.471942] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[11852.751161] LustreError: 13446:0:(llog_osd.c:978:llog_osd_next_block()) soaked-MDT0003-osp-MDT0001: missed desired record? 3 > 1
[11852.767371] LustreError: 13446:0:(lod_dev.c:419:lod_sub_recovery_thread()) soaked-MDT0003-osp-MDT0001 getting update log failed: rc = -2
[11854.072143] Lustre: soaked-MDT0001: Denying connection for new client f3a3e702-a107-eabf-3cee-2496a5fe405a(at 192.168.1.117@o2ib), waiting for 1 known clients (0 recovered, 0 in progress, and 0 evicted) to recover in 21116729:59
[11858.363376] Lustre: soaked-MDT0001: Denying connection for new client 5818e001-8bba-2aca-aa3b-47d99abbf51d(at 192.168.1.135@o2ib), waiting for 1 known clients (0 recovered, 0 in progress, and 0 evicted) to recover in 21116729:54
[11859.828551] Lustre: soaked-MDT0001: Denying connection for new client f3a3e702-a107-eabf-3cee-2496a5fe405a(at 192.168.1.117@o2ib), waiting for 1 known clients (0 recovered, 0 in progress, and 0 evicted) to recover in 21116729:53
[11859.858572] Lustre: Skipped 2 previous similar messages
[11862.187205] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 6 seconds
[11862.488311] Lustre: soaked-MDT0001: Denying connection for new client 3781f263-0251-bf98-d2df-92da202d509f(at 192.168.1.143@o2ib), waiting for 1 known clients (0 recovered, 0 in progress, and 0 evicted) to recover in 21116729:50
[11862.518295] Lustre: Skipped 2 previous similar messages
[11869.253670] Lustre: soaked-MDT0001: Denying connection for new client ae2213f0-99c9-30d3-1cb6-ec3869aa24bf(at 192.168.1.120@o2ib), waiting for 1 known clients (0 recovered, 0 in progress, and 0 evicted) to recover in 21116729:43
[11869.283705] Lustre: Skipped 2 previous similar messages
[11877.424882] Lustre: soaked-MDT0001: Denying connection for new client soaked-MDT0000-mdtlov_UUID(at 0@lo), waiting for 1 known clients (0 recovered, 0 in progress, and 0 evicted) to recover in 21116729:35
[11877.452571] Lustre: Skipped 5 previous similar messages
[11880.447022] Lustre: soaked-MDT0001: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[11880.460985] Lustre: Skipped 1 previous similar message
[11894.254542] Lustre: soaked-MDT0001: Denying connection for new client ae2213f0-99c9-30d3-1cb6-ec3869aa24bf(at 192.168.1.120@o2ib), waiting for 1 known clients (0 recovered, 0 in progress, and 0 evicted) to recover in 21116729:18
[11894.284536] Lustre: Skipped 13 previous similar messages
[11898.800464] Lustre: soaked-MDT0001: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[11898.800466] Lustre: soaked-MDT0001: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[11898.828252] Lustre: Skipped 2 previous similar messages
[11909.167534] Lustre: 13447:0:(ldlm_lib.c:2059:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[11909.183746] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[11915.431711] Lustre: soaked-MDT0001: Connection restored to f0d31e14-b434-b249-2841-12a020ff2dc3 (at 192.168.1.130@o2ib)
[11915.447336] Lustre: Skipped 20 previous similar messages
[11916.651946] Lustre: Failing over soaked-MDT0001
[11916.876401] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.131@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11916.902603] LustreError: Skipped 76 previous similar messages
[11917.178182] Lustre: server umount soaked-MDT0001 complete
[11952.427544] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[11952.454819] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[11952.469910] Lustre: Skipped 3 previous similar messages
[11958.350477] LustreError: 12400:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[11958.364336] LustreError: 12400:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 5 previous similar messages
[12022.522740] Lustre: 12236:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544532643/real 0]  req@ffff8b20cde32100 x1619547655427520/t0(0) o13->soaked-OST0001-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544532650 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[12022.564052] Lustre: 12236:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[12022.578316] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[12232.813355] Lustre: MGS: haven't heard from client b3271786-e741-789d-5a29-7a0e38baab16 (at 192.168.1.105@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff8b1972e0c400, cur 1544532860 expire 1544532710 last 1544532632
[12297.307931] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[12297.327908] Lustre: Skipped 1 previous similar message
[12297.337178] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[12316.200181] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 10 seconds
[12325.513694] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[12329.200602] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 8 seconds
[12361.765795] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[12390.218279] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544532981/real 0]  req@ffff8b20a7296c00 x1619547655443568/t0(0) o8->soaked-OST0005-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544533017 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[12390.259517] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 57 previous similar messages
[12393.187812] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[12404.202694] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 2 seconds
[12404.217622] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[12425.875161] Lustre: soaked-OST0005-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[12425.890092] Lustre: Skipped 5 previous similar messages
[12475.430132] LustreError: 11-0: soaked-OST0009-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[12475.445917] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[12475.471534] Lustre: Skipped 3 previous similar messages
[12493.334704] LustreError: 11-0: soaked-OST0001-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[12493.350839] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[12496.006844] LustreError: 11-0: soaked-OST0005-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[12496.022976] Lustre: soaked-OST0005-osc-MDT0000: Connection to soaked-OST0005 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[12506.631123] LustreError: 11-0: soaked-OST000d-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[12506.647325] Lustre: soaked-OST000d-osc-MDT0000: Connection to soaked-OST000d (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[12556.541030] LustreError: 12394:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[12556.554896] LustreError: 12394:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 14 previous similar messages
[12589.765282] perf: interrupt took too long (2517 > 2500), lowering kernel.perf_event_max_sample_rate to 79000
[12634.013233] Lustre: 13206:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[13465.242750] LustreError: 12294:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[14511.524072] Lustre: 12232:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544535131/real 0]  req@ffff8b20a7e71500 x1619547807334128/t0(0) o400->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544535138 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[14511.565840] Lustre: 12232:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[14511.580416] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[14520.100637] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.119@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[14520.125866] LustreError: Skipped 38 previous similar messages
[14558.199485] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[14558.226941] LustreError: Skipped 35 previous similar messages
[14611.608439] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544535239/real 1544535239]  req@ffff8b208820b000 x1619547808208224/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544535255 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[14611.652042] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[14633.751332] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.111@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[14633.778416] LustreError: Skipped 52 previous similar messages
[14695.444908] LDISKFS-fs warning (device dm-4): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[14695.444908] 
[14706.386127] Lustre: MGS: haven't heard from client 0da78edf-7d21-49d9-893d-7f1cff56066f (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff8b1972e09400, cur 1544535333 expire 1544535183 last 1544535106
[14744.623994] LDISKFS-fs (dm-4): recovery complete
[14744.631216] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[14745.618257] Lustre: soaked-MDT0000: Received LWP connection from 0@lo, removing former export from 192.168.1.109@o2ib
[14745.634266] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[14745.646913] Lustre: Skipped 10 previous similar messages
[14745.692520] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900
[14745.725923] LustreError: 13978:0:(llog_osd.c:978:llog_osd_next_block()) soaked-MDT0003-osp-MDT0001: missed desired record? 3 > 1
[14745.726655] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[14745.726656] Lustre: Skipped 1 previous similar message
[14745.760695] LustreError: 13978:0:(lod_dev.c:419:lod_sub_recovery_thread()) soaked-MDT0003-osp-MDT0001 getting update log failed: rc = -2
[14745.777553] LustreError: 13978:0:(lod_dev.c:419:lod_sub_recovery_thread()) Skipped 1 previous similar message
[14750.842125] Lustre: 13979:0:(ldlm_lib.c:2059:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[14750.857771] Lustre: 13979:0:(ldlm_lib.c:2059:target_recovery_overseer()) Skipped 2 previous similar messages
[14750.872794] Lustre: soaked-MDT0001: disconnecting 28 stale clients
[14750.883815] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[14755.520106] LustreError: 12405:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[14762.903961] Lustre: Failing over soaked-MDT0001
[14763.626890] Lustre: server umount soaked-MDT0001 complete
[14766.270365] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 5 seconds
[14766.285277] LNet: 12194:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[14786.319058] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[14786.345619] LustreError: Skipped 107 previous similar messages
[14795.693081] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[14795.715580] LustreError: 12446:0:(osp_object.c:582:osp_attr_get()) soaked-MDT0001-osp-MDT0000:osp_attr_get update error [0x2400088d2:0x1:0x0]: rc = -5
[14795.720544] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[14795.720548] Lustre: Skipped 25 previous similar messages
[14795.849929] LustreError: 13840:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[14795.864015] LustreError: 13840:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[14797.222444] LustreError: 12399:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[14797.236452] LustreError: 12399:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 6 previous similar messages
[14815.467283] LustreError: 12446:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[14815.481222] LustreError: 12446:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 8 previous similar messages
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [02;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [7m[4;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[4;79H[m[m[5;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [4;79H[22;1H   The selected entry will be started automatically in 5s.                     [4;79H[22;1H   The selected entry will be started automatically in 4s.                     [4;79H[22;1H   The selected entry will be started automatically in 3s.                     [4;79H[22;1H   The selected entry will be started automatically in 2s.                     [4;79H[22;1H   The selected entry will be started automatically in 1s.                     [4;79H[22;1H   The selected entry will be started automatically in 0s.                     [4;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-307-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Fri Nov 30 18:46:05 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x34b20000-0x36587fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 320MB of memory at 512MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff99372e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 6822680k/34603008k available (7664k kernel code, 1126748k absent, 1001116k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.412 MHz processor
[    0.000180] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.82 BogoMIPS (lpj=2693412)
[    0.012660] pid_max: default: 245760 minimum: 1920
[    0.019176] Security Framework initialized
[    0.024069] SELinux:  Initializing.
[    0.028545] Yama: becoming mindful.
[    0.038088] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.060387] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.074692] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.082778] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.093814] Initializing cgroup subsys memory
[    0.099045] Initializing cgroup subsys devices
[    0.104316] Initializing cgroup subsys freezer
[    0.109588] Initializing cgroup subsys net_cls
[    0.114845] Initializing cgroup subsys blkio
[    0.119909] Initializing cgroup subsys perf_event
[    0.125505] Initializing cgroup subsys hugetlb
[    0.130770] Initializing cgroup subsys pids
[    0.135741] Initializing cgroup subsys net_prio
[    0.141393] mce: CPU supports 20 MCE banks
[    0.146289] CPU0: Thermal monitoring enabled (TM1)
[    0.152020] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.158478] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.165100] tlb_flushall_shift: 6
[    0.169167] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.180430] FEATURE SPEC_CTRL Present
[    0.184819] FEATURE IBPB_SUPPORT Present
[    0.189809] Spectre V2 : Mitigation: Full retpoline
[    0.196125] Freeing SMP alternatives: 28k freed
[    0.207879] ACPI: Core revision 20130517
[    0.303951] ACPI: All ACPI Tables successfully acquired
[    0.324238] ftrace: allocating 29187 entries in 115 pages
[    0.386034] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.393728] Switched APIC routing to physical flat.
[    0.400198] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.417212] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.428464] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.441176] ... version:                3
[    0.450623] ... bit width:              48
[    0.455484] ... generic registers:      4
[    0.460249] ... value mask:             0000ffffffffffff
[    0.466473] ... max period:             00007fffffffffff
[    0.472698] ... fixed-purpose events:   3
[    0.477459] ... event mask:             000000070000000f
[    0.492192] smpboot: Booting Node   0, Processors  #1[    0.514041] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.570423] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.711492] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.754646] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.796127] Brought up 32 CPUs
[    0.800313] smpboot: Max logical packages: 15
[    0.805492] smpboot: Total of 32 processors activated (172570.24 BogoMIPS)
[    1.062531] node 0 initialised, 2813371 pages in 136ms
[    1.100182] node 1 initialised, 3599741 pages in 168ms
[    1.107460] devtmpfs: initialized
[    1.123104] EVM: security.selinux
[    1.127098] EVM: security.ima
[    1.130703] EVM: security.capability
[    1.135267] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.144639] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.157597] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.165584] pinctrl core: initialized pinctrl subsystem
[    1.172004] RTC time: 13:55:52, date: 12/11/18
[    1.177763] NET: Registered protocol family 16
[    1.183573] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.192542] ACPI: bus type PCI registered
[    1.197311] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.205442] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.216348] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.224265] PCI: Using configuration type 1 for base access
[    1.230844] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.250793] ACPI: Added _OSI(Module Device)
[    1.255761] ACPI: Added _OSI(Processor Device)
[    1.261018] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.266561] ACPI: Added _OSI(Processor Aggregator Device)
[    1.272885] ACPI: Added _OSI(Linux-Dell-Video)
[    1.317947] ACPI: Executed 1 blocks of module-level executable AML code
[    1.606483] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.640168] ACPI: Interpreter enabled
[    1.644601] ACPI: (supports S0 S1 S5)
[    1.648982] ACPI: Using IOAPIC for interrupt routing
[    1.654937] HEST: Table parsing has been initialized.
[    1.660878] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.671668] ACPI: GPE 0x1E active on init
[    1.676615] ACPI: GPE 0x24 active on init
[    1.681556] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.747575] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.754788] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.764965] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.773957] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.783018] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.792966] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.805147] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.820529] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.836294] PCI host bridge to bus 0000:00
[    1.841161] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.848362] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.857226] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.866093] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.874958] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.883817] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.892681] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.901546] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.910412] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.919267] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.928125] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.936989] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.945858] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.954722] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.963587] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.973237] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.980190] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.987111] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.994038] pci 0000:00:02.0: System wakeup disabled by ACPI
[    2.000949] pci 0000:00:02.2: System wakeup disabled by ACPI
[    2.007871] pci 0000:00:03.0: System wakeup disabled by ACPI
[    2.018387] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    2.025354] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    2.032267] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    2.039220] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.046068] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.053641] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.059662] acpiphp: Slot [2] registered
[    2.064627] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.075479] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.086672] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.097515] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.108694] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.119531] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.130714] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.141552] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.154389] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.160735] acpiphp: Slot [2-2] registered
[    2.168034] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.174058] acpiphp: Slot [2-3] registered
[    2.178968] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.184977] acpiphp: Slot [2-4] registered
[    2.190173] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.196368] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.209676] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.215646] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.221915] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.228611] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.234582] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.243865] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.252907] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.261939] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.270967] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.280000] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.289025] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.298041] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.307059] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.316289] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.323499] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.333419] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.342250] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.351307] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.361376] PCI host bridge to bus 0000:80
[    2.366247] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.374132] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.382012] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.390872] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.399738] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.409377] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.416029] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.422927] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.429816] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.436702] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.445812] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.451750] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.457682] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.463599] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.485154] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.492073] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.501772] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.511949] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.519246] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.529006] PCI host bridge to bus 0000:7f
[    2.533878] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.544811] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.551724] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.561414] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.571595] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.578893] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.588664] PCI host bridge to bus 0000:ff
[    2.593526] pci_bus 0000:ff: root bus resource [bus ff]
[    2.605045] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.614613] vgaarb: loaded
[    2.617921] vgaarb: bridge control possible 0000:09:00.0
[    2.624588] SCSI subsystem initialized
[    2.629126] ACPI: bus type USB registered
[    2.633936] usbcore: registered new interface driver usbfs
[    2.640377] usbcore: registered new interface driver hub
[    2.646906] usbcore: registered new device driver usb
[    2.653388] EDAC MC: Ver: 3.0.0
[    2.657735] PCI: Using ACPI for IRQ routing
[    2.670340] NetLabel: Initializing
[    2.674435] NetLabel:  domain hash size = 128
[    2.679591] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.685469] NetLabel:  unlabeled traffic allowed by default
[    2.692338] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.700335] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.709201] amd_nb: Cannot enumerate AMD northbridges
[    2.715342] Switched to clocksource hpet
[    2.734615] pnp: PnP ACPI init
[    2.738352] ACPI: bus type PNP registered
[    2.743425] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.750342] system 00:00: [io  0xffff] has been reserved
[    2.756578] system 00:00: [io  0xffff] has been reserved
[    2.762813] system 00:00: [io  0xffff] has been reserved
[    2.769043] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.776350] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.783263] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.790173] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.797089] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.804397] system 00:00: [io  0x0cf9] could not be reserved
[    2.811233] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.819719] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.827415] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.835106] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.842805] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.850493] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.858182] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.866261] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.874342] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.882423] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.890636] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.899245] pnp: PnP ACPI: found 7 devices
[    2.904121] ACPI: bus type PNP unregistered
[    2.918516] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.924394] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.930529] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.937641] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.945536] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.951383] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.959282] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.969234] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.975086] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.980936] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.988046] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.995939] pci 0000:00:11.0: PCI bridge to [bus 07]
[    3.001783] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    3.008891] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    3.016785] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    3.026733] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    3.032599] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    3.038445] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    3.046333] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    3.055499] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    3.061583] pci 0000:80:01.0: PCI bridge to [bus 81]
[    3.067439] pci 0000:80:02.0: PCI bridge to [bus 82]
[    3.073295] pci 0000:80:03.0: PCI bridge to [bus 83]
[    3.079147] pci 0000:80:03.2: PCI bridge to [bus 84]
[    3.085388] NET: Registered protocol family 2
[    3.092744] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.102423] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.110481] TCP: Hash tables configured (established 262144 bind 65536)
[    3.118268] TCP: reno registered
[    3.122327] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.129790] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.138787] NET: Registered protocol family 1
[    4.244375] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.352412] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.361222] Unpacking initramfs...
[    6.194508] Freeing initrd memory: 27040k freed
[    6.210500] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    6.218023] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff9933b73c7000-ffff9933bb3c6fff]
[    6.230059] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    6.239429] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    6.246152] RAPL PMU: hw unit of domain package 2^-16 Joules
[    6.252794] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    6.272318] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    6.279461] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    6.293695] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    6.302231] Initialise system trusted keyring
[    6.307538] audit: initializing netlink socket (disabled)
[    6.313939] type=2000 audit(1544536553.826:1): initialized
[    6.375891] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.383297] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.393871] zpool: loaded
[    6.397112] zbud: loaded
[    6.401453] VFS: Disk quotas dquot_6.6.0
[    6.406661] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.415675] msgmni has been set to 32768
[    6.420759] Key type big_key registered
[    6.427980] NET: Registered protocol family 38
[    6.433271] Key type asymmetric registered
[    6.438158] Asymmetric key parser 'x509' registered
[    6.444064] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.453126] io scheduler noop registered
[    6.457824] io scheduler deadline registered (default)
[    6.464029] io scheduler cfq registered
[    6.468619] io scheduler mq-deadline registered
[    6.473994] io scheduler kyber registered
[    6.484674] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.492813] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.500906] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.508514] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.516109] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.523713] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.531344] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.539427] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.547065] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.555199] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.563292] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.570938] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.579038] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.586638] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.594289] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.602413] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.610508] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.618167] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.626304] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.634444] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.642584] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.650788] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.657350] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.665101] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.673735] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.682549] ACPI: Power Button [PWRF]
[    6.687026] ACPI: Requesting acpi_cpufreq
[    6.776203] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.785146] pstore: Registered erst as persistent store backend
[    6.792404] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.801411] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.829602] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.857034] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.864633] Non-volatile memory driver v1.3
[    6.869693] Linux agpgart interface v0.103
[    6.875023] crash memory driver: version 1.1
[    6.880613] rdac: device handler registered
[    6.885686] hp_sw: device handler registered
[    6.890782] emc: device handler registered
[    6.895953] alua: device handler registered
[    6.901044] libphy: Fixed MDIO Bus: probed
[    6.910856] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.918493] ehci-pci: EHCI PCI platform driver
[    6.924229] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.930503] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.939337] ehci-pci 0000:00:1a.0: debug port 2
[    6.948667] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.960472] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.967310] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.975199] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.983790] usb usb1: Product: EHCI Host Controller
[    6.989561] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.998260] usb usb1: SerialNumber: 0000:00:1a.0
[    7.003958] hub 1-0:1.0: USB hub found
[    7.008471] hub 1-0:1.0: 2 ports detected
[    7.013844] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    7.020097] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    7.028916] ehci-pci 0000:00:1d.0: debug port 2
[    7.038230] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    7.050471] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    7.057287] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    7.065187] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.073786] usb usb2: Product: EHCI Host Controller
[    7.079544] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.088236] usb usb2: SerialNumber: 0000:00:1d.0
[    7.093905] hub 2-0:1.0: USB hub found
[    7.098407] hub 2-0:1.0: 2 ports detected
[    7.103436] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    7.110664] ohci-pci: OHCI PCI platform driver
[    7.115993] uhci_hcd: USB Universal Host Controller Interface driver
[    7.123580] usbcore: registered new interface driver usbserial_generic
[    7.131216] usbserial: USB Serial support registered for generic
[    7.138322] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    7.267615] tsc: Refined TSC clocksource calibration: 2693.511 MHz
[    8.191281] i8042: No controller found
[    8.195811] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    8.195855] Switched to clocksource tsc
[    8.195965] mousedev: PS/2 mouse device common for all mice
[    8.196186] rtc_cmos 00:01: RTC can wake from S4
[    8.216513] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    8.216568] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    8.216695] intel_pstate: Intel P-state driver initializing
[    8.228457] cpuidle: using governor menu
[    8.229990] hidraw: raw HID events driver (C) Jiri Kosina
[    8.230250] usbcore: registered new interface driver usbhid
[    8.230250] usbhid: USB HID core driver
[    8.230474] drop_monitor: Initializing network drop monitor service
[    8.231019] TCP: cubic registered
[    8.231028] Initializing XFRM netlink socket
[    8.231715] NET: Registered protocol family 10
[    8.233276] NET: Registered protocol family 17
[    8.233290] mpls_gso: MPLS GSO support
[    8.236201] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    8.236568] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    8.236784] Loading compiled-in X.509 certificates
[    8.237858] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    8.238899] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    8.239942] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: c7aec20a70554693bf19667e4c28ac12c728bbb2'
[    8.239996] registered taskstats version 1
[    8.245045] Key type trusted registered
[    8.249194] Key type encrypted registered
[    8.249343] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    8.250984]   Magic number: 14:133:938
[    8.251111] clockevents clockevent27: hash matches
[    8.251132] msr msr29: hash matches
[    8.253765] rtc_cmos 00:01: setting system clock to 2018-12-11 13:56:00 UTC (1544536560)
[    8.383540] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    8.399890] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    8.399894] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.400188] hub 1-1:1.0: USB hub found
[    8.400262] hub 1-1:1.0: 6 ports detected
[    8.436475] Freeing unused kernel memory: 1876k freed
[    8.442903] Write protecting the kernel read-only data: 12288k
[    8.451498] Freeing unused kernel memory: 516k freed
[    8.458976] Freeing unused kernel memory: 600k freed
[    8.472659] random: systemd: uninitialized urandom read (16 bytes read)
[    8.483212] random: systemd: uninitialized urandom read (16 bytes read)
[    8.490969] random: systemd: uninitialized urandom read (16 bytes read)
[    8.501159] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.510956] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    8.510959] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.511387] hub 2-1:1.0: USB hub found
[    8.511574] hub 2-1:1.0: 8 ports detected
[    8.548817] systemd[1]: Detected architecture x86-64.
[    8.554771] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.570719] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.640285] random: systemd: uninitialized urandom read (16 bytes read)
[    8.648054] random: systemd: uninitialized urandom read (16 bytes read)
[    8.655810] random: systemd: uninitialized urandom read (16 bytes read)
[    8.663643] random: systemd: uninitialized urandom read (16 bytes read)
[    8.672498] random: systemd: uninitialized urandom read (16 bytes read)
[    8.680474] random: systemd: uninitialized urandom read (16 bytes read)
[    8.688699] random: systemd: uninitialized urandom read (16 bytes read)
[    8.702619] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.712712] systemd[1]: Reached target Swap.
[ [32m  OK  [0m Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.736013] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.746762] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.759778] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.772808] systemd[1]: Created slice System Slice.
[[32m  OK  [0m[    8.779566] usb 2-1.4: new full-speed USB device number 3 using ehci-p ci
] Created s: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.802786] systemd[1]: Starting dracut cmdline hook...
         Starting dracut cmdline hook...
[    8.813690] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[    8.826678] systemd[1]: Reached target Sockets.
[ [32m  OK  [0m    8.837498] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Starting Create list of required st... nodes for the current kernel...
[    8.859403] systemd[1]: Starting Setup Virtual Console...
          Startinual Console...
[     8.871554] sS tarting Apply Kar ting Apply Kern[    8.894468] systemd[1]: Starting Journal Service...
         Startin[    8.901044] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
g Journal Servic[    8.909934] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
e...
[    8.920123] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.927109] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.927458] systemd[1]: Started Create list of required static device nodes for the current kernel.
[    8.944413] usb 2-1.4:  SerialNumber: erican Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[    8.975331] systemd[1]: Started dracut cmdline hook.
[[32m  OK  [0m] Started dracut cmdline hook.
[    8.986949] systemd[1]: Started Setup Virtual Console.
[[32m  OK  [0m] Started Setup Virtual Console.[    8.997127] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0

[    9.016521] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
[    9.031340] systemd[1]: Started Apply Kernel Variables.
[[32m  OK  [0m[    9.038156] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
] Started Apply Kernel Variables.
[    9.061862] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
         Starting dracut pre-udev hook...
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Show Plymouth Boot Screen...
         Starting dracut initqueue hook...
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [    9.285930] random: fast init done
[0m] Reached ta[    9.293027] mlx_compat: loading out-of-tree module taints kernel.
rget Paths.
[[    9.300722] dca service started, version 1.12.1
[32m  OK  [0m] [    9.307016] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
Reached target Basic System.
[    9.321184] Compat-mlnx-ofed backport release: b4fdfac
[    9.328012] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    9.335696] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    9.342285] pps_core: LinuxPPS API ver. 1 registered
[    9.348144] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    9.364939] PTP clock support registered
[    9.395250] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    9.405170] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.406952] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    9.406984] mlx4_core: Initializing 0000:04:00.0
[    9.415920] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    9.415925] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    9.433312] scsi host0: ahci
%G[    9.433455] scsi host1: ahci
[    9.438547] scsi host2: ahci
[    9.442571] scsi host3: ahci
[    9.442716] scsi host4: ahci
[    9.442956] scsi host5: ahci
[    9.443032] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 38
[    9.443034] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 38
[    9.443036] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 38
[    9.443039] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 38
[    9.443042] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 38
[    9.443045] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 38
[    9.450981] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    9.450982] igb: Copyright (c) 2007-2014 Intel Corporation.
[    9.451796] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    9.454507] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    9.454514] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    9.454518] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.454522] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.454719] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.457180] scsi host6: isci
[    9.489524] igb 0000:02:00.0: added PHC on eth0
[    9.489526] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.489527] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    9.489604] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    9.489605] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.490142] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.527178] igb 0000:02:00.1: added PHC on eth1
[    9.527180] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.527182] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.527255] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.527257] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
%G[    9.585029] igb 0000:02:00.2: added PHC on eth2
[    9.585031] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.585033] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.585107] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.585109] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.641384] igb 0000:02:00.3: added PHC on eth3
[    9.641386] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.641405] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.641478] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.641480] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.644375] [TTM] Zone  kernel: Available graphics memory: 16252602 kiB
[    9.644376] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.644377] [TTM] Initializing pool allocator
[    9.644383] [TTM] Initializing DMA pool allocator
[    9.683900] fbcon: mgadrmfb (fb0) is primary device
[    9.748639] ata6: SATA link down (SStatus 0 SControl 300)
[    9.748665] ata4: SATA link down (SStatus 0 SControl 300)
[    9.749633] ata2: SATA link down (SStatus 0 SControl 300)
[    9.749663] ata5: SATA link down (SStatus 0 SControl 300)
[    9.749687] ata3: SATA link down (SStatus 0 SControl 300)
[    9.749710] ata1: SATA link down (SStatus 0 SControl 300)
[    9.919384] Console: switching to colour frame buffer device 128x48
[    9.943787] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.991621] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   11.130618] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   11.138629] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   11.148829] ata7.00: configured for UDMA/133
[   11.156085] scsi 6:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.939328] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.946937] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.954373] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.962151] mlx4_core: device is working in RoCE mode: Roce V1
[   15.969260] mlx4_core: UD QP Gid type is: V1
[   17.030184] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   17.294277] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   17.305803] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   17.314714] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   17.433716] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   17.441738] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   17.451741] ata8.00: configured for UDMA/133
[   17.469866] scsi 6:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.553019] sd 6:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.553165] sd 6:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.553532] sd 6:0:1:0: [sdb] Write Protect is off
[   17.553635] sd 6:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.561763]  sdb:
[   17.562547] sd 6:0:1:0: [sdb] Attached SCSI disk
[   17.600484] sd 6:0:0:0: [sda] Write Protect is off
[   17.607063] sd 6:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.640790]  sda: sda1 sda2
[   17.645675] sd 6:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   18.427187] random: crng init done
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
         Mounting /sysroot...
[   18.772596] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
[[32m  OK  [0m] Stopped target Timers.
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target System Initialization.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped udev Kernel[   19.264038] systemd-journald[328]: Received SIGTERM from PID 1 (systemd).
 Device Manager.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Closed udev Kernel Socket.
[[32m  OK  [0m] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.604088] SELinux:  Disabled at runtime.
[   19.650965] type=1404 audit(1544536571.898:2): selinux=0 auid=4294967295 ses=4294967295
[   19.894054] ip_tables: (C) 2000-2006 Netfilter Core Team
[   19.902538] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
         Mounting Debug File System...
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Listening on udev Kernel Socket.
         Starting Create list of required st... nodes for the current kernel...
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Stopped target Initrd Root File System.
         Mounting Huge Pages File System...
         Starting Availability of block devices...
[[   20.806540] RPC: Registered named UNIX socket transport module.
[32m  OK  [0m][   20.806541] RPC: Registered udp transport module.
 Created slice U[   20.806542] RPC: Registered tcp transport module.
ser and Session [   20.806542] RPC: Registered tcp NFSv4.1 backchannel transport module.
Slice.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Listening on udev Control Socket.
         Starting Replay Read-Ahead Data...
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted[   20.959016] EXT4-fs (sda1): re-mounted. Opts: (null)
 Huge Pages File System.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started LVM2 metadata daemon.
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting Flush Journal to Persistent Storage...
         Starting Configure read-only root support...
         Starting udev Coldplug all Devices...
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[   21.391869] systemd-journald[4365]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[   21.506259] device-mapper: uevent: version 1.0.3
[   21.512964] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started udev Kernel Device Manager.
[[32m  OK  [0m] Started Configure read-only root support.
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[   21.727869] ipmi message handler version 39.2
[   21.735597] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.748964] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.762579] ipmi device interface
[   21.775964] IPMI System Interface driver.
[   21.781630] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   21.789569] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   21.797395] ipmi_si: Adding SMBIOS-specified kcs state machine
[   21.805149] ipmi_platform: probing via SPMI
[   21.811014] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   21.818626] (NULL device *): SPMI-specified kcs state machine: duplicate
[   21.827399] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   21.839919] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   21.848170] igb 0000:02:00.0: DCA enabled
[   21.856509] igb 0000:02:00.1: DCA enabled
[   21.864655] igb 0000:02:00.2: DCA enabled
[   21.870488] igb 0000:02:00.3: DCA enabled
[   21.876935] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   21.910769] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   21.930088] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   21.941168] i801_smbus 0000:07:00.3: Enabling SMBus device
[   21.948588] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   21.956928] mpt2sas version 20.103.01.00 loaded
[   21.957473] sd 6:0:0:0: Attached scsi generic sg0 type 0
[   21.957606] sd 6:0:1:0: Attached scsi generic sg1 type 0
[   21.968568] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[[32m  OK  [0m] Found device /dev/ttyS0.
[   21.985263] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[   21.986258] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   21.987942] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32505204 kB)
[   21.989542] IPMI SSIF Interface driver
[   22.042097] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[   22.043054] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 168
[   22.043056] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 169
[   22.043056] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 170
[   22.043057] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 171
[   22.043058] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 172
[   22.043059] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 173
[   22.043060] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 174
[   22.043060] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 175
[   22.043061] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 176
[   22.043062] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 177
[   22.043063] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 178
[   22.043064] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 179
[   22.043064] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 180
[   22.043065] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 181
[   22.043066] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 182
[   22.043066] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 183
[   22.043068] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffac2d83be0000), size(65536)
[   22.043069] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[   22.094721] cryptd: max_cpu_qlen set to 1000
[   22.097142] iTCO_vendor_support: vendor-support=0
[   22.098561] mpt2sas_cm0: sending message unit reset !!
[   22.099595] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.099670] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.100015] mpt2sas_cm0: message unit reset: SUCCESS
[   22.110138] AVX version of gcm_enc/dec engaged.
[   22.110139] AES CTR mode by8 optimization enabled
[   22.113025] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.113071] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.118965] device-mapper: multipath round-robin: version 1.2.0 loaded
[   22.168551] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[   22.168552] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[   22.168553] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[   22.180290] kvm: disabled by bios
[   22.187323] intel_rapl: Found RAPL domain package
[   22.187325] intel_rapl: Found RAPL domain core
[   22.187329] intel_rapl: Found RAPL domain dram
%G%G[   22.187344] intel_rapl: Found RAPL domain package
[   22.187347] intel_rapl: Found RAPL domain core
[   22.187352] intel_rapl: Found RAPL domain dram
[   22.196656] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.196856] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.196857] EDAC sbridge:  Ver: 1.1.2 
[   22.216915] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[   22.216916] mpt2sas_cm0: Protocol=(
[   22.216917] Initiator
[   22.216917] ,Target
[   22.216917] ), 
[   22.216918] Capabilities=(
[   22.216918] TLR
[   22.216918] ,EEDP
[   22.216919] ,Snapshot Buffer
[   22.216919] ,Diag Trace Buffer
[   22.216919] ,Task Set Full
[   22.216920] ,NCQ
[   22.216920] )
[   22.216965] scsi host7: Fusion MPT SAS Host
[   22.217283] mpt2sas_cm0: sending port enable !!
[   22.220019] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[   22.229018] mpt2sas_cm0: port enable: SUCCESS
[   22.229772] scsi 7:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.229776] scsi 7:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.229778] scsi 7:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.229780] scsi 7:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.449973] scsi 7:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.449983] scsi 7:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.449987] scsi 7:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.449993] scsi 7:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.764620] scsi 7:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.775406] scsi 7:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.788268] scsi 7:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.797509] scsi 7:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.825527] scsi 7:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.835880] scsi 7:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.848900] scsi 7:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.858165] scsi 7:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.909286] scsi 7:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   22.919155] scsi 7:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.931745] scsi 7:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.940566] scsi 7:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.965244] scsi 7:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.975329] scsi 7:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.988011] scsi 7:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.997006] scsi 7:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.025893] scsi 7:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.036450] scsi 7:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.049150] scsi 7:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.058164] scsi 7:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.082474] scsi 7:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.093160] scsi 7:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.093163] scsi 7:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.093171] scsi 7:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.157485] scsi 7:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   23.167579] scsi 7:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.180995] scsi 7:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.190690] scsi 7:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.216446] scsi 7:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   23.226905] scsi 7:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.240458] scsi 7:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.250252] scsi 7:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.276765] scsi 7:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   23.284112] sd 7:0:0:0: Attached scsi generic sg2 type 0
[   23.284146] sd 7:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.303323] sd 7:0:0:0: [sdc] Write Protect is off
[   23.303713] sd 7:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.303835] scsi 7:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   23.304018] sd 7:0:0:1: Attached scsi generic sg3 type 0
[   23.304284] sd 7:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.304774] scsi 7:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   23.304939] sd 7:0:0:2: Attached scsi generic sg4 type 0
[   23.305312] sd 7:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.305385] sd 7:0:0:1: [sdd] Write Protect is off
[   23.305938] sd 7:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.306057] scsi 7:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   23.306214] sd 7:0:0:3: Attached scsi generic sg5 type 0
[   23.306420] sd 7:0:0:7: Attached scsi generic sg6 type 0
[   23.306778] sd 7:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.306845] sd 7:0:0:2: [sde] Write Protect is off
[   23.306871] sd 7:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.307031] scsi 7:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   23.307198] sd 7:0:1:0: Attached scsi generic sg7 type 0
[   23.307320] sd 7:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.307419] sd 7:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.307931] scsi 7:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   23.308093] sd 7:0:1:1: Attached scsi generic sg8 type 0
[   23.308132] sd 7:0:1:0: [sdh] Write Protect is off
[   23.308419] sd 7:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.308474] sd 7:0:0:3: [sdf] Write Protect is off
[   23.308478] sd 7:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.308577] sd 7:0:0:7: [sdg] Write Protect is off
[   23.309110] sd 7:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.309111] scsi 7:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   23.309275] sd 7:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.309281] sd 7:0:1:2: Attached scsi generic sg9 type 0
[   23.309504] sd 7:0:1:1: [sdi] Write Protect is off
[   23.309911] sd 7:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.310127] Dev sdd: unable to read RDB block 0
[   23.310135]  sdd: unable to read partition table
[   23.310300] scsi 7:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   23.310451] sd 7:0:1:3: Attached scsi generic sg10 type 0
[   23.310596] sd 7:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.310676] sd 7:0:1:7: Attached scsi generic sg11 type 0
[   23.311178] sd 7:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.311212] sd 7:0:0:0: [sdc] Attached SCSI disk
[   23.311444] Dev sdh: unable to read RDB block 0
[   23.311455]  sdh: unable to read partition table
[   23.311714] sd 7:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.311957] sd 7:0:1:2: [sdj] Write Protect is off
[   23.312621] sd 7:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.312678] sd 7:0:1:3: [sdk] Write Protect is off
[   23.312987] Dev sdf: unable to read RDB block 0
[   23.312997]  sdf: unable to read partition table
[   23.313091] sd 7:0:0:1: [sdd] Attached SCSI disk
[   23.313378] sd 7:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.313567] sd 7:0:1:7: [sdl] Write Protect is off
[   23.314365] sd 7:0:0:2: [sde] Attached SCSI disk
[   23.314415] sd 7:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.314830] sd 7:0:0:3: [sdf] Attached SCSI disk
[   23.315027] sd 7:0:1:0: [sdh] Attached SCSI disk
[   23.316293] Dev sdj: unable to read RDB block 0
[   23.316301]  sdj: unable to read partition table
[   23.318497] sd 7:0:1:2: [sdj] Attached SCSI disk
[   23.318913] sd 7:0:1:3: [sdk] Attached SCSI disk
[   23.421450] sd 7:0:1:1: [sdi] Attached SCSI disk
[   23.518167]  sdg:
[   23.645213] sd 7:0:0:7: [sdg] Attached SCSI disk
[   23.689054]  sdl:
[   23.747611] device-mapper: table: 253:1: multipath: error getting device
[   23.747613] device-mapper: ioctl: error adding target to table
[   23.797348] sd 7:0:1:7: [sdl] Attached SCSI disk
[   23.862330] blk_update_request: I/O error, dev sdf, sector 0
[   23.865762] blk_update_request: I/O error, dev sdd, sector 0
[   23.866706] blk_update_request: I/O error, dev sdh, sector 0
[   23.867055] blk_update_request: I/O error, dev sdj, sector 0
[   23.870051] blk_update_request: I/O error, dev sdd, sector 0
[   23.871370] blk_update_request: I/O error, dev sdj, sector 0
[   23.871459] blk_update_request: I/O error, dev sdh, sector 0
[   23.874332] blk_update_request: I/O error, dev sdd, sector 0
[   23.875801] blk_update_request: I/O error, dev sdj, sector 0
[   23.876119] blk_update_request: I/O error, dev sdh, sector 0
[   23.951880] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Preprocess NFS configuration...
         Starting Import network configuration from initramfs...
         Starting Tell Plymouth To Write Out Runtime Data...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[   24.379618] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.389905] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[[32m  OK  [0m] Found device ST500NM0011 2.
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Mounting RPC Pipe File System...
         Starting Security Auditing Service...
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   24.618936] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[   24.824937] type=1305 audit(1544536577.071:3): audit_pid=9040 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting GSSAPI Proxy Daemon...
         Starting Machine Check Exception Logging Daemon...
         Starting Load CPU microcode update...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Authorization Manager...
         Starting System Security Services Daemon...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting NTP client/server...
         Starting Dump dmesg to /var/log/dmesg...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Authorization Manager.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[   25.986128] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[   26.341935] card: mlx4_0, QP: 0x220, inline size: 120
[   26.357871] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
[[32m  OK  [0m] Started mlnx_i[   26.402040] ib0: enabling connected mode will cause multicast packet drops
nterface_mgr - c[   26.402567] ib0: mtu > 4092 will cause multicast packet drops.
onfigure ib1.
[   26.514537] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[   26.604450] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   26.605645] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   26.614073] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.695628] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   26.702976] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   26.715471] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.836167] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   26.847737] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.967221] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.999973] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   27.022480] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   27.033951] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   27.055831] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   27.092027] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   27.102218] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   27.798161] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   27.808171] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   28.456628] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   28.466916] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   29.084380] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   29.094592] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   29.681595] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   34.442741] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.488911] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   34.499780] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting OpenSSH server daemon...
         Starting Postfix Mail Transport Agent...
         Starting Dynamic System Tuning Daemon...
[[3[   34.675633] FS-Cache: Loaded
2m  OK  [0m] Reached target Network is Online.
         Starting Notify NFS peers of a restart...
         Starting NFS status monitor for NFSv2/3 locking....
[   34.714161] FS-Cache: Netfs 'nfs' registered for caching
[   34.718083] Key type dns_resolver registered
[   34.759953] NFS: Registering the id_resolver key type
[   34.759957] Key type id_resolver registered
[   34.759958] Key type id_legacy registered
         Mounting /scratch...
         Starting MUNGE authentication service...
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting System Logging Service...
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Automounts filesystems on demand...
         Starting Crash recovery kernel arming...
         Starting Permit User Sessions...
[[32m  OK  [0m] Started Permit User Sessions.
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Job spooling tools.
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Started Command Scheduler.
[[32m  OK  [0m] Created slice User Slice of root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-11T13:56:39+00:00] INFO: Forking chef instance to converge...
[2018-12-11T13:56:39+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-11T13:56:39+00:00] INFO: Chef-client pid: 10833
[2018-12-11T13:56:40+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-11T13:56:40+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-11T13:56:40+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-11T13:56:40+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-11T13:56:40+00:00] INFO: Running start handlers
[2018-12-11T13:56:40+00:00] INFO: Start handlers complete.
[2018-12-11T13:56:41+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-11T13:56:41+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T13:56:41+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T13:56:41+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-11T13:56:41+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181211135641.642504
[2018-12-11T13:56:41+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181211042214.540224
[2018-12-11T13:56:41+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-11T13:56:41+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-11T13:56:46+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-11T13:56:46+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-11T13:56:46+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-11T13:56:46+00:00] INFO: service[ntpd] started
[2018-12-11T13:56:46+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-11T13:56:47+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-11T13:56:47+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-11T13:56:47+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-11T13:56:47+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-11T13:56:47+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-11T13:56:47+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-11T13:56:47+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-11T13:56:47+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-11T13:56:48+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-11T13:56:48+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-11T13:56:48+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-11T13:56:48+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-11T13:56:48+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:48+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:48+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-11T13:56:49+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-11T13:56:49+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-11T13:56:49+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-11T13:56:49+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-11T13:56:49+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-11T13:56:50+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-11T13:56:50+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-11T13:56:50+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-11T13:56:50+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-11T13:56:50+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-11T13:56:50+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-11T13:56:50+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-11T13:56:51+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-11T13:56:51+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-11T13:56:51+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-11T13:56:51+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-11T13:56:51+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-11T13:56:51+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-11T13:56:51+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-11T13:56:51+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-11T13:56:51+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-11T13:56:51+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-11T13:56:52+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-11T13:56:52+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-11T13:56:52+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[   60.490268] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[2018-12-11T13:56:52+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-11T13:56:52+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-11T13:56:52+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-11T13:56:52+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211135652.919163
[2018-12-11T13:56:52+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211042225.645878
[2018-12-11T13:56:52+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-11T13:56:52+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-11T13:56:52+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-11T13:56:52+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211135652.925531
[2018-12-11T13:56:52+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211042225.659978
[2018-12-11T13:56:52+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-11T13:56:52+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-11T13:56:52+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-11T13:56:52+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:52+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:52+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-11T13:56:52+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:52+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:52+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-11T13:56:53+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-11T13:56:53+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-11T13:56:53+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-11T13:56:53+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T13:56:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:53+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T13:56:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:53+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T13:56:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:53+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T13:56:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:53+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T13:56:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:53+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T13:56:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:53+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T13:56:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:53+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T13:56:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:53+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-11T13:56:53+00:00] INFO: service[xinetd] started
[2018-12-11T13:56:53+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-11T13:56:54+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-11T13:56:54+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-11T13:56:54+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-11T13:56:54+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-11T13:56:55+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-11T13:56:55+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-11T13:56:55+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-11T13:56:55+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181211135655.079924
[2018-12-11T13:56:55+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181211042227.881220
[2018-12-11T13:56:55+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-11T13:56:55+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-11T13:56:55+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-11T13:56:55+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-11T13:56:55+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T13:56:55+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T13:56:55+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-11T13:56:55+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-11T13:56:55+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-11T13:56:55+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-11T13:56:55+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-11T13:56:55+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-11T13:56:55+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-11T13:56:56+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-11T13:56:56+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-11T13:56:57+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-11T13:56:57+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-11T13:56:57+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-11T13:56:57+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-11T13:56:57+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-11T13:56:57+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-11T13:56:57+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-11T13:56:57+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-11T13:56:57+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-11T13:56:57+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-11T13:56:57+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-11T13:56:57+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-11T13:56:57+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-11T13:56:57+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-11T13:56:57+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-11T13:56:57+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-11T13:56:57+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-11T13:56:57+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-11T13:56:57+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-11T13:56:58+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-11T13:56:58+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-11T13:56:58+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-11T13:56:58+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-11T13:56:58+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[2018-12-11T13:57:01+00:00] INFO: service[kdump] restarted
[2018-12-11T13:57:01+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-11T13:57:01+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-11T13:57:01+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-11T13:57:01+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-11T13:57:01+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-11T13:57:01+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-11T13:57:01+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-11T13:57:01+00:00] INFO: Chef Run complete in 20.742329016 seconds
[2018-12-11T13:57:01+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-11T13:57:01+00:00] INFO: Running report handlers
[2018-12-11T13:57:01+00:00] INFO: Creating JSON run report
[2018-12-11T13:57:01+00:00] INFO: Report handlers complete
[  312.327558] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  312.337381] alg: No test for adler32 (adler32-zlib)
[  313.169111] Lustre: Lustre: Build Version: 2.10.6_RC3
[  313.394286] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  313.502285] LDISKFS-fs warning (device dm-2): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[  313.502285] 
[  363.899447] LDISKFS-fs (dm-2): recovery complete
[  363.907089] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  367.199217] Lustre: MGS: Connection restored to 04d4e57f-d16b-8ea7-0815-b48206b2a836 (at 0@lo)
[  367.614626] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  367.760483] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  367.914737] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect
[  367.925522] Lustre: soaked-MDT0000: Connection restored to 1b8367b1-f051-546e-f88f-694e2817a8cc (at 192.168.1.140@o2ib)
[  369.388620] Lustre: soaked-MDT0000: Connection restored to ae2721f1-9285-2304-935f-be2723c27377 (at 192.168.1.139@o2ib)
[  369.400789] Lustre: Skipped 4 previous similar messages
[  371.492025] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[  371.502460] Lustre: Skipped 1 previous similar message
[  377.320521] Lustre: soaked-MDT0000: Connection restored to fdb9299c-2d9e-6820-b38f-513e65188f5d (at 192.168.1.122@o2ib)
[  377.332735] Lustre: Skipped 4 previous similar messages
[  389.371545] Lustre: soaked-MDT0000: Connection restored to ae2213f0-99c9-30d3-1cb6-ec3869aa24bf (at 192.168.1.120@o2ib)
[  389.383703] Lustre: Skipped 9 previous similar messages
[  392.746819] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  406.676524] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[  406.685853] Lustre: Skipped 14 previous similar messages
[  417.762132] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  417.775311] LustreError: Skipped 2 previous similar messages
[  439.370742] Lustre: MGS: Connection restored to ae2213f0-99c9-30d3-1cb6-ec3869aa24bf (at 192.168.1.120@o2ib)
[  439.381828] Lustre: Skipped 25 previous similar messages
[  442.746143] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  467.762007] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  467.775042] LustreError: Skipped 1 previous similar message
[  492.745442] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  517.761128] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  517.774196] LustreError: Skipped 1 previous similar message
[  542.744881] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  547.843192] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  567.760677] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  567.776833] LustreError: Skipped 1 previous similar message
[  592.744081] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  607.859320] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  607.880456] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  617.759900] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  617.776234] LustreError: Skipped 1 previous similar message
[  642.743221] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  667.758944] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  667.775343] LustreError: Skipped 1 previous similar message
[  667.893485] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  667.914505] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  692.742460] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  699.742035] Lustre: 12239:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544537244/real 0]  req@ffff9936d10e6c00 x1619564287763328/t0(0) o400->soaked-OST0005-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 224/224 e 0 to 1 dl 1544537251 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[  699.742047] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[  699.810155] Lustre: 12239:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[  705.823940] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544537251/real 0]  req@ffff9936d10e1b00 x1619564287763568/t0(0) o8->soaked-OST0005-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544537257 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[  724.840206] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  724.856804] LustreError: Skipped 1 previous similar message
[  727.927617] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  727.949637] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  749.823644] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  760.823155] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544537301/real 0]  req@ffff9936d10e5100 x1619564287764192/t0(0) o8->soaked-OST000d-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544537312 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[  760.865846] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[  785.374787] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 1 seconds
[  787.962741] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  787.984887] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  824.847597] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  824.864575] LustreError: Skipped 3 previous similar messages
[  840.849001] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544537376/real 0]  req@ffff9936d10e6600 x1619564287765024/t0(0) o8->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544537392 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[  840.891605] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[  847.997871] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  848.019999] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  849.822196] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[  849.848282] LustreError: Skipped 1 previous similar message
[  865.821635] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544537401/real 0]  req@ffff9936d10e0300 x1619564287765408/t0(0) o8->soaked-OST000d-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544537417 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[  908.033007] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  908.055145] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  909.359389] Lustre: MGS: haven't heard from client f4dde0a6-1294-2c68-e758-f9db5c07d012 (at 192.168.1.105@o2ib) in 235 seconds. I think it's dead, and I am evicting it. exp ffff993729f42800, cur 1544537461 expire 1544537311 last 1544537226
[  941.525583] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[  941.546604] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[  941.560729] Lustre: Skipped 18 previous similar messages
[  945.820481] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544537476/real 0]  req@ffff9936d10e6c00 x1619564287767136/t0(0) o8->soaked-OST000d-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544537497 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[  945.862804] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[  957.100000] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[  968.068149] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  968.090246] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages
[  974.456197] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[  974.845665] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[  974.862120] LustreError: Skipped 5 previous similar messages
[  975.372079] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 3 seconds
[  989.905573] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[ 1000.388966] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1000.415021] LustreError: Skipped 2 previous similar messages
[ 1050.388362] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1050.414546] Lustre: Skipped 4 previous similar messages
[ 1063.473255] Lustre: soaked-OST0005-osc-MDT0000: Connection to soaked-OST0005 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1071.451303] Lustre: soaked-OST0005-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 1071.466739] Lustre: Skipped 14 previous similar messages
[ 1074.321027] Lustre: soaked-OST000d-osc-MDT0000: Connection to soaked-OST000d (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1088.102308] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[ 1088.124305] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages
[ 1268.135134] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[ 1268.157074] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 8 previous similar messages
[ 1275.410355] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[ 1275.426796] LustreError: Skipped 7 previous similar messages
[ 1300.383926] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1300.409818] LustreError: Skipped 5 previous similar messages
[ 1568.166198] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[ 1568.188072] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 15 previous similar messages
[ 1732.376600] Lustre: 12228:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544538277/real 0]  req@ffff9936d10e7200 x1619564287781376/t0(0) o400->soaked-OST0003-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 224/224 e 0 to 1 dl 1544538284 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 1732.376612] Lustre: soaked-OST000f-osc-MDT0000: Connection to soaked-OST000f (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1732.444912] Lustre: 12228:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 6 previous similar messages
[ 1738.458526] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544538284/real 0]  req@ffff9936d10e2400 x1619564287781648/t0(0) o8->soaked-OST0003-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544538290 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 1793.457626] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544538334/real 0]  req@ffff9936d10e6900 x1619564287782240/t0(0) o8->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544538345 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 1793.499714] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 1808.358392] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds
[ 1808.373527] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 3 previous similar messages
[ 1832.483247] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_connect to node 192.168.1.109@o2ib failed: rc = -114
[ 1832.499646] LustreError: Skipped 11 previous similar messages
[ 1857.456965] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1857.482643] LustreError: Skipped 10 previous similar messages
[ 1873.456393] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544538409/real 0]  req@ffff9936d10e1500 x1619564287783008/t0(0) o8->soaked-OST0003-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544538425 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 1873.498184] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 1898.455998] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544538434/real 0]  req@ffff9936d10e6900 x1619564287783520/t0(0) o8->soaked-OST000f-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544538450 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 1926.280699] Lustre: MGS: haven't heard from client f53763d8-ab87-690a-fce2-e6f8f6e5892e (at 192.168.1.107@o2ib) in 230 seconds. I think it's dead, and I am evicting it. exp ffff993729f45800, cur 1544538478 expire 1544538328 last 1544538248
[ 1972.355807] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 3 seconds
[ 1972.371006] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544538509/real 1544538524]  req@ffff9936d10e5400 x1619564287784272/t0(0) o8->soaked-OST0003-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544538530 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 1972.414407] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 2010.355296] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 2 seconds
[ 2061.354441] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 3 seconds
[ 2061.371553] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[ 2061.387830] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544538609/real 1544538613]  req@ffff9936d10e3300 x1619564287785552/t0(0) o8->soaked-OST0007-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544538635 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 2061.431224] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
[ 2108.193689] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[ 2108.215366] Lustre: 12404:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 26 previous similar messages
[ 2111.353663] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 3 seconds
[ 2111.368772] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[ 2162.352955] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 4 seconds
[ 2162.368013] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[ 2165.570762] LNet: 236:0:(o2iblnd_cb.c:2405:kiblnd_passive_connect()) Conn stale 192.168.1.107@o2ib version 12/12 incarnation 1544538717309262/1544538717309262
[ 2165.597350] Lustre: MGS: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 2165.610244] Lustre: Skipped 1 previous similar message
[ 2165.824599] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2165.840739] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 2165.852732] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST000b_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client[ 2166.352864] LNet: 12213:0:(o2iblnd_cb.c:1350:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.107@o2ib: connected
[ 2170.165921] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2170.182107] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline

[ 2170.193753] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0003_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client[ 2174.966780] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2174.985832] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 2174.997795] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST000f_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client
[ 2179.575590] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2179.594453] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 2179.605741] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0007_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client[ 2229.583946] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2229.603691] Lustre: Skipped 3 previous similar messages
[ 2279.584371] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2279.600718] Lustre: Skipped 3 previous similar messages
[ 2329.584418] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2329.600659] Lustre: Skipped 3 previous similar messages
[ 2332.518173] Lustre: soaked-MDT0000: recovery is timed out, evict stale exports
[ 2332.529843] Lustre: soaked-MDT0000: disconnecting 3 stale clients
[ 2332.540386] Lustre: 12404:0:(ldlm_lib.c:1619:abort_req_replay_queue()) @@@ aborted:  req@ffff993b3fd1a700 x1619486531060224/t0(60155270221) o36->19125282-9ba3-d605-7c0d-fee95de08d9f@192.168.1.119@o2ib:675/0 lens 616/0 e 76 to 0 dl 1544538905 ref 1 fl Complete:/4/ffffffff rc 0/-1
[ 2332.577496] LustreError: 12404:0:(ldlm_lib.c:1640:abort_lock_replay_queue()) @@@ aborted:  req@ffff993b16632850 x1619557402419744/t0(0) o101->soaked-MDT0003-mdtlov_UUID@192.168.1.111@o2ib:661/0 lens 328/0 e 76 to 0 dl 1544538891 ref 1 fl Complete:/40/ffffffff rc 0/-1
[ 2332.592197] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[ 2332.592200] Lustre: Skipped 4 previous similar messages
[ 2332.593359] Lustre: soaked-MDT0000: Denying connection for new client 19125282-9ba3-d605-7c0d-fee95de08d9f(at 192.168.1.119@o2ib), waiting for 29 known clients (23 recovered, 3 in progress, and 3 evicted) to recover in 21188487:36
[ 2332.904860] Lustre: 12404:0:(ldlm_lib.c:2049:target_recovery_overseer()) soaked-MDT0000 recovery is aborted by hard timeout
[ 2332.919854] Lustre: 12404:0:(ldlm_lib.c:2059:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[ 2332.937663] Lustre: soaked-MDT0000: Recovery over after 32:45, of 29 clients 23 recovered and 6 were evicted.
[ 2332.952951] Lustre: 12319:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 2379.584779] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2379.584787] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2379.584800] Lustre: Skipped 679 previous similar messages
[ 2379.626107] Lustre: Skipped 2 previous similar messages
[ 2479.586904] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2479.602657] Lustre: Skipped 7 previous similar messages
[ 2504.586840] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2504.586842] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 2504.586845] LustreError: Skipped 33 previous similar messages
[ 2504.650163] LustreError: Skipped 1 previous similar message
[ 2629.585108] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2629.600328] Lustre: Skipped 10 previous similar messages
[ 2929.581933] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 2929.598208] Lustre: Skipped 22 previous similar messages
[ 3104.579912] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 3104.606500] LustreError: Skipped 46 previous similar messages
[ 3479.574864] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 3479.590796] Lustre: Skipped 43 previous similar messages
[ 3704.573115] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 3704.599332] LustreError: Skipped 45 previous similar messages
[ 3883.301279] Lustre: 12597:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544540428/real 0]  req@ffff993b25610600 x1619564320931328/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544540435 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 3883.341052] Lustre: 12597:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
[ 3901.604145] Lustre: 12228:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544540434/real 1544540453]  req@ffff9933a26eb300 x1619564320931792/t0(0) o400->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544540492 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 3901.647565] Lustre: 12228:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 268 previous similar messages
[ 3901.662457] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 3901.687433] Lustre: Skipped 3 previous similar messages
[ 3909.245083] Lustre: 12588:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 3933.604631] Lustre: 12597:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544540485/real 1544540485]  req@ffff993b25610600 x1619564320931328/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544540492 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[ 3933.645293] Lustre: 12597:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 239624 previous similar messages
[ 3997.605552] Lustre: 12597:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544540549/real 1544540549]  req@ffff993b25610600 x1619564320931328/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544540556 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[ 3997.646461] Lustre: 12597:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 524664 previous similar messages
[ 4075.914402] LNet: Service thread pid 12608 was inactive for 200.43s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[ 4075.941311] Pid: 12608, comm: mdt00_018 3.10.0-957.el7_lustre.x86_64 #1 SMP Fri Nov 30 18:46:05 UTC 2018
[ 4075.955713] Call Trace:

[ 4075.961367]  [<ffffffffc0ebd9f1>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[ 4075.974981]  [<ffffffffc0ebf923>] ldlm_cli_enqueue_local+0x233/0x860 [ptlrpc]
[ 4075.985569]  [<ffffffffc13c08ec>] mdt_reint_rename_or_migrate.isra.39+0x67c/0x860 [mdt]
[ 4075.996951]  [<ffffffffc13c0b03>] mdt_reint_rename+0x13/0x20 [mdt]
[ 4076.006108]  [<ffffffffc13c4b43>] mdt_reint_rec+0x83/0x210 [mdt]
[ 4076.015415]  [<ffffffffc13a637b>] mdt_reint_internal+0x5fb/0x9c0 [mdt]
[ 4076.024761]  [<ffffffffc13b1f17>] mdt_reint+0x67/0x140 [mdt]
[ 4076.032994]  [<ffffffffc0f5642a>] tgt_request_handle+0x92a/0x1370 [ptlrpc]
[ 4076.042843]  [<ffffffffc0efee5b>] ptlrpc_server_handle_request+0x23b/0xaa0 [ptlrpc]
[ 4076.053309]  [<ffffffffc0f025a2>] ptlrpc_main+0xa92/0x1e40 [ptlrpc]
[ 4076.062062]  [<ffffffff872c1c31>] kthread+0xd1/0xe0
[ 4076.069133]  [<ffffffff87974c37>] ret_from_fork_nospec_end+0x0/0x39
[ 4076.077890]  [<ffffffffffffffff>] 0xffffffffffffffff
[ 4076.084953] LustreError: dumping log to /tmp/lustre-log.1544540627.12608
[ 4077.175272] LNet: Service thread pid 12559 was inactive for 201.69s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[ 4077.201008] Pid: 12559, comm: mdt01_010 3.10.0-957.el7_lustre.x86_64 #1 SMP Fri Nov 30 18:46:05 UTC 2018
[ 4077.214201] Call Trace:
[ 4077.219310]  [<ffffffffc0ebd9f1>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[ 4077.229722]  [<ffffffffc0ebf923>] ldlm_cli_enqueue_local+0x233/0x860 [ptlrpc]
[ 4077.239929]  [<ffffffffc13c08ec>] mdt_reint_rename_or_migrate.isra.39+0x67c/0x860 [mdt]
[ 4077.251168]  [<ffffffffc13c0b03>] mdt_reint_rename+0x13/0x20 [mdt]
[ 4077.259992]  [<ffffffffc13c4b43>] mdt_reint_rec+0x83/0x210 [mdt]
[ 4077.268492]  [<ffffffffc13a637b>] mdt_reint_internal+0x5fb/0x9c0 [mdt]
[ 4077.277535]  [<ffffffffc13b1f17>] mdt_reint+0x67/0x140 [mdt]
[ 4077.285473]  [<ffffffffc0f5642a>] tgt_request_handle+0x92a/0x1370 [ptlrpc]
[ 4077.294844]  [<ffffffffc0efee5b>] ptlrpc_server_handle_request+0x23b/0xaa0 [ptlrpc]
[ 4077.304954]  [<ffffffffc0f025a2>] ptlrpc_main+0xa92/0x1e40 [ptlrpc]
[ 4077.313401]  [<ffffffff872c1c31>] kthread+0xd1/0xe0
[ 4077.320171]  [<ffffffff87974c37>] ret_from_fork_nospec_end+0x0/0x39
[ 4077.328520]  [<ffffffffffffffff>] 0xffffffffffffffff
[ 4077.335313] Pid: 12416, comm: mdt01_003 3.10.0-957.el7_lustre.x86_64 #1 SMP Fri Nov 30 18:46:05 UTC 2018
[ 4077.347157] Call Trace:
[ 4077.351042]  [<ffffffffc0ebd9f1>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[ 4077.360085]  [<ffffffffc0ebf923>] ldlm_cli_enqueue_local+0x233/0x860 [ptlrpc]
[ 4077.369362]  [<ffffffffc13c08ec>] mdt_reint_rename_or_migrate.isra.39+0x67c/0x860 [mdt]
[ 4077.379375]  [<ffffffffc13c0b03>] mdt_reint_rename+0x13/0x20 [mdt]
[ 4077.387320]  [<ffffffffc13c4b43>] mdt_reint_rec+0x83/0x210 [mdt]
[ 4077.395046]  [<ffffffffc13a637b>] mdt_reint_internal+0x5fb/0x9c0 [mdt]
[ 4077.403325]  [<ffffffffc13b1f17>] mdt_reint+0x67/0x140 [mdt]
[ 4077.410623]  [<ffffffffc0f5642a>] tgt_request_handle+0x92a/0x1370 [ptlrpc]
[ 4077.419282]  [<ffffffffc0efee5b>] ptlrpc_server_handle_request+0x23b/0xaa0 [ptlrpc]
[ 4077.428796]  [<ffffffffc0f025a2>] ptlrpc_main+0xa92/0x1e40 [ptlrpc]
[ 4077.436733]  [<ffffffff872c1c31>] kthread+0xd1/0xe0
[ 4077.443060]  [<ffffffff87974c37>] ret_from_fork_nospec_end+0x0/0x39
[ 4077.450929]  [<ffffffffffffffff>] 0xffffffffffffffff
[ 4077.457323] Pid: 12317, comm: mdt00_001 3.10.0-957.el7_lustre.x86_64 #1 SMP Fri Nov 30 18:46:05 UTC 2018
[ 4077.468783] Call Trace:
[ 4077.472368]  [<ffffffffc0ebd9f1>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[ 4077.480964]  [<ffffffffc0ebf923>] ldlm_cli_enqueue_local+0x233/0x860 [ptlrpc]
[ 4077.489852]  [<ffffffffc13c08ec>] mdt_reint_rename_or_migrate.isra.39+0x67c/0x860 [mdt]
[ 4077.499690]  [<ffffffffc13c0b03>] mdt_reint_rename+0x13/0x20 [mdt]
[ 4077.507490]  [<ffffffffc13c4b43>] mdt_reint_rec+0x83/0x210 [mdt]
[ 4077.515094]  [<ffffffffc13a637b>] mdt_reint_internal+0x5fb/0x9c0 [mdt]
[ 4077.523278]  [<ffffffffc13b1f17>] mdt_reint+0x67/0x140 [mdt]
[ 4077.530489]  [<ffffffffc0f5642a>] tgt_request_handle+0x92a/0x1370 [ptlrpc]
[ 4077.539085]  [<ffffffffc0efee5b>] ptlrpc_server_handle_request+0x23b/0xaa0 [ptlrpc]
[ 4077.548552]  [<ffffffffc0f025a2>] ptlrpc_main+0xa92/0x1e40 [ptlrpc]
[ 4077.556468]  [<ffffffff872c1c31>] kthread+0xd1/0xe0
[ 4077.562798]  [<ffffffff87974c37>] ret_from_fork_nospec_end+0x0/0x39
[ 4077.570682]  [<ffffffffffffffff>] 0xffffffffffffffff
[ 4077.577108] Pid: 12415, comm: mdt00_003 3.10.0-957.el7_lustre.x86_64 #1 SMP Fri Nov 30 18:46:05 UTC 2018
[ 4077.588574] Call Trace:
[ 4077.592146]  [<ffffffffc0ebd9f1>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[ 4077.600707]  [<ffffffffc0ebf923>] ldlm_cli_enqueue_local+0x233/0x860 [ptlrpc]
[ 4077.609549]  [<ffffffffc13c08ec>] mdt_reint_rename_or_migrate.isra.39+0x67c/0x860 [mdt]
[ 4077.619337]  [<ffffffffc13c0b03>] mdt_reint_rename+0x13/0x20 [mdt]
[ 4077.627087]  [<ffffffffc13c4b43>] mdt_reint_rec+0x83/0x210 [mdt]
[ 4077.634632]  [<ffffffffc13a637b>] mdt_reint_internal+0x5fb/0x9c0 [mdt]
[ 4077.642755]  [<ffffffffc13b1f17>] mdt_reint+0x67/0x140 [mdt]
[ 4077.649918]  [<ffffffffc0f5642a>] tgt_request_handle+0x92a/0x1370 [ptlrpc]
[ 4077.658470]  [<ffffffffc0efee5b>] ptlrpc_server_handle_request+0x23b/0xaa0 [ptlrpc]
[ 4077.667896]  [<ffffffffc0f025a2>] ptlrpc_main+0xa92/0x1e40 [ptlrpc]
[ 4077.675761]  [<ffffffff872c1c31>] kthread+0xd1/0xe0
[ 4077.682045]  [<ffffffff87974c37>] ret_from_fork_nospec_end+0x0/0x39
[ 4077.689885]  [<ffffffffffffffff>] 0xffffffffffffffff
[ 4077.696271] LNet: Service thread pid 12550 was inactive for 202.21s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
[ 4079.567153] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 4079.567156] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 4079.567161] Lustre: Skipped 44 previous similar messages
[ 4079.603885] Lustre: Skipped 1 previous similar message
[ 4080.218680] Lustre: MGS: haven't heard from client 67d3360d-ad6b-0973-2b3d-61d0ead40bc3 (at 192.168.1.109@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff9933b1162800, cur 1544540632 expire 1544540482 last 1544540404
[ 4127.692631] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544540653/real 0]  req@ffff9936c3912100 x1619564320944000/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544540679 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 4127.730280] Lustre: 12224:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 673677 previous similar messages
[ 4132.323589] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 1 seconds
[ 4132.337375] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[ 4144.323408] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 13 seconds
[ 4144.337287] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[ 4157.323223] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 5 seconds
[ 4157.337007] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[ 4169.323059] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 17 seconds
[ 4169.336895] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[ 4175.475918] LustreError: 12575:0:(ldlm_request.c:130:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1544540427, 300s ago); not entering recovery in server code, just going back to sleep ns: mdt-soaked-MDT0000_UUID lock: ffff993b2b540800/0xc2e37e66498dbd7f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2 rrc: 38 type: IBT flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 12575 timeout: 0 lvb_type: 0
[ 4175.476161] LustreError: dumping log to /tmp/lustre-log.1544540727.12319
[ 4175.514322] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[ 4175.514325] Lustre: Skipped 684 previous similar messages
[ 4175.560495] LustreError: 12575:0:(ldlm_request.c:130:ldlm_expired_completion_wait()) Skipped 13 previous similar messages
[ 4195.322639] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 43 seconds
[ 4195.336852] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[ 4233.322050] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 1 seconds
[ 4233.336155] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[ 4304.953091] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.120@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4304.978195] LustreError: Skipped 290 previous similar messages
[ 4308.320902] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 56 seconds
[ 4308.335167] LNet: 12213:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 10 previous similar messages
[ 4388.319680] Lustre: 12597:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544540933/real 1544540933]  req@ffff993b25610600 x1619564320931328/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544540940 ref 1 fl Rpc:X/2/ffffffff rc 0/-1
[ 4388.359072] Lustre: 12597:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 24 previous similar messages
[ 4403.987440] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 4404.513910] Lustre: soaked-MDT0000: Client soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib) refused connection, still busy with 33 references
[ 4404.738682] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[ 4404.750283] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0001_UUID (at 192.168.1.109@o2ib) because it is indicating it is a new client[ 4409.372880] LustreError: 12597:0:(ldlm_lockd.c:697:ldlm_handle_ast_error()) ### client (nid 192.168.1.109@o2ib) returned error from completion AST (req@ffff993b25610600 x1619564320931328 status -107 rc -107), evict it ns: mdt-soaked-MDT0000_UUID lock: ffff993b299cb400/0xc2e37e66498db9ce lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2 rrc: 36 type: IBT flags: 0x60000001000020 nid: 192.168.1.109@o2ib remote: 0x59bef46ec93d8e1 expref: 32 pid: 12731 timeout: 0 lvb_type: 0
[ 4409.436509] LustreError: 138-a: soaked-MDT0000: A client on nid 192.168.1.109@o2ib was evicted due to a lock completion callback time out: rc -107
[ 4409.458382] LNet: Service thread pid 12590 completed after 533.98s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
[ 4429.737889] Lustre: soaked-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 4704.557170] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[ 4704.573662] Lustre: Skipped 50 previous similar messages
[ 4754.732876] Lustre: soaked-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 4904.554379] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 4904.567390] Lustre: Skipped 1 previous similar message
[ 5054.552542] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 5054.566178] Lustre: Skipped 2 previous similar messages
[ 5846.424867] LustreError: 12415:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 6373.201657] LustreError: 12467:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 6819.439391] LustreError: 12557:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 7509.753799] Lustre: 12610:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00H               0.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00H               tel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [02;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [02;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [7m[4;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[4;79H[m[m[5;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [4;79H[22;1H   The selected entry will be started automatically in 5s.                     [4;79H[22;1H   The selected entry will be started automatically in 4s.                     [4;79H[22;1H   The selected entry will be started automatically in 3s.                     [4;79H[22;1H   The selected entry will be started automatically in 2s.                     [4;79H[22;1H   The selected entry will be started automatically in 1s.                     [4;79H[22;1H   The selected entry will be started automatically in 0s.                     [4;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-307-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Fri Nov 30 18:46:05 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x34b20000-0x36587fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 320MB of memory at 512MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff886c6e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 6841488k/34603008k available (7664k kernel code, 1126748k absent, 1001116k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.333 MHz processor
[    0.000179] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.66 BogoMIPS (lpj=2693333)
[    0.012725] pid_max: default: 245760 minimum: 1920
[    0.019242] Security Framework initialized
[    0.024143] SELinux:  Initializing.
[    0.028611] Yama: becoming mindful.
[    0.038087] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.060364] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.074805] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.082879] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.093698] Initializing cgroup subsys memory
[    0.098917] Initializing cgroup subsys devices
[    0.104192] Initializing cgroup subsys freezer
[    0.109457] Initializing cgroup subsys net_cls
[    0.114717] Initializing cgroup subsys blkio
[    0.119785] Initializing cgroup subsys perf_event
[    0.125380] Initializing cgroup subsys hugetlb
[    0.130716] Initializing cgroup subsys pids
[    0.135689] Initializing cgroup subsys net_prio
[    0.141323] mce: CPU supports 20 MCE banks
[    0.146220] CPU0: Thermal monitoring enabled (TM1)
[    0.151952] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.158385] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.165010] tlb_flushall_shift: 6
[    0.169085] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.180348] FEATURE SPEC_CTRL Present
[    0.184727] FEATURE IBPB_SUPPORT Present
[    0.189703] Spectre V2 : Mitigation: Full retpoline
[    0.196576] Freeing SMP alternatives: 28k freed
[    0.208324] ACPI: Core revision 20130517
[    0.304239] ACPI: All ACPI Tables successfully acquired
[    0.324639] ftrace: allocating 29187 entries in 115 pages
[    0.386498] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.394201] Switched APIC routing to physical flat.
[    0.400671] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.417691] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.428942] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.441660] ... version:                3
[    0.451083] ... bit width:              48
[    0.455953] ... generic registers:      4
[    0.460715] ... value mask:             0000ffffffffffff
[    0.466939] ... max period:             00007fffffffffff
[    0.473166] ... fixed-purpose events:   3
[    0.477930] ... event mask:             000000070000000f
[    0.492728] smpboot: Booting Node   0, Processors  #1[    0.514556] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.570904] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.711984] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.755176] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.796670] Brought up 32 CPUs
[    0.800865] smpboot: Max logical packages: 15
[    0.806046] smpboot: Total of 32 processors activated (172564.03 BogoMIPS)
[    1.063809] node 0 initialised, 2813371 pages in 136ms
[    1.101840] node 1 initialised, 3595039 pages in 168ms
[    1.109144] devtmpfs: initialized
[    1.124632] EVM: security.selinux
[    1.128629] EVM: security.ima
[    1.132232] EVM: security.capability
[    1.136799] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.146171] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.159128] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.167113] pinctrl core: initialized pinctrl subsystem
[    1.173532] RTC time: 16:09:36, date: 12/11/18
[    1.179303] NET: Registered protocol family 16
[    1.185116] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.194097] ACPI: bus type PCI registered
[    1.198879] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.207013] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.217937] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.225867] PCI: Using configuration type 1 for base access
[    1.232451] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.253394] ACPI: Added _OSI(Module Device)
[    1.258367] ACPI: Added _OSI(Processor Device)
[    1.263626] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.269171] ACPI: Added _OSI(Processor Aggregator Device)
[    1.275496] ACPI: Added _OSI(Linux-Dell-Video)
[    1.320604] ACPI: Executed 1 blocks of module-level executable AML code
[    1.610003] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.643386] ACPI: Interpreter enabled
[    1.647806] ACPI: (supports S0 S1 S5)
[    1.652177] ACPI: Using IOAPIC for interrupt routing
[    1.658149] HEST: Table parsing has been initialized.
[    1.664094] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.674891] ACPI: GPE 0x1E active on init
[    1.679848] ACPI: GPE 0x24 active on init
[    1.684786] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.750975] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.758187] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.768352] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.777347] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.786404] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.796345] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.808522] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.823910] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.839677] PCI host bridge to bus 0000:00
[    1.844546] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.851740] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.860596] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.869457] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.878321] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.887186] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.896048] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.904915] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.913774] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.922640] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.931503] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.940366] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.949229] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.958094] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.966954] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.976600] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.983568] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.990488] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.997417] pci 0000:00:02.0: System wakeup disabled by ACPI
[    2.004333] pci 0000:00:02.2: System wakeup disabled by ACPI
[    2.011256] pci 0000:00:03.0: System wakeup disabled by ACPI
[    2.021791] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    2.028730] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    2.035640] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    2.042592] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.049449] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.057032] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.063057] acpiphp: Slot [2] registered
[    2.068023] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.078879] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.090059] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.100903] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.112072] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.122900] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.134073] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.144912] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.157749] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.164102] acpiphp: Slot [2-2] registered
[    2.171466] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.177506] acpiphp: Slot [2-3] registered
[    2.182413] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.188428] acpiphp: Slot [2-4] registered
[    2.193628] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.199833] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.213145] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.219112] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.225388] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.232087] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.238053] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.247349] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.256404] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.265447] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.274477] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.283504] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.292533] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.301556] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.310570] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.319792] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.326999] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.336912] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.345743] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.354800] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.364877] PCI host bridge to bus 0000:80
[    2.369748] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.377632] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.385516] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.394386] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.403251] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.412894] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.419546] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.426444] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.433346] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.440234] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.449358] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.455298] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.461230] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.467144] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.488709] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.495626] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.505326] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.515505] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.522804] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.532575] PCI host bridge to bus 0000:7f
[    2.537444] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.548359] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.555276] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.564976] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.575154] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.582454] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.592229] PCI host bridge to bus 0000:ff
[    2.597100] pci_bus 0000:ff: root bus resource [bus ff]
[    2.608633] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.618203] vgaarb: loaded
[    2.621513] vgaarb: bridge control possible 0000:09:00.0
[    2.628185] SCSI subsystem initialized
[    2.632725] ACPI: bus type USB registered
[    2.637532] usbcore: registered new interface driver usbfs
[    2.643973] usbcore: registered new interface driver hub
[    2.650496] usbcore: registered new device driver usb
[    2.656982] EDAC MC: Ver: 3.0.0
[    2.661333] PCI: Using ACPI for IRQ routing
[    2.673937] NetLabel: Initializing
[    2.678029] NetLabel:  domain hash size = 128
[    2.683189] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.689066] NetLabel:  unlabeled traffic allowed by default
[    2.695933] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.703931] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.712795] amd_nb: Cannot enumerate AMD northbridges
[    2.718934] Switched to clocksource hpet
[    2.738283] pnp: PnP ACPI init
[    2.742030] ACPI: bus type PNP registered
[    2.747105] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.754027] system 00:00: [io  0xffff] has been reserved
[    2.760256] system 00:00: [io  0xffff] has been reserved
[    2.766501] system 00:00: [io  0xffff] has been reserved
[    2.772733] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.780046] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.786963] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.793879] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.800793] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.808097] system 00:00: [io  0x0cf9] could not be reserved
[    2.814949] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.823408] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.831107] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.838788] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.846478] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.854171] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.861868] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.869947] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.878034] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.886112] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.894318] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.902942] pnp: PnP ACPI: found 7 devices
[    2.907813] ACPI: bus type PNP unregistered
[    2.922202] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.928072] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.934207] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.941318] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.949216] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.955059] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.962945] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.972892] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.978741] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.984588] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.991687] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.999585] pci 0000:00:11.0: PCI bridge to [bus 07]
[    3.005429] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    3.012540] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    3.020427] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    3.030372] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    3.036228] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    3.042078] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    3.049963] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    3.059127] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    3.065207] pci 0000:80:01.0: PCI bridge to [bus 81]
[    3.071058] pci 0000:80:02.0: PCI bridge to [bus 82]
[    3.076920] pci 0000:80:03.0: PCI bridge to [bus 83]
[    3.082777] pci 0000:80:03.2: PCI bridge to [bus 84]
[    3.089015] NET: Registered protocol family 2
[    3.096354] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.106031] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.114086] TCP: Hash tables configured (established 262144 bind 65536)
[    3.121878] TCP: reno registered
[    3.125940] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.133401] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.142404] NET: Registered protocol family 1
[    4.248007] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.356075] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.364993] Un packing initram[    6.198577] Freeing initrd memory: 27040k freed
[    6.214542] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    6.222057] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff8868f73c7000-ffff8868fb3c6fff]
[    6.234108] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    6.243473] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    6.250200] RAPL PMU: hw unit of domain package 2^-16 Joules
[    6.256837] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    6.276318] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    6.283457] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    6.297679] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    6.306260] Initialise system trusted keyring
[    6.311576] audit: initializing netlink socket (disabled)
[    6.317967] type=2000 audit(1544544577.822:1): initialized
[    6.380325] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.387735] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.398293] zpool: loaded
[    6.401528] zbud: loaded
[    6.405859] VFS: Disk quotas dquot_6.6.0
[    6.411054] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.420060] msgmni has been set to 32768
[    6.425141] Key type big_key registered
[    6.432379] NET: Registered protocol family 38
[    6.437673] Key type asymmetric registered
[    6.442561] Asymmetric key parser 'x509' registered
[    6.448471] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.457532] io scheduler noop registered
[    6.462232] io scheduler deadline registered (default)
[    6.468437] io scheduler cfq registered
[    6.473024] io scheduler mq-deadline registered
[    6.478399] io scheduler kyber registered
[    6.489092] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.497230] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.505326] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.512942] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.520548] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.528164] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.535800] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.543894] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.551543] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.559675] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.567771] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.575421] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.583521] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.591125] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.598752] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.606879] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.614977] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.622631] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.630762] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.638896] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.647029] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.655240] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.661805] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.669551] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.678181] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.686970] ACPI: Power Button [PWRF]
[    6.691450] ACPI: Requesting acpi_cpufreq
[    6.779387] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.788289] pstore: Registered erst as persistent store backend
[    6.795550] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.804574] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.832751] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.860184] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.867797] Non-volatile memory driver v1.3
[    6.872863] Linux agpgart interface v0.103
[    6.878179] crash memory driver: version 1.1
[    6.883750] rdac: device handler registered
[    6.888825] hp_sw: device handler registered
[    6.893927] emc: device handler registered
[    6.899110] alua: device handler registered
[    6.904212] libphy: Fixed MDIO Bus: probed
[    6.914048] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.921668] ehci-pci: EHCI PCI platform driver
[    6.927431] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.933682] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.942517] ehci-pci 0000:00:1a.0: debug port 2
[    6.951849] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.964184] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.971014] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.978909] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.987507] usb usb1: Product: EHCI Host Controller
[    6.993259] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.001947] usb usb1: SerialNumber: 0000:00:1a.0
[    7.007639] hub 1-0:1.0: USB hub found
[    7.012147] hub 1-0:1.0: 2 ports detected
[    7.017518] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    7.023767] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    7.032577] ehci-pci 0000:00:1d.0: debug port 2
[    7.041896] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    7.054186] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    7.060979] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    7.068873] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.077472] usb usb2: Product: EHCI Host Controller
[    7.083231] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    7.091916] usb usb2: SerialNumber: 0000:00:1d.0
[    7.097583] hub 2-0:1.0: USB hub found
[    7.102087] hub 2-0:1.0: 2 ports detected
[    7.107120] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    7.114346] ohci-pci: OHCI PCI platform driver
[    7.119678] uhci_hcd: USB Universal Host Controller Interface driver
[    7.127255] usbcore: registered new interface driver usbserial_generic
[    7.134905] usbserial: USB Serial support registered for generic
[    7.142008] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    7.271327] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    8.195019] i8042: No controller found
[    8.199551] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    8.199596] Switched to clocksource tsc
[    8.199688] mousedev: PS/2 mouse device common for all mice
[    8.199910] rtc_cmos 00:01: RTC can wake from S4
[    8.200132] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    8.200188] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    8.200319] intel_pstate: Intel P-state driver initializing
[    8.215668] cpuidle: using governor menu
[    8.217202] hidraw: raw HID events driver (C) Jiri Kosina
[    8.217468] usbcore: registered new interface driver usbhid
[    8.217469] usbhid: USB HID core driver
[    8.217688] drop_monitor: Initializing network drop monitor service
[    8.218277] TCP: cubic registered
[    8.218287] Initializing XFRM netlink socket
[    8.218972] NET: Registered protocol family 10
[    8.220569] NET: Registered protocol family 17
[    8.220583] mpls_gso: MPLS GSO support
[    8.223743] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    8.224069] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    8.224293] Loading compiled-in X.509 certificates
[    8.225387] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    8.226424] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    8.227466] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: c7aec20a70554693bf19667e4c28ac12c728bbb2'
[    8.227501] registered taskstats version 1
[    8.232445] Key type trusted registered
[    8.236298] Key type encrypted registered
[    8.236422] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    8.238011]   Magic number: 14:177:186
[    8.238294] acpi device:45: hash matches
[    8.239926] rtc_cmos 00:01: setting system clock to 2018-12-11 16:09:44 UTC (1544544584)
[    8.363283] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    8.375634] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    8.375638] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.375947] hub 1-1:1.0: USB hub found
[    8.376009] hub 1-1:1.0: 6 ports detected
[    8.434803] Freeing unused kernel memory: 1876k freed
[    8.441185] Write protecting the kernel read-only data: 12288k
[    8.449714] Freeing unused kernel memory: 516k freed
[    8.457171] Freeing unused kernel memory: 600k freed
[    8.470869] random: systemd: uninitialized urandom read (16 bytes read)
[    8.477928] random: fast init done
[    8.488254] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.488690] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    8.488693] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.489128] hub 2-1:1.0: USB hub found
[    8.489313] hub 2-1:1.0: 8 ports detected
[    8.535888] systemd[1]: Detected architecture x86-64.
[    8.541844] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.557456] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.638659] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.649582] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.660426] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.670530] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.684383] systemd[1]: Starting Create list of required static device nodes for the current kernel...
          Startin[    8.705179] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    8.716406] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.729466] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[    8.742421] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.753169] systemd[1]: Starting Setup Virtual Console...
         Starting Setup Virtual Console...
[    8.764333] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
[    8.772864] systemd[1]: Starting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.794274] systemd[1]: Starting dracut cmdline hook...
         Starting dracut cmdline hook...
[    8.805452] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.818388] systemd[1]: Reached target  Sockets.
[[3ets.
[    8.828385] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.838782] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
[ [32m  OK  [0mte list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m]  Started Setup [ [32m  OK  [0me s.
         Steate Static Device Nodes in [    8.880792] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
/dev...
[    8.889499] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.899055] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.905481] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.912199] usb 2-1.4: SerialNumber: serial
[    8.913792] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
[ [32m  OK  [0mNodes in /dev.
[[32m  OK  [0m] Started dracut cmdline hook.
         Starting dracut pre-udev hook...
[    8.964844] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
[    8.983652] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
[    8.998994] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Show Plymouth Boot Screen...
         Starting dracut initqueue hook...
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Rea[    9.178376] dca service started, version 1.12.1
ched target Basi[    9.185925] mlx_compat: loading out-of-tree module taints kernel.
c System.
[    9.194733] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    9.206893] pps_core: LinuxPPS API ver. 1 registered
[    9.212730] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    9.224108] Compat-mlnx-ofed backport release: b4fdfac
[    9.230150] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    9.237845] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    9.245406] PTP clock support registered
[    9.278538] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    9.286618] igb: Copyright (c) 2007-2014 Intel Corporation.
[    9.296067] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    9.296367] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    9.306391] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    9.306396] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    9.320820] scsi host0: ahci
[    9.321004] scsi host1: ahci
[    9.323224] scsi host2: ahci
%G[    9.323716] scsi host3: ahci
[    9.323866] scsi host4: ahci
[    9.324019] scsi host5: ahci
[    9.324105] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 38
[    9.324108] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 38
[    9.324110] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 38
[    9.324113] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 38
[    9.324115] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 38
[    9.324118] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 38
[    9.335723] igb 0000:02:00.0: added PHC on eth0
[    9.335725] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.335728] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    9.335801] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    9.335804] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.336563] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.344280] mlx4_core: Initializing 0000:04:00.0
%G[    9.369069] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    9.369109] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.369116] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    9.369122] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    9.369124] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.369126] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.369315] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.372137] scsi host6: isci
[    9.374897] igb 0000:02:00.1: added PHC on eth1
[    9.374899] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.374900] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.374973] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.374974] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.387593] [TTM] Zone  kernel: Available graphics memory: 16252602 kiB
[    9.387594] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.387595] [TTM] Initializing pool allocator
[    9.387599] [TTM] Initializing DMA pool allocator
[    9.430425] igb 0000:02:00.2: added PHC on eth2
[    9.430426] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.430428] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.430501] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.430502] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.450889] fbcon: mgadrmfb (fb0) is primary device
[    9.486826] igb 0000:02:00.3: added PHC on eth3
[    9.486827] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.486829] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.486902] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.486904] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.628419] ata1: SATA link down (SStatus 0 SControl 300)
[    9.629389] ata5: SATA link down (SStatus 0 SControl 300)
[    9.629437] ata6: SATA link down (SStatus 0 SControl 300)
[    9.629483] ata3: SATA link down (SStatus 0 SControl 300)
[    9.629528] ata2: SATA link down (SStatus 0 SControl 300)
[    9.629573] ata4: SATA link down (SStatus 0 SControl 300)
[    9.681288] Console: switching to colour frame buffer device 128x48
[    9.704965] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.721414] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   11.047409] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   11.055538] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   11.065853] ata7.00: configured for UDMA/133
[   11.082983] scsi 6:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.876052] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.883699] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.891140] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.898970] mlx4_core: device is working in RoCE mode: Roce V1
[   15.906110] mlx4_core: UD QP Gid type is: V1
[   16.969588] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   17.234808] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   17.246534] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   17.258861] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   17.377822] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   17.385866] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   17.396045] ata8.00: configured for UDMA/133
[   17.413826] scsi 6:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.468965] sd 6:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.469046] sd 6:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.469157] sd 6:0:0:0: [sda] Write Protect is off
[   17.469186] sd 6:0:1:0: [sdb] Write Protect is off
[   17.469216] sd 6:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.469225] sd 6:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.501749]  sdb:
[   17.501753]  sda: sda1 sda2
[   17.502263] sd 6:0:1:0: [sdb] Attached SCSI disk
[   17.502475] sd 6:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   18.296809] random: crng init done
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
         Mounting /sysroot...
[   18.579724] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped target Timers.
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped target Local File Systems.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped target Socke[   19.071332] systemd-journald[282]: Received SIGTERM from PID 1 (systemd).
ts.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Closed udev Kernel Socket.
[[32m  OK  [0m] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.416925] SELinux:  Disabled at runtime.
[   19.484035] type=1404 audit(1544544595.743:2): selinux=0 auid=4294967295 ses=4294967295
[   19.722916] ip_tables: (C) 2000-2006 Netfilter Core Team
[   19.731393] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Listening on udev Kernel Socket.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
         Mounting POSIX Message Queue File System...
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Listening on udev Control Socket.
         Mounting Debug File System...
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[[32m  OK  [0m] Created slice system-getty.slice.
         Starting Create list of required st... nodes for the current kernel...
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Stopped target Initrd Root File System.
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
         Mounting Huge Pages File System...
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Reached target Slices.
         Starting Availability of block devices...
[[32m  OK  [0m] Started Replay Read-Ahead Data.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Availability of block devices.
         Starting Create Static Device Nodes in /dev...
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
[[32m  OK  [0m] Started Journal Service.
[   20.837708] RPC: Registered named UNIX socket transport module.
[   20.845585] RPC: Registered udp transport module.
[   20.851950] RPC: Registered tcp transport module.
[   20.858276] RPC: Registered tcp NFSv4.1 backchannel transport module.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.[   20.914837] EXT4-fs (sda1): re-mounted. Opts: (null)

[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting Flush Journal to Persistent Storage...
         Starting udev Coldplug all Devices...
         Starting Configure read-only root support...
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[   21.081813] systemd-journald[4365]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started LVM2 metadata daemon.
[   21.342597] device-mapper: uevent: version 1.0.3
[   21.349624] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Started udev Kernel Device Manager.
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[   21.540311] ipmi message handler version 39.2
[   21.548264] ipmi device interface
[   21.553296] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.566761] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.580227] IPMI System Interface driver.
[   21.585632] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   21.593160] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   21.601072] ipmi_si: Adding SMBIOS-specified kcs state machine
[   21.608424] ipmi_platform: probing via SPMI
[   21.613887] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   21.621101] (NULL device *): SPMI-specified kcs state machine: duplicate
[   21.631740] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   21.632243] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   21.651269] i801_smbus 0000:07:00.3: Enabling SMBus device
[   21.651298] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   21.675377] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   21.686710] igb 0000:02:00.0: DCA enabled
[   21.695158] igb 0000:02:00.1: DCA enabled
[   21.702212] igb 0000:02:00.2: DCA enabled
[   21.708045] igb 0000:02:00.3: DCA enabled
[   21.715243] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   21.733855] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   21.775324] sd 6:0:0:0: Attached scsi generic sg0 type 0
[   21.782770] sd 6:0:1:0: Attached scsi generic sg1 type 0
[[32m  OK  [0m] Found device /dev/ttyS0.
[   21.790794] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   21.791050] mpt2sas version 20.103.01.00 loaded
[   21.791446] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[   21.793776] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32505204 kB)
[   21.816836] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   21.848153] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[   21.848866] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 168
[   21.848867] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 169
[   21.848868] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 170
[   21.848869] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 171
[   21.848870] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 172
[   21.848871] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 173
[   21.848871] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 174
[   21.848872] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 175
[   21.848873] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 176
[   21.848874] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 177
[   21.848875] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 178
[   21.848875] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 179
[   21.848876] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 180
[   21.848877] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 181
[   21.848878] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 182
[   21.848879] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 183
[   21.848880] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffaa1d83c00000), size(65536)
[   21.848881] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[   21.872653] IPMI SSIF Interface driver
[   21.903151] mpt2sas_cm0: sending message unit reset !!
[   21.904661] mpt2sas_cm0: message unit reset: SUCCESS
[   21.906689] cryptd: max_cpu_qlen set to 1000
[   21.907297] iTCO_vendor_support: vendor-support=0
[   21.909481] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   21.909548] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   21.922667] AVX version of gcm_enc/dec engaged.
[   21.922668] AES CTR mode by8 optimization enabled
[   21.924896] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   21.924933] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   21.971043] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[   21.971045] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[   21.971045] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[   21.980559] device-mapper: multipath round-robin: version 1.2.0 loaded
[   21.992762] kvm: disabled by bios
[   21.998727] intel_rapl: Found RAPL domain package
[   21.998729] intel_rapl: Found RAPL domain core
[   21.998733] intel_rapl: Found RAPL domain dram
[   21.998748] intel_rapl: Found RAPL domain package
[   21.998750] intel_rapl: Found RAPL domain core
[   21.998755] intel_rapl: Found RAPL domain dram
[   22.007747] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.007954] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.007955] EDAC sbridge:  Ver: 1.1.2 
[   22.031568] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[   22.031570] mpt2sas_cm0: Protocol=(
[   22.031570] Initiator
[   22.031571] ,Target
[   22.031571] ), 
[   22.031572] Capabilities=(
[   22.031572] TLR
[   22.031573] ,EEDP
[   22.031573] ,Snapshot Buffer
[   22.031574] ,Diag Trace Buffer
[   22.031574] ,Task Set Full
[   22.031575] ,NCQ
[   22.031575] )
[   22.031621] scsi host7: Fusion MPT SAS Host
[   22.031945] mpt2sas_cm0: sending port enable !!
[   22.034628] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[   22.043158] mpt2sas_cm0: port enable: SUCCESS
[   22.043913] scsi 7:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.043917] scsi 7:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.043919] scsi 7:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.043921] scsi 7:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.270457] scsi 7:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.270462] scsi 7:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.270463] scsi 7:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.270466] scsi 7:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
%G%G[   22.524573] scsi 7:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.534291] scsi 7:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.546693] scsi 7:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.555350] scsi 7:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.582598] scsi 7:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.592771] scsi 7:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.605227] scsi 7:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.613913] scsi 7:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.642593] scsi 7:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   22.652462] scsi 7:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   22.665009] scsi 7:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   22.673808] scsi 7:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.721115] scsi 7:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.731535] scsi 7:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.744161] scsi 7:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.753042] scsi 7:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.780974] scsi 7:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.791045] scsi 7:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.803754] scsi 7:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.812772] scsi 7:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.837698] scsi 7:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.847860] scsi 7:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.860653] scsi 7:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.869698] scsi 7:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.917615] scsi 7:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   22.927866] scsi 7:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   22.940751] scsi 7:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   22.949973] scsi 7:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   22.982756] scsi 7:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   22.992976] scsi 7:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   23.005918] scsi 7:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   23.015120] scsi 7:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   23.046920] scsi 7:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   23.053917] sd 7:0:0:0: Attached scsi generic sg2 type 0
[   23.061092] sd 7:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.071546] sd 7:0:0:0: [sdc] Write Protect is off
[   23.078972] scsi 7:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   23.079121] sd 7:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.087098] sd 7:0:0:0: [sdc] Attached SCSI disk
[   23.103960] sd 7:0:0:1: Attached scsi generic sg3 type 0
[   23.104073] sd 7:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.104650] sd 7:0:0:1: [sdd] Write Protect is off
[   23.104876] sd 7:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.106393] Dev sdd: unable to read RDB block 0
[   23.106401]  sdd: unable to read partition table
[   23.107609] sd 7:0:0:1: [sdd] Attached SCSI disk
[   23.158037] scsi 7:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   23.166440] sd 7:0:0:2: Attached scsi generic sg4 type 0
[   23.167006] device-mapper: table: 253:1: multipath: error getting device
[   23.167007] device-mapper: ioctl: error adding target to table
[   23.183704] sd 7:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.203094] sd 7:0:0:2: [sde] Write Protect is off
[   23.203474] scsi 7:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   23.203755] sd 7:0:0:3: Attached scsi generic sg5 type 0
[   23.203791] sd 7:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.204163] sd 7:0:0:7: Attached scsi generic sg6 type 0
[   23.204286] sd 7:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.204500] sd 7:0:0:3: [sdf] Write Protect is off
[   23.204821] sd 7:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.204898] scsi 7:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   23.205261] sd 7:0:1:0: Attached scsi generic sg7 type 0
[   23.205274] sd 7:0:0:7: [sdg] Write Protect is off
[   23.205315] sd 7:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.205577] sd 7:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.206099] sd 7:0:1:0: [sdh] Write Protect is off
[   23.206247] scsi 7:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   23.206386] sd 7:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.206600] sd 7:0:1:1: Attached scsi generic sg8 type 0
[   23.206789] sd 7:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.207114] Dev sdf: unable to read RDB block 0
[   23.207133]  sdf: unable to read partition table
[   23.207510] scsi 7:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   23.207714] sd 7:0:1:1: [sdi] Write Protect is off
[   23.207742] sd 7:0:1:2: Attached scsi generic sg9 type 0
[   23.208124] sd 7:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.208172] sd 7:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.209012] scsi 7:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   23.209302] sd 7:0:1:3: Attached scsi generic sg10 type 0
[   23.209379] Dev sdh: unable to read RDB block 0
[   23.209387]  sdh: unable to read partition table
[   23.209522] sd 7:0:1:2: [sdj] Write Protect is off
[   23.209659] sd 7:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   23.209668] sd 7:0:1:7: Attached scsi generic sg11 type 0
[   23.209913] sd 7:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.210391] sd 7:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   23.211149] sd 7:0:0:3: [sdf] Attached SCSI disk
[   23.211187] sd 7:0:1:3: [sdk] Write Protect is off
[   23.211943] sd 7:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.212005] sd 7:0:1:7: [sdl] Write Protect is off
[   23.212832] sd 7:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   23.213477] sd 7:0:1:0: [sdh] Attached SCSI disk
[   23.214140] Dev sdj: unable to read RDB block 0
[   23.214148]  sdj: unable to read partition table
[   23.215781] sd 7:0:1:1: [sdi] Attached SCSI disk
[   23.216927] sd 7:0:1:2: [sdj] Attached SCSI disk
[   23.217623] sd 7:0:1:3: [sdk] Attached SCSI disk
[   23.391324]  sdg:
[   23.392609] sd 7:0:0:7: [sdg] Attached SCSI disk
[   23.551127] sd 7:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   23.565521] sd 7:0:0:2: [sde] Attached SCSI disk
[   23.572027]  sdl:
[   23.577092] sd 7:0:1:7: [sdl] Attached SCSI disk
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Tell Plymouth To Write Out Runtime Data...
[   23.626538] blk_update_request: I/O error, dev sdd, sector 0
[   23.629300] blk_update_request: I/O error, dev sdj, sector 0
[   23.630454] blk_update_request: I/O error, dev sdh, sector 0
[   23.630539] blk_update_request: I/O error, dev sdf, sector 0
[   23.630890] blk_update_request: I/O error, dev sdd, sector 0
[   23.633467] blk_update_request: I/O error, dev sdj, sector 0
[   23.634506] blk_update_request: I/O error, dev sdh, sector 0
[   23.634944] blk_update_request: I/O error, dev sdf, sector 0
[   23.635097] blk_update_request: I/O error, dev sdd, sector 0
[   23.637868] blk_update_request: I/O error, dev sdj, sector 0
[   23.663690] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
         Starting Preprocess NFS configuration...
         Starting Import network configuration from initramfs...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...
[   23.854010] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Mounting RPC Pipe File System...
         Starting Security Auditing Service...
[[32m  OK  [0m] Reached target Swap.
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   24.142091] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   24.152234] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   24.163352] type=1305 audit(1544544600.422:3): audit_pid=9036 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting Load CPU microcode update...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting Dump dmesg to /var/log/dmesg...
         Starting System Security Services Daemon...
         Starting NTP client/server...
         Starting GSSAPI Proxy Daemon...
         Starting Authorization Manager...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Machine Check Exception Logging Daemon...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Authorization Manager.
[   24.777747] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.788078] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[   25.452906] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[   25.592975] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   25.681840] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   25.682847] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[   25.689371] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   25.770599] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   25.771215] card: mlx4_0, QP: 0x220, inline size: 120
[   25.784830] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   25.793619] card: mlx4_0, QP: 0x300, inline size: 120
[   25.798055] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
[   25.910252] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[   25.922053] ib0: enabling connected mode will cause multicast packet drops
[   25.931576] ib0: mtu > 4092 will cause multicast packet drops.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[   25.940157] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.052094] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready
[   26.123008] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.142162] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   26.152320] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   26.171384] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[   28.015347] sd 7:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   28.025789] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   28.745701] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   28.755980] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   29.384463] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   29.394825] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   30.006499] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   33.538641] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   33.581531] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   33.591014] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting MUNGE au[   33.755021] FS-Cache: Loaded
thentication service...
         Starting OpenSSH server daemon...
         Starting Dynamic System Tuning Daemon...
         Starting Postfix Mail Transport Agent...
[[32m  OK  [0m] Reached target Network is Online.
[   33.788209] FS-Cache: Netfs 'nfs' registered for caching
[   33.792134] Key type dns_resolver registered
[   33.822322] NFS: Registering the id_resolver key type
[   33.822326] Key type id_resolver registered
[   33.822327] Key type id_legacy registered
         Mounting /scratch...
         Starting NFS status monitor for NFSv2/3 locking....
         Starting Notify NFS peers of a restart...
         Starting System Logging Service...
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Crash recovery kernel arming...
         Starting Permit User Sessions...
         Starting Automounts filesystems on demand...
[[32m  OK  [0m] Started Permit User Sessions.
[[32m  OK  [0m] Created slice User Slice of root.
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Session 1 of user root.
[[32m  OK  [0m] Started Command Scheduler.
[[32m  OK  [0m] Started Job spooling tools.
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Started Session 2 of user root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-11T16:10:22+00:00] INFO: Forking chef instance to converge...
[2018-12-11T16:10:22+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-11T16:10:22+00:00] INFO: Chef-client pid: 10840
[2018-12-11T16:10:23+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-11T16:10:23+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-11T16:10:23+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-11T16:10:23+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-11T16:10:23+00:00] INFO: Running start handlers
[2018-12-11T16:10:23+00:00] INFO: Start handlers complete.
[2018-12-11T16:10:24+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-11T16:10:24+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T16:10:24+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-11T16:10:24+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-11T16:10:24+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181211161024.680856
[2018-12-11T16:10:24+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181211070544.243628
[2018-12-11T16:10:24+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-11T16:10:24+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-11T16:10:29+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-11T16:10:29+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-11T16:10:29+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-11T16:10:29+00:00] INFO: service[ntpd] started
[2018-12-11T16:10:29+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-11T16:10:30+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-11T16:10:30+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-11T16:10:30+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-11T16:10:30+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-11T16:10:30+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-11T16:10:30+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-11T16:10:30+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-11T16:10:30+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-11T16:10:30+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-11T16:10:31+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-11T16:10:31+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-11T16:10:31+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-11T16:10:31+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:31+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:31+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-11T16:10:31+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-11T16:10:32+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-11T16:10:32+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-11T16:10:32+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-11T16:10:32+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-11T16:10:32+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-11T16:10:32+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-11T16:10:32+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-11T16:10:33+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-11T16:10:33+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-11T16:10:33+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-11T16:10:33+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-11T16:10:34+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-11T16:10:34+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-11T16:10:34+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-11T16:10:34+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-11T16:10:34+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-11T16:10:34+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-11T16:10:34+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-11T16:10:34+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-11T16:10:34+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-11T16:10:34+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-11T16:10:34+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-11T16:10:34+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-11T16:10:35+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-11T16:10:35+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-11T16:10:35+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-11T16:10:35+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-11T16:10:35+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211161035.654144
[2018-12-11T16:10:35+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211070555.321017
[2018-12-11T16:10:35+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-11T16:10:35+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-11T16:10:35+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-11T16:10:35+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211161035.673338
[2018-12-11T16:10:35+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211070555.327401
[2018-12-11T16:10:35+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-11T16:10:35+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-11T16:10:35+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-11T16:10:35+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:35+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:35+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-11T16:10:35+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:35+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:35+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-11T16:10:35+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-11T16:10:35+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-11T16:10:35+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-11T16:10:35+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T16:10:35+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:35+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:35+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T16:10:35+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:35+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:35+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T16:10:35+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:35+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:35+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T16:10:35+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:36+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:36+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T16:10:36+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:36+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:36+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T16:10:36+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:36+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:36+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T16:10:36+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:36+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:36+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-11T16:10:36+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:36+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:36+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-11T16:10:36+00:00] INFO: service[xinetd] started
[2018-12-11T16:10:36+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[   60.525098] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[2018-12-11T16:10:36+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-11T16:10:36+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-11T16:10:36+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-11T16:10:37+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-11T16:10:37+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-11T16:10:37+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-11T16:10:37+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-11T16:10:37+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181211161037.678083
[2018-12-11T16:10:37+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181211070557.923777
[2018-12-11T16:10:37+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-11T16:10:37+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-11T16:10:37+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-11T16:10:37+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-11T16:10:37+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-11T16:10:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:37+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-11T16:10:37+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-11T16:10:37+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-11T16:10:37+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-11T16:10:37+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-11T16:10:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:37+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-11T16:10:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:37+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-11T16:10:37+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-11T16:10:37+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:38+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:38+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:38+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:38+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:38+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:38+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:38+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:38+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:38+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-11T16:10:38+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-11T16:10:38+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-11T16:10:38+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-11T16:10:38+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-11T16:10:38+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-11T16:10:38+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-11T16:10:38+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-11T16:10:38+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-11T16:10:39+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-11T16:10:39+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-11T16:10:39+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-11T16:10:40+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-11T16:10:40+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-11T16:10:40+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-11T16:10:40+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-11T16:10:40+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-11T16:10:40+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-11T16:10:40+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-11T16:10:40+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-11T16:10:40+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-11T16:10:40+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-11T16:10:40+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-11T16:10:40+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-11T16:10:40+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-11T16:10:40+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-11T16:10:40+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-11T16:10:40+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-11T16:10:40+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-11T16:10:40+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-11T16:10:40+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-11T16:10:40+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-11T16:10:40+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-11T16:10:40+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-11T16:10:40+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[2018-12-11T16:10:43+00:00] INFO: service[kdump] restarted
[2018-12-11T16:10:43+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-11T16:10:43+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-11T16:10:43+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-11T16:10:43+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-11T16:10:43+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-11T16:10:43+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-11T16:10:43+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-11T16:10:43+00:00] INFO: Chef Run complete in 19.92956285 seconds
[2018-12-11T16:10:43+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-11T16:10:43+00:00] INFO: Running report handlers
[2018-12-11T16:10:43+00:00] INFO: Creating JSON run report
[2018-12-11T16:10:44+00:00] INFO: Report handlers complete
[  190.770668] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  190.780870] alg: No test for adler32 (adler32-zlib)
[  191.637735] Lustre: Lustre: Build Version: 2.10.6_RC3
[  191.871830] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  193.618919] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  198.986369] Lustre: MGS: Connection restored to 14193042-a2ae-8c6e-de18-f9177eafe159 (at 0@lo)
[  199.550244] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.117@o2ib (not set up)
[  200.539222] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  200.814578] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect
[  200.825360] Lustre: soaked-MDT0000: Connection restored to a5bf3c57-9993-6ae9-d6f4-1637a8088e36 (at 192.168.1.142@o2ib)
[  201.852467] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[  201.862888] Lustre: Skipped 1 previous similar message
[  204.654111] Lustre: soaked-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[  204.664517] Lustre: Skipped 4 previous similar messages
[  208.698112] Lustre: soaked-MDT0000: Connection restored to 077d08eb-d447-a6a6-4a37-2b9dd1595095 (at 192.168.1.128@o2ib)
[  208.710311] Lustre: Skipped 4 previous similar messages
[  216.924083] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[  216.934547] Lustre: Skipped 7 previous similar messages
[  233.149307] Lustre: soaked-MDT0000: Connection restored to 9b5561dd-29a2-e610-2f13-8f90eaacdb77 (at 192.168.1.140@o2ib)
[  233.161476] Lustre: Skipped 43 previous similar messages
[  251.970764] Lustre: soaked-MDT0000: Recovery over after 0:51, of 29 clients 29 recovered and 0 were evicted.
[  490.787912] LustreError: 12406:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[  907.190786] LustreError: 12418:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[  907.201562] LustreError: 12418:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 10 previous similar messages
[  914.191721] LustreError: 12391:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[  914.202524] LustreError: 12391:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 9 previous similar messages
[  928.389535] LustreError: 12394:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[  928.400338] LustreError: 12394:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 13 previous similar messages
[ 1072.347600] LustreError: 12292:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 1072.358380] LustreError: 12292:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[ 1092.613364] LustreError: 12406:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[ 1092.624153] LustreError: 12406:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 7 previous similar messages
[ 1428.129179] LustreError: 12293:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 1428.139957] LustreError: 12293:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[ 1551.728401] Lustre: 12333:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544546113/real 0]  req@ffff886c24e63000 x1619572625734416/t0(0) o1000->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 488/4320 e 0 to 1 dl 1544546127 ref 3 fl Rpc:X/0/ffffffff rc 0/-1
[ 1551.759968] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1557.778556] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544546127/real 0]  req@ffff8868e68c5400 x1619572626382704/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544546133 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 1576.779286] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1577.861591] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1578.933035] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.125@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1578.958709] LustreError: Skipped 8 previous similar messages
[ 1587.102298] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1591.881640] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.106@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1591.907110] LustreError: Skipped 6 previous similar messages
[ 1601.779735] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544546177/real 1544546177]  req@ffff886c26728900 x1619572626656768/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544546188 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 1602.595004] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.121@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1602.620668] LustreError: Skipped 15 previous similar messages
[ 1620.061363] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.139@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1620.087563] LustreError: Skipped 3 previous similar messages
[ 1651.780526] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544546227/real 1544546227]  req@ffff886c26728300 x1619572626659472/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544546243 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 1652.595758] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.121@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1652.622083] LustreError: Skipped 40 previous similar messages
[ 1701.781371] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544546277/real 1544546277]  req@ffff886c2672da00 x1619572626662192/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544546298 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 1720.062419] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.139@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1720.089223] LustreError: Skipped 48 previous similar messages
[ 1744.691102] LDISKFS-fs warning (device dm-4): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait.
[ 1744.691102] 
[ 1762.104661] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib) in 232 seconds. I think it's dead, and I am evicting it. exp ffff886c2d591800, cur 1544546337 expire 1544546187 last 1544546105
[ 1765.627262] Lustre: MGS: haven't heard from client 20cb7df3-d924-4e32-4c5c-1e9a7ccd6e1f (at 192.168.1.109@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffff886c2c7b6400, cur 1544546341 expire 1544546191 last 1544546112
[ 1777.782061] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544546327/real 0]  req@ffff886c2672ad00 x1619572626664896/t0(0) o38->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544546353 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 1796.907928] LDISKFS-fs (dm-4): recovery complete
[ 1796.915205] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[ 1797.933799] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[ 1797.946464] Lustre: Skipped 17 previous similar messages
[ 1798.021593] Lustre: soaked-MDT0000: Received LWP connection from 0@lo, removing former export from 192.168.1.109@o2ib
[ 1798.022893] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900
[ 1798.066469] LustreError: 12725:0:(llog_osd.c:978:llog_osd_next_block()) soaked-MDT0003-osp-MDT0001: missed desired record? 3 > 1
[ 1798.074159] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[ 1798.093688] LustreError: 12725:0:(lod_dev.c:419:lod_sub_recovery_thread()) soaked-MDT0003-osp-MDT0001 getting update log failed: rc = -2
[ 1800.158283] Lustre: 12726:0:(ldlm_lib.c:2059:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[ 1800.174502] Lustre: soaked-MDT0001: disconnecting 28 stale clients
[ 1800.186065] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[ 1802.871663] Lustre: soaked-MDT0001: Connection restored to  (at 192.168.1.117@o2ib)
[ 1802.883848] Lustre: Skipped 2 previous similar messages
[ 1812.102954] Lustre: soaked-MDT0001: Connection restored to 6f38266d-9e2b-8d56-87a7-b7a77061b96f (at 192.168.1.138@o2ib)
[ 1812.118339] Lustre: Skipped 19 previous similar messages
[ 1813.882620] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 12 seconds
[ 1815.243943] Lustre: Failing over soaked-MDT0001
[ 1815.740167] Lustre: server umount soaked-MDT0001 complete
[ 1817.323872] LustreError: 12473:0:(ldlm_lockd.c:2365:ldlm_cancel_handler()) ldlm_cancel from 192.168.1.110@o2ib arrived at 1544546393 with bad export cookie 1958775464943110112
[ 1848.022906] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[ 1848.053061] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 1848.068079] Lustre: Skipped 7 previous similar messages
[ 1853.808576] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 1853.835313] LustreError: Skipped 70 previous similar messages
[ 1865.281147] LustreError: 12406:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 1865.295426] LustreError: 12406:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[ 2215.950463] LustreError: 12451:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 2215.964427] LustreError: 12451:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[ 3037.947554] LustreError: 12412:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 3037.959835] LustreError: 12412:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages
[ 3085.472667] Lustre: 12293:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 5323.885840] Lustre: 12232:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544549892/real 0]  req@ffff88700a60b000 x1619572686435936/t0(0) o13->soaked-OST000a-osc-MDT0000@192.168.1.106@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544549899 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 5323.925285] Lustre: soaked-OST000a-osc-MDT0000: Connection to soaked-OST000a (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 5326.117884] Lustre: 12226:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544549894/real 0]  req@ffff88701634da00 x1619572686462816/t0(0) o13->soaked-OST0002-osc-MDT0000@192.168.1.106@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544549901 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 5326.158448] Lustre: 12226:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[ 5326.172766] Lustre: soaked-OST0002-osc-MDT0000: Connection to soaked-OST0002 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 5326.197649] Lustre: Skipped 2 previous similar messages
[ 5330.205957] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544549899/real 0]  req@ffff8868e6a68600 x1619572686490496/t0(0) o8->soaked-OST000a-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544549905 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 5342.281748] Lustre: 12218:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544549893/real 1544549918]  req@ffff886bbbbc4e00 x1619572686443392/t0(0) o6->soaked-OST0002-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 664/432 e 0 to 1 dl 1544549944 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 5342.322622] Lustre: 12218:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 34 previous similar messages
[ 5376.207065] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544549951/real 1544549951]  req@ffff8868e6a68f00 x1619572686726912/t0(0) o8->soaked-OST0002-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544549962 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 5426.207777] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544550001/real 1544550001]  req@ffff886bbd311200 x1619572687024400/t0(0) o8->soaked-OST000a-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544550017 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 5426.249353] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 5526.209330] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544550101/real 1544550101]  req@ffff886bbd2faa00 x1619572687096656/t0(0) o8->soaked-OST000a-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544550127 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 5526.252128] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[ 5543.302233] Lustre: MGS: haven't heard from client aaeaae87-55e8-43ff-b5f1-62f3bfe1138f (at 192.168.1.106@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff886c2c7cd400, cur 1544550119 expire 1544549969 last 1544549892
[ 5587.294553] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 5587.315189] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 5613.153533] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 5613.174015] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 5625.936142] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 7 seconds
[ 5631.610289] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 5631.629661] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 5638.936345] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 12 seconds
[ 5638.951597] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[ 5653.300184] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 5653.321036] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 5689.779319] Lustre: soaked-OST0006-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 5689.794607] Lustre: Skipped 2 previous similar messages
[ 5722.619602] LustreError: 12396:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 5722.633866] LustreError: 12396:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 5 previous similar messages
[ 5724.256828] LustreError: 11-0: soaked-OST0002-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -19
[ 5724.264928] Lustre: soaked-OST0002-osc-MDT0000: Connection to soaked-OST0002 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 5724.298309] LustreError: Skipped 4 previous similar messages
[ 5724.684993] LustreError: 12403:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[ 5724.699356] LustreError: 12403:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 7 previous similar messages
[ 5741.105303] LustreError: 11-0: soaked-OST000a-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[ 5741.121467] Lustre: soaked-OST000a-osc-MDT0000: Connection to soaked-OST000a (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 5744.769021] LustreError: 12418:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 416.
[ 5744.782575] LustreError: 12418:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 5 previous similar messages
[ 5749.889285] LustreError: 11-0: soaked-OST0006-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[ 5749.905401] Lustre: soaked-OST0006-osc-MDT0000: Connection to soaked-OST0006 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 5758.284869] Lustre: soaked-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[ 5758.298696] Lustre: Skipped 5 previous similar messages
[ 5759.969328] LustreError: 11-0: soaked-OST000e-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[ 5759.985477] Lustre: soaked-OST000e-osc-MDT0000: Connection to soaked-OST000e (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 6637.845410] Lustre: 12208:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544551206/real 0]  req@ffff886bb1f29500 x1619572690102928/t0(0) o13->soaked-OST000e-osc-MDT0000@192.168.1.106@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544551213 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[ 6637.885566] Lustre: 12208:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[ 6637.900021] Lustre: soaked-OST000e-osc-MDT0000: Connection to soaked-OST000e (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 6640.261431] Lustre: soaked-OST0006-osc-MDT0000: Connection to soaked-OST0006 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 6640.286203] Lustre: Skipped 1 previous similar message
[ 6686.081298] Lustre: 12451:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 6691.238727] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544551266/real 1544551266]  req@ffff886bafedb300 x1619572690531040/t0(0) o8->soaked-OST000a-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544551277 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 6691.281397] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 8 previous similar messages
[ 6741.239410] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544551316/real 1544551316]  req@ffff886bafed9500 x1619572690565520/t0(0) o8->soaked-OST000a-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544551332 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 6741.282101] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 6841.240984] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544551416/real 1544551416]  req@ffff886bafede000 x1619572690706624/t0(0) o8->soaked-OST000a-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544551442 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[ 6841.284130] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[ 6862.758487] Lustre: MGS: haven't heard from client cd0524cf-7cd5-e2cb-af8e-9dea4b592e56 (at 192.168.1.106@o2ib) in 243 seconds. I think it's dead, and I am evicting it. exp ffff886c29432400, cur 1544551438 expire 1544551288 last 1544551195
[ 6892.600378] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 6892.621166] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 6892.635121] Lustre: Skipped 4 previous similar messages
[ 6900.954203] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 9 seconds
[ 6900.968716] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[ 6911.139887] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 6911.158607] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 6929.741280] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 6947.748917] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib
[ 6947.768466] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 6947.782456] Lustre: Skipped 1 previous similar message
[ 6951.954866] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 10 seconds
[ 6976.368237] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544551516/real 0]  req@ffff886bafede000 x1619572691111488/t0(0) o8->soaked-OST000e-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544551552 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[ 6976.410239] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[ 7001.955606] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 10 seconds
[ 7001.970824] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[ 7009.768056] LustreError: 12424:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 7009.782522] LustreError: 12424:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[ 7016.308095] LustreError: 11-0: soaked-OST0002-osc-MDT0000: operation ost_destroy to node 192.168.1.107@o2ib failed: rc = -19
[ 7016.308112] Lustre: soaked-OST0002-osc-MDT0000: Connection to soaked-OST0002 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7016.308115] Lustre: Skipped 1 previous similar message
[ 7016.355175] LustreError: Skipped 5 previous similar messages
[ 7017.245180] LustreError: 14415:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 7082.285326] LNet: 226:0:(o2iblnd_cb.c:2405:kiblnd_passive_connect()) Conn stale 192.168.1.106@o2ib version 12/12 incarnation 1544551657830948/1544551657830948
[ 7082.309732] Lustre: MGS: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[ 7082.320302] Lustre: Skipped 4 previous similar messages
[ 7082.956680] LNet: 12191:0:(o2iblnd_cb.c:1350:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.106@o2ib: connected
[ 7090.036175] LustreError: 11-0: soaked-OST000a-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[ 7090.052199] LustreError: Skipped 1 previous similar message
[ 7090.061667] Lustre: soaked-OST000a-osc-MDT0000: Connection to soaked-OST000a (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7096.210585] LustreError: 12433:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 7098.500008] LustreError: 11-0: soaked-OST0006-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[ 7107.380527] LustreError: 11-0: soaked-OST000e-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[ 7107.396576] Lustre: soaked-OST000e-osc-MDT0000: Connection to soaked-OST000e (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7107.421477] Lustre: Skipped 1 previous similar message
[ 7247.479836] LustreError: 12426:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 7266.975566] LustreError: 12477:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 7266.987588] LustreError: 12477:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[ 7298.633057] LustreError: 12888:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 7298.645267] LustreError: 12888:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[ 7343.012241] LustreError: 12888:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 7343.026125] LustreError: 12888:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages
[ 7582.401975] LustreError: 12548:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 776 actual 344.
[ 7582.414002] LustreError: 12548:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message
[ 8005.682982] LustreError: 12407:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 8005.696822] LustreError: 12407:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 10 previous similar messages
[ 8421.325078] perf: interrupt took too long (2525 > 2500), lowering kernel.perf_event_max_sample_rate to 79000
[ 8591.598046] LustreError: 12294:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 9323.791218] LustreError: 14418:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[ 9323.804950] LustreError: 14418:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 27 previous similar messages
[10285.674423] Lustre: 14249:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[10366.289973] LustreError: 12454:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[10366.303270] LustreError: 12454:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages
[10655.022829] Lustre: 12219:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544555223/real 0]  req@ffff886ffcbb2700 x1619572740319824/t0(0) o13->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544555230 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[10655.062181] Lustre: 12219:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[10655.075838] Lustre: soaked-OST000b-osc-MDT0000: Connection to soaked-OST000b (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[10705.696171] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544555281/real 1544555281]  req@ffff886c28335a00 x1619572740475904/t0(0) o8->soaked-OST000f-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544555292 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[10705.737264] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[10805.697573] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544555381/real 1544555381]  req@ffff886c28333900 x1619572740576656/t0(0) o8->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544555402 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[10805.738943] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[10849.609460] Lustre: MGS: haven't heard from client 73856d24-eb64-1f1e-dc5a-c41e2bd65e47 (at 192.168.1.107@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff886c2c564800, cur 1544555425 expire 1544555275 last 1544555198
[10936.698831] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544555481/real 0]  req@ffff8868d954b000 x1619572741541232/t0(0) o8->soaked-OST000f-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544555512 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[10936.739260] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[10967.012332] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 11 seconds
[11068.013779] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 12 seconds
[11068.028365] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 3 previous similar messages
[11143.014808] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds
[11143.028614] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 3 previous similar messages
[11155.042001] Lustre: MGS: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[11155.054175] Lustre: Skipped 8 previous similar messages
[11155.281397] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11155.296989] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[11155.308423] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST000b_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client
[11161.012075] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11161.031019] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[11161.042332] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0003_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client[11166.009756] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11166.028792] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline

[11166.040581] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST000f_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client[11173.577788] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11173.597463] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[11173.609453] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-OST0007_UUID (at 192.168.1.107@o2ib) because it is indicating it is a new client[11176.866574] Lustre: soaked-OST000f-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[11176.885068] Lustre: Skipped 1 previous similar message
[11196.773122] LustreError: 12453:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[11196.787316] LustreError: 12453:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 7 previous similar messages
[11198.583132] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11198.610052] LustreError: Skipped 5 previous similar messages
[11223.583287] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11223.599145] Lustre: Skipped 3 previous similar messages
[11248.583632] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11248.606665] LustreError: Skipped 3 previous similar messages
[11273.584092] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11273.600219] Lustre: Skipped 3 previous similar messages
[11323.584829] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11323.600945] Lustre: Skipped 2 previous similar messages
[11323.609441] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11323.609443] LustreError: Skipped 3 previous similar messages
[11373.585605] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11373.585607] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11373.585611] Lustre: Skipped 1 previous similar message
[11448.586813] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11448.602814] Lustre: Skipped 3 previous similar messages
[11498.587722] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11498.614639] LustreError: Skipped 14 previous similar messages
[11587.734986] perf: interrupt took too long (3173 > 3156), lowering kernel.perf_event_max_sample_rate to 63000

[11598.589290] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11598.605312] Lustre: Skipped 11 previous similar messages
[11798.592139] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11798.617251] LustreError: Skipped 22 previous similar messages
[11873.593177] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[11873.609444] Lustre: Skipped 21 previous similar messages
[12198.271687] LustreError: 12390:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[12198.285543] LustreError: 12390:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 19 previous similar messages
[12348.600057] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[12348.623802] LustreError: Skipped 42 previous similar messages
[12398.625565] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[12398.640162] Lustre: Skipped 39 previous similar messages
[12864.844680] LustreError: 26225:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0000: expected 416 actual 344.
[12864.858902] LustreError: 26225:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 9 previous similar messages
[12973.607435] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[12973.633891] LustreError: Skipped 46 previous similar messages
[13023.608012] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[13023.623394] Lustre: Skipped 49 previous similar messages
[13501.033108] Lustre: 12919:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544558069/real 0]  req@ffff886fdba49500 x1619572770008384/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544558076 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[13501.068279] Lustre: 12919:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
[13519.572652] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[13519.594393] Lustre: Skipped 3 previous similar messages
[13555.047902] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 5 seconds
[13555.064020] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[13562.079035] Lustre: 12919:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544558130/real 1544558130]  req@ffff886fdba49500 x1619572770008384/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544558137 ref 2 fl Rpc:X/2/ffffffff rc 0/-1
[13562.120166] Lustre: 12919:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
[13596.989382] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[13597.016070] LustreError: Skipped 45 previous similar messages
[13618.048774] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 3 seconds
[13626.599899] Lustre: 12919:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544558195/real 1544558195]  req@ffff886fdba49500 x1619572770008384/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544558202 ref 2 fl Rpc:X/2/ffffffff rc 0/-1
[13626.641244] Lustre: 12919:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[13631.048958] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 16 seconds
[13644.049135] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 29 seconds
[13646.989815] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.107@o2ib, removing former export from same NID
[13647.005910] Lustre: Skipped 47 previous similar messages
[13656.049310] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 41 seconds
[13669.049480] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 54 seconds
[13694.049831] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 79 seconds
[13694.064695] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[13713.151073] Lustre: MGS: haven't heard from client 698a3d32-e919-5817-0831-a12a55566f3c (at 192.168.1.111@o2ib) in 232 seconds. I think it's dead, and I am evicting it. exp ffff886c2c7cdc00, cur 1544558288 expire 1544558138 last 1544558056
[13721.119158] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff886c2d594400, cur 1544558296 expire 1544558146 last 1544558069
[13721.149688] LustreError: 12539:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff88703af78000 x1619572770932880/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
[13732.050366] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 117 seconds
[13732.065452] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 2 previous similar messages
[13845.605930] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544558395/real 0]  req@ffff886c213f1e00 x1619572770938272/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544558421 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[13845.646464] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 10 previous similar messages
[13871.052293] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 1 seconds
[13871.067195] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 4 previous similar messages
[13886.279566] Lustre: 12425:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[14028.209549] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[14028.222244] Lustre: Skipped 2 previous similar messages
[14028.856436] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[14028.868302] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0003_UUID (at 192.168.1.111@o2ib) because it is indicating it is a new client[14196.997374] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[14197.014374] Lustre: Skipped 1 previous similar message
[14278.826318] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.111@o2ib, removing former export from same NID
[14278.842385] Lustre: Skipped 50 previous similar messages
[14296.998743] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[14297.012393] Lustre: Skipped 1 previous similar message
[14346.999362] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[14928.817508] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.111@o2ib, removing former export from same NID
[14928.833589] Lustre: Skipped 15 previous similar messages
[15478.821464] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[15529.253638] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[17485.859860] Lustre: 12451:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[17526.484520] Lustre: 12218:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544562095/real 0]  req@ffff8868da063900 x1619572818241984/t0(0) o400->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544562102 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[17526.525197] Lustre: 12218:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[17526.539705] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[17587.565354] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544562152/real 0]  req@ffff886b71a44800 x1619572819048240/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544562163 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[17587.603789] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[17692.566840] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544562252/real 0]  req@ffff886c20be9500 x1619572819843408/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544562268 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[17725.453482] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0002-mdtlov_UUID (at 192.168.1.110@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff886c2d590c00, cur 1544562301 expire 1544562151 last 1544562074
[17726.567425] Lustre: MGS: haven't heard from client c91dfdbe-1a56-cba3-228c-2ce4d79a1c77 (at 192.168.1.110@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff886c2c7c9c00, cur 1544562302 expire 1544562152 last 1544562074
[17835.106814] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 8 seconds
[17835.121935] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message
[17902.570733] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544562452/real 0]  req@ffff886bb4318600 x1619572819854208/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544562478 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[17902.612389] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[17982.027563] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[17982.569613] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[17982.585889] Lustre: Skipped 11 previous similar messages
[17982.595119] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline

[17982.606897] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0002_UUID (at 192.168.1.110@o2ib) because it is indicating it is a new client[18007.569036] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[18007.595894] LustreError: Skipped 4 previous similar messages
[18082.569369] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[18082.585627] Lustre: Skipped 1 previous similar message
[18107.569707] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[18107.596689] LustreError: Skipped 1 previous similar message
[18282.571380] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[18282.587635] Lustre: Skipped 3 previous similar messages
[18307.571738] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[18307.598797] LustreError: Skipped 3 previous similar messages
[18632.575917] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[18632.592226] Lustre: Skipped 6 previous similar messages
[18657.576279] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[18657.603409] LustreError: Skipped 6 previous similar messages
[19141.715984] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544563710/real 0]  req@ffff886b59708000 x1619572819922352/t0(0) o13->soaked-OST0005-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544563717 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[19141.757952] Lustre: 12205:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[19141.772412] Lustre: soaked-OST0005-osc-MDT0000: Connection to soaked-OST0005 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[19142.644002] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[19142.669994] Lustre: Skipped 1 previous similar message
[19193.365333] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544563768/real 1544563768]  req@ffff886bd6361200 x1619572819924928/t0(0) o8->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544563779 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[19193.408620] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[19239.646839] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[19239.663193] Lustre: Skipped 11 previous similar messages
[19264.647335] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[19264.674645] LustreError: Skipped 11 previous similar messages
[19293.366735] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544563868/real 1544563868]  req@ffff886bbda3ce00 x1619572819929296/t0(0) o8->soaked-OST000d-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544563889 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[19293.410048] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[19350.633392] Lustre: MGS: haven't heard from client b552da80-3182-47e1-7f87-2cdc9bf3dc6c (at 192.168.1.105@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff886c2c7cb400, cur 1544563926 expire 1544563776 last 1544563699
[19390.021656] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[19390.043320] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[19390.057392] Lustre: Skipped 1 previous similar message
[19407.961229] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[19407.982188] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[19424.367909] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544563968/real 0]  req@ffff886bbda39b00 x1619572819934032/t0(0) o8->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 520/544 e 0 to 1 dl 1544563999 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[19424.409589] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[19424.511266] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[19424.532306] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[19440.518772] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.104@o2ib, removing former export from 192.168.1.105@o2ib
[19440.539660] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[19450.129284] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 8 seconds
[19462.659862] Lustre: soaked-OST0009-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[19502.348875] Lustre: soaked-OST000d-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[19522.769861] LustreError: 11-0: soaked-OST0009-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[19522.786144] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[19522.811479] Lustre: Skipped 1 previous similar message
[19530.485275] Lustre: MGS: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[19530.498179] Lustre: Skipped 2 previous similar messages
[19533.650019] LustreError: 11-0: soaked-OST0001-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[19533.666186] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[19538.849970] LustreError: 11-0: soaked-OST0005-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[19538.866137] Lustre: soaked-OST0005-osc-MDT0000: Connection to soaked-OST0005 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[19547.426189] LustreError: 11-0: soaked-OST000d-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[19547.442426] Lustre: soaked-OST000d-osc-MDT0000: Connection to soaked-OST000d (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[19842.617490] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[19842.633886] Lustre: Skipped 11 previous similar messages
[19867.618002] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[19867.645100] LustreError: Skipped 11 previous similar messages
[20107.153482] Lustre: 12214:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544564675/real 0]  req@ffff886b56a9e600 x1619572819974144/t0(0) o400->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544564682 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[20107.195873] Lustre: 12214:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[20107.210374] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[20304.212100] Lustre: MGS: haven't heard from client b1e099cb-e14f-a2fc-731d-1fc8831d5596 (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff887045e5f400, cur 1544564879 expire 1544564729 last 1544564652
[20360.142022] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 2 seconds
[20360.157094] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 3 previous similar messages
[20449.690443] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[20449.706729] Lustre: Skipped 11 previous similar messages
[20461.143433] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 4 seconds
[20499.691045] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[20499.704958] Lustre: Skipped 8 previous similar messages
[20587.539534] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[20587.967896] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline
[20587.979912] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0003_UUID (at 192.168.1.111@o2ib) because it is indicating it is a new client[20612.968115] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.111@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[20612.995051] LustreError: Skipped 7 previous similar messages
[20623.242647] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544565157/real 1544565157]  req@ffff886b56a98f00 x1619572819999936/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544565198 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
[20623.285384] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[20637.968330] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[20679.003327] Lustre: soaked-MDT0002-osp-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[21086.461422] Lustre: 12453:0:(mdd_device.c:1591:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[21257.251990] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544565832/real 1544565832]  req@ffff886b56a98000 x1619572820037600/t0(0) o38->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544565853 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
[21257.295339] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
[21290.105161] Lustre: MGS: haven't heard from client c5d7f099-cd9e-a3e2-b8c2-ae8d16fefaba (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff88701462bc00, cur 1544565865 expire 1544565715 last 1544565638
[21358.155923] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 2 seconds
[21459.157332] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 3 seconds
[21503.178106] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[21503.486480] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.111@o2ib, removing former export from same NID
[21503.502839] Lustre: Skipped 13 previous similar messages
[21503.536213] format at ldlm_lib.c:1215:target_handle_connect doesn't end in newline

[21503.547988] Lustre: soaked-MDT0000: Rejecting reconnect from the known client soaked-MDT0000-lwp-MDT0003_UUID (at 192.168.1.111@o2ib) because it is indicating it is a new client[21528.519423] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.111@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[21603.520563] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[22128.528083] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.111@o2ib, removing former export from same NID
[22128.544374] Lustre: Skipped 14 previous similar messages
[22364.266993] Lustre: 12208:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544566932/real 0]  req@ffff886b56a9ef00 x1619572820097616/t0(0) o400->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/224 e 0 to 1 dl 1544566939 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[22364.308967] Lustre: 12208:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
[22364.323437] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[22552.264466] Lustre: MGS: haven't heard from client 7f5cc40c-ca11-77dc-2715-a6c5871c88a8 (at 192.168.1.110@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff886c443bcc00, cur 1544567127 expire 1544566977 last 1544566900
[22585.109343] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.111@o2ib, removing former export from 192.168.1.110@o2ib
[22585.129583] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[22585.143446] Lustre: Skipped 1 previous similar message
[22620.173586] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 6 seconds
[22721.175028] LNet: 12191:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 7 seconds
[22760.130592] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.111@o2ib, removing former export from same NID
[22760.146904] Lustre: Skipped 11 previous similar messages
[22801.502075] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[22801.514932] Lustre: Skipped 1 previous similar message
[23000.150654] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[23040.357438] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544567564/real 1544567564]  req@ffff886b59715d00 x1619572820131952/t0(0) o38->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1544567615 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
[23040.400045] Lustre: 12202:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 9 previous similar messages
[23060.133697] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[23060.147535] Lustre: Skipped 2 previous similar messages
[23089.358832] LustreError: 167-0: soaked-MDT0002-osp-MDT0000: This client was evicted by soaked-MDT0002; in progress operations using this service will fail.
[23089.386320] Lustre: soaked-MDT0002-osp-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[23192.060020] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[24920.912178] Lustre: Failing over soaked-MDT0000
[24920.922849] LustreError: 11-0: soaked-MDT0001-osp-MDT0000: operation mds_disconnect to node 192.168.1.109@o2ib failed: rc = -107
[24920.950848] LustreError: 33116:0:(osp_dev.c:487:osp_disconnect()) soaked-MDT0002-osp-MDT0000: can't disconnect: rc = -19
[24920.972701] LustreError: 33116:0:(lod_dev.c:264:lod_sub_process_config()) soaked-MDT0000-mdtlov: error cleaning up LOD index 2: cmd 0xcf031: rc = -19
[24921.116768] LustreError: 12218:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff886bbda3aa00 x1619572820237552/t0(0) o13->soaked-OST0001-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
[24921.144814] LustreError: 12218:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 3 previous similar messages
[24923.058114] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[24923.085066] LustreError: Skipped 4 previous similar messages
[24927.846853] Lustre: 33116:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544569497/real 1544569497]  req@ffff886c68012100 x1619572820237648/t0(0) o251->MGC192.168.1.108@o2ib@0@lo:26/25 lens 224/224 e 0 to 1 dl 1544569503 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[24928.232340] Lustre: server umount soaked-MDT0000 complete
[24930.133678] LNetError: 214:0:(o2iblnd_cb.c:2299:kiblnd_passive_connect()) Can't accept conn from 192.168.1.105@o2ib on NA (ib0:1:192.168.1.108): bad dst nid 192.168.1.108@o2ib
[24931.588856] LNet: Removed LNI 192.168.1.108@o2ib
[123769.322645] perf: interrupt took too long (4001 > 3966), lowering kernel.perf_event_max_sample_rate to 49000
[130050.299251] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[130050.814842] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36
[130050.828880] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[130051.342102] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36
[130051.356035] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[130051.869176] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36
[130051.883023] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[130052.402198] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36
[130052.415714] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[130052.429824] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[130052.441664] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[130052.455546] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed

<ConMan> Console [soak-8] joined by <w3liu@ssh-1> on pts/12 at 12-13 06:53.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: root
Password: 
Last login: Thu Dec 13 01:25:42 from ssh-1.spirit.whamcloud.com
[root@soak-8 ~]# rpm -qa|grep lustre
[01;31m[Klustre[m[K-iokit-2.10.6_RC3-1.el7.x86_64
kmod-[01;31m[Klustre[m[K-tests-2.10.6_RC3-1.el7.x86_64
[01;31m[Klustre[m[K-osd-ldiskfs-mount-2.10.6_RC3-1.el7.x86_64
kmod-[01;31m[Klustre[m[K-2.10.6_RC3-1.el7.x86_64
kmod-[01;31m[Klustre[m[K-osd-ldiskfs-2.10.6_RC3-1.el7.x86_64
[01;31m[Klustre[m[K-tests-2.10.6_RC3-1.el7.x86_64
kernel-3.10.0-957.el7_[01;31m[Klustre[m[K.x86_64
[01;31m[Klustre[m[K-2.10.6_RC3-1.el7.x86_64
[root@soak-8 ~]# df -h
Filesystem                                     Size  Used Avail Use% Mounted on
/dev/sda1                                       20G  3.0G   16G  16% /
devtmpfs                                        16G     0   16G   0% /dev
tmpfs                                           16G     0   16G   0% /dev/shm
tmpfs                                           16G   18M   16G   1% /run
tmpfs                                           16G     0   16G   0% /sys/fs/cgroup
spirit-2.spirit.whamcloud.com:/export/scratch  3.9T  927G  2.8T  25% /scratch
tmpfs                                          3.1G     0  3.1G   0% /run/user/0
[root@soak-8 ~]# exit
logou
CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: 
<ConMan> Console [soak-8] departed by <w3liu@ssh-1> on pts/12 at 12-13 06:54.
[139988.396087] SGI XFS with ACLs, security attributes, no debug enabled
[139988.452737] xor: automatically using best checksumming function:
[139988.462206]    avx       : 18760.000 MB/sec
[139988.502208] raid6: sse2x1   gen()  7031 MB/s
[139988.525208] raid6: sse2x2   gen()  8824 MB/s
[139988.548207] raid6: sse2x4   gen() 10234 MB/s
[139988.554306] raid6: using algorithm sse2x4 gen() (10234 MB/s)
[139988.561938] raid6: using ssse3x2 recovery algorithm
[139988.631097] Btrfs loaded, crc32c=crc32c-intel
[139988.651333] fuse init (API version 7.22)
[139989.236222] sd 7:0:0:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[139989.246583] sd 7:0:0:1: [sdd] Sense Key : Illegal Request [current] 
[139989.255251] sd 7:0:0:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[139989.262897] sd 7:0:0:1: [sdd] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00
[139989.273738] blk_update_request: 14 callbacks suppressed
[139989.281094] blk_update_request: I/O error, dev sdd, sector 6986547072
[139989.802962] sd 7:0:0:3: [sdf] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[139989.814244] sd 7:0:0:3: [sdf] Sense Key : Illegal Request [current] 
[139989.823842] sd 7:0:0:3: [sdf] <<vendor>>ASC=0x94 ASCQ=0x1 
[139989.832409] sd 7:0:0:3: [sdf] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00
[139989.844174] blk_update_request: I/O error, dev sdf, sector 6986547072
[139991.430375] sd 7:0:1:0: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[139991.441480] sd 7:0:1:0: [sdh] Sense Key : Illegal Request [current] 
[139991.450909] sd 7:0:1:0: [sdh] <<vendor>>ASC=0x94 ASCQ=0x1 
[139991.459306] sd 7:0:1:0: [sdh] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00
[139991.470889] blk_update_request: I/O error, dev sdh, sector 6986547072
[139991.996995] sd 7:0:1:2: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[139992.007940] sd 7:0:1:2: [sdj] Sense Key : Illegal Request [current] 
[139992.017233] sd 7:0:1:2: [sdj] <<vendor>>ASC=0x94 ASCQ=0x1 
[139992.025491] sd 7:0:1:2: [sdj] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00
[139992.036910] blk_update_request: I/O error, dev sdj, sector 6986547072
[[32m  OK  [0m] Started Show Plymouth Reboot Screen.
[[32m  OK  [0m] Stopped Login Service.
[[32m  OK  [0m] Stopped System Logging Service.
[[32m  OK  [0m] Stopped Availability of block devices.
[[32m  OK  [0m] Stopped Postfix Mail Transport Agent.
[[32m  OK  [0m] Stopped target User and Group Name Lookups.
[[32m  OK  [0m] Stopped Dynamic System Tuning Daemon.
[[32m  OK  [0m] Stopped Automounts filesystems on demand.
         Stopping RPC bind service...
[[32m  OK  [0m] Stopped target Remote File Systems.
         Unmounting /scratch...
         Stopping System Security Services Daemon...
         Stopping NFS status monitor for NFSv2/3 locking....
[[32m  OK  [0m] Stopped RPC bind service.
[[32m  OK  [0m] Stopped NFS status monitor for NFSv2/3 locking..
[[32m  OK  [0m] Stopped target Host and Network Name Lookups.
[[32m  OK  [0m] Stopped System Security Services Daemon.
[[32m  OK  [0m] Unmounted /scratch.
[[32m  OK  [0m] Stopped target Network is Online.
[[32m  OK  [0m] Stopped Network Manager Wait Online.
[[32m  OK  [0m] Stopped target Network.
         Stopping Network Manager...
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped target NFS client services.
         Stopping RPC security service for NFS client and server...
[[32m  OK  [0m] Stopped RPC security service for NFS client and server.
         Stopping GSSAPI Proxy Daemon...
[[32m  OK  [0m] Stopped target rpc_pipefs.target.
         Unmounting RPC Pipe File System...
[[32m  OK  [0m] Stopped GSSAPI Proxy Daemon.
[[32m  OK  [0m] Unmounted RPC Pipe File System.
[[32m  OK  [0m] Stopped Network Manager.
         Stopping D-Bus System Message Bus...
[[32m  OK  [0m] Stopped D-Bus System Message Bus.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped Forward Pa[140000.655345] type=1305 audit(1544684574.474:13516): audit_pid=0 old=9036 auid=4294967295 ses=4294967295 res=1
ssword Requests to Wall Directory Watch.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Removed slice User and Session Slice.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Closed RPCbind Ser[140000.668606] type=1130 audit(1544684574.488:13517): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=auditd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
ver Activation S[140000.668625] type=1131 audit(1544684574.488:13518): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=auditd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
ocket.
[[32m  OK  [0m] Closed Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Closed Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Stopped Forward Password Requests to Plymouth Directory Watch.
[[32m  [140000.733705] type=1130 audit(1544684574.553:13519): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-tmpfiles-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
OK  [0m] Closed[140000.733721] type=1131 audit(1544684574.553:13520): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-tmpfiles-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
 D-Bus System Message Bus Socket.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped Setup Virtual Console.
         Stopping Load/Save Random Seed...
[[32m  OK  [0m] Stopped Read and set NIS domainname from /etc/sysconfig/network.
         Stopping Update UTMP about System Boot/Shutdown...[140000.802741] type=1130 audit(1544684574.622:13521): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=rhel-import-state comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'

[[32m  OK  [0m] Stopped Apply[140000.802756] type=1131 audit(1544684574.622:13522): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=rhel-import-state comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
 Kernel Variables.
[[32m  OK  [0m] Stopped target Local Encrypted Volumes.
[[32m  OK  [0m] Stopped Load/Save Random Seed.
[[32m  OK  [0m] Stopped Update UTMP about System Boot/Shutdown.
         Stopping Security Auditing Service...
[[32m  OK  [0m] Stopped Security Auditing Service.
[[32m  OK  [0m] Stopped Create Volatile Files and Directories.
[[32m  OK  [0m] Stopped Import network configuration from initramfs.
[140000.915925] type=1130 audit(1544684574.735:13523): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=rhel-readonly comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[140000.915940] type=1131 audit(1544684574.735:13524): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=rhel-readonly comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[[32m  OK  [0m] Stopped target Local File Systems.
         Unmounting /run/user/0...
[[32m  OK  [0m] Stopped Configure read-only root support.
[140001.007274] type=1130 audit(1544684574.826:13525): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-remount-fs comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[[32m  OK  [0m] Unmounted /run/user/0.
[[32m  OK  [0m] Stopped target Local File Systems (Pre).
[[32m  OK  [0m] Stopped Remount Root and Kernel File Systems.
         Stopping Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Replay Read-Ahead Data.
[[32m  OK  [0m] Reached target Shutdown.
[140001.222097] systemd-shutdown[1]: Syncing filesystems and block devices.
[140001.388475] systemd-shutdown[1]: Sending SIGTERM to remaining processes...
[140001.433227] systemd-journald[4365]: Received SIGTERM from PID 1 (systemd-shutdow).
[140001.457867] systemd-shutdown[1]: Sending SIGKILL to remaining processes...
[140001.494836] systemd-shutdown[1]: Unmounting file systems.
[140001.503673] systemd-shutdown[86476]: Remounting '/' read-only in with options 'data=ordered'.
[140001.608036] EXT4-fs (sda1): re-mounted. Opts: data=ordered
[140001.633038] systemd-shutdown[1]: All filesystems unmounted.
[140001.642256] systemd-shutdown[1]: Deactivating swaps.
[140001.650793] systemd-shutdown[1]: All swaps deactivated.
[140001.659499] systemd-shutdown[1]: Detaching loop devices.
[140001.696525] systemd-shutdown[1]: All loop devices detached.
[140001.705414] systemd-shutdown[1]: Detaching DM devices.
[140001.713971] systemd-shutdown[1]: All DM devices detached.
[140001.750546] systemd-shutdown[1]: Syncing filesystems and block devices.
[140001.760973] systemd-shutdown[1]: Rebooting.
[140001.772570] sd 7:0:1:3: [sdk] Synchronizing SCSI cache
[140001.780367] sd 7:0:1:2: [sdj] Synchronizing SCSI cache
[140003.330771] sd 7:0:1:2: [sdj] Synchronize Cache(10) failed: Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[140003.344368] sd 7:0:1:2: [sdj] Sense Key : Illegal Request [current] 
[140003.354072] sd 7:0:1:2: [sdj] <<vendor>>ASC=0x94 ASCQ=0x1 
[140003.362748] sd 7:0:1:1: [sdi] Synchronizing SCSI cache
[140003.371009] sd 7:0:1:0: [sdh] Synchronizing SCSI cache
[140004.914091] sd 7:0:1:0: [sdh] Synchronize Cache(10) failed: Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[140004.927401] sd 7:0:1:0: [sdh] Sense Key : Illegal Request [current] 
[140004.936874] sd 7:0:1:0: [sdh] <<vendor>>ASC=0x94 ASCQ=0x1 
[140004.945321] sd 7:0:0:3: [sdf] Synchronizing SCSI cache
[140006.486815] sd 7:0:0:3: [sdf] Synchronize Cache(10) failed: Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[140006.499978] sd 7:0:0:3: [sdf] Sense Key : Illegal Request [current] 
[140006.509268] sd 7:0:0:3: [sdf] <<vendor>>ASC=0x94 ASCQ=0x1 
[140006.517574] sd 7:0:0:2: [sde] Synchronizing SCSI cache
[140006.525449] sd 7:0:0:1: [sdd] Synchronizing SCSI cache
[140008.070204] sd 7:0:0:1: [sdd] Synchronize Cache(10) failed: Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[140008.083195] sd 7:0:0:1: [sdd] Sense Key : Illegal Request [current] 
[140008.092296] sd 7:0:0:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[140008.100403] sd 7:0:0:0: [sdc] Synchronizing SCSI cache
[140008.108150] sd 6:0:1:0: [sdb] Synchronizing SCSI cache
[140008.116223] sd 6:0:0:0: [sda] Synchronizing SCSI cache
[140008.124825] mpt2sas_cm0: sending message unit reset !!
[140008.133682] mpt2sas_cm0: message unit reset: SUCCESS
[140008.937558] mlx4_core 0000:04:00.0: mlx4_shutdown was called
[140011.997954] R estarting syste2.003191] reboot: machine restart
[2J[1;1HCopyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 

<ConMan> Console [soak-8] joined by <w3liu@ssh-1> on pts/12 at 12-13 07:03.
[2J[1;1H[1;1H[0;37;40m[2J[1;1H[1;1H[1;37;40m[1;1HCopyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               [2;1HVersion 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.          [01;00H[0m[2m                                                                                [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [7m[4;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[4;79H[m[m[5;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [4;79H[22;1H   The selected entry will be started automatically in 5s.                     [4;79H[22;1H   The selected entry will be started automatically in 4s.                     [4;79H[22;1H   The selected entry will be started automatically in 3s.                     [4;79H[22;1H   The selected entry will be started automatically in 2s.                     [4;79H[22;1H   The selected entry will be started automatically in 1s.                     [4;79H[22;1H   The selected entry will be started automatically in 0s.                     [4;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.1.3.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Thu Nov 29 14:49:43 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.1.3.el7.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x357b2000-0x36bd0fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 162MB of memory at 688MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff902cae000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.1.3.el7.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 7009716k/34603008k available (7664k kernel code, 1126748k absent, 832888k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.264 MHz processor
[    0.000177] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.52 BogoMIPS (lpj=2693264)
[    0.012055] pid_max: default: 245760 minimum: 1920
[    0.018261] Security Framework initialized
[    0.022852] SELinux:  Initializing.
[    0.027033] Yama: becoming mindful.
[    0.036233] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.058188] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.071998] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.079769] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.090066] Initializing cgroup subsys memory
[    0.095000] Initializing cgroup subsys devices
[    0.099961] Initializing cgroup subsys freezer
[    0.104930] Initializing cgroup subsys net_cls
[    0.109923] Initializing cgroup subsys blkio
[    0.114697] Initializing cgroup subsys perf_event
[    0.120006] Initializing cgroup subsys hugetlb
[    0.124974] Initializing cgroup subsys pids
[    0.129661] Initializing cgroup subsys net_prio
[    0.135003] mce: CPU supports 20 MCE banks
[    0.139611] CPU0: Thermal monitoring enabled (TM1)
[    0.145023] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.151154] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.157478] tlb_flushall_shift: 6
[    0.161254] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.171994] FEATURE SPEC_CTRL Present
[    0.176144] FEATURE IBPB_SUPPORT Present
[    0.180836] Spectre V2 : Mitigation: Full retpoline
[    0.187433] Freeing SMP alternatives: 28k freed
[    0.198660] ACPI: Core revision 20130517
[    0.294588] ACPI: All ACPI Tables successfully acquired
[    0.314847] ftrace: allocating 29188 entries in 115 pages
[    0.377094] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.384483] Switched APIC routing to physical flat.
[    0.390651] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.407363] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.417856] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.429628] ... version:                3
[    0.434105] ... bit width:              48
[    0.438679] ... generic registers:      4
[    0.443156] ... value mask:             0000ffffffffffff
[    0.449089] ... max period:             00007fffffffffff
[    0.455021] ... fixed-purpose events:   3
[    0.459499] ... event mask:             000000070000000f
[    0.473692] smpboot: Booting Node   0, Processors  #1[    0.495113] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.549693] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.688789] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.730743] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.771451] Brought up 32 CPUs
[    0.775071] smpboot: Max logical packages: 15
[    0.779945] smpboot: Total of 32 processors activated (172572.38 BogoMIPS)
[    1.036205] node 0 initialised, 2808669 pages in 137ms
[    1.073818] node 1 initialised, 3599741 pages in 169ms
[    1.080783] devtmpfs: initialized
[    1.096386] EVM: security.selinux
[    1.100092] EVM: security.ima
[    1.103407] EVM: security.capability
[    1.107661] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.116526] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.128906] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.136593] pinctrl core: initialized pinctrl subsystem
[    1.142706] RTC time:  7:04:59, date: 12/13/18
[    1.148173] NET: Registered protocol family 16
[    1.153647] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.162112] ACPI: bus type PCI registered
[    1.166592] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.174430] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.184829] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.192463] PCI: Using configuration type 1 for base access
[    1.198727] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.221342] ACPI: Added _OSI(Module Device)
[    1.226017] ACPI: Added _OSI(Processor Device)
[    1.230980] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.236234] ACPI: Added _OSI(Processor Aggregator Device)
[    1.242265] ACPI: Added _OSI(Linux-Dell-Video)
[    1.286332] ACPI: Executed 1 blocks of module-level executable AML code
[    1.581055] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.614597] ACPI: Interpreter enabled
[    1.618721] ACPI: (supports S0 S1 S5)
[    1.622813] ACPI: Using IOAPIC for interrupt routing
[    1.628480] HEST: Table parsing has been initialized.
[    1.634128] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.644397] ACPI: GPE 0x1E active on init
[    1.648906] ACPI: GPE 0x24 active on init
[    1.653408] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.719309] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.726224] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.735889] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.744377] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.752930] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.762361] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.774024] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.788886] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.804139] PCI host bridge to bus 0000:00
[    1.808718] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.815623] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.823982] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.832340] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.840700] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.849059] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.857420] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.865780] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.874138] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.882496] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.890856] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.899214] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.907573] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.915931] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.924292] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.933428] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.940086] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.946718] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.953360] pci 0000:00:02.0: System wakeup disabled by ACPI
[    1.959998] pci 0000:00:02.2: System wakeup disabled by ACPI
[    1.966641] pci 0000:00:03.0: System wakeup disabled by ACPI
[    1.976872] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    1.983539] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    1.990157] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    1.996816] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.003379] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.010664] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.016394] acpiphp: Slot [2] registered
[    2.021066] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.031390] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.042062] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.052396] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.063075] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.073400] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.084074] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.094398] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.106730] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.112801] acpiphp: Slot [2-2] registered
[    2.119886] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.125633] acpiphp: Slot [2-3] registered
[    2.130251] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.135968] acpiphp: Slot [2-4] registered
[    2.140872] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.146784] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.159599] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.165272] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.171247] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.177659] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.183332] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.192323] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.200228] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.208129] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.216024] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.223921] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.231817] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.239721] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.247613] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.255727] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.262639] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.272051] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.280377] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.288930] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.298507] PCI host bridge to bus 0000:80
[    2.303088] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.310671] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.318255] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.326613] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.334972] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.344105] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.350464] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.357079] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.363687] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.370290] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.379139] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.384798] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.390450] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.396089] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.412720] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.419340] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.428525] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.438197] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.445198] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.454464] PCI host bridge to bus 0000:7f
[    2.459043] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.469695] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.476306] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.485499] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.495171] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.502177] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.511444] PCI host bridge to bus 0000:ff
[    2.516023] pci_bus 0000:ff: root bus resource [bus ff]
[    2.527278] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.536340] vgaarb: loaded
[    2.539363] vgaarb: bridge control possible 0000:09:00.0
[    2.545720] SCSI subsystem initialized
[    2.549965] ACPI: bus type USB registered
[    2.554482] usbcore: registered new interface driver usbfs
[    2.560625] usbcore: registered new interface driver hub
[    2.566852] usbcore: registered new device driver usb
[    2.573033] EDAC MC: Ver: 3.0.0
[    2.577081] PCI: Using ACPI for IRQ routing
[    2.589385] NetLabel: Initializing
[    2.593185] NetLabel:  domain hash size = 128
[    2.598051] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.603638] NetLabel:  unlabeled traffic allowed by default
[    2.610188] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.617205] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.625772] amd_nb: Cannot enumerate AMD northbridges
[    2.631609] Switched to clocksource hpet
[    2.650623] pnp: PnP ACPI init
[    2.654063] ACPI: bus type PNP registered
[    2.658837] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.665461] system 00:00: [io  0xffff] has been reserved
[    2.671399] system 00:00: [io  0xffff] has been reserved
[    2.677336] system 00:00: [io  0xffff] has been reserved
[    2.683274] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.690278] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.696895] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.703511] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.710127] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.717131] system 00:00: [io  0x0cf9] could not be reserved
[    2.723680] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.731851] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.739251] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.746646] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.754039] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.761436] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.768830] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.776602] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.784381] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.792163] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.800066] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.808380] pnp: PnP ACPI: found 7 devices
[    2.812963] ACPI: bus type PNP unregistered
[    2.826961] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.832531] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.838372] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.845185] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.852779] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.858332] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.865922] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.875354] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.880915] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.886465] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.893280] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.900874] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.906423] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    2.913238] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    2.920829] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    2.930264] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.935829] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.941381] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    2.948978] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    2.957637] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    2.963425] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.968986] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.974547] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.980106] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.986029] NET: Registered protocol family 2
[    2.993026] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.002193] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.009938] TCP: Hash tables configured (established 262144 bind 65536)
[    3.017425] TCP: reno registered
[    3.021191] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.028354] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.037003] NET: Registered protocol family 1
[    4.141726] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.249818] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.258320] Unpacking initramfs...
[    5.852674] Freeing initrd memory: 20604k freed
[    5.865787] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.873000] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff9029373c7000-ffff90293b3c6fff]
[    5.884500] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    5.893349] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    5.899777] RAPL PMU: hw unit of domain package 2^-16 Joules
[    5.906104] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    5.925232] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    5.932075] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    5.946079] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    5.954339] Initialise system trusted keyring
[    5.959339] audit: initializing netlink socket (disabled)
[    5.965420] type=2000 audit(1544684700.499:1): initialized
[    6.027701] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.034811] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.045140] zpool: loaded
[    6.048084] zbud: loaded
[    6.052103] VFS: Disk quotas dquot_6.5.2
[    6.056998] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.065703] msgmni has been set to 32768
[    6.070476] Key type big_key registered
[    6.077400] NET: Registered protocol family 38
[    6.082383] Key type asymmetric registered
[    6.086968] Asymmetric key parser 'x509' registered
[    6.092590] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.101138] io scheduler noop registered
[    6.105533] io scheduler deadline registered (default)
[    6.111420] io scheduler cfq registered
[    6.115717] io scheduler mq-deadline registered
[    6.120789] io scheduler kyber registered
[    6.131169] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.138991] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.146777] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.154080] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.161378] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.168686] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.176019] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.183810] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.191148] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.198965] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.206756] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.214100] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.221890] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.229200] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.236535] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.244352] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.252144] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.259487] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.267317] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.275146] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.282973] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.290870] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.297113] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.304557] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.312846] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.321119] ACPI: Power Button [PWRF]
[    6.325305] ACPI: Requesting acpi_cpufreq
[    6.413620] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.422071] pstore: Registered erst as persistent store backend
[    6.429033] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.437526] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.465409] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.492544] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.499829] Non-volatile memory driver v1.3
[    6.504591] Linux agpgart interface v0.103
[    6.509595] crash memory driver: version 1.1
[    6.514866] rdac: device handler registered
[    6.519624] hp_sw: device handler registered
[    6.524417] emc: device handler registered
[    6.529290] alua: device handler registered
[    6.534083] libphy: Fixed MDIO Bus: probed
[    6.538753] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.546073] ehci-pci: EHCI PCI platform driver
[    6.551500] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.557491] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.565783] ehci-pci 0000:00:1a.0: debug port 2
[    6.574821] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.586947] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.593475] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.601064] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.609141] usb usb1: Product: EHCI Host Controller
[    6.614601] usb usb1: Manufacturer: Linux 3.10.0-957.1.3.el7.x86_64 ehci_hcd
[    6.622483] usb usb1: SerialNumber: 0000:00:1a.0
[    6.627875] hub 1-0:1.0: USB hub found
[    6.632094] hub 1-0:1.0: 2 ports detected
[    6.637165] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    6.643110] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    6.651393] ehci-pci 0000:00:1d.0: debug port 2
[    6.660415] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    6.671956] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    6.678477] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    6.686065] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.694126] usb usb2: Product: EHCI Host Controller
[    6.699579] usb usb2: Manufacturer: Linux 3.10.0-957.1.3.el7.x86_64 ehci_hcd
[    6.707458] usb usb2: SerialNumber: 0000:00:1d.0
[    6.712851] hub 2-0:1.0: USB hub found
[    6.717059] hub 2-0:1.0: 2 ports detected
[    6.721790] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    6.728725] ohci-pci: OHCI PCI platform driver
[    6.733737] uhci_hcd: USB Universal Host Controller Interface driver
[    6.741013] usbcore: registered new interface driver usbserial_generic
[    6.748331] usbserial: USB Serial support registered for generic
[    6.755120] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    6.920992] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    7.807921] i8042: No controller found
[    7.812184] Switched to clocksource tsc
[    7.812266] mousedev: PS/2 mouse device common for all mice
[    7.812447] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    7.812522] rtc_cmos 00:01: RTC can wake from S4
[    7.812767] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    7.812823] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    7.812961] intel_pstate: Intel P-state driver initializing
[    7.824731] cpuidle: using governor menu
[    7.826281] hidraw: raw HID events driver (C) Jiri Kosina
[    7.826543] usbcore: registered new interface driver usbhid
[    7.826543] usbhid: USB HID core driver
[    7.826769] drop_monitor: Initializing network drop monitor service
[    7.827362] TCP: cubic registered
[    7.827372] Initializing XFRM netlink socket
[    7.828072] NET: Registered protocol family 10
[    7.829702] NET: Registered protocol family 17
[    7.829716] mpls_gso: MPLS GSO support
[    7.831495] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    7.835512] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    7.835745] Loading compiled-in X.509 certificates
[    7.835800] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717'
[    7.835827] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b'
[    7.836907] Loaded X.509 cert 'CentOS Linux kernel signing key: e7cef3613a9b8bd012fae7498272159bb1879c65'
[    7.836948] registered taskstats version 1
[    7.841861] Key type trusted registered
[    7.845610] Key type encrypted registered
[    7.845744] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.847424]   Magic number: 14:267:66
[    7.847774] memory memory227: hash matches
[    7.847799] memory memory94: hash matches
[    7.850574] rtc_cmos 00:01: setting system clock to 2018-12-13 07:05:05 UTC (1544684705)
[    7.863087] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    7.937631] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    7.937635] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.938041] hub 1-1:1.0: USB hub found
[    7.938245] hub 1-1:1.0: 6 ports detected
[    7.987247] random: fast init done
[    7.987637] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    7.987640] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.988008] hub 2-1:1.0: USB hub found
[    7.988142] hub 2-1:1.0: 8 ports detected
[    8.065625] Freeing unused kernel memory: 1876k freed
[    8.072068] Write protecting the kernel read-only data: 12288k
[    8.081862] Freeing unused kernel memory: 516k freed
[    8.090503] Freeing unused kernel memory: 600k freed
[    8.109738] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.131230] systemd[1]: Detected architecture x86-64.
[    8.136892] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.152295] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.228877] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.239226] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.249243] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.262488] systemd[1]: Created slice Root Slice.
[    8.267769] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
[ [32m  OK  [0m324] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.291229] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.301272] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[     8.314315] socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.326305] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Starting Create list of required st... nodes for the current kernel...
[    8.348034] systemd[1]: Starting Setup Virtual Console ...
         Sual Console...
[    8.360030] systemd[1]: Starting Apply Kernel Variables...
          Starting[    8.382281] systemd[1]: Starting dracut cmdline hook...
         Startin[    8.388980] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
g dracut cmdline[    8.397591] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
 hook...
[    8.407290] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.414358] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.420779] usb 2-1.4: SerialNumber: serial
[    8.426139] systemd[1]: Starting Journal Service...
[    8.426998] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
         Starting Journal Service...
[    8.451220] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.464172] systemd[1]: Reached target Sockets.
[[32m  OK  [0m] Reached target Sockets.
[    8.474612] systemd[1]: Started Create list of required static device nodes for the current kernel.
[    8.477461] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
[    8.478559] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
[    8.478792] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[    8.542797] systemd[1]: Started Setup Virtual Console.
[[32m  OK  [0m] Started Setup Virtual Console.
[    8.555499] systemd[1]: Started Apply Kernel Variables.
[[32m  OK  [0m] Started Apply Kernel Variables.
[    8.568493] systemd[1]: Started dracut cmdline hook.
[[32m  OK  [0m] Started dracut cmdline hook.
[    8.581405] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
         Starting dracut pre-udev hook...
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Show Plymouth Boot Screen...
         Starting dracut initqueue hook...
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Reached targe[    8.810740] dca service started, version 1.12.1
t Paths.
[[32m  OK  [0m] Reached target Basi[    8.820698] pps_core: LinuxPPS API ver. 1 registered
c System.
[    8.826686] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    8.841441] PTP clock support registered
[    8.859036] mlx4_core: Mellanox ConnectX core driver v4.0-0
[    8.865295] mlx4_core: Initializing 0000:04:00.0
[    8.876339] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    8.876346] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    8.876404] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    8.876415] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    8.876421] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    8.876424] isci 0000:07:00.0: OEM parameter table found in OROM
[    8.876429] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    8.878673] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    8.881229] scsi host0: isci
[    8.882219] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    8.882224] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    8.893718] scsi host1: ahci
[    8.894039] scsi host2: ahci
[    8.896364] scsi host3: ahci
[    8.896664] scsi host4: ahci
[    8.896864] scsi host5: ahci
[    8.897031] scsi host6: ahci
[    8.897089] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 39
[    8.897091] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 39
[    8.897093] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 39
[    8.897096] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 39
[    8.897099] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 39
[    8.897102] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 39
[    8.975771] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.976476] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    9.025767] igb 0000:02:00.0: added PHC on eth0
[    9.025768] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    9.025770] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    9.025844] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    9.025845] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.026474] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.064242] igb 0000:02:00.1: added PHC on eth1
[    9.064243] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.064245] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.064318] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.064320] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.122774] igb 0000:02:00.2: added PHC on eth2
[    9.122775] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.122777] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.122850] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.122852] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
%G[    9.178670] igb 0000:02:00.3: added PHC on eth3
[    9.183734] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.191413] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.199459] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.202186] ata3: SATA link down (SStatus 0 SControl 300)
[    9.202214] ata6: SATA link down (SStatus 0 SControl 300)
[    9.202241] ata1: SATA link down (SStatus 0 SControl 300)
[    9.203184] ata2: SATA link down (SStatus 0 SControl 300)
[    9.204188] ata4: SATA link down (SStatus 0 SControl 300)
[    9.204219] ata5: SATA link down (SStatus 0 SControl 300)
[    9.223326] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.237855] [TTM] Zone  kernel: Available graphics memory: 16333498 kiB
[    9.237856] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.237857] [TTM] Initializing pool allocator
[    9.237861] [TTM] Initializing DMA pool allocator
[    9.274644] fbcon: mgadrmfb (fb0) is primary device
[    9.508303] Console: switching to colour frame buffer device 128x48
[    9.544530] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
%G[    9.553268] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   10.560051] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   10.566275] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   10.574492] ata7.00: configured for UDMA/133
[   10.589773] scsi 0:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.404115] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.411111] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   16.142841] mlx4_core 0000:04:00.0: PCIe link speed is 8.0GT/s, device supports 8.0GT/s
[   16.151776] mlx4_core 0000:04:00.0: PCIe link width is x8, device supports x8
[   16.525854] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   16.532101] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   16.540565] ata8.00: configured for UDMA/133
[   16.556802] scsi 0:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   16.604100] sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   16.604159] sd 0:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   16.604334] sd 0:0:1:0: [sdb] Write Protect is off
[   16.604398] sd 0:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   16.620915]  sdb:
[   16.621629] sd 0:0:1:0: [sdb] Attached SCSI disk
[   16.643685] sd 0:0:0:0: [sda] Write Protect is off
[   16.649061] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   16.678077]  sda: sda1 sda2
[   16.681758] sd 0:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
         Mounting /sysroot...
[   17.193944] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped target Timers.
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Closed udev Control Socket.
[[32m  OK  [0m][   17.608378] systemd-journald[307]: Received SIGTERM from PID 1 (systemd).
 Closed udev Kernel Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   17.652527] random: crng init done
[   17.983516] SELinux:  Disabled at runtime.
[   18.032008] type=1404 audit(1544684715.682:2): selinux=0 auid=4294967295 ses=4294967295
[   18.274594] ip_tables: (C) 2000-2006 Netfilter Core Team
[   18.281557] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
         Mounting Debug File System...
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
         Mounting Huge Pages File System...
[[32m  OK  [0m] Created slice User and Session Slice.
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
         Starting Create list of required st... nodes for the current kernel...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Stopped target Initrd Root File System.
         Starting Availability of block devices...
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
         [   19.226133] RPC: Registered named UNIX socket transport module.
Starting Monitor[   19.233547] RPC: Registered udp transport module.
ing of LVM2 mirr[   19.240349] RPC: Registered tcp transport module.
ors... dmeventd [   19.247143] RPC: Registered tcp NFSv4.1 backchannel transport module.
or progress polling...
[[32m  OK  [0m] Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Create Static Device Nodes in /dev...
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[   19.383675] EXT4-fs (sda1): re-mounted. Opts: (null)
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting udev Coldplug all Devices...
         Starting Configure read-only root support...
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started LVM2 metadata daemon.
[[32m  OK  [0m] Started Journal Service.
         Starting Flush Journal to Persistent Storage...
[   19.812567] systemd-journald[4341]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Started udev Kernel Device Manager.
[   20.005445] device-mapper: uevent: version 1.0.3
[   20.010779] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[   20.399754] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   20.408599] igb 0000:02:00.0: DCA enabled
[   20.413237] igb 0000:02:00.1: DCA enabled
[   20.418605] igb 0000:02:00.2: DCA enabled
[   20.424030] igb 0000:02:00.3: DCA enabled
[   20.446580] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   20.454113] ipmi message handler version 39.2
[   20.455919] i801_smbus 0000:07:00.3: Enabling SMBus device
[   20.455959] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   20.472508] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   20.484563] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[[32m  OK  [0m[   20.498238] ipmi device interface
] Found device /dev/ttyS0.
[   20.532206] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   20.564203] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   20.572405] sd 0:0:0:0: Attached scsi generic sg0 type 0
[   20.580586] sd 0:0:1:0: Attached scsi generic sg1 type 0
[   20.590727] IPMI System Interface driver.
[   20.590784] mpt2sas version 20.103.01.00 loaded
[   20.590871] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[   20.591116] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32666996 kB)
[   20.617900] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   20.624631] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   20.624638] ipmi_si: Adding SMBIOS-specified kcs state machine
[   20.624688] ipmi_platform: probing via SPMI
[   20.624690] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   20.624694] (NULL device *): SPMI-specified kcs state machine: duplicate
[   20.624777] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   20.645744] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[   20.646357] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 159
[   20.646358] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 160
[   20.646359] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 161
[   20.646359] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 162
[   20.646360] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 163
[   20.646360] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 164
[   20.646361] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 165
[   20.646361] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 166
[   20.646362] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 167
[   20.646363] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 168
[   20.646363] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 169
[   20.646364] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 170
[   20.646364] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 171
[   20.646365] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 172
[   20.646365] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 173
[   20.646366] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 174
[   20.646367] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffa641c3b60000), size(65536)
[   20.646368] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[   20.669669] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   20.705226] mpt2sas_cm0: sending message unit reset !!
[   20.706742] mpt2sas_cm0: message unit reset: SUCCESS
[   20.728523] iTCO_vendor_support: vendor-support=0
[   20.728588] cryptd: max_cpu_qlen set to 1000
[   20.767542] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   20.774406] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[   20.774408] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[   20.774408] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[   20.806043] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   20.806095] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   20.824188] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[   20.824190] mpt2sas_cm0: Protocol=(
[   20.824190] Initiator
[   20.824190] ,Target
[   20.824191] ), 
[   20.824191] Capabilities=(
[   20.824192] TLR
[   20.824192] ,EEDP
[   20.824192] ,Snapshot Buffer
[   20.824193] ,Diag Trace Buffer
[   20.824193] ,Task Set Full
[   20.824194] ,NCQ
[   20.824194] )
[   20.824241] scsi host7: Fusion MPT SAS Host
[   20.824581] mpt2sas_cm0: sending port enable !!
[   20.827270] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[   20.835233] mpt2sas_cm0: port enable: SUCCESS
[   20.836007] scsi 7:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   20.836012] scsi 7:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   20.836013] scsi 7:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   20.836016] scsi 7:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   20.885191] device-mapper: multipath round-robin: version 1.2.0 loaded
[   20.902609] IPMI SSIF Interface driver
%G%G[   21.043117] scsi 7:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   21.052269] scsi 7:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   21.064018] scsi 7:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   21.072057] scsi 7:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   21.082503] AVX version of gcm_enc/dec engaged.
[   21.087566] AES CTR mode by8 optimization enabled
[   21.095652] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   21.102958] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   21.113632] scsi 7:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   21.122723] scsi 7:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   21.134469] scsi 7:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   21.142467] scsi 7:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   21.172702] scsi 7:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   21.181791] scsi 7:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   21.193538] scsi 7:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   21.201563] scsi 7:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   21.222892] scsi 7:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   21.231965] scsi 7:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[   21.243712] scsi 7:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[   21.251736] scsi 7:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   21.300281] scsi 7:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   21.318773] scsi 7:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   21.330531] scsi 7:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   21.338563] scsi 7:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   21.365670] kvm: disabled by bios
[   21.381996] scsi 7:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   21.391073] scsi 7:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   21.402821] scsi 7:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   21.410817] scsi 7:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   21.421463] kvm: disabled by bios
[   21.436687] scsi 7:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   21.445819] scsi 7:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   21.457566] scsi 7:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   21.465671] scsi 7:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   21.489168] intel_rapl: Found RAPL domain package
[   21.494440] intel_rapl: Found RAPL domain core
[   21.499423] intel_rapl: Found RAPL domain dram
[   21.504480] intel_rapl: Found RAPL domain package
[   21.509772] intel_rapl: Found RAPL domain core
[   21.514776] intel_rapl: Found RAPL domain dram
[   21.522786] scsi 7:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[   21.531836] scsi 7:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   21.543584] scsi 7:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   21.551579] scsi 7:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   21.578791] scsi 7:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[   21.587850] scsi 7:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[   21.599597] scsi 7:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[   21.607663] scsi 7:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[   21.630093] scsi 7:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   21.636066] sd 7:0:0:0: Attached scsi generic sg2 type 0
[   21.642092] sd 7:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   21.643071] scsi 7:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   21.643272] sd 7:0:0:1: Attached scsi generic sg3 type 0
[   21.643357] sd 7:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   21.644034] scsi 7:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   21.644186] sd 7:0:0:1: [sdd] Write Protect is off
[   21.644233] sd 7:0:0:2: Attached scsi generic sg4 type 0
[   21.644473] sd 7:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   21.644482] sd 7:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   21.645276] scsi 7:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   21.645494] sd 7:0:0:3: Attached scsi generic sg5 type 0
[   21.645654] sd 7:0:0:2: [sde] Write Protect is off
[   21.645720] sd 7:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   21.645810] sd 7:0:0:7: Attached scsi generic sg6 type 0
[   21.646107] sd 7:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   21.646144] sd 7:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   21.646424] scsi 7:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   21.646627] sd 7:0:1:0: Attached scsi generic sg7 type 0
[   21.646753] sd 7:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   21.647045] sd 7:0:0:3: [sdf] Write Protect is off
[   21.647337] scsi 7:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   21.647516] sd 7:0:0:7: [sdg] Write Protect is off
[   21.647564] sd 7:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   21.647574] sd 7:0:1:1: Attached scsi generic sg8 type 0
[   21.647646] sd 7:0:1:0: [sdh] Write Protect is off
[   21.647697] Dev sdd: unable to read RDB block 0
[   21.647708]  sdd: unable to read partition table
[   21.647757] sd 7:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   21.647941] sd 7:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   21.648046] sd 7:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   21.648750] sd 7:0:1:1: [sdi] Write Protect is off
[   21.649180] sd 7:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   21.649230] scsi 7:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   21.649518] sd 7:0:1:2: Attached scsi generic sg9 type 0
[   21.650835] sd 7:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   21.651345] Dev sdf: unable to read RDB block 0
[   21.651362]  sdf: unable to read partition table
[   21.651562] Dev sdh: unable to read RDB block 0
[   21.651573]  sdh: unable to read partition table
[   21.651912] sd 7:0:1:2: [sdj] Write Protect is off
[   21.652095] scsi 7:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   21.652341] sd 7:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   21.652372]  sdg:
[   21.652427] sd 7:0:1:3: Attached scsi generic sg10 type 0
[   21.652879] sd 7:0:1:7: Attached scsi generic sg11 type 0
[   21.652922] sd 7:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   21.653379] sd 7:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   21.653406] sd 7:0:0:2: [sde] Attached SCSI disk
[   21.653843] sd 7:0:0:1: [sdd] Attached SCSI disk
[   21.653995] sd 7:0:0:3: [sdf] Attached SCSI disk
[   21.654396] sd 7:0:0:7: [sdg] Attached SCSI disk
[   21.654637] sd 7:0:1:0: [sdh] Attached SCSI disk
[   21.654863] sd 7:0:1:3: [sdk] Write Protect is off
[   21.655185] sd 7:0:1:7: [sdl] Write Protect is off
[   21.655436] sd 7:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   21.655839] sd 7:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   21.656468] Dev sdj: unable to read RDB block 0
[   21.656475]  sdj: unable to read partition table
[   21.656819] sd 7:0:1:1: [sdi] Attached SCSI disk
[   21.658695] sd 7:0:1:2: [sdj] Attached SCSI disk
[   21.659098]  sdl:
[   21.660620] sd 7:0:1:3: [sdk] Attached SCSI disk
[   21.660649] sd 7:0:1:7: [sdl] Attached SCSI disk
[   21.818096] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   21.818255] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   21.818256] EDAC sbridge:  Ver: 1.1.2 
[   22.071444] sd 7:0:0:0: [sdc] Write Protect is off
[   22.077027] sd 7:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   22.089481] sd 7:0:0:0: [sdc] Attached SCSI disk
[   22.149502] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   22.647580] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   22.656296] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   23.062904] device-mapper: table: 253:5: multipath: error getting device
[   23.070503] device-mapper: ioctl: error adding target to table
[   23.292611] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   23.301336] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...[   23.520299] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS

[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Preprocess NFS configuration...
         Starting Tell Plymouth To Write Out Runtime Data...
         Starting Import network configuration from initramfs...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Starting Security Auditing Service...
         Mounting RPC Pipe File System...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   23.975113] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   23.983889] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   24.032219] type=1305 audit(1544684721.681:3): audit_pid=8765 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting GSSAPI Proxy Daemon...
         Starting Authorization Manager...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Machine Check Exception Logging Daemon...
         Starting Network Manager...
         Starting Load CPU microcode update...
         Starting System Security Services Daemon...
         Starting NTP client/server...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Dump dmesg to /var/log/dmesg...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[   24.623821] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   24.632535] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[   25.260097] sd 7:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   25.268809] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   25.347863] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   25.435778] igb 0000:02:00.0 ens2f0: igb: ens2f0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   25.435982] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   25.439218] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   25.520421] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   25.527145] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[   25.537815] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   25.656177] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   25.665913] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   25.784287] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   25.870397] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting MUNGE authentication service...
         Starting Postfix Mail Transport Agent...
         Starting OpenSSH server daemon...
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting Dynamic System Tuning Daemon...
[[32m  OK  [0m] Reached target Network is Online.
         Starting Notify NFS peers of a restart...
         Starting NFS status monitor for NFSv2/3 locking....
         Starting System Logging Service...
         Mounting /scratch...
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[   33.052699] FS-Cache: Loaded
[   33.149131] FS-Cache: Netfs 'nfs' registered for caching
[   33.164044] Key type dns_resolver registered
[   33.199814] NFS: Registering the id_resolver key type
[   33.205481] Key type id_resolver registered
[   33.210164] Key type id_legacy registered
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Permit User Sessions...
         Starting Automounts filesystems on demand...
         Starting Crash recovery kernel arming...
[[32m  OK  [0m] Started Permit User Sessions.
[[32m  OK  [0m] Started Job spooling tools.
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Started Command Scheduler.
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Created slice User Slice of root.
[[32m  OK  [0m] Started Session 1 of user root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.1.3.el7.x86_64 on an x86_64

soak-8 login: [2018-12-13T07:05:42+00:00] INFO: Forking chef instance to converge...
[2018-12-13T07:05:42+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-13T07:05:42+00:00] INFO: Chef-client pid: 15211
[2018-12-13T07:05:44+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-13T07:05:44+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-13T07:05:44+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-13T07:05:44+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-13T07:05:44+00:00] INFO: Running start handlers
[2018-12-13T07:05:44+00:00] INFO: Start handlers complete.
[2018-12-13T07:05:45+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-13T07:05:45+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-13T07:05:45+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-13T07:05:45+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-13T07:05:45+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181213070545.259465
[2018-12-13T07:05:45+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181211074923.277514
[2018-12-13T07:05:45+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-13T07:05:45+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-13T07:05:50+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-13T07:05:50+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-13T07:05:50+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-13T07:05:50+00:00] INFO: service[ntpd] started
[2018-12-13T07:05:50+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-13T07:05:51+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-13T07:05:51+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-13T07:05:51+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-13T07:05:51+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-13T07:05:51+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-13T07:05:51+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-13T07:05:51+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-13T07:05:51+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-13T07:05:51+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-13T07:05:52+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-13T07:05:52+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-13T07:05:52+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-13T07:05:52+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:52+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:52+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-13T07:05:52+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-13T07:05:53+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-13T07:05:53+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-13T07:05:53+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-13T07:05:53+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-13T07:05:54+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-13T07:05:54+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-13T07:05:54+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-13T07:05:54+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-13T07:05:54+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-13T07:05:54+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-13T07:05:54+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-13T07:05:55+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-13T07:05:55+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-13T07:05:55+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-13T07:05:55+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-13T07:05:55+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-13T07:05:55+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-13T07:05:55+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-13T07:05:55+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-13T07:05:55+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-13T07:05:55+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-13T07:05:55+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-13T07:05:55+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-13T07:05:56+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-13T07:05:56+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-13T07:05:56+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-13T07:05:56+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-13T07:05:56+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181213070556.593160
[2018-12-13T07:05:56+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211074934.333138
[2018-12-13T07:05:56+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-13T07:05:56+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-13T07:05:56+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-13T07:05:56+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181213070556.600159
[2018-12-13T07:05:56+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211074934.339359
[2018-12-13T07:05:56+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-13T07:05:56+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-13T07:05:56+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-13T07:05:56+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:56+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-13T07:05:56+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:56+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-13T07:05:56+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-13T07:05:56+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:05:56+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:56+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:05:56+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:56+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:05:56+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:56+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:05:56+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:56+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:05:56+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:56+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:05:56+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:56+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:05:56+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:56+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:56+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:05:56+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:57+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:57+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-13T07:05:57+00:00] INFO: service[xinetd] started
[2018-12-13T07:05:57+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-13T07:05:58+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-13T07:05:58+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-13T07:05:58+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-13T07:05:58+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-13T07:05:59+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-13T07:05:59+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-13T07:05:59+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-13T07:05:59+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181213070559.342942
[2018-12-13T07:05:59+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181211074936.994138
[2018-12-13T07:05:59+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-13T07:05:59+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-13T07:05:59+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-13T07:05:59+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-13T07:05:59+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-13T07:05:59+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-13T07:05:59+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-13T07:05:59+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:05:59+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:05:59+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:05:59+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-13T07:05:59+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-13T07:05:59+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-13T07:05:59+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-13T07:06:00+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-13T07:06:00+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-13T07:06:00+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-13T07:06:00+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-13T07:06:00+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-13T07:06:00+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-13T07:06:00+00:00] INFO: Processing service[rdma] action enable (test_node::default line 66)
[0m
================================================================================[0m
[31mError executing action `enable` on resource 'service[rdma]'[0m
================================================================================[0m

[0mMixlib::ShellOut::ShellCommandFailed[0m
------------------------------------[0m
Expected process to exit with [0], but received '1'
[0m---- Begin output of /bin/systemctl enable rdma ----
[0mSTDOUT: 
[0mSTDERR: Failed to execute operation: No such file or directory
[0m---- End output of /bin/systemctl enable rdma ----
[0mRan /bin/systemctl enable rdma returned 1[0m

[0mResource Declaration:[0m
---------------------[0m
# In /var/tmp/chef-solo/cookbooks/test_node/recipes/default.rb
[0m
[0m 66:   service openib_service do
[0m 67:     if node[:platform_version].to_f < 7.0
[0m 68:       action [:enable]
[0m 69:     else
[0m 70:       action [:enable, :start]
[0m 71:     end
[0m 72:   end
[0m
[0mCompiled Resource:[0m
------------------[0m
# Declared in /var/tmp/chef-solo/cookbooks/test_node/recipes/default.rb:66:in `from_file'
[0m
[0mservice("rdma") do
[0m  action [:enable, :start]
[0m  supports {:restart=>false, :reload=>false, :status=>false}
[0m  retries 0
[0m  retry_delay 2
[0m  default_guard_interpreter :default
[0m  service_name "rdma"
[0m  pattern "rdma"
[0m  declared_type :service
[0m  cookbook_name :test_node
[0m  recipe_name "default"
[0mend
[0m
[0m[2018-12-13T07:06:01+00:00] INFO: Running queued delayed notifications before re-raising exception
[2018-12-13T07:06:01+00:00] ERROR: Running exception handlers
[2018-12-13T07:06:01+00:00] ERROR: Exception handlers complete
[2018-12-13T07:06:01+00:00] FATAL: Stacktrace dumped to /var/tmp/chef-solo/chef-stacktrace.out
[2018-12-13T07:06:01+00:00] ERROR: service[rdma] (test_node::default line 66) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but received '1'
---- Begin output of /bin/systemctl enable rdma ----
STDOUT: 
STDERR: Failed to execute operation: No such file or directory
---- End output of /bin/systemctl enable rdma ----
Ran /bin/systemctl enable rdma returned 1
[2018-12-13T07:06:01+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)

CentOS Linux 7 (Core)
Kernel 3.10.0-957.1.3.el7.x86_64 on an x86_64

soak-8 login: root
Password: 
Last login: Thu Dec 13 06:56:41 from ssh-1.spirit.whamcloud.com
[root@soak-8 ~]# rpm -qa|grpe lus[K[K[K[K[K[Kep lsu[K[Kustre
kernel-3.10.0-957.el7_[01;31m[Klustre[m[K.x86_64
[root@soak-8 ~]# yum remove kernel-3.10.0-957.el7_lustre.x86_64
Loaded plugins: fastestmirror
Resolving Dependencies
--> Running transaction check
---> Package kernel.x86_64 0:3.10.0-957.el7_lustre will be erased
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package     Arch        Version                       Repository          Size
================================================================================
Removing:
 kernel      x86_64      3.10.0-957.el7_lustre         @lustre-build       63 M

Transaction Summary
================================================================================
Remove  1 Package

Installed size: 63 M
Is this ok [y/N]: y
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Erasing    : kernel-3.10.0-957.el7_lustre.x86_64                          1/1 
  Verifying  : kernel-3.10.0-957.el7_lustre.x86_64                          1/1 

Removed:
  kernel.x86_64 0:3.10.0-957.el7_lustre                                         

Complete!
[root@soak-8 ~]# yum install kernel-3.10.0-957.el7_lustre.x86_64
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
Resolving Dependencies
--> Running transaction check
---> Package kernel.x86_64 0:3.10.0-957.el7_lustre will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package      Arch         Version                     Repository          Size
================================================================================
Installing:
 kernel       x86_64       3.10.0-957.el7_lustre       lustre-build        48 M

Transaction Summary
================================================================================
Install  1 Package

Total download size: 48 M
Installed size: 63 M
Is this ok [y/d/N]: y
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
kernel-3.10.0-957.el7_lust 71% [===========     ]  0.0 B/s |  34 MB   --:-- ETA kernel-3.10.0-957.el7_lustre.x86_64.rpm                    |  48 MB   00:00     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : kernel-3.10.0-957.el7_lustre [                             ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [#                            ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [##                           ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [###                          ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [####                         ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [#####                        ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [######                       ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [#######                      ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [########                     ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [#########                    ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [##########                   ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [###########                  ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [############                 ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [#############                ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [##############               ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [###############              ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [################             ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [#################            ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [##################           ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [###################          ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [####################         ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [#####################        ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [######################       ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [#######################      ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [########################     ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [#########################    ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [##########################   ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [###########################  ] 1/1  Installing : kernel-3.10.0-957.el7_lustre [############################ ] 1/1  Installing : kernel-3.10.0-957.el7_lustre.x86_64                          1/1 
[  141.000767] sd 7:0:0:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[  141.009453] sd 7:0:0:1: [sdd] Sense Key : Illegal Request [current] 
[  141.016561] sd 7:0:0:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[  141.022697] sd 7:0:0:1: [sdd] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00
[  141.032037] blk_update_request: I/O error, dev sdd, sector 6986547072
[  141.550744] sd 7:0:0:3: [sdf] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[  141.559410] sd 7:0:0:3: [sdf] Sense Key : Illegal Request [current] 
[  141.566516] sd 7:0:0:3: [sdf] <<vendor>>ASC=0x94 ASCQ=0x1 
[  141.572646] sd 7:0:0:3: [sdf] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00
[  141.581978] blk_update_request: I/O error, dev sdf, sector 6986547072
[  142.095052] sd 7:0:1:0: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[  142.103718] sd 7:0:1:0: [sdh] Sense Key : Illegal Request [current] 
[  142.110817] sd 7:0:1:0: [sdh] <<vendor>>ASC=0x94 ASCQ=0x1 
[  142.116958] sd 7:0:1:0: [sdh] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00
[  142.126283] blk_update_request: I/O error, dev sdh, sector 6986547072
[  143.495141] sd 7:0:1:2: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[  143.503799] sd 7:0:1:2: [sdj] Sense Key : Illegal Request [current] 
[  143.510898] sd 7:0:1:2: [sdj] <<vendor>>ASC=0x94 ASCQ=0x1 
[  143.517049] sd 7:0:1:2: [sdj] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00
[  143.526376] blk_update_request: I/O error, dev sdj, sector 6986547072


<ConMan> Console [soak-8] departed by <w3liu@ssh-1> on pts/12 at 12-13 07:07.
  Verifying  : kernel-3.10.0-957.el7_lustre.x86_64                          1/1 

Installed:
  kernel.x86_64 0:3.10.0-957.el7_lustre                                         

Complete!
[root@soak-8 ~]# 
[root@soak-8 ~]# [  201.583657] SGI XFS with ACLs, security attributes, no debug enabled
[  201.660151] xor: automatically using best checksumming function:
[  201.676106]    avx       : 11556.000 MB/sec
[  201.712135] raid6: sse2x1   gen()  4925 MB/s
[  201.733119] raid6: sse2x2   gen()  6882 MB/s
[  201.754120] raid6: sse2x4   gen()  8769 MB/s
[  201.758893] raid6: using algorithm sse2x4 gen() (8769 MB/s)
[  201.765124] raid6: using ssse3x2 recovery algorithm
[  201.839407] Btrfs loaded, crc32c=crc32c-intel
[  201.860536] fuse init (API version 7.22)

<ConMan> Console [soak-8] joined by <w3liu@ssh-1> on pts/12 at 12-13 07:08.

[root@soak-8 ~]# shutdown -r now
[[32m  OK  [0m] Started Show Plymouth Reboot Screen.
[[32m  OK  [0m] Stopped Login Service.
[[32m  OK  [0m] Stopped target User and Group Name Lookups.
[[32m  OK  [0m] Stopped Availability of block devices.
[[32m  OK  [0m] Stopped Dynamic System Tuning Daemon.
[[32m  OK  [0m] Stopped Automounts filesystems on demand.
         Stopping NFS status monitor for NFSv2/3 locking....
         Stopping RPC bind service...
         Stopping System Security Services Daemon...
[[32m  OK  [0m] Stopped target Remote File Systems.
         Unmounting /scratch...
[[32m  OK  [0m] Stopped RPC bind service.
[[32m  OK  [0m] Stopped NFS status monitor for NFSv2/3 locking..
[[32m  OK  [0m] Stopped target Host and Network Name Lookups.
[[32m  OK  [0m] Stopped System Security Services Daemon.
[[32m  OK  [0m] Unmounted /scratch.
[[32m  OK  [0m] Stopped target Network is Online.
[[32m  OK  [0m] Stopped target Network.
[[32m  OK  [0m] Stopped Network Manager Wait Online.
         Stopping Network Manager...
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped target NFS client services.
         Stopping RPC security service for NFS client and server...
[[32m  OK  [0m] Stopped RPC security service for NFS client and [  214.655949] type=1305 audit(1544684912.646:138): audit_pid=0 old=8765 auid=4294967295 ses=4294967295 res=1
server.
      [  214.667291] type=1131 audit(1544684912.657:139): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=auditd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
   Stopping GSSA[  214.689007] type=1131 audit(1544684912.679:140): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-tmpfiles-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
PI Proxy Daemon.[  214.711402] type=1131 audit(1544684912.701:141): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=rhel-import-state comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
..
[[32m  OK  [0m] Stopped t[  214.735724] type=1131 audit(1544684912.726:142): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=rhel-readonly comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
arget rpc_pipefs.target.
         Unmounting RPC Pipe File System...
[[32m  OK  [0m] Stopped GSSAPI Proxy Daemon.
[[32m[  214.768528] type=1131 audit(1544684912.758:143): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-tmpfiles-setup-dev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
  OK  [0m] Unmo[  214.791417] type=1131 audit(1544684912.781:144): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-remount-fs comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
unted RPC Pipe F[  214.813644] type=1131 audit(1544684912.804:145): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-readahead-replay comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
ile System.
[[32m  OK  [0m] Stopped Network Manager.
         Stopping D-Bus System Message Bus...
[[32m  OK  [0m] Stopped D-Bus System Message Bus.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Stopped t[  214.866802] type=1131 audit(1544684912.857:146): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=lvm2-monitor comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
arget Sockets.
[[32m  OK  [0m] Closed Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Closed RPCbind Server Activation Socket.
[[32m  OK  [0m] Closed Remote Login Facilities Activation Socket.
[[32m[  214.910017] systemd-shutdown[1]: Syncing filesystems and block devices.
  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Removed slice User and Session Slice.
[[32m  OK  [0m] Closed D-Bus System Message Bus Socket.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped target Local Encrypted Volumes.
         Stopping Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Stopped Setup Virtual Console.
[[32m  OK  [0m] Stopped Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
         Stopping Load/Save Random Seed...
[[32m  OK  [0m] Stopped Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Stopped Load/Save Random Seed.
         Stopping Security Auditing Service...
[[32m  OK  [0m] Stopped Security Auditing Service.
[[32m  OK  [0m] Stopped Create Volatile Files and Directories.
[[32m  OK  [0m] Stopped Import network configuration from initramfs.
[[32m  OK  [0m] Stopped target Local File Systems.
         Unmounting Configuration File System...
         Unmounting /run/user/0...
[[32m  OK  [0m] Stopped Configure read-only root support.
[[32m  OK  [0m] Unmounted Configuration File System.
[[32m  OK  [0m] Unmounted /run/user/0.
[[32m  OK  [0m] Stopped target Local File Systems (Pre).
[[32m[  215.063415] systemd-shutdown[1]: Sending SIGTERM to remaining processes...
  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Remount Root and Kernel File Systems.
[[32m  OK  [0m] Stopped Replay Read-Ahead Data.
[[32m  OK  [0m] Reached target Shutdown.
[  215.106369] systemd-journald[4341]: Received SIGTERM from PID 1 (systemd-shutdow).
[  215.127087] systemd-shutdown[1]: Sending SIGKILL to remaining processes...
[  215.162091] systemd-shutdown[1]: Unmounting file systems.
[  215.168702] systemd-shutdown[34451]: Remounting '/' read-only in with options 'data=ordered'.
[  215.233743] EXT4-fs (sda1): re-mounted. Opts: data=ordered
[  215.253701] systemd-shutdown[1]: All filesystems unmounted.
[  215.259951] systemd-shutdown[1]: Deactivating swaps.
[  215.265616] systemd-shutdown[1]: All swaps deactivated.
[  215.271474] systemd-shutdown[1]: Detaching loop devices.
[  215.313879] systemd-shutdown[1]: All loop devices detached.
[  215.320122] systemd-shutdown[1]: Detaching DM devices.
[  215.326032] systemd-shutdown[1]: All DM devices detached.
[  215.351189] systemd-shutdown[1]: Syncing filesystems and block devices.
[  215.358683] systemd-shutdown[1]: Rebooting.
[  215.367603] sd 7:0:1:3: [sdk] Synchronizing SCSI cache
[  215.373450] sd 7:0:1:2: [sdj] Synchronizing SCSI cache
[  216.916277] sd 7:0:1:2: [sdj] Synchronize Cache(10) failed: Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[  216.927209] sd 7:0:1:2: [sdj] Sense Key : Illegal Request [current] 
[  216.934321] sd 7:0:1:2: [sdj] <<vendor>>ASC=0x94 ASCQ=0x1 
[  216.940481] sd 7:0:1:1: [sdi] Synchronizing SCSI cache
[  216.946319] sd 7:0:1:0: [sdh] Synchronizing SCSI cache
[  218.483032] sd 7:0:1:0: [sdh] Synchronize Cache(10) failed: Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[  218.493971] sd 7:0:1:0: [sdh] Sense Key : Illegal Request [current] 
[  218.501068] sd 7:0:1:0: [sdh] <<vendor>>ASC=0x94 ASCQ=0x1 
[  218.507226] sd 7:0:0:3: [sdf] Synchronizing SCSI cache
[  220.055497] sd 7:0:0:3: [sdf] Synchronize Cache(10) failed: Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[  220.066420] sd 7:0:0:3: [sdf] Sense Key : Illegal Request [current] 
[  220.073538] sd 7:0:0:3: [sdf] <<vendor>>ASC=0x94 ASCQ=0x1 
[  220.079698] sd 7:0:0:2: [sde] Synchronizing SCSI cache
[  220.085592] sd 7:0:0:1: [sdd] Synchronizing SCSI cache
[  221.638936] sd 7:0:0:1: [sdd] Synchronize Cache(10) failed: Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[  221.649842] sd 7:0:0:1: [sdd] Sense Key : Illegal Request [current] 
[  221.656938] sd 7:0:0:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[  221.663103] sd 7:0:0:0: [sdc] Synchronizing SCSI cache
[  221.669076] sd 0:0:1:0: [sdb] Synchronizing SCSI cache
[  221.675501] sd 0:0:0:0: [sda] Synchronizing SCSI cache
[  221.682296] mpt2sas_cm0: sending message unit reset !!
[  221.689593] mpt2sas_cm0: message unit reset: SUCCESS
[  222.517382] mlx4_core 0000:04:00.0: mlx4_shutdown was called
[  226.375010] Re starting system restart
[2J[1;1HCopyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
[2J[1;1H[1;1H[0;37;40m[2J[1;1H[1;1H[1;37;40m[1;1HCopyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               [2;1HVersion 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.          [01;00H[0m[2m                                                                                [02;00H                                                                                [03;00H                                                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [m[4;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[4;79H[m[7m[5;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [5;79H[22;1H   The selected entry will be started automatically in 5s.                     [5;79H[22;1H   The selected entry will be started automatically in 4s.                     [5;79H[22;1H   The selected entry will be started automatically in 3s.                     [5;79H[22;1H   The selected entry will be started automatically in 2s.                     [5;79H[22;1H   The selected entry will be started automatically in 1s.                     [5;79H[22;1H   The selected entry will be started automatically in 0s.                     [5;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-309-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Sat Dec 8 05:53:16 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x35c21000-0x36e08fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 162MB of memory at 688MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff9af96e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 7011984k/34603008k available (7664k kernel code, 1126748k absent, 830620k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.714 MHz processor
[    0.000180] Calibrating delay loop (skipped), value calculated using timer frequency.. 5387.42 BogoMIPS (lpj=2693714)
[    0.012078] pid_max: default: 245760 minimum: 1920
[    0.018296] Security Framework initialized
[    0.022905] SELinux:  Initializing.
[    0.027092] Yama: becoming mindful.
[    0.036337] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.058308] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.072125] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.079904] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.090218] Initializing cgroup subsys memory
[    0.095155] Initializing cgroup subsys devices
[    0.100131] Initializing cgroup subsys freezer
[    0.105103] Initializing cgroup subsys net_cls
[    0.110071] Initializing cgroup subsys blkio
[    0.114873] Initializing cgroup subsys perf_event
[    0.120175] Initializing cgroup subsys hugetlb
[    0.125156] Initializing cgroup subsys pids
[    0.129839] Initializing cgroup subsys net_prio
[    0.135201] mce: CPU supports 20 MCE banks
[    0.139820] CPU0: Thermal monitoring enabled (TM1)
[    0.145246] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.151377] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.157713] tlb_flushall_shift: 6
[    0.161505] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.172247] FEATURE SPEC_CTRL Present
[    0.176449] FEATURE IBPB_SUPPORT Present
[    0.181156] Spectre V2 : Mitigation: Full retpoline
[    0.189442] Freeing SMP alternatives: 28k freed
[    0.200918] ACPI: Core revision 20130517
[    0.296378] ACPI: All ACPI Tables successfully acquired
[    0.316655] ftrace: allocating 29187 entries in 115 pages
[    0.378231] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.385632] Switched APIC routing to physical flat.
[    0.391819] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.408543] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.419062] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.430897] ... version:                3
[    0.435374] ... bit width:              48
[    0.439946] ... generic registers:      4
[    0.444415] ... value mask:             0000ffffffffffff
[    0.450345] ... max period:             00007fffffffffff
[    0.456282] ... fixed-purpose events:   3
[    0.460759] ... event mask:             000000070000000f
[    0.475202] smpboot: Booting Node   0, Processors  #1[    0.496843] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.551836] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.690887] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.732851] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.773356] Brought up 32 CPUs
[    0.776985] smpboot: Max logical packages: 15
[    0.781872] smpboot: Total of 32 processors activated (172585.12 BogoMIPS)
[    1.039503] node 0 initialised, 2813371 pages in 136ms
[    1.077199] node 1 initialised, 3595039 pages in 168ms
[    1.084165] devtmpfs: initialized
[    1.099157] EVM: security.selinux
[    1.102860] EVM: security.ima
[    1.106174] EVM: security.capability
[    1.110433] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.119296] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.131735] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.139421] pinctrl core: initialized pinctrl subsystem
[    1.145545] RTC time:  7:10:37, date: 12/13/18
[    1.151022] NET: Registered protocol family 16
[    1.156505] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.164961] ACPI: bus type PCI registered
[    1.169442] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.177275] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.187674] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.195291] PCI: Using configuration type 1 for base access
[    1.201558] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.222196] ACPI: Added _OSI(Module Device)
[    1.226878] ACPI: Added _OSI(Processor Device)
[    1.231844] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.237097] ACPI: Added _OSI(Processor Aggregator Device)
[    1.243125] ACPI: Added _OSI(Linux-Dell-Video)
[    1.287789] ACPI: Executed 1 blocks of module-level executable AML code
[    1.576736] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.610030] ACPI: Interpreter enabled
[    1.614155] ACPI: (supports S0 S1 S5)
[    1.618246] ACPI: Using IOAPIC for interrupt routing
[    1.623908] HEST: Table parsing has been initialized.
[    1.629570] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.639838] ACPI: GPE 0x1E active on init
[    1.644351] ACPI: GPE 0x24 active on init
[    1.648851] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.714657] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.721571] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.731239] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.739725] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.748277] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.757710] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.769371] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.784231] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.799472] PCI host bridge to bus 0000:00
[    1.804052] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.810955] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.819311] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.827669] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.836027] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.844386] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.852743] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.861099] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.869458] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.877815] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.886172] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.894528] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.902885] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.911244] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.919605] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.928741] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.935409] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.942034] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.948664] pci 0000:00:02.0: System wakeup disabled by ACPI
[    1.955281] pci 0000:00:02.2: System wakeup disabled by ACPI
[    1.961911] pci 0000:00:03.0: System wakeup disabled by ACPI
[    1.972141] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    1.978785] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    1.985405] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    1.992053] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    1.998607] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.005878] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.011616] acpiphp: Slot [2] registered
[    2.016285] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.026618] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.037288] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.047629] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.058293] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.068631] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.079289] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.089624] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.101949] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.108018] acpiphp: Slot [2-2] registered
[    2.115058] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.120791] acpiphp: Slot [2-3] registered
[    2.125414] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.131132] acpiphp: Slot [2-4] registered
[    2.136044] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.141942] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.154733] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.160406] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.166393] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.172792] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.178465] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.187446] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.195353] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.203243] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.211145] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.219048] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.226949] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.234852] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.242746] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.250850] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.257761] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.267172] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.275497] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.284048] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.293602] PCI host bridge to bus 0000:80
[    2.298182] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.305763] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.313346] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.321702] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.330057] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.339191] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.345541] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.352141] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.358742] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.365347] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.374168] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.379812] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.385449] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.391073] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.407596] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.414214] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.423406] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.433075] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.440076] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.449338] PCI host bridge to bus 0000:7f
[    2.453918] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.464542] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.471153] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.480345] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.490019] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.497023] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.506288] PCI host bridge to bus 0000:ff
[    2.510867] pci_bus 0000:ff: root bus resource [bus ff]
[    2.522116] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.531176] vgaarb: loaded
[    2.534200] vgaarb: bridge control possible 0000:09:00.0
[    2.540569] SCSI subsystem initialized
[    2.544820] ACPI: bus type USB registered
[    2.549337] usbcore: registered new interface driver usbfs
[    2.555481] usbcore: registered new interface driver hub
[    2.561703] usbcore: registered new device driver usb
[    2.567895] EDAC MC: Ver: 3.0.0
[    2.571951] PCI: Using ACPI for IRQ routing
[    2.584254] NetLabel: Initializing
[    2.588056] NetLabel:  domain hash size = 128
[    2.592922] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.598508] NetLabel:  unlabeled traffic allowed by default
[    2.605074] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.612096] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.620668] amd_nb: Cannot enumerate AMD northbridges
[    2.626513] Switched to clocksource hpet
[    2.645592] pnp: PnP ACPI init
[    2.649046] ACPI: bus type PNP registered
[    2.653809] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.660431] system 00:00: [io  0xffff] has been reserved
[    2.666376] system 00:00: [io  0xffff] has been reserved
[    2.672318] system 00:00: [io  0xffff] has been reserved
[    2.678270] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.685274] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.691894] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.698514] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.705138] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.712145] system 00:00: [io  0x0cf9] could not be reserved
[    2.718698] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.726877] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.734274] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.741671] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.749075] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.756474] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.763866] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.771653] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.779438] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.787216] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.795115] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.803434] pnp: PnP ACPI: found 7 devices
[    2.808017] ACPI: bus type PNP unregistered
[    2.822064] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.827648] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.833496] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.840309] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.847901] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.853467] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.861068] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.870503] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.876068] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.881619] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.888435] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.896029] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.901579] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    2.908390] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    2.915976] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    2.925413] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.930984] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.936544] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    2.944145] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    2.952813] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    2.958608] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.964167] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.969731] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.975291] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.981225] NET: Registered protocol family 2
[    2.988275] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    2.997439] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.005193] TCP: Hash tables configured (established 262144 bind 65536)
[    3.012681] TCP: reno registered
[    3.016456] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.023628] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.032322] NET: Registered protocol family 1
[    4.137379] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.245292] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.253818] Unpacking initramfs...
[    5.811551] Freeing initrd memory: 18336k freed
[    5.823686] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.830900] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff9af5f73c7000-ffff9af5fb3c6fff]
[    5.842417] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    5.851260] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    5.857683] RAPL PMU: hw unit of domain package 2^-16 Joules
[    5.864014] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    5.883258] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    5.890099] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    5.904065] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    5.912317] Initialise system trusted keyring
[    5.917344] audit: initializing netlink socket (disabled)
[    5.923422] type=2000 audit(1544685038.448:1): initialized
[    5.985271] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    5.992377] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.002664] zpool: loaded
[    6.005608] zbud: loaded
[    6.009635] VFS: Disk quotas dquot_6.6.0
[    6.014540] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.023254] msgmni has been set to 32768
[    6.028018] Key type big_key registered
[    6.034933] NET: Registered protocol family 38
[    6.039917] Key type asymmetric registered
[    6.044508] Asymmetric key parser 'x509' registered
[    6.050127] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.058662] io scheduler noop registered
[    6.063056] io scheduler deadline registered (default)
[    6.068953] io scheduler cfq registered
[    6.073254] io scheduler mq-deadline registered
[    6.078329] io scheduler kyber registered
[    6.088716] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.096538] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.104331] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.111631] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.118929] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.126228] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.133565] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.141351] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.148684] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.156502] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.164287] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.171621] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.179403] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.186703] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.194043] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.201863] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.209648] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.216996] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.224820] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.232643] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.240465] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.248363] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.254607] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.262051] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.270379] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.278657] ACPI: Power Button [PWRF]
[    6.282841] ACPI: Requesting acpi_cpufreq
[    6.371492] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.379880] pstore: Registered erst as persistent store backend
[    6.386832] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.395332] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.423226] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.450361] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.457651] Non-volatile memory driver v1.3
[    6.462410] Linux agpgart interface v0.103
[    6.467426] crash memory driver: version 1.1
[    6.472695] rdac: device handler registered
[    6.477461] hp_sw: device handler registered
[    6.482256] emc: device handler registered
[    6.487125] alua: device handler registered
[    6.491916] libphy: Fixed MDIO Bus: probed
[    6.496596] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.503913] ehci-pci: EHCI PCI platform driver
[    6.509373] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.515342] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.523647] ehci-pci 0000:00:1a.0: debug port 2
[    6.532678] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.544191] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.550723] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.558309] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.566379] usb usb1: Product: EHCI Host Controller
[    6.571843] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.580020] usb usb1: SerialNumber: 0000:00:1a.0
[    6.585417] hub 1-0:1.0: USB hub found
[    6.589633] hub 1-0:1.0: 2 ports detected
[    6.594712] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    6.600660] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    6.608962] ehci-pci 0000:00:1d.0: debug port 2
[    6.617992] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    6.630188] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    6.636697] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    6.644282] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.652366] usb usb2: Product: EHCI Host Controller
[    6.657822] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.665995] usb usb2: SerialNumber: 0000:00:1d.0
[    6.671382] hub 2-0:1.0: USB hub found
[    6.675595] hub 2-0:1.0: 2 ports detected
[    6.680347] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    6.687283] ohci-pci: OHCI PCI platform driver
[    6.692302] uhci_hcd: USB Universal Host Controller Interface driver
[    6.699561] usbcore: registered new interface driver usbserial_generic
[    6.706875] usbserial: USB Serial support registered for generic
[    6.713663] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    6.877223] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    7.766138] i8042: No controller found
[    7.770405] Switched to clocksource tsc
[    7.770468] mousedev: PS/2 mouse device common for all mice
[    7.770592] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    7.770708] rtc_cmos 00:01: RTC can wake from S4
[    7.770950] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    7.771005] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    7.771148] intel_pstate: Intel P-state driver initializing
[    7.782732] cpuidle: using governor menu
[    7.784279] hidraw: raw HID events driver (C) Jiri Kosina
[    7.784537] usbcore: registered new interface driver usbhid
[    7.784537] usbhid: USB HID core driver
[    7.784758] drop_monitor: Initializing network drop monitor service
[    7.785306] TCP: cubic registered
[    7.785315] Initializing XFRM netlink socket
[    7.785998] NET: Registered protocol family 10
[    7.787605] NET: Registered protocol family 17
[    7.787619] mpls_gso: MPLS GSO support
[    7.789387] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    7.793705] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    7.793955] Loading compiled-in X.509 certificates
[    7.795048] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    7.796115] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    7.797162] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: d73e894149b8945b8dc07cc18b4508db322683f2'
[    7.797209] registered taskstats version 1
[    7.801136] Key type trusted registered
[    7.804653] Key type encrypted registered
[    7.804825] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.806605]   Magic number: 14:370:167
[    7.806892] acpi device:30: hash matches
[    7.806910] acpi PNP0000:00: hash matches
[    7.808769] rtc_cmos 00:01: setting system clock to 2018-12-13 07:10:44 UTC (1544685044)
[    7.821130] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    7.895510] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    7.895513] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.895960] hub 1-1:1.0: USB hub found
[    7.896131] hub 1-1:1.0: 6 ports detected
[    7.945340] random: fast init done
[    7.945513] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    7.945517] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.945917] hub 2-1:1.0: USB hub found
[    7.946125] hub 2-1:1.0: 8 ports detected
[    8.027823] Freeing unused kernel memory: 1876k freed
[    8.034219] Write protecting the kernel read-only data: 12288k
[    8.044038] Freeing unused kernel memory: 516k freed
[    8.052613] Freeing unused kernel memory: 600k freed
[    8.071844] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.093343] systemd[1]: Detected architecture x86-64.
[    8.099006] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.114297] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.191673] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.202197] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.215482] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m[    8.221059] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
] Cr eated slice Roostening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.244323] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.256293] systemd[1]: Starting Create list of required static device nodes for the current kernel...
          Starting Createthe current kernel...
[    8.276894] systemd[1]: Starting Setup Virtual Console...
         Starting Setup Virtual Console...
[    8.288893] systemd[1]: Starting Journal Service...
          Startin Journal Service...
[    8.309182] systemd[1]: Reached target Swap.
[[32m  OK  [0m]  Reached targetemd[1]: Listening on udev Control Socket.
[ [32m  OK  [0me t.
[    8.3321target Slices.
[[32m  OK  [0m[    8.338699] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
] Reached target[    8.346611] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
 Slices.
[    8.356331] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.363375] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.369806] usb 2-1.4: SerialNumber: serial
[     8.371651] iKeyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
[    8.390290] systemd[1]: Starting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.404126] systemd[1]: Starting dracut cmdline hook...
         Starting dracut cmdline hook...
[    8.415211] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m[    8.422444] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
] Listening on u[    8.440660] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
dev Kernel Socke[    8.455880] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
t.
[    8.475152] systemd[1]: Reached target Sockets.
[[32m  OK  [0m] Reached target Sockets.
[    8.485630] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Setup Virtual Console.
[[32m  OK  [0m] Started Apply Kernel Variables.
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut cmdline hook.
         Starting dracut pre-udev hook...
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
[[32m  OK  [0m] Reached target System Initialization.
         Starting Show Plymouth Boot Screen...
         Starting dracut initqueue hook...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Started Forwar[    8.768798] dca service started, version 1.12.1
d Password Requests to Plymouth Directory Watch.[    8.777752] pps_core: LinuxPPS API ver. 1 registered

[[32m  OK  [    8.784545] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[0m] Reached target Paths.
[[32m  OK  [0m] R[    8.799433] PTP clock support registered
eached target Basic System.
[    8.808823] mpt2sas version 20.103.01.00 loaded
[    8.814237] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[    8.823360] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32666996 kB)
[    8.834343] mlx4_core: Mellanox ConnectX core driver v4.0-0
[    8.840641] mlx4_core: Initializing 0000:04:00.0
[    8.845920] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    8.855054] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    8.864317] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    8.864380] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    8.865220] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    8.865233] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    8.865240] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    8.865243] isci 0000:07:00.0: OEM parameter table found in OROM
[    8.865248] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    8.865426] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    8.867967] scsi host1: isci
[    8.877080] scsi host2: ahci
[    8.877231] scsi host3: ahci
[    8.877426] scsi host4: ahci
[    8.877545] scsi host5: ahci
[    8.877657] scsi host6: ahci
[    8.877779] scsi host7: ahci
[    8.877842] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 39
[    8.877844] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 39
[    8.877846] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 39
[    8.877849] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 39
[    8.877851] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 39
[    8.877854] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 39
[    8.917698] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[    8.918361] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 43
[    8.918362] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 44
[    8.918363] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 45
[    8.918364] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 46
[    8.918364] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 47
[    8.918365] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 48
[    8.918366] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 49
[    8.918367] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 50
[    8.918368] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 51
[    8.918369] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 52
[    8.918370] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 53
[    8.918370] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 54
[    8.918371] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 55
[    8.918372] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 56
[    8.918373] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 57
[    8.918373] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 58
[    8.918375] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffad88c3be0000), size(65536)
[    8.918376] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[    8.932731] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.933808] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    8.972057] igb 0000:02:00.0: added PHC on eth0
[    8.972059] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.972062] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    8.972136] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    8.972138] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.972897] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    8.980509] mpt2sas_cm0: sending message unit reset !!
[    8.981996] mpt2sas_cm0: message unit reset: SUCCESS
[    9.011690] igb 0000:02:00.1: added PHC on eth1
[    9.011693] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.011697] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.011772] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.011775] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.080098] igb 0000:02:00.2: added PHC on eth2
[    9.080100] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.080102] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.080176] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.080178] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.102601] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[    9.102602] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[    9.102603] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    9.155877] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[    9.155878] mpt2sas_cm0: Protocol=(
[    9.155879] Initiator
[    9.155880] ,Target
[    9.155880] ), 
[    9.155880] Capabilities=(
[    9.155881] TLR
[    9.155882] ,EEDP
[    9.155882] ,Snapshot Buffer
[    9.155883] ,Diag Trace Buffer
[    9.155883] ,Task Set Full
[    9.155884] ,NCQ
[    9.155884] )
[    9.155931] scsi host0: Fusion MPT SAS Host
[    9.158287] mpt2sas_cm0: sending port enable !!
[    9.160962] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[    9.163027] igb 0000:02:00.3: added PHC on eth3
[    9.163029] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.163031] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.163104] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.163106] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.168975] mpt2sas_cm0: port enable: SUCCESS
[    9.169728] scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.169733] scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.169735] scsi 0:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.169738] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.182001] ata1: SATA link down (SStatus 0 SControl 300)
[    9.182999] ata4: SATA link down (SStatus 0 SControl 300)
[    9.184013] ata6: SATA link down (SStatus 0 SControl 300)
[    9.184039] ata5: SATA link down (SStatus 0 SControl 300)
[    9.185995] ata2: SATA link down (SStatus 0 SControl 300)
[    9.186036] ata3: SATA link down (SStatus 0 SControl 300)
%G[    9.477295] [TTM] Zone  kernel: Available graphics memory: 16333498 kiB
[    9.484712] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.492009] [TTM] Initializing pool allocator
[    9.496880] [TTM] Initializing DMA pool allocator
[    9.516743] scsi 0:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.525786] scsi 0:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.537531] scsi 0:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.545501] scsi 0:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.557223] fbcon: mgadrmfb (fb0) is primary device
[    9.577391] scsi 0:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.577401] scsi 0:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.577405] scsi 0:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.577411] scsi 0:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.602349] scsi 0:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.602358] scsi 0:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.602362] scsi 0:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.602367] scsi 0:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.615425] scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.615432] scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.615436] scsi 0:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.615441] scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.627924] scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.627929] scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.627931] scsi 0:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.627934] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.669954] scsi 0:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.669974] scsi 0:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.669976] scsi 0:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.669980] scsi 0:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.681366] scsi 0:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.681375] scsi 0:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.681379] scsi 0:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.681384] scsi 0:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.693397] scsi 0:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.693417] scsi 0:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.693420] scsi 0:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.693424] scsi 0:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.708398] scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.708405] scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.708408] scsi 0:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.708413] scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.790190] Console: switching to colour frame buffer device 128x48
[    9.849076] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
%G[   10.541654] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   10.547886] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   10.556084] ata7.00: configured for UDMA/133
[   10.561422] scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   12.734735] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   15.395414] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.402432] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   16.145823] mlx4_core 0000:04:00.0: PCIe link speed is 8.0GT/s, device supports 8.0GT/s
[   16.154760] mlx4_core 0000:04:00.0: PCIe link width is x8, device supports x8
[   16.524478] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   16.530721] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   16.539176] ata8.00: configured for UDMA/133
[   16.555595] scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   16.578254] scsi 0:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   16.584622] scsi 0:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   16.591249] scsi 0:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   16.597625] scsi 0:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   16.604397] scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   16.610920] scsi 0:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   16.617056] sd 1:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   16.617070] sd 1:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   16.617233] sd 1:0:1:0: [sdb] Write Protect is off
[   16.617276] sd 1:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   16.617352] sd 0:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.617388] scsi 0:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   16.617478] sd 0:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.617680] sd 0:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.617741] sd 0:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.617828] sd 0:0:1:2: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.617848] sd 0:0:1:0: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.617901] sd 0:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   16.618014] sd 0:0:1:1: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.618645] scsi 0:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   16.618764] sd 0:0:0:0: [sdc] Write Protect is off
[   16.619013] sd 0:0:0:1: [sdd] Write Protect is off
[   16.619132] sd 0:0:1:2: [sdh] Write Protect is off
[   16.619182] sd 0:0:1:0: [sdi] Write Protect is off
[   16.619308] sd 0:0:0:2: [sde] Write Protect is off
[   16.619359] sd 0:0:1:1: [sdj] Write Protect is off
[   16.619421] sd 0:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.619499] sd 0:0:0:3: [sdf] Write Protect is off
[   16.619552] sd 0:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.619614] sd 0:0:0:7: [sdg] Write Protect is off
[   16.619656] sd 0:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   16.619784] sd 0:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.619833] sd 0:0:1:2: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.619879] sd 0:0:1:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.619917] sd 0:0:1:1: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.620217] sd 0:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.620421] sd 0:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.620576] sd 0:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   16.621181] sd 0:0:1:3: [sdk] Write Protect is off
[   16.621423] sd 0:0:1:7: [sdl] Write Protect is off
[   16.621807] sd 0:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.622024] sd 0:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   16.624209] Dev sdi: unable to read RDB block 0
[   16.624222]  sdi: unable to read partition table
[   16.624423] Dev sdh: unable to read RDB block 0
[   16.624437]  sdh: unable to read partition table
[   16.624470] Dev sdd: unable to read RDB block 0
[   16.624484]  sdd: unable to read partition table
[   16.624489] Dev sdf: unable to read RDB block 0
[   16.624503]  sdf: unable to read partition table
[   16.624954]  sdg:
[   16.627579]  sdl:
[   16.627707] sd 0:0:1:0: [sdi] Attached SCSI disk
[   16.627720] sd 0:0:0:0: [sdc] Attached SCSI disk
[   16.627784] sd 0:0:1:2: [sdh] Attached SCSI disk
[   16.627815] sd 0:0:0:1: [sdd] Attached SCSI disk
[   16.627918] sd 0:0:0:3: [sdf] Attached SCSI disk
[   16.628005] sd 0:0:0:7: [sdg] Attached SCSI disk
[   16.628217] sd 0:0:1:1: [sdj] Attached SCSI disk
[   16.628251] sd 0:0:0:2: [sde] Attached SCSI disk
[   16.628843] sd 0:0:1:3: [sdk] Attached SCSI disk
[   16.629327] sd 0:0:1:7: [sdl] Attached SCSI disk
[   16.633851]  sdb:
[   16.634247] sd 1:0:1:0: [sdb] Attached SCSI disk
[   16.999118] sd 1:0:0:0: [sda] Write Protect is off
[   17.004545] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.031812]  sda: sda1 sda2
[   17.035772] sd 1:0:0:0: [sda] Attached SCSI disk
[   17.056013] random: crng init done
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
[[32m  OK  [0m] Started dracut initqueue hook.
         Mounting /sysroot...
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   18.588401] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
[[32m  OK  [0m] Stopped target Timers.
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target System Initialization.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Closed udev Control Socket.
[[32m  OK  [   19.025109] systemd-journald[285]: Received SIGTERM from PID 1 (systemd).
[0m] Closed udev Kernel Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.394793] SELinux:  Disabled at runtime.
[   19.443241] type=1404 audit(1544685056.136:2): selinux=0 auid=4294967295 ses=4294967295
[   19.677072] ip_tables: (C) 2000-2006 Netfilter Core Team
[   19.684158] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Listening on udev Control Socket.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
         Starting Create list of required st... nodes for the current kernel...
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd Root File System.
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Reached target Slices.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
         Starting Availability of block devices...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
         Mounting Huge Pages File System...
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[[32m  OK  [0m] Reached target Paths.
         Mounting Debug File System...
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Remount Root and Kernel File Systems...
         Starting Create Static Device Nodes in /dev...
         Starting Apply Kernel Variables...
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m[   20.779258] EXT4-fs (sda1): re-mounted. Opts: (null)
] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting Flush Journal to Persistent Storage...
   [   20.811985] RPC: Registered named UNIX socket transport module.
      Starting C[   20.819445] RPC: Registered udp transport module.
onfigure read-on[   20.826267] RPC: Registered tcp transport module.
[   20.833034] RPC: Registered tcp NFSv4.1 backchannel transport module.
ly root support...
         Starting udev Coldplug all Devices...
[[32m  OK  [0m] Started LVM2 metadata daemon.
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[   20.978949] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   20.987621] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   20.994725] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   21.002614] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.010199] blk_update_request: critical target error, dev sdg, sector 0
[   21.017729] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.026386] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   21.033507] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   21.041387] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.048970] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[   21.228265] systemd-journald[4543]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started Kerne[   21.298382] device-mapper: uevent: version 1.0.3
l Module support[   21.305321] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
ing RPCSEC_GSS.
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started udev Kernel Device Manager.
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[   21.471858] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.483926] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   21.496323] ipmi message handler version 39.2
[   21.503484] ipmi device interface
[   21.515686] IPMI System Interface driver.
[   21.520202] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   21.526915] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   21.533533] ipmi_si: Adding SMBIOS-specified kcs state machine
[   21.540088] ipmi_platform: probing via SPMI
[   21.544765] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   21.551183] (NULL device *): SPMI-specified kcs state machine: duplicate
[   21.558742] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   21.616299] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   21.657947] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   21.668116] IPMI SSIF Interface driver
[   21.727684] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   21.735748] igb 0000:02:00.0: DCA enabled
[   21.740327] igb 0000:02:00.1: DCA enabled
[   21.747336] igb 0000:02:00.2: DCA enabled
[   21.752009] igb 0000:02:00.3: DCA enabled
[   21.763741] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[[32m  OK  [0m] Found device /dev/ttyS0.
[   21.774605] i801_smbus 0000:07:00.3: Enabling SMBus device
[   21.781833] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   21.788983] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   21.792672] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   21.805055] sd 1:0:0:0: Attached scsi generic sg0 type 0
[   21.811225] sd 1:0:1:0: Attached scsi generic sg1 type 0
[   21.817364] sd 0:0:0:0: Attached scsi generic sg2 type 0
[   21.823742] sd 0:0:0:1: Attached scsi generic sg3 type 0
[   21.829841] sd 0:0:0:2: Attached scsi generic sg4 type 0
[   21.835892] sd 0:0:0:3: Attached scsi generic sg5 type 0
[   21.841943] sd 0:0:0:7: Attached scsi generic sg6 type 0
[   21.848025] sd 0:0:1:0: Attached scsi generic sg7 type 0
[   21.854064] sd 0:0:1:1: Attached scsi generic sg8 type 0
[   21.860130] sd 0:0:1:2: Attached scsi generic sg9 type 0
[   21.866192] sd 0:0:1:3: Attached scsi generic sg10 type 0
[   21.872527] sd 0:0:1:7: Attached scsi generic sg11 type 0
[   21.883311] cryptd: max_cpu_qlen set to 1000
[   21.904382] AVX version of gcm_enc/dec engaged.
[   21.909452] AES CTR mode by8 optimization enabled
%G%G[   21.921155] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   21.928895] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   21.937993] device-mapper: multipath round-robin: version 1.2.0 loaded
[   21.949103] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   22.125983] iTCO_vendor_support: vendor-support=0
[   22.136779] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.143146] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.224446] kvm: disabled by bios
[   22.330039] intel_rapl: Found RAPL domain package
[   22.335307] intel_rapl: Found RAPL domain core
[   22.340278] intel_rapl: Found RAPL domain dram
[   22.345312] intel_rapl: Found RAPL domain package
[   22.350594] intel_rapl: Found RAPL domain core
[   22.355579] intel_rapl: Found RAPL domain dram
[   22.442346] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   22.451086] sd 0:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   22.488971] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.499511] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.509719] EDAC sbridge:  Ver: 1.1.2 
[   23.071338] sd 0:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   23.080048] sd 0:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   23.734936] sd 0:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   23.743634] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   24.351313] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   24.360009] sd 0:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   24.964908] sd 0:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.973670] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   25.252890] device-mapper: table: 253:5: multipath: error getting device
[   25.260385] device-mapper: ioctl: error adding target to table
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...
[   25.409921] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[   25.564426] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   25.936869] sd 0:0:0:3: [sdf] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   25.945532] sd 0:0:0:3: [sdf] Sense Key : Illegal Request [current] 
[   25.952647] sd 0:0:0:3: [sdf] <<vendor>>ASC=0x94 ASCQ=0x1 
[   25.958778] sd 0:0:0:3: [sdf] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   25.968120] blk_update_request: I/O error, dev sdf, sector 0
[   25.975715] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   25.984392] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   25.991503] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   25.999372] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.006957] blk_update_request: critical target error, dev sdg, sector 0
[   26.015072] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.023744] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   26.030854] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   26.038727] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.046316] blk_update_request: critical target error, dev sdg, sector 0
[   26.054489] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.063148] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   26.070255] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   26.078138] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.085734] blk_update_request: critical target error, dev sdg, sector 0
[   26.600379] sd 0:0:1:2: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.609041] sd 0:0:1:2: [sdh] Sense Key : Illegal Request [current] 
[   26.616140] sd 0:0:1:2: [sdh] <<vendor>>ASC=0x94 ASCQ=0x1 
[   26.622268] sd 0:0:1:2: [sdh] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   26.631599] blk_update_request: I/O error, dev sdh, sector 0
[   27.150477] sd 0:0:1:0: [sdi] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.159137] sd 0:0:1:0: [sdi] Sense Key : Illegal Request [current] 
[   27.166237] sd 0:0:1:0: [sdi] <<vendor>>ASC=0x94 ASCQ=0x1 
[   27.172372] sd 0:0:1:0: [sdi] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   27.181703] blk_update_request: I/O error, dev sdi, sector 0
[   27.190599] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.199281] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.206383] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.214263] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.221851] blk_update_request: critical target error, dev sdl, sector 0
[   27.229688] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.238355] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.245478] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.253353] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.260941] blk_update_request: critical target error, dev sdl, sector 0
[   27.268941] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.277609] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.284724] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.292606] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.300194] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Preprocess NFS configuration...
         Starting Tell Plymouth To Write Out Runtime Data...
         Starting Import network configuration from initramfs...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Mounting RPC Pipe File System...
         Starting Security Auditing Service...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   27.483388] type=1305 audit(1544685064.176:3): audit_pid=8942 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
         Starting RPC bind service...
[[32m  OK  [0m] Reached target Basic System.
[[32m  OK  [0m] Started irqbalance daemon.
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting Machine Check Exception Logging Daemon...
         Starting System Security Services Daemon...
         Starting GSSAPI Proxy Daemon...
         Starting Authorization Manager...
         Starting Load CPU microcode update...
         Starting NTP client/server...
         Starting Dump dmesg to /var/log/dmesg...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[   28.124708] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   28.212702] igb 0000:02:00.0 ens2f0: igb: ens2f0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   28.213845] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   28.219651] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   28.301076] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   28.307839] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[   28.318853] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   28.437475] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   28.447685] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   28.566132] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting Postfix Mail Transport Agent...
         Starting OpenSSH server daemon...
         Starting Dynamic System Tuning Daemon...
         Starting MUNGE authentication service...
[[32m  OK  [0m][   35.753358] FS-Cache: Loaded
 Reached target Network is Online.
         Mounting /scratch...
         Starting System Logging Service...
         Starting NFS status monitor for NFSv2/3 locking....
         Starting Notify NFS peers of a restart...
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[   35.824321] FS-Cache: Netfs 'nfs' registered for caching
[   35.853469] Key type dns_resolver registered
[   35.891490] NFS: Registering the id_resolver key type
[   35.897136] Key type id_resolver registered
[   35.901806] Key type id_legacy registered
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Crash recovery kernel arming...
         Starting Permit User Sessions...
         Starting Automounts filesystems on demand...
[[32m  OK  [0m] Started Permit User Sessions.
         Starting Terminate Plymouth Boot Screen...
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Job spooling tools.
[[32m  OK  [0m] Started Command Scheduler.
[[32m  OK  [0m] Created slice User Slice of root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-13T07:11:24+00:00] INFO: Forking chef instance to converge...
[2018-12-13T07:11:24+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-13T07:11:24+00:00] INFO: Chef-client pid: 15116
[2018-12-13T07:11:26+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-13T07:11:26+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-13T07:11:26+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-13T07:11:26+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-13T07:11:26+00:00] INFO: Running start handlers
[2018-12-13T07:11:26+00:00] INFO: Start handlers complete.
[2018-12-13T07:11:27+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-13T07:11:27+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-13T07:11:27+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-13T07:11:27+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-13T07:11:27+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181213071127.058284
[2018-12-13T07:11:27+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181211084648.063089
[2018-12-13T07:11:27+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-13T07:11:27+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-13T07:11:33+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-13T07:11:33+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-13T07:11:33+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-13T07:11:33+00:00] INFO: service[ntpd] started
[2018-12-13T07:11:33+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-13T07:11:34+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-13T07:11:34+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-13T07:11:34+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-13T07:11:34+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-13T07:11:34+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-13T07:11:34+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-13T07:11:34+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-13T07:11:34+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-13T07:11:34+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-13T07:11:35+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-13T07:11:35+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-13T07:11:35+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-13T07:11:35+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:35+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:35+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-13T07:11:35+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-13T07:11:36+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-13T07:11:36+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-13T07:11:36+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-13T07:11:36+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-13T07:11:37+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-13T07:11:37+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-13T07:11:37+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-13T07:11:37+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-13T07:11:37+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-13T07:11:37+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-13T07:11:37+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-13T07:11:38+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-13T07:11:38+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-13T07:11:38+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-13T07:11:38+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-13T07:11:38+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-13T07:11:38+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-13T07:11:38+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-13T07:11:38+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-13T07:11:38+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-13T07:11:38+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-13T07:11:38+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-13T07:11:38+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-13T07:11:39+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-13T07:11:39+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-13T07:11:39+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-13T07:11:39+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-13T07:11:39+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181213071139.462423
[2018-12-13T07:11:39+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211084658.962631
[2018-12-13T07:11:39+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-13T07:11:39+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-13T07:11:39+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-13T07:11:39+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181213071139.470027
[2018-12-13T07:11:39+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211084658.978060
[2018-12-13T07:11:39+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-13T07:11:39+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-13T07:11:39+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-13T07:11:39+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:39+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-13T07:11:39+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:39+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-13T07:11:39+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-13T07:11:39+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:11:39+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:39+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:11:39+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:39+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:11:39+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:39+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:11:39+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:39+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:11:39+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:39+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:11:39+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:39+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:11:39+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:39+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:11:39+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:39+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:39+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-13T07:11:40+00:00] INFO: service[xinetd] started
[2018-12-13T07:11:40+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-13T07:11:40+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-13T07:11:40+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-13T07:11:40+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-13T07:11:41+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-13T07:11:41+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-13T07:11:41+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-13T07:11:41+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-13T07:11:41+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181213071141.548617
[2018-12-13T07:11:41+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181211084701.788120
[2018-12-13T07:11:41+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-13T07:11:41+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-13T07:11:41+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-13T07:11:41+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-13T07:11:41+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-13T07:11:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:41+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-13T07:11:41+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-13T07:11:41+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-13T07:11:41+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-13T07:11:41+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-13T07:11:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:41+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-13T07:11:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:41+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-13T07:11:41+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-13T07:11:41+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-13T07:11:41+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-13T07:11:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:41+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-13T07:11:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:41+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-13T07:11:41+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:11:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:41+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:11:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:42+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:11:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:42+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:11:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:42+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:11:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:42+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:11:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:42+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:11:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:42+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:11:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:11:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:11:42+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-13T07:11:42+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-13T07:11:42+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-13T07:11:42+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-13T07:11:42+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-13T07:11:42+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-13T07:11:42+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-13T07:11:42+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-13T07:11:42+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-13T07:11:43+00:00] INFO: Processing service[rdma] action enable (test_node::default line 66)
[0m
================================================================================[0m
[31mError executing action `enable` on resource 'service[rdma]'[0m
================================================================================[0m

[0mMixlib::ShellOut::ShellCommandFailed[0m
------------------------------------[0m
Expected process to exit with [0], but received '1'
[0m---- Begin output of /bin/systemctl enable rdma ----
[0mSTDOUT: 
[0mSTDERR: Failed to execute operation: No such file or directory
[0m---- End output of /bin/systemctl enable rdma ----
[0mRan /bin/systemctl enable rdma returned 1[0m

[0mResource Declaration:[0m
---------------------[0m
# In /var/tmp/chef-solo/cookbooks/test_node/recipes/default.rb
[0m
[0m 66:   service openib_service do
[0m 67:     if node[:platform_version].to_f < 7.0
[0m 68:       action [:enable]
[0m 69:     else
[0m 70:       action [:enable, :start]
[0m 71:     end
[0m 72:   end
[0m
[0mCompiled Resource:[0m
------------------[0m
# Declared in /var/tmp/chef-solo/cookbooks/test_node/recipes/default.rb:66:in `from_file'
[0m
[0mservice("rdma") do
[0m  action [:enable, :start]
[0m  supports {:restart=>false, :reload=>false, :status=>false}
[0m  retries 0
[0m  retry_delay 2
[0m  default_guard_interpreter :default
[0m  service_name "rdma"
[0m  pattern "rdma"
[0m  declared_type :service
[0m  cookbook_name :test_node
[0m  recipe_name "default"
[0mend
[0m
[0m[2018-12-13T07:11:43+00:00] INFO: Running queued delayed notifications before re-raising exception
[2018-12-13T07:11:43+00:00] ERROR: Running exception handlers
[2018-12-13T07:11:43+00:00] ERROR: Exception handlers complete
[2018-12-13T07:11:43+00:00] FATAL: Stacktrace dumped to /var/tmp/chef-solo/chef-stacktrace.out
[2018-12-13T07:11:43+00:00] ERROR: service[rdma] (test_node::default line 66) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but received '1'
---- Begin output of /bin/systemctl enable rdma ----
STDOUT: 
STDERR: Failed to execute operation: No such file or directory
---- End output of /bin/systemctl enable rdma ----
Ran /bin/systemctl enable rdma returned 1
[2018-12-13T07:11:43+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: root
Password: 
Last login: Thu Dec 13 07:07:46 from ssh-1.spirit.whamcloud.com
[root@soak-8 ~]# yum install kmod-lustre kmod-lustre-osd-ldiskfs lustre lustre-e t[K[A[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[K
[K[A[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[C[Ct ests
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
Resolving Dependencies
--> Running transaction check
---> Package kmod-lustre.x86_64 0:2.12.0_RC2-1.el7 will be installed
--> Processing Dependency: ksym(rdma_set_reuseaddr) = 0x86918430 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_resolve_route) = 0xcdd4c250 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_resolve_addr) = 0xee6c848c for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_reject) = 0xc13ae5c7 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_notify) = 0xcdf28ac5 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_listen) = 0xe615756e for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_disconnect) = 0x0db1a0df for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_destroy_qp) = 0x8c755381 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_destroy_id) = 0x12af231d for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_create_qp) = 0xce9ca423 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_connect) = 0x4999b6fd for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(rdma_bind_addr) = 0x94cd1b9d for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(ib_modify_qp) = 0x0f249557 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(ib_map_mr_sg) = 0xb5e8392a for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(ib_get_dma_mr) = 0x9f8691e0 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(ib_fmr_pool_unmap) = 0xbdef2d8b for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(ib_fmr_pool_map_phys) = 0x934d0948 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(ib_destroy_cq) = 0xed67143d for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(ib_dereg_mr) = 0x0f4b7151 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(ib_dealloc_pd) = 0x6b1e8796 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(ib_create_fmr_pool) = 0x2b7f7e13 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(ib_alloc_mr) = 0x777e82db for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(backport_dependency_symbol) = 0xb43a926b for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(__rdma_create_id) = 0xa189c02a for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(__rdma_accept) = 0x770f92b5 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(__ib_create_cq) = 0x8bbba292 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: ksym(__ib_alloc_pd) = 0xe256a5a9 for package: kmod-lustre-2.12.0_RC2-1.el7.x86_64
---> Package kmod-lustre-osd-ldiskfs.x86_64 0:2.12.0_RC2-1.el7 will be installed
--> Processing Dependency: lustre-osd-ldiskfs-mount = 2.12.0_RC2 for package: kmod-lustre-osd-ldiskfs-2.12.0_RC2-1.el7.x86_64
---> Package lustre.x86_64 0:2.12.0_RC2-1.el7 will be installed
---> Package lustre-tests.x86_64 0:2.12.0_RC2-1.el7 will be installed
--> Processing Dependency: kmod-lustre-tests = 2.12.0_RC2 for package: lustre-tests-2.12.0_RC2-1.el7.x86_64
--> Processing Dependency: lustre-iokit for package: lustre-tests-2.12.0_RC2-1.el7.x86_64
--> Running transaction check
---> Package kmod-lustre-tests.x86_64 0:2.12.0_RC2-1.el7 will be installed
---> Package kmod-mlnx-ofa_kernel.x86_64 0:4.5-OFED.4.5.1.0.1.1.gb4fdfac will be installed
--> Processing Dependency: mlnx-ofa_kernel for package: kmod-mlnx-ofa_kernel-4.5-OFED.4.5.1.0.1.1.gb4fdfac.x86_64
---> Package lustre-iokit.x86_64 0:2.12.0_RC2-1.el7 will be installed
---> Package lustre-osd-ldiskfs-mount.x86_64 0:2.12.0_RC2-1.el7 will be installed
--> Running transaction check
---> Package mlnx-ofa_kernel.x86_64 0:4.5-OFED.4.5.1.0.1.1.gb4fdfac will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package                Arch   Version                       Repository    Size
================================================================================
Installing:
 kmod-lustre            x86_64 2.12.0_RC2-1.el7              lustre-build 4.0 M
 kmod-lustre-osd-ldiskfs
                        x86_64 2.12.0_RC2-1.el7              lustre-build 478 k
 lustre                 x86_64 2.12.0_RC2-1.el7              lustre-build 766 k
 lustre-tests           x86_64 2.12.0_RC2-1.el7              lustre-build 7.9 M
Installing for dependencies:
 kmod-lustre-tests      x86_64 2.12.0_RC2-1.el7              lustre-build  45 k
 kmod-mlnx-ofa_kernel   x86_64 4.5-OFED.4.5.1.0.1.1.gb4fdfac lustre-build 1.2 M
 lustre-iokit           x86_64 2.12.0_RC2-1.el7              lustre-build  41 k
 lustre-osd-ldiskfs-mount
                        x86_64 2.12.0_RC2-1.el7              lustre-build  14 k
 mlnx-ofa_kernel        x86_64 4.5-OFED.4.5.1.0.1.1.gb4fdfac lustre-build 103 k

Transaction Summary
================================================================================
Install  4 Packages (+5 Dependent packages)

Total download size: 14 M
Installed size: 42 M
Is this ok [y/d/N]: y
Downloading packages:
(1/9): kmod-lustre-2.12.0_RC2-1.el7.x86_64.rpm             | 4.0 MB   00:00     
(2/9): kmod-lustre-osd-ldiskfs-2.12.0_RC2-1.el7.x86_64.rpm | 478 kB   00:00     
(3/9): kmod-lustre-tests-2.12.0_RC2-1.el7.x86_64.rpm       |  45 kB   00:00     
(4/9): lustre-2.12.0_RC2-1.el7.x86_64.rpm                  | 766 kB   00:00     
(5/9): kmod-mlnx-ofa_kernel-4.5-OFED.4.5.1.0.1.1.gb4fdfac. | 1.2 MB   00:00     
(6/9): lustre-iokit-2.12.0_RC2-1.el7.x86_64.rpm            |  41 kB   00:00     
(7/9): lustre-osd-ldiskfs-mount-2.12.0_RC2-1.el7.x86_64.rp |  14 kB   00:00     
(8/9): mlnx-ofa_kernel-4.5-OFED.4.5.1.0.1.1.gb4fdfac.x86_6 | 103 kB   00:00     
(9/9): lustre-tests-2.12.0_RC2-1.el7.x86_64.rpm            | 7.9 MB   00:00     
--------------------------------------------------------------------------------
Total                                               43 MB/s |  14 MB  00:00     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : lustre-osd-ldiskfs-mount-2.1 [                             ] 1/9  Installing : lustre-osd-ldiskfs-mount-2.1 [############################ ] 1/9  Installing : lustre-osd-ldiskfs-mount-2.12.0_RC2-1.el7.x86_64             1/9 
  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [                             ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [#                            ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [######                       ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [#######                      ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [########                     ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [#########                    ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [##########                   ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [###########                  ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [############                 ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [#############                ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [##############               ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [###############              ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [################             ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [####################         ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [########################     ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [#########################    ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [##########################   ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [###########################  ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5 [############################ ] 2/9  Installing : mlnx-ofa_kernel-4.5-OFED.4.5.1.0.1.1.gb4fdfac.x86_64         2/9 
  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [                             ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [#                            ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [##                           ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [###                          ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [####                         ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [#####                        ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [######                       ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [#######                      ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [########                     ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [#########                    ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [##########                   ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [###########                  ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [############                 ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [#############                ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [##############               ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [###############              ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [################             ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [#################            ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [##################           ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [###################          ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [####################         ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [#####################        ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [######################       ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [#######################      ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [########################     ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [#########################    ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [##########################   ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [###########################  ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFE [############################ ] 3/9  Installing : kmod-mlnx-ofa_kernel-4.5-OFED.4.5.1.0.1.1.gb4fdfac.x86_64    3/9 
  Installing : kmod-lustre-2.12.0_RC2-1.el7 [                             ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [#                            ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [##                           ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [###                          ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [####                         ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [#####                        ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [######                       ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [#######                      ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [########                     ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [#########                    ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [##########                   ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [###########                  ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [############                 ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [#############                ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [##############               ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [###############              ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [################             ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [#################            ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [##################           ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [###################          ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [####################         ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [#####################        ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [######################       ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [#######################      ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [########################     ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [#########################    ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [##########################   ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [###########################  ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7 [############################ ] 4/9  Installing : kmod-lustre-2.12.0_RC2-1.el7.x86_64                          4/9 
  Installing : kmod-lustre-osd-ldiskfs-2.12 [                             ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [#                            ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [##                           ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [###                          ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [####                         ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [#####                        ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [######                       ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [#######                      ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [########                     ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [#########                    ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [##########                   ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [###########                  ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [############                 ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [#############                ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [##############               ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [###############              ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [################             ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [#################            ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [##################           ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [###################          ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [####################         ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [#####################        ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [######################       ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [#######################      ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [########################     ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [#########################    ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [##########################   ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [###########################  ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12 [############################ ] 5/9  Installing : kmod-lustre-osd-ldiskfs-2.12.0_RC2-1.el7.x86_64              5/9 
  Installing : lustre-2.12.0_RC2-1.el7.x86_ [                             ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [#                            ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [##                           ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [###                          ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [####                         ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [#####                        ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [######                       ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [#######                      ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [########                     ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [#########                    ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [##########                   ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [###########                  ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [############                 ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [#############                ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [##############               ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [###############              ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [################             ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [#################            ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [##################           ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [###################          ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [####################         ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [#####################        ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [######################       ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [#######################      ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [########################     ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [#########################    ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [##########################   ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [###########################  ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_ [############################ ] 6/9  Installing : lustre-2.12.0_RC2-1.el7.x86_64                               6/9 
  Installing : kmod-lustre-tests-2.12.0_RC2 [                             ] 7/9  Installing : kmod-lustre-tests-2.12.0_RC2 [######                       ] 7/9  Installing : kmod-lustre-tests-2.12.0_RC2 [##############               ] 7/9  Installing : kmod-lustre-tests-2.12.0_RC2 [#####################        ] 7/9  Installing : kmod-lustre-tests-2.12.0_RC2 [############################ ] 7/9  Installing : kmod-lustre-tests-2.12.0_RC2-1.el7.x86_64                    7/9 
  Installing : lustre-iokit-2.12.0_RC2-1.el [                             ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [##                           ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [####                         ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [#######                      ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [########                     ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [#########                    ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [##########                   ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [###########                  ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [#############                ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [################             ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [###################          ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [#####################        ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [#######################      ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [########################     ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [#########################    ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [##########################   ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [###########################  ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el [############################ ] 8/9  Installing : lustre-iokit-2.12.0_RC2-1.el7.x86_64                         8/9 
  Installing : lustre-tests-2.12.0_RC2-1.el [                             ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [#                            ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [##                           ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [###                          ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [####                         ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [#####                        ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [######                       ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [#######                      ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [########                     ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [#########                    ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [##########                   ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [###########                  ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [############                 ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [#############                ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [##############               ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [###############              ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [################             ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [#################            ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [##################           ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [###################          ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [####################         ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [#####################        ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [######################       ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [#######################      ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [########################     ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [#########################    ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [##########################   ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [###########################  ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el [############################ ] 9/9  Installing : lustre-tests-2.12.0_RC2-1.el7.x86_64                         9/9 
  Verifying  : kmod-mlnx-ofa_kernel-4.5-OFED.4.5.1.0.1.1.gb4fdfac.x86_64    1/9 
  Verifying  : lustre-2.12.0_RC2-1.el7.x86_64                               2/9 
  Verifying  : kmod-lustre-osd-ldiskfs-2.12.0_RC2-1.el7.x86_64              3/9 
  Verifying  : lustre-iokit-2.12.0_RC2-1.el7.x86_64                         4/9 
  Verifying  : lustre-tests-2.12.0_RC2-1.el7.x86_64                         5/9 
  Verifying  : mlnx-ofa_kernel-4.5-OFED.4.5.1.0.1.1.gb4fdfac.x86_64         6/9 
  Verifying  : lustre-osd-ldiskfs-mount-2.12.0_RC2-1.el7.x86_64             7/9 
  Verifying  : kmod-lustre-tests-2.12.0_RC2-1.el7.x86_64                    8/9 
  Verifying  : kmod-lustre-2.12.0_RC2-1.el7.x86_64                          9/9 

Installed:
  kmod-lustre.x86_64 0:2.12.0_RC2-1.el7                                         
  kmod-lustre-osd-ldiskfs.x86_64 0:2.12.0_RC2-1.el7                             
  lustre.x86_64 0:2.12.0_RC2-1.el7                                              
  lustre-tests.x86_64 0:2.12.0_RC2-1.el7                                        

Dependency Installed:
  kmod-lustre-tests.x86_64 0:2.12.0_RC2-1.el7                                   
  kmod-mlnx-ofa_kernel.x86_64 0:4.5-OFED.4.5.1.0.1.1.gb4fdfac                   
  lustre-iokit.x86_64 0:2.12.0_RC2-1.el7                                        
  lustre-osd-ldiskfs-mount.x86_64 0:2.12.0_RC2-1.el7                            
  mlnx-ofa_kernel.x86_64 0:4.5-OFED.4.5.1.0.1.1.gb4fdfac                        

Complete!
[root@soak-8 ~]# rpm -qa|grep -i lustre
kmod-[01;31m[Klustre[m[K-tests-2.12.0_RC2-1.el7.x86_64
kernel-3.10.0-957.el7_[01;31m[Klustre[m[K.x86_64
kmod-[01;31m[Klustre[m[K-2.12.0_RC2-1.el7.x86_64
[01;31m[Klustre[m[K-2.12.0_RC2-1.el7.x86_64
[01;31m[Klustre[m[K-iokit-2.12.0_RC2-1.el7.x86_64
[01;31m[Klustre[m[K-osd-ldiskfs-mount-2.12.0_RC2-1.el7.x86_64
kmod-[01;31m[Klustre[m[K-osd-ldiskfs-2.12.0_RC2-1.el7.x86_64
[01;31m[Klustre[m[K-tests-2.12.0_RC2-1.el7.x86_64
[root@soak-8 ~]# rpm -qa|grep -i lustre[K[K[K[K[K[Kmlnx
libibumad-43.1.1.[01;31m[KMLNX[m[K20180612.87b4d9b-0.1.45101.x86_64
kmod-[01;31m[Kmlnx[m[K-ofa_kernel-4.5-OFED.4.5.1.0.1.1.gb4fdfac.x86_64
libibverbs-41[01;31m[Kmlnx[m[K1-OFED.4.5.0.1.0.45101.x86_64
librdmacm-41[01;31m[Kmlnx[m[K1-OFED.4.2.0.1.3.45101.x86_64
opensm-libs-5.3.0.[01;31m[KMLNX[m[K20181108.33944a2-0.1.45101.x86_64
[01;31m[Kmlnx[m[K-ofa_kernel-4.5-OFED.4.5.1.0.1.1.gb4fdfac.x86_64
[root@soak-8 ~]# ifconfig
ens2f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.10.1.108  netmask 255.255.0.0  broadcast 10.10.255.255
        inet6 fe80::21e:67ff:fe6b:246b  prefixlen 64  scopeid 0x20<link>
        ether 00:1e:67:6b:24:6b  txqueuelen 1000  (Ethernet)
        RX packets 14208  bytes 17148856 (16.3 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 12305  bytes 1894982 (1.8 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device memory 0xd0b60000-d0b7ffff  

ens2f1: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether 00:1e:67:6b:24:6c  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device memory 0xd0b40000-d0b5ffff  

ens2f2: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether 00:1e:67:6b:24:6d  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device memory 0xd0b20000-d0b3ffff  

ens2f3: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether 00:1e:67:6b:24:6e  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device memory 0xd0b00000-d0b1ffff  

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 2  bytes 140 (140.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 2  bytes 140 (140.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

[root@soak-8 ~]# 
<ConMan> Console [soak-8] departed by <w3liu@ssh-1> on pts/12 at 12-13 07:19.
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H
<ConMan> Console [soak-8] joined by <w3liu@ssh-1> on pts/12 at 12-13 07:21.
[02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[11;01H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [02;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [m[4;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[4;79H[m[7m[5;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [5;79H[22;1H   The selected entry will be started automatically in 5s.                     [5;79H[22;1H   The selected entry will be started automatically in 4s.                     [5;79H[22;1H   The selected entry will be started automatically in 3s.                     [5;79H[22;1H   The selected entry will be started automatically in 2s.                     [5;79H[22;1H   The selected entry will be started automatically in 1s.                     [5;79H[22;1H   The selected entry will be started automatically in 0s.                     [5;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-309-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Sat Dec 8 05:53:16 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x35bfe000-0x36df6fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 162MB of memory at 688MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff970dee000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 7011916k/34603008k available (7664k kernel code, 1126748k absent, 830688k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.727 MHz processor
[    0.000180] Calibrating delay loop (skipped), value calculated using timer frequency.. 5387.45 BogoMIPS (lpj=2693727)
[    0.012096] pid_max: default: 245760 minimum: 1920
[    0.018326] Security Framework initialized
[    0.022934] SELinux:  Initializing.
[    0.027120] Yama: becoming mindful.
[    0.036367] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.058170] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.072054] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.079834] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.090166] Initializing cgroup subsys memory
[    0.095104] Initializing cgroup subsys devices
[    0.100094] Initializing cgroup subsys freezer
[    0.105066] Initializing cgroup subsys net_cls
[    0.110037] Initializing cgroup subsys blkio
[    0.114816] Initializing cgroup subsys perf_event
[    0.120119] Initializing cgroup subsys hugetlb
[    0.125097] Initializing cgroup subsys pids
[    0.129876] Initializing cgroup subsys net_prio
[    0.135237] mce: CPU supports 20 MCE banks
[    0.139852] CPU0: Thermal monitoring enabled (TM1)
[    0.145291] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.151429] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.157763] tlb_flushall_shift: 6
[    0.161549] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.172301] FEATURE SPEC_CTRL Present
[    0.176400] FEATURE IBPB_SUPPORT Present
[    0.181106] Spectre V2 : Mitigation: Full retpoline
[    0.189266] Freeing SMP alternatives: 28k freed
[    0.200707] ACPI: Core revision 20130517
[    0.296040] ACPI: All ACPI Tables successfully acquired
[    0.321384] ftrace: allocating 29187 entries in 115 pages
[    0.383219] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.390627] Switched APIC routing to physical flat.
[    0.396813] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.413537] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.424063] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.435910] ... version:                3
[    0.440386] ... bit width:              48
[    0.444965] ... generic registers:      4
[    0.449443] ... value mask:             0000ffffffffffff
[    0.455380] ... max period:             00007fffffffffff
[    0.461316] ... fixed-purpose events:   3
[    0.465790] ... event mask:             000000070000000f
[    0.480314] smpboot: Booting Node   0, Processors  #1[    0.502148] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.557124] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.697188] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.739180] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.779699] Brought up 32 CPUs
[    0.783332] smpboot: Max logical packages: 15
[    0.788220] smpboot: Total of 32 processors activated (172590.56 BogoMIPS)
[    1.044728] node 0 initialised, 2813371 pages in 136ms
[    1.082777] node 1 initialised, 3595039 pages in 169ms
[    1.089751] devtmpfs: initialized
[    1.105102] EVM: security.selinux
[    1.108806] EVM: security.ima
[    1.112120] EVM: security.capability
[    1.116380] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.125243] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.137665] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.145353] pinctrl core: initialized pinctrl subsystem
[    1.151475] RTC time:  7:22:11, date: 12/13/18
[    1.156947] NET: Registered protocol family 16
[    1.162430] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.170890] ACPI: bus type PCI registered
[    1.175369] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.183210] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.193609] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.201226] PCI: Using configuration type 1 for base access
[    1.207493] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.228156] ACPI: Added _OSI(Module Device)
[    1.232838] ACPI: Added _OSI(Processor Device)
[    1.237800] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.243055] ACPI: Added _OSI(Processor Aggregator Device)
[    1.249086] ACPI: Added _OSI(Linux-Dell-Video)
[    1.293724] ACPI: Executed 1 blocks of module-level executable AML code
[    1.582632] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.616063] ACPI: Interpreter enabled
[    1.620189] ACPI: (supports S0 S1 S5)
[    1.624280] ACPI: Using IOAPIC for interrupt routing
[    1.629944] HEST: Table parsing has been initialized.
[    1.635593] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.645863] ACPI: GPE 0x1E active on init
[    1.650374] ACPI: GPE 0x24 active on init
[    1.654878] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.720608] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.727524] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.737187] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.745673] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.754224] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.763647] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.775299] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.790158] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.805407] PCI host bridge to bus 0000:00
[    1.809995] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.816899] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.825272] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.833631] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.841989] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.850349] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.858708] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.867067] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.875427] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.883785] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.892141] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.900497] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.908855] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.917212] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.925571] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.934705] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.941367] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.947991] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.954632] pci 0000:00:02.0: System wakeup disabled by ACPI
[    1.961247] pci 0000:00:02.2: System wakeup disabled by ACPI
[    1.967876] pci 0000:00:03.0: System wakeup disabled by ACPI
[    1.978094] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    1.984741] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    1.991346] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    1.998003] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.004553] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.011824] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.017550] acpiphp: Slot [2] registered
[    2.022220] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.032553] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.043223] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.053562] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.064232] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.074553] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.085215] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.095536] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.107862] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.113915] acpiphp: Slot [2-2] registered
[    2.120930] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.126665] acpiphp: Slot [2-3] registered
[    2.131281] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.136984] acpiphp: Slot [2-4] registered
[    2.141886] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.147776] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.160570] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.166244] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.172227] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.178633] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.184307] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.193286] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.201197] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.209092] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.216996] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.224897] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.232792] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.240697] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.248601] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.256698] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.263606] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.273009] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.281333] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.289885] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.299449] PCI host bridge to bus 0000:80
[    2.304029] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.311618] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.319200] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.327565] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.335923] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.345055] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.351411] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.358011] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.364602] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.371193] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.380026] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.385670] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.391312] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.396941] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.413476] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.420095] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.429285] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.438954] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.445954] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.455214] PCI host bridge to bus 0000:7f
[    2.459793] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.470425] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.477043] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.486238] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.495909] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.502912] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.512175] PCI host bridge to bus 0000:ff
[    2.516756] pci_bus 0000:ff: root bus resource [bus ff]
[    2.527965] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.537028] vgaarb: loaded
[    2.540052] vgaarb: bridge control possible 0000:09:00.0
[    2.546421] SCSI subsystem initialized
[    2.550677] ACPI: bus type USB registered
[    2.555195] usbcore: registered new interface driver usbfs
[    2.561343] usbcore: registered new interface driver hub
[    2.567580] usbcore: registered new device driver usb
[    2.573771] EDAC MC: Ver: 3.0.0
[    2.577829] PCI: Using ACPI for IRQ routing
[    2.590138] NetLabel: Initializing
[    2.593939] NetLabel:  domain hash size = 128
[    2.598806] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.604392] NetLabel:  unlabeled traffic allowed by default
[    2.610955] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.617972] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.626554] amd_nb: Cannot enumerate AMD northbridges
[    2.632395] Switched to clocksource hpet
[    2.651433] pnp: PnP ACPI init
[    2.654886] ACPI: bus type PNP registered
[    2.659658] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.666280] system 00:00: [io  0xffff] has been reserved
[    2.672225] system 00:00: [io  0xffff] has been reserved
[    2.678162] system 00:00: [io  0xffff] has been reserved
[    2.684107] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.691120] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.697747] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.704369] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.710990] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.717990] system 00:00: [io  0x0cf9] could not be reserved
[    2.724539] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.732705] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.740104] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.747510] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.754908] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.762310] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.769702] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.777490] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.785266] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.793052] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.800956] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.809281] pnp: PnP ACPI: found 7 devices
[    2.813863] ACPI: bus type PNP unregistered
[    2.827959] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.833540] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.839395] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.846208] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.853799] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.859362] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.866954] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.876391] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.881956] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.887512] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.894336] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.901929] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.907477] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    2.914291] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    2.921880] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    2.931311] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.936876] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.942436] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    2.950029] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    2.958689] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    2.964478] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.970037] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.975589] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.981148] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.987079] NET: Registered protocol family 2
[    2.994111] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.003278] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.011021] TCP: Hash tables configured (established 262144 bind 65536)
[    3.018512] TCP: reno registered
[    3.022279] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.029457] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.038142] NET: Registered protocol family 1
[    4.143255] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.251162] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.259676] Unpacking initramfs...
[    5.822520] Freeing initrd memory: 18404k freed
[    5.834658] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.841871] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff970a773c7000-ffff970a7b3c6fff]
[    5.853380] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    5.862214] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    5.868638] RAPL PMU: hw unit of domain package 2^-16 Joules
[    5.874965] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    5.894225] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    5.901063] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    5.914989] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    5.923246] Initialise system trusted keyring
[    5.928249] audit: initializing netlink socket (disabled)
[    5.934324] type=2000 audit(1544685732.455:1): initialized
[    5.996361] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.003473] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.013730] zpool: loaded
[    6.016674] zbud: loaded
[    6.020695] VFS: Disk quotas dquot_6.6.0
[    6.025589] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.034299] msgmni has been set to 32768
[    6.039060] Key type big_key registered
[    6.045964] NET: Registered protocol family 38
[    6.050948] Key type asymmetric registered
[    6.055538] Asymmetric key parser 'x509' registered
[    6.061157] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.069697] io scheduler noop registered
[    6.074099] io scheduler deadline registered (default)
[    6.079994] io scheduler cfq registered
[    6.084294] io scheduler mq-deadline registered
[    6.089368] io scheduler kyber registered
[    6.099734] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.107554] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.115339] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.122638] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.129939] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.137238] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.144574] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.152357] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.159691] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.167515] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.175294] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.182631] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.190417] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.197718] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.205053] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.212872] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.220657] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.228002] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.235820] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.243644] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.251465] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.259353] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.265598] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.273041] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.281349] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.289627] ACPI: Power Button [PWRF]
[    6.293812] ACPI: Requesting acpi_cpufreq
[    6.381376] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.389766] pstore: Registered erst as persistent store backend
[    6.396711] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.405201] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.433093] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.460238] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.467542] Non-volatile memory driver v1.3
[    6.472302] Linux agpgart interface v0.103
[    6.477329] crash memory driver: version 1.1
[    6.482596] rdac: device handler registered
[    6.487353] hp_sw: device handler registered
[    6.492145] emc: device handler registered
[    6.497013] alua: device handler registered
[    6.501798] libphy: Fixed MDIO Bus: probed
[    6.506488] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.513804] ehci-pci: EHCI PCI platform driver
[    6.519268] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.525232] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.533532] ehci-pci 0000:00:1a.0: debug port 2
[    6.542562] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.554055] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.560588] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.568175] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.576237] usb usb1: Product: EHCI Host Controller
[    6.581701] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.589879] usb usb1: SerialNumber: 0000:00:1a.0
[    6.595278] hub 1-0:1.0: USB hub found
[    6.599493] hub 1-0:1.0: 2 ports detected
[    6.604576] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    6.610525] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    6.618820] ehci-pci 0000:00:1d.0: debug port 2
[    6.627853] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    6.640047] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    6.646560] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    6.654146] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.662228] usb usb2: Product: EHCI Host Controller
[    6.667684] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.675856] usb usb2: SerialNumber: 0000:00:1d.0
[    6.681239] hub 2-0:1.0: USB hub found
[    6.685451] hub 2-0:1.0: 2 ports detected
[    6.690191] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    6.697136] ohci-pci: OHCI PCI platform driver
[    6.702160] uhci_hcd: USB Universal Host Controller Interface driver
[    6.709422] usbcore: registered new interface driver usbserial_generic
[    6.716735] usbserial: USB Serial support registered for generic
[    6.723520] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    6.889079] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    7.775987] i8042: No controller found
[    7.780243] Switched to clocksource tsc
[    7.780322] mousedev: PS/2 mouse device common for all mice
[    7.780482] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    7.780572] rtc_cmos 00:01: RTC can wake from S4
[    7.780815] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    7.780871] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    7.781014] intel_pstate: Intel P-state driver initializing
[    7.792729] cpuidle: using governor menu
[    7.794277] hidraw: raw HID events driver (C) Jiri Kosina
[    7.794535] usbcore: registered new interface driver usbhid
[    7.794535] usbhid: USB HID core driver
[    7.794756] drop_monitor: Initializing network drop monitor service
[    7.795347] TCP: cubic registered
[    7.795356] Initializing XFRM netlink socket
[    7.796046] NET: Registered protocol family 10
[    7.797642] NET: Registered protocol family 17
[    7.797656] mpls_gso: MPLS GSO support
[    7.799404] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    7.803567] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    7.803793] Loading compiled-in X.509 certificates
[    7.804885] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    7.805973] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    7.807024] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: d73e894149b8945b8dc07cc18b4508db322683f2'
[    7.807062] registered taskstats version 1
[    7.811693] Key type trusted registered
[    7.815830] Key type encrypted registered
[    7.815997] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.817653]   Magic number: 14:576:369
[    7.817660] machinecheck machinecheck21: hash matches
[    7.817807] msr msr8: hash matches
[    7.817827] pci 0000:ff:0f.5: hash matches
[    7.818615] rtc_cmos 00:01: setting system clock to 2018-12-13 07:22:18 UTC (1544685738)
[    7.835959] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    7.910651] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    7.910654] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.911090] hub 1-1:1.0: USB hub found
[    7.911257] hub 1-1:1.0: 6 ports detected
[    7.974124] random: fast init done
[    7.974517] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    7.974528] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.974938] hub 2-1:1.0: USB hub found
[    7.975130] hub 2-1:1.0: 8 ports detected
[    8.042698] Freeing unused kernel memory: 1876k freed
[    8.049126] Write protecting the kernel read-only data: 12288k
[    8.059277] Freeing unused kernel memory: 516k freed
[    8.068309] Freeing unused kernel memory: 600k freed
[    8.087776] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.109251] systemd[1]: Detected architecture x86-64.
[    8.114923] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.131150] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.206364] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.219278] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.230137] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.241101] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on u[    8.249918] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
dev  Control Socket.ening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[    8.274035] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.284035] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.294037] systemd[1]: Reached target Timers.
[ [32m  OK  [0m   8.304101] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.315748] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    8.326020] systemd[1]: Reached target Sockets .
[[32m  OK  rget Sockets.
[    8.336832] systemd[1]: Starting Setup Virtual Console...
          Startin[     8.348799] sist of required static device nodes for the current kernel...
[    8.365914] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
[    8.365916] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.365918] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.365932] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.365934] usb 2-1.4: SerialNumber: serial
[    8.367601] input: American Megatrends Inc. Virtua l Keyboard and d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
         Startin[    8.418426] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
g Create list of[    8.436622] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
 required st... [    8.451601] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
nodes for the current kernel...
[    8.474496] systemd[1]: Starting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.486661] systemd[1]: Starting dracut cmdline hook...
         Starting dracut cmdline hook...
[    8.497335] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Setup Virtual Console.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Apply Kernel Variables.
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut cmdline hook.
         Starting dracut pre-udev hook...
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Show Plymouth Boot Screen...
         Starting dracut initqueue hook...
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] [    8.838344] dca service started, version 1.12.1
Started Forward [    8.838375] mlx_compat: loading out-of-tree module taints kernel.
Password Request[    8.838676] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
s to Plymouth Directory Watch.
[[32m  OK  [0[    8.868289] pps_core: LinuxPPS API ver. 1 registered
m] Reached targe[    8.868528] Compat-mlnx-ofed backport release: b4fdfac
t Paths.
[[32[    8.868529] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
m  OK  [0m] Rea[    8.868529] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
ched target Basi[    8.898983] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
c System.
[    8.917437] PTP clock support registered
[    8.940310] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    8.946975] mlx4_core: Initializing 0000:04:00.0
[    8.955394] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    8.955442] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    8.955443] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.956235] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    8.970500] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    8.970504] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    8.981203] scsi host0: ahci
[    8.981392] scsi host1: ahci
[    8.984587] scsi host2: ahci
[    8.984939] scsi host3: ahci
[    8.985952] scsi host4: ahci
[    8.986175] scsi host5: ahci
[    8.986289] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 39
[    8.986291] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 39
[    8.986293] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 39
[    8.986296] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 39
[    8.986299] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 39
[    8.986302] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 39
[    8.994063] igb 0000:02:00.0: added PHC on eth0
[    8.994065] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.994067] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    8.994141] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    8.994142] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.994760] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.002595] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.002604] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    9.002610] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    9.002625] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.002637] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.002805] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.005490] scsi host6: isci
[    9.018740] mpt2sas version 20.103.01.00 loaded
[    9.018818] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[    9.018977] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32666996 kB)
[    9.031397] igb 0000:02:00.1: added PHC on eth1
[    9.031399] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.031400] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.031474] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.031476] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.080842] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[    9.081298] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 73
[    9.081299] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 74
[    9.081299] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 75
[    9.081300] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 76
[    9.081300] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 77
[    9.081301] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 78
[    9.081302] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 79
[    9.081302] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 80
[    9.081303] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 81
[    9.081303] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 82
[    9.081304] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 83
[    9.081304] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 84
[    9.081305] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 85
[    9.081305] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 86
[    9.081306] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 87
[    9.081306] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 88
[    9.081308] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffb6f943ac0000), size(65536)
[    9.081308] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[    9.087883] igb 0000:02:00.2: added PHC on eth2
[    9.087884] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.087886] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.087960] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.087961] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.146846] mpt2sas_cm0: sending message unit reset !!
[    9.146876] igb 0000:02:00.3: added PHC on eth3
[    9.146878] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.146880] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.146954] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.146955] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.148352] mpt2sas_cm0: message unit reset: SUCCESS
%G%G[    9.206629] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[    9.206630] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[    9.206631] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    9.251709] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[    9.251710] mpt2sas_cm0: Protocol=(
[    9.251710] Initiator
[    9.251711] ,Target
[    9.251711] ), 
[    9.251711] Capabilities=(
[    9.251712] TLR
[    9.251712] ,EEDP
[    9.251713] ,Snapshot Buffer
[    9.251713] ,Diag Trace Buffer
[    9.251714] ,Task Set Full
[    9.251714] ,NCQ
[    9.251714] )
[    9.251760] scsi host7: Fusion MPT SAS Host
[    9.252112] mpt2sas_cm0: sending port enable !!
[    9.254736] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[    9.262819] mpt2sas_cm0: port enable: SUCCESS
[    9.263530] scsi 7:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.263535] scsi 7:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.263537] scsi 7:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.263539] scsi 7:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.290834] ata3: SATA link down (SStatus 0 SControl 300)
[    9.291834] ata2: SATA link down (SStatus 0 SControl 300)
[    9.291864] ata1: SATA link down (SStatus 0 SControl 300)
[    9.291893] ata5: SATA link down (SStatus 0 SControl 300)
[    9.291922] ata6: SATA link down (SStatus 0 SControl 300)
[    9.291953] ata4: SATA link down (SStatus 0 SControl 300)
[    9.384973] [TTM] Zone  kernel: Available graphics memory: 16333498 kiB
[    9.384975] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.384988] [TTM] Initializing pool allocator
[    9.384991] [TTM] Initializing DMA pool allocator
[    9.425119] fbcon: mgadrmfb (fb0) is primary device
[    9.461586] scsi 7:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.461592] scsi 7:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.461594] scsi 7:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.461597] scsi 7:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.493176] scsi 7:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.493185] scsi 7:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.493188] scsi 7:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.493193] scsi 7:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.539224] scsi 7:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.539232] scsi 7:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.539235] scsi 7:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.539241] scsi 7:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.551252] scsi 7:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.551272] scsi 7:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.551275] scsi 7:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.551279] scsi 7:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.563754] scsi 7:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.563757] scsi 7:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.563758] scsi 7:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.563761] scsi 7:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.579553] scsi 7:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.579573] scsi 7:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.579575] scsi 7:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.579578] scsi 7:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.593221] scsi 7:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.593228] scsi 7:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.593231] scsi 7:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.593236] scsi 7:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.605159] scsi 7:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.605165] scsi 7:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.605167] scsi 7:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.605171] scsi 7:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.629227] scsi 7:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.629234] scsi 7:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.629237] scsi 7:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.629242] scsi 7:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.658842] Console: switching to colour frame buffer device 128x48
[    9.716424] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.753838] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   10.678676] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   10.684913] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   10.693331] ata7.00: configured for UDMA/133
[   10.709644] scsi 6:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.489632] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.496629] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.503437] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.510628] mlx4_core: device is working in RoCE mode: Roce V1
[   15.517141] mlx4_core: UD QP Gid type is: V1
[   16.323167] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   16.329403] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   16.337672] ata8.00: configured for UDMA/133
[   16.354307] scsi 6:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   16.665437] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   16.958034] scsi 7:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   16.964420] scsi 7:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   16.971022] scsi 7:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   16.977397] scsi 7:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   16.984244] scsi 7:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   16.990645] scsi 7:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   16.996853] sd 6:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   16.996904] sd 6:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   16.996991] sd 6:0:1:0: [sdb] Write Protect is off
[   16.997027] sd 6:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.005272] sd 7:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   17.005276]  sdb:
[   17.005506] sd 6:0:1:0: [sdb] Attached SCSI disk
[   17.013633] sd 7:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.019004] sd 7:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.019007] sd 7:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.019009] sd 7:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.019012] sd 7:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.019023] sd 7:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.019061] sd 7:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.019062] sd 7:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.034762] scsi 7:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   17.059432] sd 7:0:0:0: [sdc] Write Protect is off
[   17.059434] sd 7:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.059436] sd 7:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.076751] sd 7:0:1:1: [sdi] Write Protect is off
[   17.076752] sd 7:0:0:3: [sdf] Write Protect is off
[   17.076755] sd 7:0:0:7: [sdg] Write Protect is off
[   17.076757] sd 7:0:1:2: [sdj] Write Protect is off
[   17.076762] sd 7:0:0:2: [sde] Write Protect is off
[   17.076764] sd 7:0:0:1: [sdd] Write Protect is off
[   17.076765] sd 7:0:1:0: [sdh] Write Protect is off
[   17.094087] sd 7:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.110908] sd 7:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.110912] sd 7:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.110913] sd 7:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.110915] sd 7:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.110918] sd 7:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.110919] sd 7:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.110921] sd 7:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.138711] sd 7:0:1:7: [sdl] Write Protect is off
[   17.138712] sd 7:0:1:3: [sdk] Write Protect is off
[   17.160189] sd 7:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.160193] sd 7:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.282718] Dev sdh: unable to read RDB block 0
[   17.282735] sd 6:0:0:0: [sda] Write Protect is off
[   17.282744] Dev sdd: unable to read RDB block 0
[   17.282749] Dev sdf: unable to read RDB block 0
[   17.282751] sd 6:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.282752]  sdd: unable to read partition table
[   17.282757]  sdf: unable to read partition table
[   17.282762] Dev sdj: unable to read RDB block 0
[   17.282769]  sdj: unable to read partition table
[   17.283136]  sdg:
[   17.285596] sd 7:0:1:2: [sdj] Attached SCSI disk
[   17.285679] sd 7:0:1:1: [sdi] Attached SCSI disk
[   17.286184] sd 7:0:0:3: [sdf] Attached SCSI disk
[   17.286274] sd 7:0:0:1: [sdd] Attached SCSI disk
[   17.286376] sd 7:0:0:0: [sdc] Attached SCSI disk
[   17.286400] sd 7:0:1:3: [sdk] Attached SCSI disk
[   17.286465] sd 7:0:0:2: [sde] Attached SCSI disk
[   17.286602] sd 7:0:0:7: [sdg] Attached SCSI disk
[   17.299197]  sda: sda1 sda2
[   17.299687] sd 6:0:0:0: [sda] Attached SCSI disk
[   17.385584]  sdh: unable to read partition table
[   17.392473] sd 7:0:1:0: [sdh] Attached SCSI disk
[   17.501174]  sdl:
[   17.504618] sd 7:0:1:7: [sdl] Attached SCSI disk
[   17.526914] random: crng init done
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
[[32m  OK  [0m] Started dracut initqueue hook.
         Mounting /sysroot...
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   19.377960] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped target Timers.
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped target Swap.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped C[   19.780927] systemd-journald[279]: Received SIGTERM from PID 1 (systemd).
reate Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Closed udev Kernel Socket.
[[32m  OK  [0m] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   20.120182] SELinux:  Disabled at runtime.
[   20.165979] type=1404 audit(1544685750.847:2): selinux=0 auid=4294967295 ses=4294967295
[   20.402719] ip_tables: (C) 2000-2006 Netfilter Core Team
[   20.409826] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Listening on udev Control Socket.
         Mounting Huge Pages File System...
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
         Starting Availability of block devices...
[[32m  OK  [0m] Reached target RPC Port Mapper.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
         Starting Create list of required st... nodes for the current kernel...
         Mounting POSIX Message Queue File System...
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd Root File System.
         Mounting Debug File System...
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[[32m  OK  [0m] Created slice s[   21.347262] RPC: Registered named UNIX socket transport module.
ystem-serial\x2d[   21.354386] RPC: Registered udp transport module.
getty.slice.
[[   21.361176] RPC: Registered tcp transport module.
[32m  OK  [0m][   21.367984] RPC: Registered tcp NFSv4.1 backchannel transport module.
 Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Create Static Device Nodes in /dev...
         Starting Apply Kernel Variables...
         Starting Remount Root and Kernel File Systems...
[[32m  OK  [0m[   21.444661] EXT4-fs (sda1): re-mounted. Opts: (null)
] Started LVM2 metadata daemon.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting Flush Journal to Persistent Storage...
         Starting Configure read-only root support...
         Starting udev Coldplug all Devices...
[[32m  OK  [0m] Started Apply [   21.518459] sd 7:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Kernel Variables[   21.527725] sd 7:0:0:7: [sdg] Sense Key : Illegal Request [current] 
.
[   21.527729] sd 7:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   21.527734] sd 7:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.527737] blk_update_request: critical target error, dev sdg, sector 0
[   21.528812] sd 7:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.528814] sd 7:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   21.528817] sd 7:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   21.528820] sd 7:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.528822] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.[   21.604428] systemd-journald[4550]: Received request to flush runtime journal from PID 1

[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started Load/S[   22.007875] device-mapper: uevent: version 1.0.3
ave Random Seed.[   22.014824] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com

[[32m  OK  [0m] Started udev Kernel Device Manager.
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[   22.258318] ipmi message handler version 39.2
[   22.266697] ipmi device interface
[   22.278738] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   22.286406] igb 0000:02:00.0: DCA enabled
[   22.290931] igb 0000:02:00.1: DCA enabled
[   22.295902] IPMI System Interface driver.
[   22.296465] igb 0000:02:00.2: DCA enabled
[   22.296491] igb 0000:02:00.3: DCA enabled
[   22.309429] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   22.309685] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   22.312301] i801_smbus 0000:07:00.3: Enabling SMBus device
[   22.312339] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   22.335310] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   22.341923] ipmi_si: Adding SMBIOS-specified kcs state machine
[   22.348461] ipmi_platform: probing via SPMI
[   22.353135] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   22.359564] (NULL device *): SPMI-specified kcs state machine: duplicate
[   22.367092] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   22.387949] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   22.436059] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.448120] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.454331] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[[32m  OK  [0m] Found device /dev/ttyS0.
[   22.506292] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   22.518525] IPMI SSIF Interface driver
[   22.528386] sd 6:0:0:0: Attached scsi generic sg0 type 0
[   22.535344] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   22.535435] sd 6:0:1:0: Attached scsi generic sg1 type 0
[   22.535953] sd 7:0:0:0: Attached scsi generic sg2 type 0
[   22.536042] sd 7:0:0:1: Attached scsi generic sg3 type 0
[   22.536118] sd 7:0:0:2: Attached scsi generic sg4 type 0
[   22.536207] sd 7:0:0:3: Attached scsi generic sg5 type 0
[   22.536287] sd 7:0:0:7: Attached scsi generic sg6 type 0
[   22.536373] sd 7:0:1:0: Attached scsi generic sg7 type 0
[   22.536465] sd 7:0:1:1: Attached scsi generic sg8 type 0
[   22.536569] sd 7:0:1:2: Attached scsi generic sg9 type 0
[   22.536681] sd 7:0:1:3: Attached scsi generic sg10 type 0
[   22.536834] sd 7:0:1:7: Attached scsi generic sg11 type 0
[   22.608344] cryptd: max_cpu_qlen set to 1000
[   22.628797] AVX version of gcm_enc/dec engaged.
[   22.633879] AES CTR mode by8 optimization enabled
%G[   22.644965] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
%G[   22.652251] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.691733] blk_update_request: I/O error, dev sdd, sector 0
[   22.692021] blk_update_request: I/O error, dev sdf, sector 0
[   22.692428] blk_update_request: I/O error, dev sdh, sector 0
[   22.699960] blk_update_request: I/O error, dev sdf, sector 0
[   22.700238] blk_update_request: I/O error, dev sdh, sector 0
[   22.700252] blk_update_request: I/O error, dev sdd, sector 0
[   22.700756] blk_update_request: I/O error, dev sdj, sector 0
[   22.703955] blk_update_request: I/O error, dev sdf, sector 0
[   22.784147] iTCO_vendor_support: vendor-support=0
[   22.865191] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.871515] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.935293] device-mapper: multipath round-robin: version 1.2.0 loaded
[   22.969481] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   22.983828] kvm: disabled by bios
[   23.013899] intel_rapl: Found RAPL domain package
[   23.019159] intel_rapl: Found RAPL domain core
[   23.024124] intel_rapl: Found RAPL domain dram
[   23.029114] intel_rapl: Found RAPL domain package
[   23.034381] intel_rapl: Found RAPL domain core
[   23.039359] intel_rapl: Found RAPL domain dram
[   23.197753] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   23.208120] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   23.218323] EDAC sbridge:  Ver: 1.1.2 
[   23.404692] sd 7:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   23.413387] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   24.039838] sd 7:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   24.048542] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   24.692678] sd 7:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.701400] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   25.322467] sd 7:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   25.331169] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   25.627292] device-mapper: table: 253:5: multipath: error getting device
[   25.634804] device-mapper: ioctl: error adding target to table
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...[   26.050379] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS

[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[   26.093980] sd 7:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   26.102732] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   26.752062] sd 7:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   26.955071] sd 7:0:0:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.963744] sd 7:0:0:1: [sdd] Sense Key : Illegal Request [current] 
[   26.970858] sd 7:0:0:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[   26.976988] sd 7:0:0:1: [sdd] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   26.986319] blk_update_request: 15 callbacks suppressed
[   26.992159] blk_update_request: I/O error, dev sdd, sector 0
[   27.504930] sd 7:0:0:3: [sdf] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.513596] sd 7:0:0:3: [sdf] Sense Key : Illegal Request [current] 
[   27.520697] sd 7:0:0:3: [sdf] <<vendor>>ASC=0x94 ASCQ=0x1 
[   27.526830] sd 7:0:0:3: [sdf] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   27.536156] blk_update_request: I/O error, dev sdf, sector 0
[   27.543497] sd 7:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.552152] sd 7:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   27.559261] sd 7:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   27.567151] sd 7:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.574736] blk_update_request: critical target error, dev sdg, sector 0
[   27.582697] sd 7:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.591353] sd 7:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   27.598465] sd 7:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   27.606338] sd 7:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.613925] blk_update_request: critical target error, dev sdg, sector 0
[   27.622015] sd 7:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.630688] sd 7:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   27.637794] sd 7:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   27.645670] sd 7:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.653251] blk_update_request: critical target error, dev sdg, sector 0
[   28.166722] sd 7:0:1:0: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   28.175395] sd 7:0:1:0: [sdh] Sense Key : Illegal Request [current] 
[   28.182497] sd 7:0:1:0: [sdh] <<vendor>>ASC=0x94 ASCQ=0x1 
[   28.188630] sd 7:0:1:0: [sdh] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   28.197962] blk_update_request: I/O error, dev sdh, sector 0
[   28.716547] sd 7:0:1:2: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   28.725207] sd 7:0:1:2: [sdj] Sense Key : Illegal Request [current] 
[   28.732309] sd 7:0:1:2: [sdj] <<vendor>>ASC=0x94 ASCQ=0x1 
[   28.738437] sd 7:0:1:2: [sdj] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   28.747783] blk_update_request: I/O error, dev sdj, sector 0
[   28.756451] sd 7:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   28.765117] sd 7:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   28.772235] sd 7:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   28.780110] sd 7:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   28.787700] blk_update_request: critical target error, dev sdl, sector 0
[   28.795894] sd 7:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   28.804552] sd 7:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   28.811650] sd 7:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   28.819530] sd 7:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   28.827124] blk_update_request: critical target error, dev sdl, sector 0
[   28.835324] sd 7:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   28.843995] sd 7:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   28.851089] sd 7:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   28.858961] sd 7:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   28.866549] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Preprocess NFS configuration...
         Starting Tell Plymouth To Write Out Runtime Data...
         Starting Import network configuration from initramfs...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Starting Security Auditing Service...
         Mounting RPC Pipe File System...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   29.000199] type=1305 audit(1544685759.682:3): audit_pid=9357 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting Machine Check Exception Logging Daemon...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Authorization Manager...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting GSSAPI Proxy Daemon...
         Starting NTP client/server...
         Starting Load CPU microcode update...
         Starting System Security Services Daemon...
         Starting Dump dmesg to /var/log/dmesg...
         Starting RPC bind service...
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[   29.658916] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   29.747061] igb 0000:02:00.0 ens2f0: igb: ens2f0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   29.747478] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   29.751449] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   29.832949] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   29.839751] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[   29.850986] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   29.858366] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   29.868557] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   29.876157] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   29.970597] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   29.980333] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   30.068413] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[   30.098426] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   30.625225] card: mlx4_0, QP: 0x220, inline size: 120
[   30.641117] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.[   30.653533] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready

[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
[   30.673317] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[32m  OK  [0m] Started mlnx_interface_mgr - c[   30.689035] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
onfigure ib1.
[   30.708402] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   30.739334] ib0: enabling connected mode will cause multicast packet drops
[   30.747153] ib0: mtu > 4092 will cause multicast packet drops.
[   30.769784] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   37.693477] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   37.738408] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   37.747358] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting Postfix Mail Transport Agent...
         Starting Dynamic System Tuning Daemon...
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting MUNGE authentication service...
         Starting OpenSSH server daemon...
[[32m  OK  [0m] Reached target Network is Online.
         Starting Notify NFS peers of a restart...
      [   37.929681] FS-Cache: Loaded
   Starting NFS status monitor for NFSv2/3 locking....
         Starting System Logging Service...
         Mounting /scratch...
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[   38.008990] FS-Cache: Netfs 'nfs' registered for caching
[   38.027528] Key type dns_resolver registered
[   38.075286] NFS: Registering the id_resolver key type
[   38.080941] Key type id_resolver registered
[   38.085620] Key type id_legacy registered
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Permit User Sessions...
         Starting Automounts filesystems on demand...
         Starting Crash recovery kernel arming...
[[32m  OK  [0m] Started Permit User Sessions.
         Starting Wait for Plymouth Boot Screen to Quit...
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Started Command Scheduler.
[[32m  OK  [0m] Started Job spooling tools.
[[32m  OK  [0m] Created slice User Slice of root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-13T07:23:01+00:00] INFO: Forking chef instance to converge...
[2018-12-13T07:23:01+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-13T07:23:01+00:00] INFO: Chef-client pid: 13894
[2018-12-13T07:23:02+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-13T07:23:02+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-13T07:23:02+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-13T07:23:02+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-13T07:23:02+00:00] INFO: Running start handlers
[2018-12-13T07:23:02+00:00] INFO: Start handlers complete.
[2018-12-13T07:23:02+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-13T07:23:02+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-13T07:23:02+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-13T07:23:03+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-13T07:23:03+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181213072303.008658
[2018-12-13T07:23:03+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181211093117.612604
[2018-12-13T07:23:03+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-13T07:23:03+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-13T07:23:09+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-13T07:23:09+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-13T07:23:09+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-13T07:23:10+00:00] INFO: service[ntpd] started
[2018-12-13T07:23:10+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-13T07:23:10+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-13T07:23:10+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-13T07:23:10+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-13T07:23:10+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-13T07:23:10+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-13T07:23:10+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-13T07:23:10+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-13T07:23:10+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-13T07:23:11+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-13T07:23:11+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-13T07:23:11+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-13T07:23:11+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-13T07:23:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:11+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-13T07:23:12+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-13T07:23:12+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-13T07:23:12+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-13T07:23:12+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-13T07:23:13+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-13T07:23:13+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-13T07:23:13+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-13T07:23:13+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-13T07:23:13+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-13T07:23:13+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-13T07:23:13+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-13T07:23:14+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-13T07:23:14+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-13T07:23:14+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-13T07:23:14+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-13T07:23:15+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-13T07:23:15+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-13T07:23:15+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-13T07:23:15+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-13T07:23:15+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-13T07:23:15+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-13T07:23:15+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-13T07:23:15+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-13T07:23:15+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-13T07:23:15+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-13T07:23:16+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-13T07:23:16+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-13T07:23:16+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-13T07:23:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181213072316.194601
[2018-12-13T07:23:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211093128.595559
[2018-12-13T07:23:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-13T07:23:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-13T07:23:16+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-13T07:23:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181213072316.210759
[2018-12-13T07:23:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211093128.602624
[2018-12-13T07:23:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-13T07:23:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-13T07:23:16+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-13T07:23:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-13T07:23:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-13T07:23:16+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-13T07:23:16+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:23:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:23:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:23:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:23:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:23:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:23:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:23:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T07:23:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:16+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-13T07:23:17+00:00] INFO: service[xinetd] started
[2018-12-13T07:23:17+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-13T07:23:17+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-13T07:23:17+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-13T07:23:17+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-13T07:23:17+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-13T07:23:18+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-13T07:23:18+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-13T07:23:18+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-13T07:23:18+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181213072318.084521
[2018-12-13T07:23:18+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181211093130.690286
[2018-12-13T07:23:18+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-13T07:23:18+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-13T07:23:18+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-13T07:23:18+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-13T07:23:18+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T07:23:18+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T07:23:18+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-13T07:23:18+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-13T07:23:18+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-13T07:23:18+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-13T07:23:18+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-13T07:23:18+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-13T07:23:18+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-13T07:23:19+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-13T07:23:19+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-13T07:23:20+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-13T07:23:20+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-13T07:23:20+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-13T07:23:20+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-13T07:23:20+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-13T07:23:20+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-13T07:23:20+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-13T07:23:20+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-13T07:23:20+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-13T07:23:20+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-13T07:23:20+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-13T07:23:20+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-13T07:23:20+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-13T07:23:20+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-13T07:23:20+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-13T07:23:20+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-13T07:23:20+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-13T07:23:20+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-13T07:23:20+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-13T07:23:21+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-13T07:23:21+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-13T07:23:21+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-13T07:23:21+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-13T07:23:21+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[   73.192693] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[2018-12-13T07:24:05+00:00] INFO: service[kdump] restarted
[2018-12-13T07:24:05+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-13T07:24:05+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-13T07:24:05+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-13T07:24:05+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-13T07:24:05+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-13T07:24:05+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-13T07:24:05+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-13T07:24:05+00:00] INFO: Chef Run complete in 63.385854058 seconds
[2018-12-13T07:24:05+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-13T07:24:05+00:00] INFO: Running report handlers
[2018-12-13T07:24:05+00:00] INFO: Creating JSON run report
[2018-12-13T07:24:05+00:00] INFO: Report handlers complete

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: 
CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: root
Password: 
Last login: Thu Dec 13 07:11:52 on ttyS0
[root@soak-8 ~]# modprobe lustre
[  539.978185] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  539.991347] alg: No test for adler32 (adler32-zlib)
[  540.800321] Lustre: Lustre: Build Version: 2.12.0_RC2
[  540.967453] LNet: Using FMR for registration
[  540.985924] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[root@soak-8 ~]# lctl get_param version
version=2.12.0_RC2
[root@soak-8 ~]# e[K
<ConMan> Console [soak-8] departed by <w3liu@ssh-1> on pts/12 at 12-13 07:31.
[33261.355231] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[33262.475062] Lustre: MGS: Connection restored to b92b05ba-0fb4-d49c-0530-a95d428c004e (at 0@lo)
[33262.927853] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[33262.959918] Lustre: soaked-MDT0000: in recovery but waiting for the first client to connect
[33265.036491] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[33265.345857] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 1 client reconnects
[33267.925508] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[33267.934780] Lustre: Skipped 2 previous similar messages
[33270.693282] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[33270.702553] Lustre: Skipped 1 previous similar message
[33276.110121] Lustre: MGS: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[33276.119419] Lustre: Skipped 2 previous similar messages
[33287.971776] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[33287.972117] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[33287.972119] Lustre: Skipped 3 previous similar messages
[33293.397317] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[33296.105674] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.111@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[33306.535246] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[33306.545618] Lustre: Skipped 5 previous similar messages
[33319.133218] Lustre: soaked-MDT0000: Recovery over after 0:54, of 3 clients 3 recovered and 0 were evicted.
[33340.334694] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[33340.345042] Lustre: Skipped 10 previous similar messages
[33404.421657] Lustre: MGS: Connection restored to 9c3d3ed6-edf5-ce57-b95d-be3fb28d882b (at 192.168.1.144@o2ib)
[33404.432694] Lustre: Skipped 53 previous similar messages
[34324.521237] LNetError: 31407:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[34324.532623] LNetError: 31407:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.107@o2ib (10): c: 5, oc: 0, rc: 8
[34324.546423] Lustre: 31436:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544720053/real 1544720059]  req@ffff971183f35a00 x1619720955997472/t0(0) o13->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544720060 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[34324.546444] Lustre: soaked-OST0007-osc-MDT0000: Connection to soaked-OST0007 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[34324.597281] Lustre: 31436:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[34345.079530] Lustre: 33751:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544720035/real 1544720035]  req@ffff970d985a2400 x1619720955951184/t0(0) o5->soaked-OST0003-osc-MDT0000@192.168.1.107@o2ib:28/4 lens 432/432 e 0 to 1 dl 1544720079 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[34345.111512] LustreError: 33751:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST0003-osc-MDT0000: can't precreate: rc = -11
[34345.124601] LustreError: 33751:0:(osp_precreate.c:1312:osp_precreate_thread()) soaked-OST0003-osc-MDT0000: cannot precreate objects: rc = -11
[34518.017926] LNet: Service thread pid 33897 was inactive for 200.45s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[34518.036887] Pid: 33897, comm: mdt00_014 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[34518.047394] Call Trace:
[34518.050176]  [<ffffffffc17a3bf8>] osp_precreate_reserve+0x2e8/0x800 [osp]
[34518.057818]  [<ffffffffc17988b9>] osp_declare_create+0x199/0x5b0 [osp]
[34518.065149]  [<ffffffffc16e039f>] lod_sub_declare_create+0xdf/0x210 [lod]
[34518.072794]  [<ffffffffc16d856e>] lod_qos_declare_object_on+0xbe/0x3a0 [lod]
[34518.080712]  [<ffffffffc16db50e>] lod_alloc_rr.constprop.19+0xeee/0x1490 [lod]
[34518.088827]  [<ffffffffc16df62d>] lod_qos_prep_create+0x12fd/0x1890 [lod]
[34518.096454]  [<ffffffffc16dfdd5>] lod_prepare_create+0x215/0x2e0 [lod]
[34518.103780]  [<ffffffffc16cfcee>] lod_declare_striped_create+0x1ee/0x980 [lod]
[34518.111868]  [<ffffffffc16d45c4>] lod_declare_create+0x204/0x590 [lod]
[34518.119182]  [<ffffffffc1749ad2>] mdd_declare_create_object_internal+0xe2/0x2f0 [mdd]
[34518.127979]  [<ffffffffc17395ec>] mdd_declare_create+0x4c/0xcb0 [mdd]
[34518.135219]  [<ffffffffc173d6e7>] mdd_create+0x827/0x1440 [mdd]
[34518.141863]  [<ffffffffc15e0660>] mdt_reint_open+0x19d0/0x27d0 [mdt]
[34518.149025]  [<ffffffffc15d35e3>] mdt_reint_rec+0x83/0x210 [mdt]
[34518.155799]  [<ffffffffc15b0133>] mdt_reint_internal+0x6e3/0xaf0 [mdt]
[34518.163117]  [<ffffffffc15bc972>] mdt_intent_open+0x82/0x350 [mdt]
[34518.170067]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[34518.177312]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[34518.184889]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[34518.192850]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[34518.199763]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[34518.207539]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[34518.216161]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[34518.223207]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[34518.228716]  [<ffffffff99774c37>] ret_from_fork_nospec_end+0x0/0x39
[34518.235749]  [<ffffffffffffffff>] 0xffffffffffffffff
[34518.241360] LustreError: dumping log to /tmp/lustre-log.1544720252.33897
[34525.184991] LNet: Service thread pid 33689 was inactive for 200.66s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[34525.203948] Pid: 33689, comm: mdt01_000 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[34525.214463] Call Trace:
[34525.217243]  [<ffffffff99386db7>] call_rwsem_down_write_failed+0x17/0x30
[34525.224790]  [<ffffffffc16dc2f7>] lod_qos_statfs_update+0x97/0x2b0 [lod]
[34525.232339]  [<ffffffffc16de49a>] lod_qos_prep_create+0x16a/0x1890 [lod]
[34525.239899]  [<ffffffffc16dfdd5>] lod_prepare_create+0x215/0x2e0 [lod]
[34525.247248]  [<ffffffffc16cfcee>] lod_declare_striped_create+0x1ee/0x980 [lod]
[34525.255363]  [<ffffffffc16d45c4>] lod_declare_create+0x204/0x590 [lod]
[34525.262684]  [<ffffffffc1749ad2>] mdd_declare_create_object_internal+0xe2/0x2f0 [mdd]
[34525.271466]  [<ffffffffc17395ec>] mdd_declare_create+0x4c/0xcb0 [mdd]
[34525.278686]  [<ffffffffc173d6e7>] mdd_create+0x827/0x1440 [mdd]
[34525.285327]  [<ffffffffc15e0660>] mdt_reint_open+0x19d0/0x27d0 [mdt]
[34525.292492]  [<ffffffffc15d35e3>] mdt_reint_rec+0x83/0x210 [mdt]
[34525.299232]  [<ffffffffc15b0133>] mdt_reint_internal+0x6e3/0xaf0 [mdt]
[34525.306552]  [<ffffffffc15bc972>] mdt_intent_open+0x82/0x350 [mdt]
[34525.313489]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[34525.320711]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[34525.328257]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[34525.336187]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[34525.343060]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[34525.350806]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[34525.359427]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[34525.366476]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[34525.371938]  [<ffffffff99774c37>] ret_from_fork_nospec_end+0x0/0x39
[34525.378947]  [<ffffffffffffffff>] 0xffffffffffffffff
[34525.384538] LustreError: dumping log to /tmp/lustre-log.1544720260.33689
[34536.629652] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST0003_UUID (at 192.168.1.107@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff970dd47a3c00, cur 1544720271 expire 1544720121 last 1544720043
[34537.751825] Lustre: MGS: haven't heard from client 2d7046f1-5015-6d95-75d3-40604294d8b8 (at 192.168.1.107@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffff970daeeacc00, cur 1544720272 expire 1544720122 last 1544720043
[34537.775570] Lustre: Skipped 3 previous similar messages
[34556.716963] INFO: task mdt01_000:33689 blocked for more than 120 seconds.
[34556.724564] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[34556.733314] mdt01_000       D ffff9709f588b0c0     0 33689      2 0x00000080
[34556.741256] Call Trace:
[34556.744008]  [<ffffffff99767bc9>] schedule+0x29/0x70
[34556.749567]  [<ffffffff997694b5>] rwsem_down_write_failed+0x225/0x3a0
[34556.756773]  [<ffffffff99386db7>] call_rwsem_down_write_failed+0x17/0x30
[34556.764268]  [<ffffffff99766ecd>] down_write+0x2d/0x3d
[34556.770034]  [<ffffffffc16dc2f7>] lod_qos_statfs_update+0x97/0x2b0 [lod]
[34556.777548]  [<ffffffffc16de49a>] lod_qos_prep_create+0x16a/0x1890 [lod]
[34556.785072]  [<ffffffffc1316181>] ? qsd_op_begin+0xb1/0x4b0 [lquota]
[34556.792218]  [<ffffffffc1434d10>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
[34556.800208]  [<ffffffffc143525b>] ? osd_declare_inode_qid+0x2ab/0x400 [osd_ldiskfs]
[34556.808785]  [<ffffffffc16dfdd5>] lod_prepare_create+0x215/0x2e0 [lod]
[34556.816102]  [<ffffffffc16cfcee>] lod_declare_striped_create+0x1ee/0x980 [lod]
[34556.824187]  [<ffffffffc16e039f>] ? lod_sub_declare_create+0xdf/0x210 [lod]
[34556.831992]  [<ffffffffc16d45c4>] lod_declare_create+0x204/0x590 [lod]
[34556.839296]  [<ffffffffc16c31b3>] ? lod_striping_from_default+0x93/0x5d0 [lod]
[34556.847415]  [<ffffffffc0d19be9>] ? lu_context_refill+0x19/0x50 [obdclass]
[34556.855126]  [<ffffffffc1749ad2>] mdd_declare_create_object_internal+0xe2/0x2f0 [mdd]
[34556.863896]  [<ffffffffc17395ec>] mdd_declare_create+0x4c/0xcb0 [mdd]
[34556.871095]  [<ffffffffc173d6e7>] mdd_create+0x827/0x1440 [mdd]
[34556.877748]  [<ffffffffc15e0660>] mdt_reint_open+0x19d0/0x27d0 [mdt]
[34556.884872]  [<ffffffffc0d2e518>] ? upcall_cache_get_entry+0x218/0x8b0 [obdclass]
[34556.893253]  [<ffffffffc15d35e3>] mdt_reint_rec+0x83/0x210 [mdt]
[34556.899994]  [<ffffffffc15b0133>] mdt_reint_internal+0x6e3/0xaf0 [mdt]
[34556.907324]  [<ffffffffc15bc706>] ? mdt_intent_fixup_resent+0x36/0x220 [mdt]
[34556.915228]  [<ffffffffc15bc972>] mdt_intent_open+0x82/0x350 [mdt]
[34556.922163]  [<ffffffffc0cf8929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
[34556.930161]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[34556.937372]  [<ffffffffc15bc8f0>] ? mdt_intent_fixup_resent+0x220/0x220 [mdt]
[34556.945408]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[34556.952925]  [<ffffffffc0bdafa3>] ? cfs_hash_bd_add_locked+0x63/0x80 [libcfs]
[34556.960909]  [<ffffffffc0bde72e>] ? cfs_hash_add+0xbe/0x1a0 [libcfs]
[34556.968071]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[34556.976008]  [<ffffffffc0f547f0>] ? lustre_swab_ldlm_lock_desc+0x30/0x30 [ptlrpc]
[34556.984454]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[34556.991327]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[34556.999080]  [<ffffffffc0f93a51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
[34557.007579]  [<ffffffffc0bcfbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
[34557.015505]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[34557.024104]  [<ffffffffc0f5b7b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
[34557.031695]  [<ffffffff990d67c2>] ? default_wake_function+0x12/0x20
[34557.038705]  [<ffffffff990cba9b>] ? __wake_up_common+0x5b/0x90
[34557.045265]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[34557.052313]  [<ffffffffc0f61760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
[34557.060583]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[34557.066039]  [<ffffffff990c1b60>] ? insert_kthread_work+0x40/0x40
[34557.072862]  [<ffffffff99774c37>] ret_from_fork_nospec_begin+0x21/0x21
[34557.080160]  [<ffffffff990c1b60>] ? insert_kthread_work+0x40/0x40
[34557.087016] INFO: task mdt00_028:34762 blocked for more than 120 seconds.
[34557.094611] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[34557.103355] mdt00_028       D ffff970f75998000     0 34762      2 0x00000080
[34557.111284] Call Trace:
[34557.114031]  [<ffffffff99767bc9>] schedule+0x29/0x70
[34557.119588]  [<ffffffff997694b5>] rwsem_down_write_failed+0x225/0x3a0
[34557.126800]  [<ffffffff99386db7>] call_rwsem_down_write_failed+0x17/0x30
[34557.134292]  [<ffffffff99766ecd>] down_write+0x2d/0x3d
[34557.140050]  [<ffffffffc16dc2f7>] lod_qos_statfs_update+0x97/0x2b0 [lod]
[34557.147656]  [<ffffffffc16de49a>] lod_qos_prep_create+0x16a/0x1890 [lod]
[34557.155192]  [<ffffffffc1316181>] ? qsd_op_begin+0xb1/0x4b0 [lquota]
[34557.162317]  [<ffffffffc1434d10>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
[34557.170310]  [<ffffffffc143525b>] ? osd_declare_inode_qid+0x2ab/0x400 [osd_ldiskfs]
[34557.178879]  [<ffffffffc16dfdd5>] lod_prepare_create+0x215/0x2e0 [lod]
[34557.186183]  [<ffffffffc16cfcee>] lod_declare_striped_create+0x1ee/0x980 [lod]
[34557.194268]  [<ffffffffc16e039f>] ? lod_sub_declare_create+0xdf/0x210 [lod]
[34557.202065]  [<ffffffffc16d45c4>] lod_declare_create+0x204/0x590 [lod]
[34557.209371]  [<ffffffffc16c31b3>] ? lod_striping_from_default+0x93/0x5d0 [lod]
[34557.217469]  [<ffffffffc0d19be9>] ? lu_context_refill+0x19/0x50 [obdclass]
[34557.225164]  [<ffffffffc1749ad2>] mdd_declare_create_object_internal+0xe2/0x2f0 [mdd]
[34557.233928]  [<ffffffffc17395ec>] mdd_declare_create+0x4c/0xcb0 [mdd]
[34557.241135]  [<ffffffffc173d6e7>] mdd_create+0x827/0x1440 [mdd]
[34557.247763]  [<ffffffffc15e0660>] mdt_reint_open+0x19d0/0x27d0 [mdt]
[34557.254889]  [<ffffffffc0d2e518>] ? upcall_cache_get_entry+0x218/0x8b0 [obdclass]
[34557.263270]  [<ffffffffc15d35e3>] mdt_reint_rec+0x83/0x210 [mdt]
[34557.269994]  [<ffffffffc15b0133>] mdt_reint_internal+0x6e3/0xaf0 [mdt]
[34557.277307]  [<ffffffffc15bc706>] ? mdt_intent_fixup_resent+0x36/0x220 [mdt]
[34557.285194]  [<ffffffffc15bc972>] mdt_intent_open+0x82/0x350 [mdt]
[34557.292131]  [<ffffffffc0cf8929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
[34557.300119]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[34557.307328]  [<ffffffffc15bc8f0>] ? mdt_intent_fixup_resent+0x220/0x220 [mdt]
[34557.315343]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[34557.322846]  [<ffffffffc0bdafa3>] ? cfs_hash_bd_add_locked+0x63/0x80 [libcfs]
[34557.330837]  [<ffffffffc0bde72e>] ? cfs_hash_add+0xbe/0x1a0 [libcfs]
[34557.337973]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[34557.345894]  [<ffffffffc0f547f0>] ? lustre_swab_ldlm_lock_desc+0x30/0x30 [ptlrpc]
[34557.354298]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[34557.361173]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[34557.368915]  [<ffffffffc0f93a51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
[34557.377414]  [<ffffffffc0bcfbde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
[34557.385325]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[34557.393919]  [<ffffffffc0f5b7b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
[34557.401519]  [<ffffffff990d67c2>] ? default_wake_function+0x12/0x20
[34557.408542]  [<ffffffff990cba9b>] ? __wake_up_common+0x5b/0x90
[34557.415097]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[34557.422164]  [<ffffffffc0f61760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
[34557.430434]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[34557.435885]  [<ffffffff990c1b60>] ? insert_kthread_work+0x40/0x40
[34557.442701]  [<ffffffff99774c37>] ret_from_fork_nospec_begin+0x21/0x21
[34557.450017]  [<ffffffff990c1b60>] ? insert_kthread_work+0x40/0x40
[34579.487954] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds
[34581.487688] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 1 seconds
[34581.499159] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 2 previous similar messages
[34629.481405] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds
[34644.385667] Lustre: MGS: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[34644.394919] Lustre: Skipped 1 previous similar message
[34668.526276] LNet: Service thread pid 34762 was inactive for 250.95s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[34668.545224] Pid: 34762, comm: mdt00_028 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[34668.555739] Call Trace:
[34668.558534]  [<ffffffff99386db7>] call_rwsem_down_write_failed+0x17/0x30
[34668.566066]  [<ffffffffc16dc2f7>] lod_qos_statfs_update+0x97/0x2b0 [lod]
[34668.573601]  [<ffffffffc16de49a>] lod_qos_prep_create+0x16a/0x1890 [lod]
[34668.581142]  [<ffffffffc16dfdd5>] lod_prepare_create+0x215/0x2e0 [lod]
[34668.588466]  [<ffffffffc16cfcee>] lod_declare_striped_create+0x1ee/0x980 [lod]
[34668.596560]  [<ffffffffc16d45c4>] lod_declare_create+0x204/0x590 [lod]
[34668.603876]  [<ffffffffc1749ad2>] mdd_declare_create_object_internal+0xe2/0x2f0 [mdd]
[34668.612670]  [<ffffffffc17395ec>] mdd_declare_create+0x4c/0xcb0 [mdd]
[34668.619899]  [<ffffffffc173d6e7>] mdd_create+0x827/0x1440 [mdd]
[34668.626544]  [<ffffffffc15e0660>] mdt_reint_open+0x19d0/0x27d0 [mdt]
[34668.633697]  [<ffffffffc15d35e3>] mdt_reint_rec+0x83/0x210 [mdt]
[34668.640438]  [<ffffffffc15b0133>] mdt_reint_internal+0x6e3/0xaf0 [mdt]
[34668.647771]  [<ffffffffc15bc972>] mdt_intent_open+0x82/0x350 [mdt]
[34668.654711]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[34668.661924]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[34668.669532]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[34668.677484]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[34668.684389]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[34668.692188]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[34668.700837]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[34668.707918]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[34668.713411]  [<ffffffff99774c37>] ret_from_fork_nospec_end+0x0/0x39
[34668.720447]  [<ffffffffffffffff>] 0xffffffffffffffff
[34668.726089] LustreError: dumping log to /tmp/lustre-log.1544720403.34762
[34673.437075] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[34673.447390] Lustre: Skipped 3 previous similar messages
[34676.794831] LNet: Service thread pid 33897 completed after 359.25s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
[34676.812947] LNet: Skipped 2 previous similar messages
[34716.470045] LNetError: 31407:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[34716.481434] LNetError: 31407:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.104@o2ib (7): c: 4, oc: 0, rc: 8
[34716.495182] Lustre: 31420:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544720444/real 1544720451]  req@ffff970da3273300 x1619720956354384/t0(0) o13->soaked-OST000c-osc-MDT0000@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544720451 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[34716.495207] Lustre: soaked-OST0004-osc-MDT0000: Connection to soaked-OST0004 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[34716.495210] Lustre: Skipped 3 previous similar messages
[34716.551902] Lustre: 31420:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[34722.600034] Lustre: soaked-OST0007-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[34722.611549] Lustre: Skipped 3 previous similar messages
[34727.441387] Lustre: 33689:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[34921.487722] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST0000_UUID (at 192.168.1.104@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9711ec604400, cur 1544720656 expire 1544720506 last 1544720429
[34978.050969] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[35023.429992] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds
[35023.441461] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 3 previous similar messages
[35054.908603] LustreError: 11-0: soaked-OST0008-osc-MDT0000: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107
[35054.921202] Lustre: soaked-OST0008-osc-MDT0000: Connection to soaked-OST0008 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[35054.939873] Lustre: Skipped 2 previous similar messages
[35076.553610] LustreError: 11-0: soaked-OST0000-osc-MDT0000: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107
[35076.566206] Lustre: soaked-OST0000-osc-MDT0000: Connection to soaked-OST0000 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[35081.753072] LustreError: 11-0: soaked-OST0004-osc-MDT0000: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107
[35081.765649] Lustre: soaked-OST0004-osc-MDT0000: Connection to soaked-OST0004 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[35093.671255] LustreError: 11-0: soaked-OST000c-osc-MDT0000: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107
[35093.683845] Lustre: soaked-OST000c-osc-MDT0000: Connection to soaked-OST000c (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[35109.315773] Lustre: soaked-OST000c-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[35109.327259] Lustre: Skipped 15 previous similar messages
[36033.670005] LustreError: 36656:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x2000090a2:0xe3d:0x0]
[36538.231884] LNetError: 31407:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[36538.243265] LNetError: 31407:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.111@o2ib (5): c: 3, oc: 0, rc: 7
[36538.257097] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544722269/real 1544722273]  req@ffff970d973f0900 x1619720964916528/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544722276 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[36538.257117] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[36538.307112] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[36538.756761] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544722273/real 1544722273]  req@ffff970d973f0900 x1619720964916528/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544722280 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[36538.788116] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 3478 previous similar messages
[36539.756684] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544722274/real 1544722274]  req@ffff970d973f0900 x1619720964916528/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544722281 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[36539.788045] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 7955 previous similar messages
[36541.756367] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544722276/real 1544722276]  req@ffff970d973f0900 x1619720964916528/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544722283 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[36541.787710] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 14208 previous similar messages
[36545.755863] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544722280/real 1544722280]  req@ffff970d973f0900 x1619720964916528/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544722287 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[36545.787209] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 34890 previous similar messages
[36553.229921] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 2 seconds
[36553.241400] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[36553.754891] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544722288/real 1544722288]  req@ffff970d973f0900 x1619720964916528/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544722295 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[36553.786251] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 80075 previous similar messages
[36569.752792] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544722304/real 1544722304]  req@ffff970d973f0900 x1619720964916528/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544722311 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[36569.784185] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 168344 previous similar messages
[36601.748520] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544722336/real 1544722336]  req@ffff970d973f0900 x1619720964916528/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544722343 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[36601.779875] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 330054 previous similar messages
[36665.740251] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544722400/real 1544722400]  req@ffff970d973f0900 x1619720964916528/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544722407 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[36665.771626] Lustre: 37102:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 654390 previous similar messages
[36685.655620] LustreError: 37102:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 192.168.1.111@o2ib) failed to reply to completion AST (req@ffff970d973f0900 x1619720964916528 status 0 rc -110), evict it ns: mdt-soaked-MDT0000_UUID lock: ffff971176f8a400/0xeb2b84d89339cab6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 44 type: IBT flags: 0x60000001000020 nid: 192.168.1.111@o2ib remote: 0x2487033a4388e824 expref: 103 pid: 34087 timeout: 0 lvb_type: 0
[36685.703582] LustreError: 138-a: soaked-MDT0000: A client on nid 192.168.1.111@o2ib was evicted due to a lock completion callback time out: rc -110
[36685.718352] LustreError: 33664:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 1544722420s: evicting client at 192.168.1.111@o2ib  ns: mdt-soaked-MDT0000_UUID lock: ffff971176f8a400/0xeb2b84d89339cab6 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 43 type: IBT flags: 0x60000001000020 nid: 192.168.1.111@o2ib remote: 0x2487033a4388e824 expref: 104 pid: 34087 timeout: 0 lvb_type: 0
[36755.485666] Lustre: MGS: haven't heard from client 9ba56a8d-1b81-86c5-5ca6-df70eb786d5c (at 192.168.1.111@o2ib) in 233 seconds. I think it's dead, and I am evicting it. exp ffff9711ec8a3400, cur 1544722490 expire 1544722340 last 1544722257
[36755.509392] Lustre: Skipped 4 previous similar messages
[36794.198563] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[36833.918587] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[36833.931313] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[36844.191905] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[36894.185459] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[36944.178823] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[36995.172288] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 1 seconds
[37044.165732] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[37094.159235] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[37144.974227] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[37145.152782] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.110@o2ib, removing former export from 192.168.1.111@o2ib
[37197.145673] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 1 seconds
[37197.157146] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[37339.312513] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[37339.321799] Lustre: Skipped 1 previous similar message
[37354.127437] LNet: Service thread pid 34219 was inactive for 200.50s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[37354.146399] Pid: 34219, comm: mdt01_018 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[37354.156902] Call Trace:
[37354.159678]  [<ffffffffc0f1d031>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[37354.167480]  [<ffffffffc0f1ddcc>] ldlm_cli_enqueue_local+0x23c/0x870 [ptlrpc]
[37354.175527]  [<ffffffffc15b44ab>] mdt_object_local_lock+0x50b/0xb20 [mdt]
[37354.183217]  [<ffffffffc15b4b30>] mdt_object_lock_internal+0x70/0x3e0 [mdt]
[37354.191068]  [<ffffffffc15b5d1a>] mdt_getattr_name_lock+0x90a/0x1c30 [mdt]
[37354.198805]  [<ffffffffc15bdbb5>] mdt_intent_getattr+0x2b5/0x480 [mdt]
[37354.206146]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[37354.213390]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[37354.220947]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[37354.228920]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[37354.235835]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[37354.243593]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[37354.252228]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[37354.259308]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[37354.264825]  [<ffffffff99774c37>] ret_from_fork_nospec_end+0x0/0x39
[37354.271868]  [<ffffffffffffffff>] 0xffffffffffffffff
[37354.277501] LustreError: dumping log to /tmp/lustre-log.1544723089.34219
[37366.030358] LustreError: 167-0: soaked-MDT0003-osp-MDT0000: This client was evicted by soaked-MDT0003; in progress operations using this service will fail.
[37366.046278] LustreError: 33875:0:(osp_object.c:594:osp_attr_get()) soaked-MDT0003-osp-MDT0000:osp_attr_get update error [0x2c000a040:0x2:0x0]: rc = -5
[37366.061360] LustreError: 33875:0:(osp_object.c:594:osp_attr_get()) Skipped 1 previous similar message
[37370.915071] LNet: Service thread pid 34219 completed after 217.29s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
[37943.657000] LustreError: 33691:0:(mdt_lvb.c:430:mdt_lvbo_fill()) soaked-MDT0000: small buffer size 576 for EA 776 (max_mdsize 776): rc = -34
[38326.532235] Lustre: 37342:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[38790.936457] LNetError: 31407:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[38790.947836] LNetError: 31407:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.105@o2ib (8): c: 4, oc: 0, rc: 8
[38790.961626] Lustre: 31432:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544724521/real 1544724526]  req@ffff970d8b2c4e00 x1619720980369440/t0(0) o13->soaked-OST000d-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544724528 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[38790.961647] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[38791.012543] Lustre: 31432:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 141362 previous similar messages
[39004.717318] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST0005_UUID (at 192.168.1.105@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9711ec62d400, cur 1544724740 expire 1544724590 last 1544724513
[39046.902680] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds
[39046.914166] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 2 previous similar messages
[39093.896545] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds
[39093.908018] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 3 previous similar messages
[39147.889314] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds
[39147.900794] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 3 previous similar messages
[39247.876135] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds
[39247.887608] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 7 previous similar messages
[39307.102868] Lustre: MGS: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[39307.112119] Lustre: Skipped 3 previous similar messages
[39324.163996] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[39324.174330] Lustre: Skipped 5 previous similar messages
[39373.275679] Lustre: soaked-OST000d-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[39373.287177] Lustre: Skipped 1 previous similar message
[39399.897960] LustreError: 36659:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x2000090a2:0xc3d9:0x0]
[41466.841314] LustreError: 38507:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x2000090be:0x12b3d:0x0]
[41926.586069] Lustre: 33874:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[42609.432229] LNetError: 31407:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[42609.443604] LNetError: 31407:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.110@o2ib (5): c: 6, oc: 0, rc: 8
[42609.457422] Lustre: 31429:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544728342/real 1544728345]  req@ffff970da9843000 x1619721072324400/t0(0) o41->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544728349 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[42609.489800] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[42609.508449] Lustre: Skipped 3 previous similar messages
[42682.695493] LustreError: 44566:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x2000090c5:0xff29:0x0]
[42829.842145] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0002-mdtlov_UUID (at 192.168.1.110@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9711eca52c00, cur 1544728565 expire 1544728415 last 1544728338
[42829.865994] Lustre: Skipped 4 previous similar messages
[42829.871996] LustreError: 34767:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff97119c21f500 x1619721074872880/t0(0) o105->soaked-MDT0000@192.168.1.110@o2ib:15/16 lens 304/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
[42834.307635] Lustre: MGS: haven't heard from client 5144539d-12a1-f17b-e0cc-e89759b2c0cf (at 192.168.1.110@o2ib) in 231 seconds. I think it's dead, and I am evicting it. exp ffff970daeead800, cur 1544728570 expire 1544728420 last 1544728339
[42852.464703] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[42852.550551] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.111@o2ib, removing former export from 192.168.1.110@o2ib
[42866.398365] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds
[42866.409840] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 7 previous similar messages
[42916.391803] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds
[42967.385091] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds
[43060.638789] LNet: Service thread pid 33829 was inactive for 200.41s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[43060.657758] Pid: 33829, comm: mdt00_004 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[43060.668254] Call Trace:
[43060.671040]  [<ffffffffc0f1d031>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[43060.678847]  [<ffffffffc0f1ddcc>] ldlm_cli_enqueue_local+0x23c/0x870 [ptlrpc]
[43060.686911]  [<ffffffffc15b44ab>] mdt_object_local_lock+0x50b/0xb20 [mdt]
[43060.694582]  [<ffffffffc15b4b30>] mdt_object_lock_internal+0x70/0x3e0 [mdt]
[43060.702421]  [<ffffffffc15b5d1a>] mdt_getattr_name_lock+0x90a/0x1c30 [mdt]
[43060.710157]  [<ffffffffc15bdbb5>] mdt_intent_getattr+0x2b5/0x480 [mdt]
[43060.717507]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[43060.724738]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[43060.732304]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[43060.740269]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[43060.747176]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[43060.754921]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[43060.763541]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[43060.770631]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[43060.776104]  [<ffffffff99774c37>] ret_from_fork_nospec_end+0x0/0x39
[43060.783122]  [<ffffffffffffffff>] 0xffffffffffffffff
[43060.788724] LustreError: dumping log to /tmp/lustre-log.1544728796.33829
[43061.892802] LNet: Service thread pid 34096 was inactive for 200.64s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[43061.911765] Pid: 34096, comm: mdt01_016 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[43061.922275] Call Trace:
[43061.925055]  [<ffffffffc0f45890>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc]
[43061.932477]  [<ffffffffc0f45ce3>] ptlrpc_queue_wait+0x83/0x230 [ptlrpc]
[43061.939958]  [<ffffffffc17b4aa3>] osp_remote_sync+0xd3/0x200 [osp]
[43061.946944]  [<ffffffffc179ac63>] osp_attr_get+0x463/0x730 [osp]
[43061.953703]  [<ffffffffc17978cd>] osp_object_init+0x16d/0x2d0 [osp]
[43061.960728]  [<ffffffffc0d18fd5>] lu_object_alloc+0xe5/0x320 [obdclass]
[43061.968183]  [<ffffffffc0d192e6>] lu_object_find_at+0x76/0x280 [obdclass]
[43061.975806]  [<ffffffffc0d19506>] lu_object_find+0x16/0x20 [obdclass]
[43061.983036]  [<ffffffffc15b2fbb>] mdt_object_find+0x4b/0x170 [mdt]
[43061.989999]  [<ffffffffc15b5c58>] mdt_getattr_name_lock+0x848/0x1c30 [mdt]
[43061.997715]  [<ffffffffc15bdbb5>] mdt_intent_getattr+0x2b5/0x480 [mdt]
[43062.005051]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[43062.012272]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[43062.019824]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[43062.027749]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[43062.034625]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[43062.042359]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[43062.050964]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[43062.058005]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[43062.063472]  [<ffffffff99774c37>] ret_from_fork_nospec_end+0x0/0x39
[43062.070491]  [<ffffffffffffffff>] 0xffffffffffffffff
[43062.076096] Pid: 37503, comm: mdt01_028 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[43062.086583] Call Trace:
[43062.089321]  [<ffffffffc0f1d031>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[43062.097038]  [<ffffffffc0f1ddcc>] ldlm_cli_enqueue_local+0x23c/0x870 [ptlrpc]
[43062.105043]  [<ffffffffc15b43d8>] mdt_object_local_lock+0x438/0xb20 [mdt]
[43062.112652]  [<ffffffffc15b4b30>] mdt_object_lock_internal+0x70/0x3e0 [mdt]
[43062.120457]  [<ffffffffc15b642d>] mdt_getattr_name_lock+0x101d/0x1c30 [mdt]
[43062.128262]  [<ffffffffc15bdbb5>] mdt_intent_getattr+0x2b5/0x480 [mdt]
[43062.135568]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[43062.142786]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[43062.150306]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[43062.158214]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[43062.165061]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[43062.172782]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[43062.181378]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[43062.188420]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[43062.193889]  [<ffffffff99774c37>] ret_from_fork_nospec_end+0x0/0x39
[43062.200904]  [<ffffffffffffffff>] 0xffffffffffffffff
[43062.206482] Pid: 33837, comm: mdt01_004 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[43062.216964] Call Trace:
[43062.219705]  [<ffffffffc0f1d031>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[43062.227425]  [<ffffffffc0f1ddcc>] ldlm_cli_enqueue_local+0x23c/0x870 [ptlrpc]
[43062.235437]  [<ffffffffc15b44ab>] mdt_object_local_lock+0x50b/0xb20 [mdt]
[43062.243044]  [<ffffffffc15b4b30>] mdt_object_lock_internal+0x70/0x3e0 [mdt]
[43062.250837]  [<ffffffffc15b5d1a>] mdt_getattr_name_lock+0x90a/0x1c30 [mdt]
[43062.258538]  [<ffffffffc15bdbb5>] mdt_intent_getattr+0x2b5/0x480 [mdt]
[43062.265853]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[43062.273072]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[43062.280588]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[43062.288487]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[43062.295334]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[43062.303063]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[43062.311653]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[43062.318697]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[43062.324170]  [<ffffffff99774c37>] ret_from_fork_nospec_end+0x0/0x39
[43062.331177]  [<ffffffffffffffff>] 0xffffffffffffffff
[43063.710409] LNet: Service thread pid 38668 was inactive for 200.44s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[43063.729355] LNet: Skipped 2 previous similar messages
[43063.735017] Pid: 38668, comm: mdt01_033 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[43063.745516] Call Trace:
[43063.748269]  [<ffffffffc0f1d031>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[43063.756049]  [<ffffffffc0f1ddcc>] ldlm_cli_enqueue_local+0x23c/0x870 [ptlrpc]
[43063.764092]  [<ffffffffc15b44ab>] mdt_object_local_lock+0x50b/0xb20 [mdt]
[43063.771716]  [<ffffffffc15b4b30>] mdt_object_lock_internal+0x70/0x3e0 [mdt]
[43063.779519]  [<ffffffffc15b5d1a>] mdt_getattr_name_lock+0x90a/0x1c30 [mdt]
[43063.787241]  [<ffffffffc15bdbb5>] mdt_intent_getattr+0x2b5/0x480 [mdt]
[43063.794567]  [<ffffffffc15baa18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[43063.801795]  [<ffffffffc0f03ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[43063.809318]  [<ffffffffc0f2c8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[43063.817256]  [<ffffffffc0fb3302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[43063.824135]  [<ffffffffc0fba35a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[43063.831886]  [<ffffffffc0f5e92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[43063.840496]  [<ffffffffc0f6225c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[43063.847565]  [<ffffffff990c1c31>] kthread+0xd1/0xe0
[43063.853042]  [<ffffffff99774c37>] ret_from_fork_nospec_end+0x0/0x39
[43063.860059]  [<ffffffffffffffff>] 0xffffffffffffffff
[43063.865623] LustreError: dumping log to /tmp/lustre-log.1544728799.38668
[43065.424374] Lustre: MGS: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[43065.433654] Lustre: Skipped 1 previous similar message
[43068.317770] LNet: Service thread pid 37342 was inactive for 200.56s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
[43068.332151] LustreError: dumping log to /tmp/lustre-log.1544728804.37342
[43160.156614] LustreError: 37503:0:(ldlm_request.c:129:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1544728596, 300s ago); not entering recovery in server code, just going back to sleep ns: mdt-soaked-MDT0000_UUID lock: ffff97116f601680/0xeb2b84d8a790c02a lrc: 3/1,0 mode: --/CR res: [0x2000032eb:0x4:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 37503 timeout: 0 lvb_type: 0
[43160.200932] LustreError: dumping log to /tmp/lustre-log.1544728896.37503
[43161.358323] LNet: Service thread pid 38668 completed after 298.10s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
[43161.361928] LustreError: 167-0: soaked-MDT0002-osp-MDT0000: This client was evicted by soaked-MDT0002; in progress operations using this service will fail.
[43161.362014] LustreError: 37342:0:(osp_object.c:594:osp_attr_get()) soaked-MDT0002-osp-MDT0000:osp_attr_get update error [0x2800088d1:0x1:0x0]: rc = -5
[43161.364585] Lustre: soaked-MDT0002-osp-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[43161.364587] Lustre: Skipped 2 previous similar messages
[43161.424236] LNet: Skipped 5 previous similar messages
[43648.295428] LNetError: 31407:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[43648.306808] LNetError: 31407:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.111@o2ib (5): c: 5, oc: 0, rc: 8
[43648.320642] Lustre: 31446:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544729381/real 1544729384]  req@ffff97116cb5a700 x1619721080515344/t0(0) o41->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544729388 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[43648.352989] Lustre: 31446:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 237 previous similar messages
[43648.364083] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[43648.820168] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544729384/real 1544729384]  req@ffff971145bd3f00 x1619721080515168/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544729391 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[43648.851533] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 3893 previous similar messages
[43649.820058] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544729385/real 1544729385]  req@ffff971145bd3f00 x1619721080515168/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544729392 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[43649.851436] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 8340 previous similar messages
[43651.819813] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544729387/real 1544729387]  req@ffff971145bd3f00 x1619721080515168/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544729394 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[43651.851211] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 17595 previous similar messages
[43655.819272] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544729391/real 1544729391]  req@ffff971145bd3f00 x1619721080515168/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544729398 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[43655.850640] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 36254 previous similar messages
[43663.818235] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544729399/real 1544729399]  req@ffff971145bd3f00 x1619721080515168/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544729406 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[43663.849607] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 71355 previous similar messages
[43679.816126] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544729415/real 1544729415]  req@ffff971145bd3f00 x1619721080515168/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544729422 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[43679.847479] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 154073 previous similar messages
[43711.811898] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544729447/real 1544729447]  req@ffff971145bd3f00 x1619721080515168/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544729454 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[43711.843260] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 290219 previous similar messages
[43775.803442] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544729511/real 1544729511]  req@ffff971145bd3f00 x1619721080515168/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544729518 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[43775.834795] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 582201 previous similar messages
[43792.276268] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 1 seconds
[43792.287740] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[43857.467528] Lustre: MGS: haven't heard from client fb7894ed-0714-b6ef-6554-9660f19999dd (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff970a68f1a000, cur 1544729593 expire 1544729443 last 1544729366
[43882.264494] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[43908.261065] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544729637/real 1544729637]  req@ffff971145bd3f00 x1619721080515168/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544729644 ref 1 fl Rpc:X/2/ffffffff rc 0/-1
[43908.292046] Lustre: 37186:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 828253 previous similar messages
[43915.400622] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[43916.027211] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.111@o2ib, removing former export from same NID
[44014.858582] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[44014.870103] Lustre: Skipped 2 previous similar messages
[45282.079990] LNetError: 31407:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[45282.091373] LNetError: 31407:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.111@o2ib (9): c: 6, oc: 0, rc: 8
[45282.105158] Lustre: 31451:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544731012/real 1544731018]  req@ffff97113f63e000 x1619721085813984/t0(0) o41->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544731056 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[45282.137483] Lustre: 31451:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[45282.148309] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[45497.263308] Lustre: MGS: haven't heard from client 3b4a9a04-0b38-120e-c3c5-acb4ce4f0819 (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff970a682c8800, cur 1544731233 expire 1544731083 last 1544731006
[45525.637333] Lustre: 37504:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[45538.046412] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[45538.057889] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 10 previous similar messages
[45589.039789] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[45639.033027] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[45690.026381] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 1 seconds
[45739.019892] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[45789.013402] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[45890.000150] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[45890.011621] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[45958.467735] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.110@o2ib, removing former export from 192.168.1.111@o2ib
[45958.481210] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[45959.457642] LustreError: 167-0: soaked-MDT0003-osp-MDT0000: This client was evicted by soaked-MDT0003; in progress operations using this service will fail.
[45964.480714] LustreError: 11-0: soaked-MDT0003-osp-MDT0000: operation mds_statfs to node 192.168.1.110@o2ib failed: rc = -107
[45964.493303] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[45965.001455] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[45965.010716] Lustre: Skipped 2 previous similar messages
[46009.626564] LustreError: 167-0: soaked-MDT0003-osp-MDT0000: This client was evicted by soaked-MDT0003; in progress operations using this service will fail.
[46009.642439] LustreError: 37503:0:(osp_object.c:594:osp_attr_get()) soaked-MDT0003-osp-MDT0000:osp_attr_get update error [0x2c000b7b1:0x1:0x0]: rc = -5
[46009.645710] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[46009.645712] Lustre: Skipped 2 previous similar messages
[46009.674798] LustreError: 37503:0:(osp_object.c:594:osp_attr_get()) Skipped 2 previous similar messages
[47709.760259] LNetError: 31407:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[47709.771644] LNetError: 31407:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.107@o2ib (8): c: 0, oc: 0, rc: 8
[47709.785278] Lustre: 31430:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544733439/real 1544733446]  req@ffff970d936e4200 x1619721185260560/t0(0) o13->soaked-OST000f-osc-MDT0000@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544733446 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[47709.785320] Lustre: soaked-OST0007-osc-MDT0000: Connection to soaked-OST0007 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[47709.836150] Lustre: 31430:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 32 previous similar messages
[47924.031418] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST0003_UUID (at 192.168.1.107@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff970a64efb000, cur 1544733660 expire 1544733510 last 1544733433
[47930.291712] Lustre: MGS: haven't heard from client d2874fec-faf4-09ec-f65d-ece42afc0048 (at 192.168.1.107@o2ib) in 233 seconds. I think it's dead, and I am evicting it. exp ffff970dea29ac00, cur 1544733666 expire 1544733516 last 1544733433
[47930.315506] Lustre: Skipped 3 previous similar messages
[47970.231313] Lustre: soaked-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[47989.177348] Lustre: soaked-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[48014.720215] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds
[48014.731682] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[48019.405074] Lustre: soaked-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[48030.917435] Lustre: soaked-OST000f-osc-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[48044.982783] Lustre: soaked-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[48054.706280] Lustre: soaked-OST0007-osc-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[48063.478741] LustreError: 11-0: soaked-OST000b-osc-MDT0000: operation ost_destroy to node 192.168.1.106@o2ib failed: rc = -19
[48063.478767] Lustre: soaked-OST000b-osc-MDT0000: Connection to soaked-OST000b (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[48063.478770] Lustre: Skipped 3 previous similar messages
[48063.515747] LustreError: Skipped 1 previous similar message
[48064.437619] LustreError: 11-0: soaked-OST000b-osc-MDT0000: operation ost_create to node 192.168.1.106@o2ib failed: rc = -19
[48064.450107] LustreError: 33767:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST000b-osc-MDT0000: can't precreate: rc = -19
[48064.463138] LustreError: 33767:0:(osp_precreate.c:1312:osp_precreate_thread()) soaked-OST000b-osc-MDT0000: cannot precreate objects: rc = -19
[48086.711968] LNetError: 184:0:(o2iblnd_cb.c:2935:kiblnd_rejected()) 192.168.1.107@o2ib rejected: o2iblnd fatal error
[48087.178108] Lustre: MGS: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[48087.187349] Lustre: Skipped 2 previous similar messages
[48089.234737] LustreError: 11-0: soaked-OST0003-osc-MDT0000: operation ost_create to node 192.168.1.106@o2ib failed: rc = -19
[48089.247193] Lustre: soaked-OST0003-osc-MDT0000: Connection to soaked-OST0003 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[48089.265872] LustreError: 33751:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST0003-osc-MDT0000: can't precreate: rc = -19
[48089.278897] LustreError: 33751:0:(osp_precreate.c:1312:osp_precreate_thread()) soaked-OST0003-osc-MDT0000: cannot precreate objects: rc = -19
[48101.031421] LustreError: 11-0: soaked-OST000f-osc-MDT0000: operation ost_statfs to node 192.168.1.106@o2ib failed: rc = -107
[48101.044037] Lustre: soaked-OST000f-osc-MDT0000: Connection to soaked-OST000f (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[48105.318675] LustreError: 11-0: soaked-OST0007-osc-MDT0000: operation ost_statfs to node 192.168.1.106@o2ib failed: rc = -107
[48105.331222] Lustre: soaked-OST0007-osc-MDT0000: Connection to soaked-OST0007 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[48121.435665] Lustre: soaked-OST0007-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[48121.447176] Lustre: Skipped 6 previous similar messages
[48251.503768] Lustre: soaked-OST000b-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[48685.631796] LNetError: 31407:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[48685.643168] LNetError: 31407:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.104@o2ib (9): c: 0, oc: 0, rc: 8
[48685.656905] Lustre: 31445:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544734416/real 1544734422]  req@ffff97110dfc8300 x1619721199762448/t0(0) o13->soaked-OST0000-osc-MDT0000@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544734423 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[48685.656930] Lustre: soaked-OST0008-osc-MDT0000: Connection to soaked-OST0008 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[48685.707770] Lustre: 31445:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 35 previous similar messages
[48895.748310] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST0008_UUID (at 192.168.1.104@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff970a68454000, cur 1544734632 expire 1544734482 last 1544734405
[48896.815035] Lustre: MGS: haven't heard from client cbbcc10a-2f39-82ff-9af0-deecffcf6984 (at 192.168.1.104@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff970da591b800, cur 1544734633 expire 1544734483 last 1544734405
[48896.838989] Lustre: Skipped 3 previous similar messages
[48988.592116] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 11 seconds
[48988.603686] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[48991.591717] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds
[48991.603184] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[49037.585551] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 9 seconds
[49037.597023] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[49087.579062] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 9 seconds
[49087.590540] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 3 previous similar messages
[49124.682806] Lustre: 33837:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[49137.572439] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 9 seconds
[49137.583900] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 3 previous similar messages
[49138.870648] Lustre: MGS: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[49161.160100] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[49161.170448] Lustre: Skipped 3 previous similar messages
[49296.201252] Lustre: soaked-OST0008-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[49296.212770] Lustre: Skipped 1 previous similar message
[49334.721174] perf: interrupt took too long (2504 > 2500), lowering kernel.perf_event_max_sample_rate to 79000
[50628.376085] LNetError: 31407:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[50628.387496] LNetError: 31407:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.105@o2ib (7): c: 0, oc: 0, rc: 8
[50628.401222] Lustre: 31433:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544736359/real 1544736365]  req@ffff970d3125f200 x1619721211040960/t0(0) o13->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544736366 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[50628.401232] Lustre: soaked-OST000d-osc-MDT0000: Connection to soaked-OST000d (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[50628.401235] Lustre: Skipped 3 previous similar messages
[50628.401885] LustreError: 33763:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST0009-osc-MDT0000: can't precreate: rc = -5
[50628.401893] LustreError: 33763:0:(osp_precreate.c:1312:osp_precreate_thread()) soaked-OST0009-osc-MDT0000: cannot precreate objects: rc = -5
[50628.484978] Lustre: 31433:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 38 previous similar messages
[50829.372706] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST0005_UUID (at 192.168.1.105@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff970daa89e800, cur 1544736566 expire 1544736416 last 1544736339
[50878.684390] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[50878.694750] Lustre: Skipped 2 previous similar messages
[50879.343083] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 3 seconds
[50884.342592] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds
[50884.354061] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[50901.651485] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[50931.589509] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[50934.335898] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds
[50934.347375] LNet: 31407:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[50968.221624] Lustre: soaked-OST000d-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[50968.233115] Lustre: Skipped 1 previous similar message
[51035.757564] Lustre: soaked-OST0009-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[51105.020001] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[51105.038692] Lustre: Skipped 3 previous similar messages
[51123.139653] LustreError: 11-0: soaked-OST0001-osc-MDT0000: operation ost_destroy to node 192.168.1.104@o2ib failed: rc = -107
[51123.139677] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[51123.170949] LustreError: Skipped 1 previous similar message
[51133.447401] LustreError: 11-0: soaked-OST0005-osc-MDT0000: operation ost_destroy to node 192.168.1.104@o2ib failed: rc = -107
[51133.447461] Lustre: soaked-OST0005-osc-MDT0000: Connection to soaked-OST0005 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[51133.478679] LustreError: Skipped 1 previous similar message
[51140.804471] LustreError: 11-0: soaked-OST000d-osc-MDT0000: operation ost_create to node 192.168.1.104@o2ib failed: rc = -107
[51140.817105] LustreError: 33771:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST000d-osc-MDT0000: can't precreate: rc = -107
[52724.743184] Lustre: 33837:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[53108.055868] perf: interrupt took too long (3196 > 3130), lowering kernel.perf_event_max_sample_rate to 62000
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00H                                                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [m[4;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[4;79H[m[7m[5;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [5;79H[22;1H   The selected entry will be started automatically in 5s.                     [5;79H[22;1H   The selected entry will be started automatically in 4s.                     [5;79H[22;1H   The selected entry will be started automatically in 3s.                     [5;79H[22;1H   The selected entry will be started automatically in 2s.                     [5;79H[22;1H   The selected entry will be started automatically in 1s.                     [5;79H[22;1H   The selected entry will be started automatically in 0s.                     [5;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-309-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Sat Dec 8 05:53:16 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x35bfe000-0x36df6fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 162MB of memory at 688MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff8cf52e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 7011916k/34603008k available (7664k kernel code, 1126748k absent, 830688k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.281 MHz processor
[    0.000176] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.56 BogoMIPS (lpj=2693281)
[    0.012052] pid_max: default: 245760 minimum: 1920
[    0.018267] Security Framework initialized
[    0.022860] SELinux:  Initializing.
[    0.027041] Yama: becoming mindful.
[    0.036233] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.058023] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.071920] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.079706] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.090003] Initializing cgroup subsys memory
[    0.094936] Initializing cgroup subsys devices
[    0.099905] Initializing cgroup subsys freezer
[    0.104872] Initializing cgroup subsys net_cls
[    0.109840] Initializing cgroup subsys blkio
[    0.114615] Initializing cgroup subsys perf_event
[    0.119923] Initializing cgroup subsys hugetlb
[    0.125095] Initializing cgroup subsys pids
[    0.129771] Initializing cgroup subsys net_prio
[    0.135115] mce: CPU supports 20 MCE banks
[    0.139716] CPU0: Thermal monitoring enabled (TM1)
[    0.145146] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.151278] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.157603] tlb_flushall_shift: 6
[    0.161385] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.172124] FEATURE SPEC_CTRL Present
[    0.176220] FEATURE IBPB_SUPPORT Present
[    0.180911] Spectre V2 : Mitigation: Full retpoline
[    0.187081] Freeing SMP alternatives: 28k freed
[    0.198377] ACPI: Core revision 20130517
[    0.293716] ACPI: All ACPI Tables successfully acquired
[    0.315605] ftrace: allocating 29187 entries in 115 pages
[    0.376203] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.383591] Switched APIC routing to physical flat.
[    0.389756] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.406459] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.416952] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.428722] ... version:                3
[    0.433199] ... bit width:              48
[    0.437773] ... generic registers:      4
[    0.442251] ... value mask:             0000ffffffffffff
[    0.448181] ... max period:             00007fffffffffff
[    0.454114] ... fixed-purpose events:   3
[    0.458591] ... event mask:             000000070000000f
[    0.472889] smpboot: Booting Node   0, Processors  #1[    0.494301] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.549161] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.688240] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.730149] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.770865] Brought up 32 CPUs
[    0.774476] smpboot: Max logical packages: 15
[    0.779350] smpboot: Total of 32 processors activated (172566.78 BogoMIPS)
[    1.036626] node 0 initialised, 2808669 pages in 136ms
[    1.074420] node 1 initialised, 3599741 pages in 168ms
[    1.081387] devtmpfs: initialized
[    1.096369] EVM: security.selinux
[    1.100075] EVM: security.ima
[    1.103391] EVM: security.capability
[    1.107647] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.116511] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.128876] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.136564] pinctrl core: initialized pinctrl subsystem
[    1.142694] RTC time: 22:15:38, date: 12/13/18
[    1.148162] NET: Registered protocol family 16
[    1.153625] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.162081] ACPI: bus type PCI registered
[    1.166561] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.174401] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.184792] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.192417] PCI: Using configuration type 1 for base access
[    1.198682] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.219310] ACPI: Added _OSI(Module Device)
[    1.223987] ACPI: Added _OSI(Processor Device)
[    1.228951] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.234203] ACPI: Added _OSI(Processor Aggregator Device)
[    1.240235] ACPI: Added _OSI(Linux-Dell-Video)
[    1.284885] ACPI: Executed 1 blocks of module-level executable AML code
[    1.574434] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.607589] ACPI: Interpreter enabled
[    1.611712] ACPI: (supports S0 S1 S5)
[    1.615802] ACPI: Using IOAPIC for interrupt routing
[    1.621469] HEST: Table parsing has been initialized.
[    1.627115] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.637393] ACPI: GPE 0x1E active on init
[    1.641913] ACPI: GPE 0x24 active on init
[    1.646415] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.712051] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.718956] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.728613] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.737102] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.745658] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.755081] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.766744] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.781607] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.796850] PCI host bridge to bus 0000:00
[    1.801430] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.808333] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.816693] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.825053] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.833411] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.841771] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.850128] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.858486] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.866846] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.875205] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.883563] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.891921] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.900280] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.908640] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.917000] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.926136] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.932802] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.939434] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.946078] pci 0000:00:02.0: System wakeup disabled by ACPI
[    1.952715] pci 0000:00:02.2: System wakeup disabled by ACPI
[    1.959349] pci 0000:00:03.0: System wakeup disabled by ACPI
[    1.969580] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    1.976248] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    1.982871] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    1.989536] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    1.996100] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.003391] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.009126] acpiphp: Slot [2] registered
[    2.013801] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.024126] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.034805] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.045140] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.055809] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.066133] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.076802] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.087124] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.099448] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.105511] acpiphp: Slot [2-2] registered
[    2.112585] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.118329] acpiphp: Slot [2-3] registered
[    2.122947] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.128679] acpiphp: Slot [2-4] registered
[    2.133589] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.139503] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.152304] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.157984] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.163982] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.170394] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.176090] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.185098] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.193003] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.200923] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.208827] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.216722] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.224614] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.232509] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.240409] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.248512] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.255422] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.264834] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.273161] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.281714] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.291290] PCI host bridge to bus 0000:80
[    2.295871] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.303454] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.311036] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.319393] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.327753] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.336886] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.343259] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.349880] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.356484] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.363084] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.371938] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.377589] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.383228] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.388869] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.405429] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.412049] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.421242] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.430911] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.437911] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.447168] PCI host bridge to bus 0000:7f
[    2.451748] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.462370] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.468990] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.478182] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.487852] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.494856] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.504129] PCI host bridge to bus 0000:ff
[    2.508710] pci_bus 0000:ff: root bus resource [bus ff]
[    2.519931] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.528993] vgaarb: loaded
[    2.532017] vgaarb: bridge control possible 0000:09:00.0
[    2.538395] SCSI subsystem initialized
[    2.542646] ACPI: bus type USB registered
[    2.547170] usbcore: registered new interface driver usbfs
[    2.553312] usbcore: registered new interface driver hub
[    2.559530] usbcore: registered new device driver usb
[    2.565719] EDAC MC: Ver: 3.0.0
[    2.569773] PCI: Using ACPI for IRQ routing
[    2.582058] NetLabel: Initializing
[    2.585860] NetLabel:  domain hash size = 128
[    2.590724] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.596318] NetLabel:  unlabeled traffic allowed by default
[    2.602873] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.609886] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.618449] amd_nb: Cannot enumerate AMD northbridges
[    2.624301] Switched to clocksource hpet
[    2.643242] pnp: PnP ACPI init
[    2.646684] ACPI: bus type PNP registered
[    2.651471] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.658096] system 00:00: [io  0xffff] has been reserved
[    2.664035] system 00:00: [io  0xffff] has been reserved
[    2.669976] system 00:00: [io  0xffff] has been reserved
[    2.675916] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.682913] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.689530] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.696149] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.702766] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.709763] system 00:00: [io  0x0cf9] could not be reserved
[    2.716310] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.724471] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.731870] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.739269] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.746662] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.754059] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.761451] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.769232] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.777012] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.784793] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.792701] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.801008] pnp: PnP ACPI: found 7 devices
[    2.805591] ACPI: bus type PNP unregistered
[    2.819639] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.825209] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.831052] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.837865] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.845457] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.851011] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.858600] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.868033] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.873594] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.879144] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.885961] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.893556] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.899105] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    2.905919] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    2.913507] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    2.922940] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.928508] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.934062] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    2.941656] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    2.950313] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    2.956098] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.961661] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.967220] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.972785] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.978714] NET: Registered protocol family 2
[    2.985734] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    2.994904] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.002652] TCP: Hash tables configured (established 262144 bind 65536)
[    3.010142] TCP: reno registered
[    3.013913] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.021075] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.029763] NET: Registered protocol family 1
[    4.134402] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.242489] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.250994] Unpacking initramfs...
[    5.814520] Freeing initrd memory: 18404k freed
[    5.826686] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.833908] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff8cf1b73c7000-ffff8cf1bb3c6fff]
[    5.845379] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    5.854231] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    5.860658] RAPL PMU: hw unit of domain package 2^-16 Joules
[    5.866985] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    5.886110] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    5.892953] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    5.906873] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    5.915144] Initialise system trusted keyring
[    5.920151] audit: initializing netlink socket (disabled)
[    5.926228] type=2000 audit(1544739339.455:1): initialized
[    5.988142] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    5.995249] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.005531] zpool: loaded
[    6.008475] zbud: loaded
[    6.012498] VFS: Disk quotas dquot_6.6.0
[    6.017387] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.026074] msgmni has been set to 32768
[    6.030848] Key type big_key registered
[    6.037776] NET: Registered protocol family 38
[    6.042762] Key type asymmetric registered
[    6.047358] Asymmetric key parser 'x509' registered
[    6.052967] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.061503] io scheduler noop registered
[    6.065897] io scheduler deadline registered (default)
[    6.071781] io scheduler cfq registered
[    6.076068] io scheduler mq-deadline registered
[    6.081137] io scheduler kyber registered
[    6.091508] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.099329] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.107122] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.114428] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.121724] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.129032] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.136366] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.144154] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.151487] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.159308] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.167094] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.174428] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.182213] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.189514] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.196850] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.204670] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.212453] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.219797] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.227617] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.235440] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.243256] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.251168] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.257418] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.264865] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.273185] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.281470] ACPI: Power Button [PWRF]
[    6.285656] ACPI: Requesting acpi_cpufreq
[    6.373176] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.381606] pstore: Registered erst as persistent store backend
[    6.388547] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.397045] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.424926] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.452045] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.459351] Non-volatile memory driver v1.3
[    6.464119] Linux agpgart interface v0.103
[    6.469131] crash memory driver: version 1.1
[    6.474399] rdac: device handler registered
[    6.479159] hp_sw: device handler registered
[    6.483953] emc: device handler registered
[    6.488823] alua: device handler registered
[    6.493617] libphy: Fixed MDIO Bus: probed
[    6.498287] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.505616] ehci-pci: EHCI PCI platform driver
[    6.511051] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.517018] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.525316] ehci-pci 0000:00:1a.0: debug port 2
[    6.534389] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.546606] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.553128] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.560718] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.568788] usb usb1: Product: EHCI Host Controller
[    6.574252] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.582424] usb usb1: SerialNumber: 0000:00:1a.0
[    6.587833] hub 1-0:1.0: USB hub found
[    6.592043] hub 1-0:1.0: 2 ports detected
[    6.597106] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    6.603044] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    6.611340] ehci-pci 0000:00:1d.0: debug port 2
[    6.620366] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    6.632611] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    6.639138] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    6.646728] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.654799] usb usb2: Product: EHCI Host Controller
[    6.660258] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.668436] usb usb2: SerialNumber: 0000:00:1d.0
[    6.673817] hub 2-0:1.0: USB hub found
[    6.678028] hub 2-0:1.0: 2 ports detected
[    6.682774] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    6.689714] ohci-pci: OHCI PCI platform driver
[    6.694735] uhci_hcd: USB Universal Host Controller Interface driver
[    6.701987] usbcore: registered new interface driver usbserial_generic
[    6.709306] usbserial: USB Serial support registered for generic
[    6.716097] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    6.880644] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    7.768596] i8042: No controller found
[    7.772857] Switched to clocksource tsc
[    7.772934] mousedev: PS/2 mouse device common for all mice
[    7.773131] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    7.773195] rtc_cmos 00:01: RTC can wake from S4
[    7.773445] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    7.773502] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    7.773638] intel_pstate: Intel P-state driver initializing
[    7.785367] cpuidle: using governor menu
[    7.786923] hidraw: raw HID events driver (C) Jiri Kosina
[    7.787183] usbcore: registered new interface driver usbhid
[    7.787183] usbhid: USB HID core driver
[    7.787409] drop_monitor: Initializing network drop monitor service
[    7.788011] TCP: cubic registered
[    7.788022] Initializing XFRM netlink socket
[    7.788716] NET: Registered protocol family 10
[    7.790354] NET: Registered protocol family 17
[    7.790369] mpls_gso: MPLS GSO support
[    7.792143] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    7.796168] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    7.796412] Loading compiled-in X.509 certificates
[    7.797526] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    7.798605] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    7.799645] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: d73e894149b8945b8dc07cc18b4508db322683f2'
[    7.799685] registered taskstats version 1
[    7.804337] Key type trusted registered
[    7.808408] Key type encrypted registered
[    7.808539] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.810194]   Magic number: 14:69:300
[    7.810451] acpi device:9a: hash matches
[    7.811216] rtc_cmos 00:01: setting system clock to 2018-12-13 22:15:45 UTC (1544739345)
[    7.823741] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    7.897189] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    7.897193] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.897600] hub 1-1:1.0: USB hub found
[    7.897812] hub 1-1:1.0: 6 ports detected
[    7.948128] random: fast init done
[    7.948147] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    7.948151] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.948631] hub 2-1:1.0: USB hub found
[    7.948814] hub 2-1:1.0: 8 ports detected
[    8.025429] Freeing unused kernel memory: 1876k freed
[    8.031899] Write protecting the kernel read-only data: 12288k
[    8.041711] Freeing unused kernel memory: 516k freed
[    8.050346] Freeing unused kernel memory: 600k freed
[    8.069632] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.091114] systemd[1]: Detected architecture x86-64.
[    8.096782] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.112952] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.189141] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.198920] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.211889] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.222178] systemd[1]: Created slice Root Slice.
[    8.227478] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
[ [32m  OK  [0m950] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.252918] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[    8.265979] systemd[1] : Listening on ] Listening on Journal Socket.
[    8.276888] systemd[1]: Reached target Sockets.
[[32m  OK  [0m] Reached target Sockets.
[    8.286993] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.297894] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.308723] systemd[1]: Starting Create list of required static device nodes for the current kernel... 
         Star of required st... nodes for the current kernel...
[    8.329777] systemd[1]: Starting dracut cmdline hook...
          Startin[     8.341601] srtual Console...
          Startin[    8.353645] systemd[1]: Starting Journal Service...
[    8.359664] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
[    8.359666] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.359668]  usb 2-1.4: Pro    8.359670] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.359671] usb 2-1.4: SerialNumber: serial
[    8.361507] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
[    8.417142] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
         Startin[    8.435045] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
g Journal Servic[    8.450181] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
e...
[    8.471630] systemd[1]: Starting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.483263] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started dracut cmdline hook.
[[32m  OK  [0m] Started Setup Virtual Console.
[[32m  OK  [0m] Started Apply Kernel Variables.
         Starting dracut pre-udev hook...
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
[[32m  OK  [0m] Reached target System Initialization.
         Starting dracut initqueue hook...
         Starting Show Plymouth Boot Screen...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Reached target Basic System.
[    8.746751] dca service started, version 1.12.1
[    8.753506] mlx_compat: loading out-of-tree module taints kernel.
[    8.760565] pps_core: LinuxPPS API ver. 1 registered
[    8.766115] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    8.776732] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    8.789552] PTP clock support registered
[    8.794361] Compat-mlnx-ofed backport release: b4fdfac
[    8.800139] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    8.807536] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    8.822612] mpt2sas version 20.103.01.00 loaded
[    8.827996] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    8.829846] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[    8.831018] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32666996 kB)
[    8.853401] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.860662] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    8.874169] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    8.879918] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    8.879923] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    8.886163] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[    8.886881] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 50
[    8.886881] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 51
[    8.886882] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 52
[    8.886883] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 53
[    8.886883] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 54
[    8.886884] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 55
[    8.886884] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 56
[    8.886885] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 57
[    8.886886] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 58
[    8.886886] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 59
[    8.886887] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 60
[    8.886887] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 61
[    8.886888] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 62
[    8.886888] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 63
[    8.886889] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 64
[    8.886889] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 65
[    8.886891] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffa50983b00000), size(65536)
[    8.886891] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[    8.899280] scsi host1: ahci
[    8.901102] scsi host2: ahci
[    8.901264] scsi host3: ahci
[    8.901412] scsi host4: ahci
[    8.901637] scsi host5: ahci
[    8.901915] scsi host6: ahci
[    8.901971] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 49
[    8.901973] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 49
[    8.901976] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 49
[    8.901979] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 49
[    8.901982] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 49
[    8.901984] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 49
[    8.905926] igb 0000:02:00.0: added PHC on eth0
[    8.905928] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.905929] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    8.906002] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    8.906004] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.906629] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    8.908935] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    8.908944] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    8.908949] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    8.908951] isci 0000:07:00.0: OEM parameter table found in OROM
[    8.908954] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    8.909286] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    8.911747] scsi host7: isci
[    8.940794] mpt2sas_cm0: sending message unit reset !!
[    8.942299] mpt2sas_cm0: message unit reset: SUCCESS
[    8.943345] igb 0000:02:00.1: added PHC on eth1
[    8.943346] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    8.943348] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    8.943421] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    8.943422] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
%G%G[    8.994149] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    8.994190] mlx4_core: Initializing 0000:04:00.0
[    8.999201] igb 0000:02:00.2: added PHC on eth2
[    8.999203] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    8.999204] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    8.999277] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    8.999279] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.003940] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[    9.003941] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[    9.003942] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    9.049235] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[    9.049237] mpt2sas_cm0: Protocol=(
[    9.049237] Initiator
[    9.049238] ,Target
[    9.049238] ), 
[    9.049239] Capabilities=(
[    9.049239] TLR
[    9.049240] ,EEDP
[    9.049241] ,Snapshot Buffer
[    9.049241] ,Diag Trace Buffer
[    9.049242] ,Task Set Full
[    9.049242] ,NCQ
[    9.049242] )
[    9.049291] scsi host0: Fusion MPT SAS Host
[    9.049659] mpt2sas_cm0: sending port enable !!
[    9.052723] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[    9.056226] igb 0000:02:00.3: added PHC on eth3
[    9.056228] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.056230] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.056304] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.056306] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.059803] mpt2sas_cm0: port enable: SUCCESS
[    9.060651] scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.060657] scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.060659] scsi 0:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.060663] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.198078] [TTM] Zone  kernel: Available graphics memory: 16333498 kiB
[    9.198078] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.198079] [TTM] Initializing pool allocator
[    9.198083] [TTM] Initializing DMA pool allocator
[    9.210831] ata1: SATA link down (SStatus 0 SControl 300)
[    9.210859] ata5: SATA link down (SStatus 0 SControl 300)
[    9.210886] ata4: SATA link down (SStatus 0 SControl 300)
[    9.210912] ata2: SATA link down (SStatus 0 SControl 300)
[    9.210941] ata6: SATA link down (SStatus 0 SControl 300)
[    9.210970] ata3: SATA link down (SStatus 0 SControl 300)
[    9.229809] fbcon: mgadrmfb (fb0) is primary device
[    9.261550] scsi 0:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.261555] scsi 0:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.261557] scsi 0:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.261559] scsi 0:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.290144] scsi 0:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.290148] scsi 0:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.290149] scsi 0:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.290151] scsi 0:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.310183] scsi 0:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.310187] scsi 0:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.310188] scsi 0:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.310190] scsi 0:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.353328] scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.353332] scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.353333] scsi 0:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.353335] scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.366714] scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.366723] scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.366737] scsi 0:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.366740] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.379590] scsi 0:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.379608] scsi 0:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.379610] scsi 0:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.379613] scsi 0:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.391264] scsi 0:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.391271] scsi 0:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.391274] scsi 0:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.391279] scsi 0:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.403251] scsi 0:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.403270] scsi 0:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.403273] scsi 0:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.403277] scsi 0:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.424388] scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.424397] scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.424400] scsi 0:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.424404] scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.467915] Console: switching to colour frame buffer device 128x48
[    9.492450] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.519907] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   10.586711] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   10.592934] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   10.601207] ata7.00: configured for UDMA/133
[   10.617369] scsi 7:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.525321] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.532321] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.539131] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.546321] mlx4_core: device is working in RoCE mode: Roce V1
[   15.552833] mlx4_core: UD QP Gid type is: V1
[   16.608526] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   17.012432] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   17.018673] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   17.027127] ata8.00: configured for UDMA/133
[   17.043724] scsi 7:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.065270] scsi 0:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   17.071657] scsi 0:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   17.078260] scsi 0:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   17.084720] scsi 0:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   17.091704] scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   17.098149] scsi 0:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   17.104327] scsi 0:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   17.110728] scsi 0:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   17.110891] sd 7:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.111045] sd 7:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.111287] sd 7:0:1:0: [sdb] Write Protect is off
[   17.111305] sd 7:0:0:0: [sda] Write Protect is off
[   17.111401] sd 7:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.111441] sd 7:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.124761] sd 0:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.124775] sd 0:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.124777] sd 0:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.124795] sd 0:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.124797] sd 0:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.124799] sd 0:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.124810] sd 0:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.124813] sd 0:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.124819] sd 0:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.124851]  sdb:
[   17.125517] sd 7:0:1:0: [sdb] Attached SCSI disk
[   17.133299]  sda: sda1 sda2
[   17.134370] sd 7:0:0:0: [sda] Attached SCSI disk
[   17.164389] sd 0:0:1:3: [sdk] Write Protect is off
[   17.164396] sd 0:0:0:0: [sdc] Write Protect is off
[   17.164408] sd 0:0:0:3: [sdf] Write Protect is off
[   17.164411] sd 0:0:1:2: [sdj] Write Protect is off
[   17.164415] sd 0:0:0:1: [sdd] Write Protect is off
[   17.164418] sd 0:0:1:0: [sdh] Write Protect is off
[   17.164439] sd 0:0:0:2: [sde] Write Protect is off
[   17.164444] sd 0:0:0:7: [sdg] Write Protect is off
[   17.164457] sd 0:0:1:1: [sdi] Write Protect is off
[   17.181770] sd 0:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.181784] sd 0:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.181786] sd 0:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.181810] sd 0:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.181812] sd 0:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.181814] sd 0:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.181817] sd 0:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.181818] sd 0:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.181827] sd 0:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.300915] Dev sdh: unable to read RDB block 0
[   17.300917] Dev sdf: unable to read RDB block 0
[   17.300930]  sdh: unable to read partition table
[   17.300933] Dev sdd: unable to read RDB block 0
[   17.300947]  sdf: unable to read partition table
[   17.300965] Dev sdj: unable to read RDB block 0
[   17.300970]  sdd: unable to read partition table
[   17.300989]  sdj: unable to read partition table
[   17.433331] sd 0:0:0:3: [sdf] Attached SCSI disk
[   17.433394] sd 0:0:1:0: [sdh] Attached SCSI disk
[   17.433434] sd 0:0:1:2: [sdj] Attached SCSI disk
[   17.433436] sd 0:0:0:1: [sdd] Attached SCSI disk
[   17.433454] sd 0:0:0:2: [sde] Attached SCSI disk
[   17.433467] sd 0:0:1:3: [sdk] Attached SCSI disk
[   17.433496] sd 0:0:1:1: [sdi] Attached SCSI disk
[   17.433515] sd 0:0:0:0: [sdc] Attached SCSI disk
[   17.433774] sd 0:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.434415] sd 0:0:1:7: [sdl] Write Protect is off
[   17.434641] sd 0:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.504444]  sdg:
[   17.508301] sd 0:0:0:7: [sdg] Attached SCSI disk
[   17.672395]  sdl:
[   17.675969] sd 0:0:1:7: [sdl] Attached SCSI disk
[   17.693093] random: crng init done
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
[[32m  OK  [0m] Started dracut initqueue hook.
         Mounting /sysroot...
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   19.609284] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped target Timers.
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target System Initialization.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped dracut pre-udev h[   20.012104] systemd-journald[290]: Received SIGTERM from PID 1 (systemd).
ook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Closed udev Control Socket.
[[32m  OK  [0m] Closed udev Kernel Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   20.351849] SELinux:  Disabled at runtime.
[   20.397801] type=1404 audit(1544739358.085:2): selinux=0 auid=4294967295 ses=4294967295
[   20.625892] ip_tables: (C) 2000-2006 Netfilter Core Team
[   20.632968] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
         Starting Create list of required st... nodes for the current kernel...
         Mounting POSIX Message Queue File System...
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
         Starting Availability of block devices...
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Reached target Paths.
         Mounting Debug File System...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
         Mounting Huge Pages File System...
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd Root File System.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Reached target RPC Port Mapper.
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Listening on udev Control Socket.
[[32m  OK  [   21.589664] RPC: Registered named UNIX socket transport module.
[0m] Started Av[   21.596735] RPC: Registered udp transport module.
ailability of bl[   21.603546] RPC: Registered tcp transport module.
ock devices.
[[   21.603546] RPC: Registered tcp NFSv4.1 backchannel transport module.
[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Create Static Device Nodes in /dev...
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug Fil[   21.724120] EXT4-fs (sda1): re-mounted. Opts: (null)
e System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
[[32m  OK  [0m] Started LVM2 metadata daemon.
         Starting Flush Journal to Persistent Storage...
         Starting udev Coldplug all Devices...
         Starting Configure read-only root support...
[   21.834685] systemd-journald[4549]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[   21.861740] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.870414] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   21.870419] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   21.870428] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.870433] blk_update_request: critical target error, dev sdg, sector 0
[   21.870473] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.870476] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   21.870480] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   21.870483] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.870485] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started udev Coldplug all Devices.
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[   22.193530] device-mapper: uevent: version 1.0.3
[   22.198927] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[[32m  OK  [0m] Started udev Kernel Device Manager.
[[32m  OK  [0m] Started Load/Save Random Seed.
[   22.423350] ipmi message handler version 39.2
[   22.430620] ipmi device interface
[   22.443415] IPMI System Interface driver.
[   22.447922] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   22.454639] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   22.461258] ipmi_si: Adding SMBIOS-specified kcs state machine
[   22.467819] ipmi_platform: probing via SPMI
[   22.472499] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   22.478920] (NULL device *): SPMI-specified kcs state machine: duplicate
[   22.487019] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   22.498992] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   22.499204] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   22.501828] i801_smbus 0000:07:00.3: Enabling SMBus device
[   22.501866] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   22.525886] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.526050] igb 0000:02:00.0: DCA enabled
[   22.526084] igb 0000:02:00.1: DCA enabled
[   22.527197] igb 0000:02:00.2: DCA enabled
[   22.527224] igb 0000:02:00.3: DCA enabled
[   22.555848] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.569142] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   22.583813] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[[32m  OK  [0m] Found device /dev/ttyS0.
[   22.672579] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   22.684885] IPMI SSIF Interface driver
[   22.735477] sd 7:0:0:0: Attached scsi generic sg0 type 0
[   22.741545] sd 7:0:1:0: Attached scsi generic sg1 type 0
[   22.747600] sd 0:0:0:0: Attached scsi generic sg2 type 0
[   22.753903] sd 0:0:0:1: Attached scsi generic sg3 type 0
[   22.754178] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   22.767806] sd 0:0:0:2: Attached scsi generic sg4 type 0
[   22.774026] cryptd: max_cpu_qlen set to 1000
[   22.774230] sd 0:0:0:3: Attached scsi generic sg5 type 0
[   22.774309] sd 0:0:0:7: Attached scsi generic sg6 type 0
[   22.774386] sd 0:0:1:0: Attached scsi generic sg7 type 0
%G%G[   22.774466] sd 0:0:1:1: Attached scsi generic sg8 type 0
[   22.774544] sd 0:0:1:2: Attached scsi generic sg9 type 0
[   22.774617] sd 0:0:1:3: Attached scsi generic sg10 type 0
[   22.774704] sd 0:0:1:7: Attached scsi generic sg11 type 0
[   22.799235] iTCO_vendor_support: vendor-support=0
[   22.805001] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.805074] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.812852] AVX version of gcm_enc/dec engaged.
[   22.812853] AES CTR mode by8 optimization enabled
[   22.820062] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.820102] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.897869] blk_update_request: I/O error, dev sdj, sector 0
[   22.898336] blk_update_request: I/O error, dev sdh, sector 0
[   22.898495] blk_update_request: I/O error, dev sdd, sector 0
[   22.899270] blk_update_request: I/O error, dev sdf, sector 0
[   22.931453] blk_update_request: I/O error, dev sdd, sector 0
[   22.931780] blk_update_request: I/O error, dev sdf, sector 0
[   22.931782] blk_update_request: I/O error, dev sdj, sector 0
[   22.931893] blk_update_request: I/O error, dev sdh, sector 0
[   22.997972] kvm: disabled by bios
[   23.018580] kvm: disabled by bios
[   23.201298] device-mapper: multipath round-robin: version 1.2.0 loaded
[   23.209117] intel_rapl: Found RAPL domain package
[   23.214378] intel_rapl: Found RAPL domain core
[   23.219363] intel_rapl: Found RAPL domain dram
[   23.224386] intel_rapl: Found RAPL domain package
[   23.229645] intel_rapl: Found RAPL domain core
[   23.234627] intel_rapl: Found RAPL domain dram
[   23.238537] sd 0:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   23.437279] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   23.447667] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   23.457870] EDAC sbridge:  Ver: 1.1.2 
[   23.770252] sd 0:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   23.778936] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   24.399688] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.408459] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   25.067769] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   25.076464] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   25.559888] device-mapper: table: 253:5: multipath: error getting device
[   25.567399] device-mapper: ioctl: error adding target to table
[   25.712477] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1[   25.836010] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
-459a-4b67-8a02-f59c8600579d...
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[   26.308029] sd 0:0:0:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.316709] sd 0:0:0:1: [sdd] Sense Key : Illegal Request [current] 
[   26.323818] sd 0:0:0:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[   26.329960] sd 0:0:0:1: [sdd] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   26.342140] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.350808] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   26.357930] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   26.365814] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.373996] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.382659] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   26.389780] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   26.397665] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.405823] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.414492] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   26.421619] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   26.429497] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.941692] sd 0:0:1:2: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.950356] sd 0:0:1:2: [sdj] Sense Key : Illegal Request [current] 
[   26.957468] sd 0:0:1:2: [sdj] <<vendor>>ASC=0x94 ASCQ=0x1 
[   26.963594] sd 0:0:1:2: [sdj] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   26.972920] blk_update_request: 20 callbacks suppressed
[   26.978754] blk_update_request: I/O error, dev sdj, sector 0
[   26.987473] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.996134] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.003248] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.011138] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.018730] blk_update_request: critical target error, dev sdl, sector 0
[   27.026845] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.035513] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.042611] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.050487] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.058066] blk_update_request: critical target error, dev sdl, sector 0
[   27.066136] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.074809] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.081908] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.089781] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.097378] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Tell Plymouth To Write Out Runtime Data...
         Starting Preprocess NFS configuration...
         Starting Import network configuration from initramfs...
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Mounting RPC Pipe File System...
         Starting Security Auditing Service...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   27.426040] type=1305 audit(1544739365.112:3): audit_pid=9393 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting NTP client/server...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Authorization Manager...
         Starting GSSAPI Proxy Daemon...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting Machine Check Exception Logging Daemon...
         Starting Dump dmesg to /var/log/dmesg...
         Starting System Security Services Daemon...
         Starting Load CPU microcode update...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started Login Service.
[   28.586633] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   28.675061] igb 0000:02:00.0 ens2f0: igb: ens2f0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   28.676017] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   28.684758] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   28.766670] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   28.773491] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[   28.785667] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   28.793090] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   28.803284] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   28.810878] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   28.903816] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   28.914259] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   29.013015] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[   29.034453] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   29.601512] card: mlx4_0, QP: 0x220, inline size: 120
[   29.618615] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [0m] Started mln[   29.632557] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
x_interface_mgr - configure ib0.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[   29.654828] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   29.663314] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   29.681562] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   29.710306] ib0: enabling connected mode will cause multicast packet drops
[   29.718225] ib0: mtu > 4092 will cause multicast packet drops.
[   29.741231] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   36.633875] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   36.673192] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   36.681094] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting OpenSSH server daemon...
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting MUNGE authentication service...
         Starting Postfix Mail Transport Agent...
         Starting Dynamic System Tuning Daemon...
[[   36.855977] FS-Cache: Loaded
[32m  OK  [0m] Reached target Network is Online.
         Mounting /scratch...
         Starting NFS status monitor for NFSv2/3 locking....
         Starting System Logging Service...
         Starting Notify NFS peers of a restart...
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started OpenSSH serv[   36.905602] FS-Cache: Netfs 'nfs' registered for caching
er daemon.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[   36.929286] Key type dns_resolver registered
[   36.977647] NFS: Registering the id_resolver key type
[   36.983294] Key type id_resolver registered
[   36.987966] Key type id_legacy registered
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Crash recovery kernel arming...
         Starting Automounts filesystems on demand...
         Starting Permit User Sessions...
[[32m  OK  [0m] Started Permit User Sessions.
[[32m  OK  [0m] Started Job spooling tools.
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Command Scheduler.
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Created slice User Slice of root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-13T22:16:27+00:00] INFO: Forking chef instance to converge...
[2018-12-13T22:16:27+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-13T22:16:27+00:00] INFO: Chef-client pid: 10996
[2018-12-13T22:16:28+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-13T22:16:28+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-13T22:16:28+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-13T22:16:28+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-13T22:16:28+00:00] INFO: Running start handlers
[2018-12-13T22:16:28+00:00] INFO: Start handlers complete.
[2018-12-13T22:16:29+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-13T22:16:29+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-13T22:16:29+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-13T22:16:29+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-13T22:16:29+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181213221629.371960
[2018-12-13T22:16:29+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181211135641.642504
[2018-12-13T22:16:29+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-13T22:16:29+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-13T22:16:35+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-13T22:16:35+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-13T22:16:35+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-13T22:16:35+00:00] INFO: service[ntpd] started
[2018-12-13T22:16:35+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-13T22:16:36+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-13T22:16:36+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-13T22:16:36+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-13T22:16:36+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-13T22:16:36+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-13T22:16:36+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-13T22:16:36+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-13T22:16:36+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-13T22:16:36+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-13T22:16:37+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-13T22:16:37+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-13T22:16:37+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-13T22:16:37+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:37+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:37+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-13T22:16:37+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-13T22:16:38+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-13T22:16:38+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-13T22:16:38+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-13T22:16:38+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-13T22:16:39+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-13T22:16:39+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-13T22:16:39+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-13T22:16:39+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-13T22:16:39+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-13T22:16:39+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-13T22:16:39+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-13T22:16:40+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-13T22:16:40+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-13T22:16:40+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-13T22:16:40+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-13T22:16:40+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-13T22:16:40+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-13T22:16:40+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-13T22:16:40+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-13T22:16:40+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-13T22:16:40+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-13T22:16:40+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-13T22:16:40+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-13T22:16:41+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-13T22:16:41+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-13T22:16:41+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-13T22:16:41+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-13T22:16:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181213221641.740636
[2018-12-13T22:16:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211135652.919163
[2018-12-13T22:16:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-13T22:16:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-13T22:16:41+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-13T22:16:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181213221641.747387
[2018-12-13T22:16:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211135652.925531
[2018-12-13T22:16:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-13T22:16:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-13T22:16:41+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-13T22:16:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:41+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-13T22:16:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:41+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-13T22:16:41+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-13T22:16:41+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-13T22:16:41+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-13T22:16:41+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T22:16:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:41+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T22:16:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:42+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T22:16:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:42+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T22:16:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:42+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T22:16:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:42+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T22:16:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:42+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T22:16:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:42+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T22:16:42+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:42+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:42+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-13T22:16:42+00:00] INFO: service[xinetd] started
[2018-12-13T22:16:42+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-13T22:16:42+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-13T22:16:42+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-13T22:16:42+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-13T22:16:43+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-13T22:16:43+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-13T22:16:43+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-13T22:16:43+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-13T22:16:43+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181213221643.856548
[2018-12-13T22:16:43+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181211135655.079924
[2018-12-13T22:16:43+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-13T22:16:43+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-13T22:16:43+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-13T22:16:43+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-13T22:16:43+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-13T22:16:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:43+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-13T22:16:43+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-13T22:16:43+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-13T22:16:43+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-13T22:16:44+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T22:16:44+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T22:16:44+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-13T22:16:44+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-13T22:16:44+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-13T22:16:44+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-13T22:16:44+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-13T22:16:44+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-13T22:16:44+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-13T22:16:45+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-13T22:16:45+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-13T22:16:46+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-13T22:16:46+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-13T22:16:46+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-13T22:16:46+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-13T22:16:46+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-13T22:16:46+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-13T22:16:46+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-13T22:16:46+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-13T22:16:46+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-13T22:16:46+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-13T22:16:46+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-13T22:16:46+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-13T22:16:46+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-13T22:16:46+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-13T22:16:46+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-13T22:16:46+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-13T22:16:46+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-13T22:16:46+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-13T22:16:46+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-13T22:16:47+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-13T22:16:47+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-13T22:16:47+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-13T22:16:47+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-13T22:16:47+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[2018-12-13T22:16:50+00:00] INFO: service[kdump] restarted
[2018-12-13T22:16:50+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-13T22:16:50+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-13T22:16:50+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-13T22:16:50+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-13T22:16:50+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-13T22:16:50+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-13T22:16:50+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-13T22:16:50+00:00] INFO: Chef Run complete in 21.688434528 seconds
[2018-12-13T22:16:50+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-13T22:16:50+00:00] INFO: Running report handlers
[2018-12-13T22:16:50+00:00] INFO: Creating JSON run report
[2018-12-13T22:16:50+00:00] INFO: Report handlers complete
[   73.419562] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[  173.224754] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  173.235269] alg: No test for adler32 (adler32-zlib)
[  174.079340] Lustre: Lustre: Build Version: 2.12.0_RC2
[  174.303150] LNet: Using FMR for registration
[  174.320712] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  174.406214] LDISKFS-fs warning (device dm-1): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait.
[  174.406214] 
[  222.589475] LDISKFS-fs (dm-1): recovery complete
[  222.595063] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  223.689084] Lustre: MGS: Connection restored to 0ecbd77b-3732-1ead-ecb8-18a683273147 (at 0@lo)
[  224.121865] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  224.695152] Lustre: MGS: Connection restored to 9c3d3ed6-edf5-ce57-b95d-be3fb28d882b (at 192.168.1.144@o2ib)
[  225.995772] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[  226.005025] Lustre: Skipped 1 previous similar message
[  229.267473] Lustre: MGS: Connection restored to 89c39733-20e8-0467-afb7-e7519721ab22 (at 192.168.1.124@o2ib)
[  229.278478] Lustre: Skipped 1 previous similar message
[  233.409225] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect
[  234.419138] Lustre: soaked-MDT0000: Connection restored to 9c3d3ed6-edf5-ce57-b95d-be3fb28d882b (at 192.168.1.144@o2ib)
[  234.431176] Lustre: Skipped 1 previous similar message
[  245.127200] Lustre: soaked-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[  245.137576] Lustre: Skipped 3 previous similar messages
[  261.832501] Lustre: soaked-MDT0000: Connection restored to e886e3d3-3ebf-375d-809a-3a736449e0f7 (at 192.168.1.135@o2ib)
[  261.844584] Lustre: Skipped 19 previous similar messages
[  294.378223] Lustre: soaked-MDT0000: Connection restored to 3bb0cfb9-248b-1acc-48fb-be296c117507 (at 192.168.1.129@o2ib)
[  294.390311] Lustre: Skipped 20 previous similar messages
[  533.961259] Lustre: soaked-MDT0000: recovery is timed out, evict stale exports
[  533.969379] Lustre: soaked-MDT0000: disconnecting 1 stale clients
[  534.008449] Lustre: soaked-MDT0000: Recovery over after 5:01, of 29 clients 28 recovered and 1 was evicted.
[ 2107.365331] LNetError: 12347:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[ 2107.376700] LNetError: 12347:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.105@o2ib (8): c: 0, oc: 0, rc: 8
[ 2107.390373] Lustre: 12385:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544741439/real 1544741444]  req@ffff8cf4b7fabf00 x1619776878168960/t0(0) o6->soaked-OST0005-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 544/432 e 0 to 1 dl 1544741483 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 2107.390391] Lustre: soaked-OST0005-osc-MDT0000: Connection to soaked-OST0005 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 2107.441260] Lustre: 12385:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[ 2108.365366] LNet: 12347:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 1 seconds
[ 2108.376913] Lustre: 12369:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544741439/real 1544741445]  req@ffff8cf4b5834e00 x1619776878169152/t0(0) o6->soaked-OST0001-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 544/432 e 0 to 1 dl 1544741483 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 2108.376923] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 2108.427790] Lustre: 12369:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[ 2109.365459] LNet: 12347:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 2 seconds
[ 2109.376913] LNet: 12347:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 7 previous similar messages
[ 2109.387429] Lustre: 12369:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544741439/real 1544741446]  req@ffff8cf4b5298c00 x1619776878172096/t0(0) o6->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 544/432 e 0 to 1 dl 1544741483 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 2109.387439] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 2109.438292] Lustre: 12369:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
[ 2111.365486] LNet: 12347:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 4 seconds
[ 2111.376967] LNet: 12347:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 6 previous similar messages
[ 2112.365609] Lustre: 12367:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544741441/real 1544741449]  req@ffff8cf4b7155d00 x1619776878441552/t0(0) o13->soaked-OST0009-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544741448 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 2112.397846] Lustre: 12367:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 12 previous similar messages
[ 2320.058379] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST0009_UUID (at 192.168.1.105@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff8cf52c494c00, cur 1544741657 expire 1544741507 last 1544741430
[ 2364.217076] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 2364.227401] Lustre: Skipped 28 previous similar messages
[ 2367.373754] LNet: 12347:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds
[ 2367.385225] LNet: 12347:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 10 previous similar messages
[ 2375.874067] Lustre: soaked-OST0009-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 2397.394614] Lustre: soaked-OST0001-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 2397.406098] Lustre: Skipped 1 previous similar message
[ 2418.375460] LNet: 12347:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds
[ 2418.386935] LNet: 12347:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 3 previous similar messages
[ 2435.148022] Lustre: soaked-OST000d-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 2435.159493] Lustre: Skipped 3 previous similar messages
[ 2442.584580] LustreError: 11-0: soaked-OST0009-osc-MDT0000: operation ost_create to node 192.168.1.104@o2ib failed: rc = -107
[ 2442.597149] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 2442.615814] Lustre: Skipped 1 previous similar message
[ 2442.621632] LustreError: 12542:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST0009-osc-MDT0000: can't precreate: rc = -107
[ 2462.520260] LustreError: 11-0: soaked-OST0001-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[ 2462.532825] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 2477.207686] LustreError: 11-0: soaked-OST0005-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[ 2477.220256] Lustre: soaked-OST0005-osc-MDT0000: Connection to soaked-OST0005 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 2487.640129] LustreError: 11-0: soaked-OST000d-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[ 2500.364771] Lustre: soaked-OST000d-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 2500.376246] Lustre: Skipped 5 previous similar messages
[ 2641.542320] Lustre: soaked-OST0001-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 2641.553814] Lustre: Skipped 1 previous similar message
[ 2724.200593] Lustre: 12586:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
[2J[1;1H[1;1H[0;37;40m[2J[1;1H[1;1H[1;37;40m[1;1HCopyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               [2;1HVersion 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.          [01;00H[0m[2m                                                                                [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [m[4;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[4;79H[m[7m[5;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [5;79H[22;1H   The selected entry will be started automatically in 5s.                     [5;79H[22;1H   The selected entry will be started automatically in 4s.                     [5;79H[22;1H   The selected entry will be started automatically in 3s.                     [5;79H[22;1H   The selected entry will be started automatically in 2s.                     [5;79H[22;1H   The selected entry will be started automatically in 1s.                     [5;79H[22;1H   The selected entry will be started automatically in 0s.                     [5;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-309-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Sat Dec 8 05:53:16 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x35bfe000-0x36df6fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 162MB of memory at 688MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff9a0dae000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 7011916k/34603008k available (7664k kernel code, 1126748k absent, 830688k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.453 MHz processor
[    0.000176] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.90 BogoMIPS (lpj=2693453)
[    0.012109] pid_max: default: 245760 minimum: 1920
[    0.018330] Security Framework initialized
[    0.022922] SELinux:  Initializing.
[    0.027102] Yama: becoming mindful.
[    0.036303] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.058096] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.071895] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.079676] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.089961] Initializing cgroup subsys memory
[    0.094897] Initializing cgroup subsys devices
[    0.099874] Initializing cgroup subsys freezer
[    0.104841] Initializing cgroup subsys net_cls
[    0.109808] Initializing cgroup subsys blkio
[    0.114582] Initializing cgroup subsys perf_event
[    0.119890] Initializing cgroup subsys hugetlb
[    0.124857] Initializing cgroup subsys pids
[    0.129593] Initializing cgroup subsys net_prio
[    0.134933] mce: CPU supports 20 MCE banks
[    0.139543] CPU0: Thermal monitoring enabled (TM1)
[    0.144973] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.151104] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.157427] tlb_flushall_shift: 6
[    0.161202] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.171941] FEATURE SPEC_CTRL Present
[    0.176034] FEATURE IBPB_SUPPORT Present
[    0.180731] Spectre V2 : Mitigation: Full retpoline
[    0.189014] Freeing SMP alternatives: 28k freed
[    0.200327] ACPI: Core revision 20130517
[    0.295693] ACPI: All ACPI Tables successfully acquired
[    0.320164] ftrace: allocating 29187 entries in 115 pages
[    0.380743] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.388128] Switched APIC routing to physical flat.
[    0.394297] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.411008] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.421493] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.433253] ... version:                3
[    0.437730] ... bit width:              48
[    0.442303] ... generic registers:      4
[    0.446772] ... value mask:             0000ffffffffffff
[    0.452701] ... max period:             00007fffffffffff
[    0.458632] ... fixed-purpose events:   3
[    0.463109] ... event mask:             000000070000000f
[    0.477334] smpboot: Booting Node   0, Processors  #1[    0.498586] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.553224] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.693292] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.735181] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.775899] Brought up 32 CPUs
[    0.779519] smpboot: Max logical packages: 15
[    0.784392] smpboot: Total of 32 processors activated (172570.72 BogoMIPS)
[    1.041984] node 0 initialised, 2808669 pages in 137ms
[    1.079746] node 1 initialised, 3599741 pages in 169ms
[    1.086709] devtmpfs: initialized
[    1.101729] EVM: security.selinux
[    1.105433] EVM: security.ima
[    1.108748] EVM: security.capability
[    1.113009] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.121874] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.134227] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.141913] pinctrl core: initialized pinctrl subsystem
[    1.148030] RTC time: 23:43:24, date: 12/13/18
[    1.153499] NET: Registered protocol family 16
[    1.158974] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.167438] ACPI: bus type PCI registered
[    1.171916] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.179765] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.190153] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.197765] PCI: Using configuration type 1 for base access
[    1.204031] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.224656] ACPI: Added _OSI(Module Device)
[    1.229331] ACPI: Added _OSI(Processor Device)
[    1.234295] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.239547] ACPI: Added _OSI(Processor Aggregator Device)
[    1.245579] ACPI: Added _OSI(Linux-Dell-Video)
[    1.290270] ACPI: Executed 1 blocks of module-level executable AML code
[    1.579936] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.613066] ACPI: Interpreter enabled
[    1.617198] ACPI: (supports S0 S1 S5)
[    1.621289] ACPI: Using IOAPIC for interrupt routing
[    1.626963] HEST: Table parsing has been initialized.
[    1.632609] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.642881] ACPI: GPE 0x1E active on init
[    1.647392] ACPI: GPE 0x24 active on init
[    1.651897] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.717608] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.724522] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.734178] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.742671] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.751223] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.760658] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.772335] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.787197] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.802437] PCI host bridge to bus 0000:00
[    1.807016] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.813919] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.822279] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.830638] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.838996] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.847355] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.855711] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.864070] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.872426] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.880783] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.889140] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.897499] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.905856] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.914215] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.922575] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.931708] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.938366] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.945001] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.951644] pci 0000:00:02.0: System wakeup disabled by ACPI
[    1.958272] pci 0000:00:02.2: System wakeup disabled by ACPI
[    1.964903] pci 0000:00:03.0: System wakeup disabled by ACPI
[    1.975135] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    1.981787] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    1.988399] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    1.995054] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.001608] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.008889] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.014618] acpiphp: Slot [2] registered
[    2.019291] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.029613] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.040286] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.050618] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.061285] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.071608] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.082274] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.092587] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.104912] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.110968] acpiphp: Slot [2-2] registered
[    2.117981] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.123715] acpiphp: Slot [2-3] registered
[    2.128332] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.134046] acpiphp: Slot [2-4] registered
[    2.138953] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.144855] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.157650] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.163321] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.169305] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.175707] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.181379] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.190359] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.198266] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.206157] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.214054] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.221951] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.229849] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.237749] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.245646] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.253745] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.260654] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.270061] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.278388] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.286940] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.296505] PCI host bridge to bus 0000:80
[    2.301085] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.308668] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.316249] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.324608] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.332967] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.342101] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.348464] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.355064] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.361662] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.368263] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.377091] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.382735] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.388373] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.393995] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.410551] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.417172] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.426365] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.436035] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.443035] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.452293] PCI host bridge to bus 0000:7f
[    2.456872] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.467473] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.474092] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.483283] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.492951] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.499955] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.509218] PCI host bridge to bus 0000:ff
[    2.513798] pci_bus 0000:ff: root bus resource [bus ff]
[    2.525008] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.534069] vgaarb: loaded
[    2.537092] vgaarb: bridge control possible 0000:09:00.0
[    2.543452] SCSI subsystem initialized
[    2.547704] ACPI: bus type USB registered
[    2.552226] usbcore: registered new interface driver usbfs
[    2.558378] usbcore: registered new interface driver hub
[    2.564605] usbcore: registered new device driver usb
[    2.570795] EDAC MC: Ver: 3.0.0
[    2.574845] PCI: Using ACPI for IRQ routing
[    2.587115] NetLabel: Initializing
[    2.590918] NetLabel:  domain hash size = 128
[    2.595782] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.601375] NetLabel:  unlabeled traffic allowed by default
[    2.607928] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.614950] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.623507] amd_nb: Cannot enumerate AMD northbridges
[    2.629353] Switched to clocksource hpet
[    2.648281] pnp: PnP ACPI init
[    2.651738] ACPI: bus type PNP registered
[    2.656512] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.663136] system 00:00: [io  0xffff] has been reserved
[    2.669073] system 00:00: [io  0xffff] has been reserved
[    2.675011] system 00:00: [io  0xffff] has been reserved
[    2.680947] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.687952] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.694567] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.701183] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.707799] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.714803] system 00:00: [io  0x0cf9] could not be reserved
[    2.721350] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.729530] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.736928] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.744321] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.751712] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.759110] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.766504] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.774276] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.782053] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.789832] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.797759] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.806073] pnp: PnP ACPI: found 7 devices
[    2.810657] ACPI: bus type PNP unregistered
[    2.824689] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.830257] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.836098] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.842912] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.850505] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.856058] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.863645] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.873069] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.878629] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.884178] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.890995] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.898589] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.904139] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    2.910954] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    2.918542] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    2.927975] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.933540] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.939092] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    2.946687] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    2.955344] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    2.961126] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.966688] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.972248] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.977799] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.983729] NET: Registered protocol family 2
[    2.990753] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    2.999927] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.007671] TCP: Hash tables configured (established 262144 bind 65536)
[    3.015154] TCP: reno registered
[    3.018921] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.026077] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.034772] NET: Registered protocol family 1
[    4.139362] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.247379] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.255876] Un packing initram[    5.821106] Freeing initrd memory: 18404k freed
[    5.833256] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.840459] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff9a0a373c7000-ffff9a0a3b3c6fff]
[    5.851941] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    5.860795] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    5.867221] RAPL PMU: hw unit of domain package 2^-16 Joules
[    5.873545] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    5.892691] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    5.899528] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    5.913506] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    5.921767] Initialise system trusted keyring
[    5.926777] audit: initializing netlink socket (disabled)
[    5.932859] type=2000 audit(1544744605.461:1): initialized
[    5.994689] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.001800] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.012100] zpool: loaded
[    6.015044] zbud: loaded
[    6.019088] VFS: Disk quotas dquot_6.6.0
[    6.023978] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.032690] msgmni has been set to 32768
[    6.037461] Key type big_key registered
[    6.044365] NET: Registered protocol family 38
[    6.049356] Key type asymmetric registered
[    6.053943] Asymmetric key parser 'x509' registered
[    6.059563] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.068114] io scheduler noop registered
[    6.072513] io scheduler deadline registered (default)
[    6.078418] io scheduler cfq registered
[    6.082722] io scheduler mq-deadline registered
[    6.087799] io scheduler kyber registered
[    6.098140] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.105964] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.113753] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.121044] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.128344] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.135644] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.142975] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.150759] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.158105] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.165921] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.173696] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.181029] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.188813] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.196115] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.203448] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.211266] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.219049] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.226399] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.234228] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.242053] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.249880] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.257775] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.264023] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.271476] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.279783] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.288067] ACPI: Power Button [PWRF]
[    6.292251] ACPI: Requesting acpi_cpufreq
[    6.379833] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.388266] pstore: Registered erst as persistent store backend
[    6.395207] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.403695] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.431569] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.458685] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.465987] Non-volatile memory driver v1.3
[    6.470741] Linux agpgart interface v0.103
[    6.475762] crash memory driver: version 1.1
[    6.481033] rdac: device handler registered
[    6.485791] hp_sw: device handler registered
[    6.490585] emc: device handler registered
[    6.495456] alua: device handler registered
[    6.500240] libphy: Fixed MDIO Bus: probed
[    6.504916] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.512224] ehci-pci: EHCI PCI platform driver
[    6.517669] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.523631] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.531931] ehci-pci 0000:00:1a.0: debug port 2
[    6.540967] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.552427] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.558940] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.566529] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.574598] usb usb1: Product: EHCI Host Controller
[    6.580060] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.588232] usb usb1: SerialNumber: 0000:00:1a.0
[    6.593640] hub 1-0:1.0: USB hub found
[    6.597859] hub 1-0:1.0: 2 ports detected
[    6.602924] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    6.608869] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    6.617163] ehci-pci 0000:00:1d.0: debug port 2
[    6.626208] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    6.638420] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    6.644938] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    6.652526] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.660596] usb usb2: Product: EHCI Host Controller
[    6.666059] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.674230] usb usb2: SerialNumber: 0000:00:1d.0
[    6.679615] hub 2-0:1.0: USB hub found
[    6.683832] hub 2-0:1.0: 2 ports detected
[    6.688573] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    6.695520] ohci-pci: OHCI PCI platform driver
[    6.700541] uhci_hcd: USB Universal Host Controller Interface driver
[    6.707797] usbcore: registered new interface driver usbserial_generic
[    6.715113] usbserial: USB Serial support registered for generic
[    6.721901] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    6.887428] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    7.774277] i8042: No controller found
[    7.778532] Switched to clocksource tsc
[    7.778610] mousedev: PS/2 mouse device common for all mice
[    7.778748] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    7.778879] rtc_cmos 00:01: RTC can wake from S4
[    7.779140] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    7.779196] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    7.779331] intel_pstate: Intel P-state driver initializing
[    7.791025] cpuidle: using governor menu
[    7.792564] hidraw: raw HID events driver (C) Jiri Kosina
[    7.792824] usbcore: registered new interface driver usbhid
[    7.792825] usbhid: USB HID core driver
[    7.793048] drop_monitor: Initializing network drop monitor service
[    7.793597] TCP: cubic registered
[    7.793608] Initializing XFRM netlink socket
[    7.794299] NET: Registered protocol family 10
[    7.795952] NET: Registered protocol family 17
[    7.795966] mpls_gso: MPLS GSO support
[    7.797735] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    7.801857] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    7.802103] Loading compiled-in X.509 certificates
[    7.803216] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    7.804287] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    7.805327] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: d73e894149b8945b8dc07cc18b4508db322683f2'
[    7.805370] registered taskstats version 1
[    7.809920] Key type trusted registered
[    7.813925] Key type encrypted registered
[    7.814065] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.815715]   Magic number: 14:140:757
[    7.815917] acpi LNXCPU:4f: hash matches
[    7.816905] rtc_cmos 00:01: setting system clock to 2018-12-13 23:43:31 UTC (1544744611)
[    7.829467] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    7.903868] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    7.903872] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.904364] hub 1-1:1.0: USB hub found
[    7.904556] hub 1-1:1.0: 6 ports detected
[    7.941890] random: fast init done
[    7.953894] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    7.953898] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.954378] hub 2-1:1.0: USB hub found
[    7.954558] hub 2-1:1.0: 8 ports detected
[    8.031458] Freeing unused kernel memory: 1876k freed
[    8.037947] Write protecting the kernel read-only data: 12288k
[    8.047693] Freeing unused kernel memory: 516k freed
[    8.056355] Freeing unused kernel memory: 600k freed
[    8.075643] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.097124] systemd[1]: Detected architecture x86-64.
[    8.102786] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.118657] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.195254] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.205667] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.216687] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.227581] systemd[1]: Reached target Slices.
[    8.232559] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
[ [32m  OK  [0m[    8.246565] systemd[1]: Starting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.257570] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.270572] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.28 1281] systemd[1        Starting Journal Service...
[    8.291549] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.301679] systemd[1]: Listening on udev Control Sock et.
[[32m  OKn udev Control Socket.
[    8.314594] systemd[1]: Listening on udev Kernel Socket.
[ [32m  OK  [0mt. 
[    8.327557ed target Sockets.
[ [32m  OK  [0m[    8.338470] systemd[1]: Starting dracut cmdline hook...
         Startin[    8.345121] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
g dracut cmdline[    8.353728] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
 hook...
[    8.363440] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.370489] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.376914] usb 2-1.4: SerialNumber: serial
[    8.382219] systemd[1]: Starting Create list of requir ed static devic 8.383106] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
         Starting Create list of required st... nodes for the current kernel...
[    8.417596] systemd[1]: Starting Setup Virtual Console...
         Starting Setup Virtual Console...
[    8.430143] systemd[1]: Started Journal Service.
[    8.435764] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
[    8.437241] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
[    8.437458] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started dracut cmdline hook.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
         Starting Create Static Device Nodes in /dev...
         Starting dracut pre-udev hook...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started Setup Virtual Console.
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
[[32m  OK  [0m] Reached target System Initialization.
         Starting Show Plymouth Boot Screen...
         Starting dracut initqueue hook...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Reached target Basic System.[    8.751373] dca service started, version 1.12.1

[    8.757844] mlx_compat: loading out-of-tree module taints kernel.
[    8.765030] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    8.777763] pps_core: LinuxPPS API ver. 1 registered
[    8.783341] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    8.793958] Compat-mlnx-ofed backport release: b4fdfac
[    8.799714] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    8.807106] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    8.814275] PTP clock support registered
[    8.831764] mpt2sas version 20.103.01.00 loaded
[    8.836956] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[    8.845922] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32666996 kB)
[    8.859909] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    8.866512] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    8.866516] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    8.878462] scsi host1: ahci
[    8.879462] scsi host2: ahci
[    8.879616] scsi host3: ahci
[    8.879974] scsi host4: ahci
[    8.880437] scsi host5: ahci
[    8.881118] scsi host6: ahci
[    8.881206] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 39
[    8.881209] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 39
[    8.881211] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 39
[    8.881214] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 39
[    8.881216] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 39
[    8.881219] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 39
[    8.909456] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[    8.910005] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 40
[    8.910005] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 41
[    8.910006] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 42
[    8.910006] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 43
[    8.910007] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 44
[    8.910008] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 45
[    8.910008] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 46
[    8.910009] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 47
[    8.910009] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 48
[    8.910010] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 49
[    8.910010] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 50
[    8.910011] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 51
[    8.910011] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 52
[    8.910012] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 53
[    8.910012] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 54
[    8.910013] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 55
[    8.910014] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffb08743ae0000), size(65536)
[    8.910015] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[    8.929416] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    8.929428] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    8.929433] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    8.929457] isci 0000:07:00.0: OEM parameter table found in OROM
[    8.929462] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    8.929768] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    8.932198] scsi host7: isci
[    8.937658] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    8.937659] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.937786] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    8.937814] mlx4_core: Initializing 0000:04:00.0
[    8.938338] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    8.964445] mpt2sas_cm0: sending message unit reset !!
[    8.965950] mpt2sas_cm0: message unit reset: SUCCESS
[    8.975422] igb 0000:02:00.0: added PHC on eth0
[    8.975423] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.975424] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    8.975497] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    8.975498] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.976050] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.013082] igb 0000:02:00.1: added PHC on eth1
[    9.013083] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.013085] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.013158] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.013159] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.031006] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[    9.031007] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[    9.031007] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    9.068483] igb 0000:02:00.2: added PHC on eth2
[    9.068484] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.068485] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.068566] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.068568] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.074862] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[    9.074863] mpt2sas_cm0: Protocol=(
[    9.074864] Initiator
[    9.074864] ,Target
[    9.074864] ), 
[    9.074865] Capabilities=(
[    9.074865] TLR
%G%G[    9.074866] ,EEDP
[    9.074866] ,Snapshot Buffer
[    9.074867] ,Diag Trace Buffer
[    9.074867] ,Task Set Full
[    9.074868] ,NCQ
[    9.074868] )
[    9.074921] scsi host0: Fusion MPT SAS Host
[    9.075357] mpt2sas_cm0: sending port enable !!
[    9.078179] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[    9.086449] mpt2sas_cm0: port enable: SUCCESS
[    9.087212] scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.087216] scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.087218] scsi 0:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.087221] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.123659] igb 0000:02:00.3: added PHC on eth3
[    9.123660] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.123661] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.123734] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.123735] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.187505] ata4: SATA link down (SStatus 0 SControl 300)
[    9.188468] ata3: SATA link down (SStatus 0 SControl 300)
[    9.189467] ata2: SATA link down (SStatus 0 SControl 300)
[    9.194466] ata5: SATA link down (SStatus 0 SControl 300)
[    9.195469] ata6: SATA link down (SStatus 0 SControl 300)
[    9.196466] ata1: SATA link down (SStatus 0 SControl 300)
[    9.307381] [TTM] Zone  kernel: Available graphics memory: 16333498 kiB
[    9.307382] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.307382] [TTM] Initializing pool allocator
[    9.307386] [TTM] Initializing DMA pool allocator
[    9.333552] fbcon: mgadrmfb (fb0) is primary device
[    9.359314] scsi 0:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.359324] scsi 0:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.359328] scsi 0:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.359334] scsi 0:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.383772] scsi 0:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.383776] scsi 0:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.383778] scsi 0:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.383780] scsi 0:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.399867] scsi 0:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.399884] scsi 0:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.399886] scsi 0:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.399888] scsi 0:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.413831] scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.413836] scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.413838] scsi 0:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.413855] scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.456513] scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.456521] scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.456524] scsi 0:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.456529] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.469249] scsi 0:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.469255] scsi 0:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.469259] scsi 0:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.469264] scsi 0:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.480911] scsi 0:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.480931] scsi 0:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.480934] scsi 0:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.480938] scsi 0:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.492876] scsi 0:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.492896] scsi 0:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.492899] scsi 0:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.492903] scsi 0:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.507898] scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.507905] scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.507908] scsi 0:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.507913] scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.571333] Console: switching to colour frame buffer device 128x48
[    9.607546] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.648540] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   10.606444] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   10.612684] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   10.621032] ata7.00: configured for UDMA/133
[   10.626400] scsi 7:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.469708] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.476705] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.483514] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.490705] mlx4_core: device is working in RoCE mode: Roce V1
[   15.497221] mlx4_core: UD QP Gid type is: V1
[   16.560443] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   16.976652] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   16.982905] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   16.991508] ata8.00: configured for UDMA/133
[   17.007651] scsi 7:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.029420] scsi 0:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   17.035834] scsi 0:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   17.042487] scsi 0:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   17.048870] scsi 0:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   17.055781] scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   17.062300] scsi 0:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   17.068558] scsi 0:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   17.074979] scsi 0:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   17.111659] sd 7:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.111731] sd 7:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.111811] sd 7:0:1:0: [sdb] Write Protect is off
[   17.111836] sd 7:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.111996] sd 0:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.112139] sd 0:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.112220] sd 0:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.112330] sd 0:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.112405] sd 0:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.112594] sd 0:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.112617] sd 0:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.112669] sd 0:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.112872] sd 0:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.113069] sd 0:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.113415] sd 0:0:0:0: [sdc] Write Protect is off
[   17.113637] sd 0:0:1:0: [sdh] Write Protect is off
[   17.113676] sd 0:0:0:1: [sdd] Write Protect is off
[   17.113923] sd 0:0:0:2: [sde] Write Protect is off
[   17.114068] sd 0:0:0:3: [sdf] Write Protect is off
[   17.114153] sd 0:0:1:1: [sdi] Write Protect is off
[   17.114209] sd 0:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.114267] sd 0:0:1:2: [sdj] Write Protect is off
[   17.114310] sd 0:0:0:7: [sdg] Write Protect is off
[   17.114351] sd 0:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.114414] sd 0:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.114562] sd 0:0:1:3: [sdk] Write Protect is off
[   17.114739] sd 0:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.114985] sd 0:0:1:7: [sdl] Write Protect is off
[   17.115035] sd 0:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.115082] sd 0:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.115245] sd 0:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.115373] sd 0:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.115566] sd 0:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.115600]  sdb:
[   17.115735] sd 0:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.115896] sd 7:0:1:0: [sdb] Attached SCSI disk
[   17.118645] Dev sdh: unable to read RDB block 0
[   17.118656]  sdh: unable to read partition table
[   17.118886] Dev sdd: unable to read RDB block 0
[   17.118894]  sdd: unable to read partition table
[   17.119289] Dev sdf: unable to read RDB block 0
[   17.119308]  sdf: unable to read partition table
[   17.119324] Dev sdj: unable to read RDB block 0
[   17.119335]  sdj: unable to read partition table
[   17.121599] sd 0:0:1:0: [sdh] Attached SCSI disk
[   17.121843] sd 0:0:0:1: [sdd] Attached SCSI disk
[   17.122182] sd 0:0:1:2: [sdj] Attached SCSI disk
[   17.122351] sd 0:0:1:3: [sdk] Attached SCSI disk
[   17.122574] sd 0:0:0:0: [sdc] Attached SCSI disk
[   17.122665] sd 0:0:0:2: [sde] Attached SCSI disk
[   17.122756] sd 0:0:0:3: [sdf] Attached SCSI disk
[   17.141779] sd 0:0:1:1: [sdi] Attached SCSI disk
[   17.334429]  sdg:
[   17.335679] sd 0:0:0:7: [sdg] Attached SCSI disk
[   17.343199] random: crng init done
[   17.478706] sd 7:0:0:0: [sda] Write Protect is off
[   17.484130] sd 7:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.502359]  sdl:
[   17.505927] sd 0:0:1:7: [sdl] Attached SCSI disk
[   17.512097]  sda: sda1 sda2
[   17.515934] sd 7:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
[[32m  OK  [0m] Started dracut initqueue hook.
         Mounting /sysroot...
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   19.382882] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped target Timers.
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK [   19.787320] systemd-journald[281]: Received SIGTERM from PID 1 (systemd).
 [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Closed udev Kernel Socket.
[[32m  OK  [0m] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   20.125288] SELinux:  Disabled at runtime.
[   20.173712] type=1404 audit(1544744623.856:2): selinux=0 auid=4294967295 ses=4294967295
[   20.417422] ip_tables: (C) 2000-2006 Netfilter Core Team
[   20.424283] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[[32m  OK  [0m] Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Create list of required st... nodes for the current kernel...
         Starting Read and set NIS domainname from /etc/sysconfig/network...
         Mounting Huge Pages File System...
         Starting Availability of block devices...
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
         Mounting Debug File System...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Stopped target Initrd Root File System.
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Reached target Paths.
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Apply Kernel Variables...
         Starting Create Static Device Nodes in /dev...
         Starting Remount Root and Kernel File Systems...
[[32m  OK  [0m] Started Journal Service.
[   21.517146] EXT4-fs (sda1): re-mounted. Opts: (null)
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting udev Coldplug all Devices...
         Starting Flush Journal to Persistent Storage...
         Starting Configure read-only root support...
[[32m  OK  [0m] Started LVM2 metadata daemon.
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started Apply Kernel Variables.
[   21.615395] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.624059] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   21.631175] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   21.639062] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.646650] blk_update_request: critical target error, dev sdg, sector 0
[   21.654189] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.662850] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   21.669952] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   21.677835] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.685428] blk_update_request: critical target error, dev sdl, sector 0
[   21.805863] systemd-journald[4543]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[   22.011602] RPC: Registered named UNIX socket transport module.
[   22.018225] RPC: Registered udp transport module.
[   22.023502] RPC: Registered tcp transport module.
[   22.028784] RPC: Registered tcp NFSv4.1 backchannel transport module.
[[32m  OK  [0m] Started Configure read-only root support.
  [   22.056093] device-mapper: uevent: version 1.0.3
       Starting [   22.062514] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
Load/Save Random Seed...
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
[   22.512159] ipmi message handler version 39.2
[   22.520073] ipmi device interface
[   22.528130] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.540189] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.552691] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   22.560250] IPMI System Interface driver.
[   22.561139] igb 0000:02:00.0: DCA enabled
[   22.561184] igb 0000:02:00.1: DCA enabled
[   22.562028] igb 0000:02:00.2: DCA enabled
[   22.562056] igb 0000:02:00.3: DCA enabled
[   22.583425] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   22.590155] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   22.597292] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   22.598448] ipmi_si: Adding SMBIOS-specified kcs state machine
[   22.598482] ipmi_platform: probing via SPMI
[   22.598484] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   22.598486] (NULL device *): SPMI-specified kcs state machine: duplicate
[   22.598572] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[[32m  OK  [0m[   22.641984] input: PC Speaker as /devices/platform/pcspkr/input/input3
] Found device /[   22.651450] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
dev/ttyS0.
[   22.658928] sd 7:0:0:0: Attached scsi generic sg0 type 0
[   22.661051] i801_smbus 0000:07:00.3: Enabling SMBus device
[   22.661092] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   22.664502] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   22.687997] sd 7:0:1:0: Attached scsi generic sg1 type 0
[   22.694792] sd 0:0:0:0: Attached scsi generic sg2 type 0
[   22.700842] sd 0:0:0:1: Attached scsi generic sg3 type 0
[   22.706886] sd 0:0:0:2: Attached scsi generic sg4 type 0
[   22.712944] sd 0:0:0:3: Attached scsi generic sg5 type 0
[   22.719011] sd 0:0:0:7: Attached scsi generic sg6 type 0
[   22.725061] sd 0:0:1:0: Attached scsi generic sg7 type 0
[   22.731206] cryptd: max_cpu_qlen set to 1000
[   22.731861] sd 0:0:1:1: Attached scsi generic sg8 type 0
[   22.731959] sd 0:0:1:2: Attached scsi generic sg9 type 0
[   22.732045] sd 0:0:1:3: Attached scsi generic sg10 type 0
[   22.732398] sd 0:0:1:7: Attached scsi generic sg11 type 0
[   22.744026] ipmi_si ipmi_si.0: IPMI kcs interface initialized
%G%G[   22.772564] iTCO_vendor_support: vendor-support=0
[   22.778794] IPMI SSIF Interface driver
[   22.786867] AVX version of gcm_enc/dec engaged.
[   22.791937] AES CTR mode by8 optimization enabled
[   22.797433] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.797497] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.800123] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.800173] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   23.061060] kvm: disabled by bios
[   23.088875] kvm: disabled by bios
[   23.102038] kvm: disabled by bios
[   23.114133] blk_update_request: I/O error, dev sdf, sector 0
[   23.114205] blk_update_request: I/O error, dev sdh, sector 0
[   23.114853] blk_update_request: I/O error, dev sdj, sector 0
[   23.133344] intel_rapl: Found RAPL domain package
[   23.138602] intel_rapl: Found RAPL domain core
[   23.143579] intel_rapl: Found RAPL domain dram
[   23.148597] intel_rapl: Found RAPL domain package
[   23.153872] intel_rapl: Found RAPL domain core
[   23.158836] intel_rapl: Found RAPL domain dram
[   23.179586] blk_update_request: I/O error, dev sdf, sector 0
[   23.179612] blk_update_request: I/O error, dev sdd, sector 0
[   23.179723] blk_update_request: I/O error, dev sdh, sector 0
[   23.179777] blk_update_request: I/O error, dev sdj, sector 0
[   23.183338] blk_update_request: I/O error, dev sdd, sector 0
[   23.240228] device-mapper: multipath round-robin: version 1.2.0 loaded
[   23.250246] sd 0:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   23.267686] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   23.278072] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   23.288274] EDAC sbridge:  Ver: 1.1.2 
[   23.719790] sd 0:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   23.728457] sd 0:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   24.352113] sd 0:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.360922] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   25.050429] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   25.059130] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   25.624765] device-mapper: table: 253:5: multipath: error getting device
[   25.632267] device-mapper: ioctl: error adding target to table
[   25.693540] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1[   25.960102] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
-459a-4b67-8a02-f59c8600579d...
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[   26.395958] sd 0:0:0:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.404627] sd 0:0:0:1: [sdd] Sense Key : Illegal Request [current] 
[   26.411727] sd 0:0:0:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[   26.417856] sd 0:0:0:1: [sdd] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   26.433863] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.442522] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   26.449628] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   26.457507] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.465704] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.474365] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   26.481473] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   26.489355] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.497538] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.506198] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   26.513296] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   26.521170] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.037296] sd 0:0:1:0: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.045964] sd 0:0:1:0: [sdh] Sense Key : Illegal Request [current] 
[   27.053071] sd 0:0:1:0: [sdh] <<vendor>>ASC=0x94 ASCQ=0x1 
[   27.059199] sd 0:0:1:0: [sdh] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   27.068529] blk_update_request: 19 callbacks suppressed
[   27.074362] blk_update_request: I/O error, dev sdh, sector 0
[   27.587261] sd 0:0:1:2: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.595927] sd 0:0:1:2: [sdj] Sense Key : Illegal Request [current] 
[   27.603019] sd 0:0:1:2: [sdj] <<vendor>>ASC=0x94 ASCQ=0x1 
[   27.609154] sd 0:0:1:2: [sdj] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   27.618486] blk_update_request: I/O error, dev sdj, sector 0
[   27.627051] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.635713] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.642834] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.650717] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.658309] blk_update_request: critical target error, dev sdl, sector 0
[   27.666423] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.675081] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.682178] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.690052] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.697634] blk_update_request: critical target error, dev sdl, sector 0
[   27.705711] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.714378] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.721480] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.729360] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.736948] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Tell Plymouth To Write Out Runtime Data...
         Starting Preprocess NFS configuration...
         Starting Import network configuration from initramfs...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Starting Security Auditing Service...
[   27.870269] type=1305 audit(1544744631.552:3): audit_pid=9440 old=0 auid=4294967295 ses=4294967295 res=1
         Mounting RPC Pipe File System...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting GSSAPI Proxy Daemon...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Dump dmesg to /var/log/dmesg...
         Starting System Security Services Daemon...
         Starting Authorization Manager...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Load CPU microcode update...
         Starting NTP client/server...
         Starting Network Manager...
         Starting Machine Check Exception Logging Daemon...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[   28.590661] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   28.678790] igb 0000:02:00.0 ens2f0: igb: ens2f0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   28.679396] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   28.686802] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   28.768597] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   28.775382] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[   28.787401] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   28.794907] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   28.805026] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   28.812622] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   28.906786] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   28.916636] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   29.015934] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[   29.033745] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   29.579660] card: mlx4_0, QP: 0x220, inline size: 120
[   29.595862] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.[   29.607278] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready

[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[   29.628250] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   29.636662] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   29.655687] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   29.682727] ib0: enabling connected mode will cause multicast packet drops
[   29.690530] ib0: mtu > 4092 will cause multicast packet drops.
[   29.715695] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   36.623544] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   36.666312] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   36.674801] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting Dynamic System Tuning Daemon...
         Starting MUNGE authentication service...
         Starting Postfix Mail Transport Agent...
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting OpenSSH server daemon...
[[32m  OK  [0m] Reached target Network is Online.
         St[   36.851911] FS-Cache: Loaded
arting Notify NFS peers of a restart...
         Starting NFS status monitor for NFSv2/3 locking....
         Mounting /scratch...
         Starting System Logging Service...
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started OpenSSH serv[   36.893927] FS-Cache: Netfs 'nfs' registered for caching
er daemon.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[   36.918100] Key type dns_resolver registered
[   36.961947] NFS: Registering the id_resolver key type
[   36.967590] Key type id_resolver registered
[   36.972271] Key type id_legacy registered
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Automounts filesystems on demand...
         Starting Crash recovery kernel arming...
         Starting Permit User Sessions...
[[32m  OK  [0m] Started Permit User Sessions.
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Started Job spooling tools.
[[32m  OK  [0m] Started Command Scheduler.
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Created slice User Slice of root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-13T23:44:12+00:00] INFO: Forking chef instance to converge...
[2018-12-13T23:44:12+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-13T23:44:12+00:00] INFO: Chef-client pid: 11041
[2018-12-13T23:44:14+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-13T23:44:14+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-13T23:44:14+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-13T23:44:14+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-13T23:44:14+00:00] INFO: Running start handlers
[2018-12-13T23:44:14+00:00] INFO: Start handlers complete.
[2018-12-13T23:44:15+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-13T23:44:15+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-13T23:44:15+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-13T23:44:15+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-13T23:44:15+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181213234415.290203
[2018-12-13T23:44:15+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181211161024.680856
[2018-12-13T23:44:15+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-13T23:44:15+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-13T23:44:20+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-13T23:44:20+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-13T23:44:20+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-13T23:44:20+00:00] INFO: service[ntpd] started
[2018-12-13T23:44:20+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-13T23:44:21+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-13T23:44:21+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-13T23:44:21+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-13T23:44:21+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-13T23:44:21+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-13T23:44:21+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-13T23:44:21+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-13T23:44:21+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-13T23:44:21+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-13T23:44:22+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-13T23:44:22+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-13T23:44:22+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-13T23:44:22+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:22+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:22+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-13T23:44:22+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-13T23:44:23+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-13T23:44:23+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-13T23:44:23+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-13T23:44:23+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-13T23:44:24+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-13T23:44:24+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-13T23:44:24+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-13T23:44:24+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-13T23:44:24+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-13T23:44:24+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-13T23:44:24+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-13T23:44:25+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-13T23:44:25+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-13T23:44:25+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-13T23:44:25+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-13T23:44:25+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-13T23:44:25+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-13T23:44:25+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-13T23:44:25+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-13T23:44:25+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-13T23:44:25+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-13T23:44:25+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-13T23:44:25+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-13T23:44:26+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-13T23:44:26+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-13T23:44:26+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-13T23:44:26+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-13T23:44:26+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181213234426.937250
[2018-12-13T23:44:26+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181211161035.654144
[2018-12-13T23:44:26+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-13T23:44:26+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-13T23:44:26+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-13T23:44:26+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181213234426.944518
[2018-12-13T23:44:26+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181211161035.673338
[2018-12-13T23:44:26+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-13T23:44:26+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-13T23:44:26+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-13T23:44:26+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:26+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:26+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-13T23:44:26+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:26+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:26+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-13T23:44:27+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-13T23:44:27+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-13T23:44:27+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-13T23:44:27+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T23:44:27+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:27+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:27+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T23:44:27+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:27+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:27+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T23:44:27+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:27+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:27+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T23:44:27+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:27+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:27+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T23:44:27+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:27+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:27+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T23:44:27+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:27+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:27+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T23:44:27+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:27+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:27+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-13T23:44:27+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:27+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:27+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-13T23:44:28+00:00] INFO: service[xinetd] started
[2018-12-13T23:44:28+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-13T23:44:28+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-13T23:44:28+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-13T23:44:28+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-13T23:44:29+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-13T23:44:29+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-13T23:44:29+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-13T23:44:29+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-13T23:44:29+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181213234429.553156
[2018-12-13T23:44:29+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181211161037.678083
[2018-12-13T23:44:29+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-13T23:44:29+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-13T23:44:29+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-13T23:44:29+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-13T23:44:29+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-13T23:44:29+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:29+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:29+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-13T23:44:29+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-13T23:44:29+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-13T23:44:29+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-13T23:44:29+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-13T23:44:29+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:29+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:29+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-13T23:44:29+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:29+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-13T23:44:29+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-13T23:44:29+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-13T23:44:29+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-13T23:44:29+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:29+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:29+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-13T23:44:29+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:29+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-13T23:44:29+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T23:44:29+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:30+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:30+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T23:44:30+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:30+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:30+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T23:44:30+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:30+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:30+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T23:44:30+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:30+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:30+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T23:44:30+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:30+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:30+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T23:44:30+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:30+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:30+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T23:44:30+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:30+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:30+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-13T23:44:30+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-13T23:44:30+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-13T23:44:30+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-13T23:44:30+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-13T23:44:30+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-13T23:44:30+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-13T23:44:30+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-13T23:44:30+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-13T23:44:30+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-13T23:44:30+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-13T23:44:30+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-13T23:44:31+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-13T23:44:31+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-13T23:44:32+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-13T23:44:32+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-13T23:44:32+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-13T23:44:32+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-13T23:44:32+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-13T23:44:32+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-13T23:44:32+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-13T23:44:32+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-13T23:44:32+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-13T23:44:32+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-13T23:44:32+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-13T23:44:32+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-13T23:44:32+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-13T23:44:32+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-13T23:44:32+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-13T23:44:32+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-13T23:44:32+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-13T23:44:32+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-13T23:44:32+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-13T23:44:32+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-13T23:44:32+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-13T23:44:32+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-13T23:44:32+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[   71.030243] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[2018-12-13T23:44:35+00:00] INFO: service[kdump] restarted
[2018-12-13T23:44:35+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-13T23:44:35+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-13T23:44:35+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-13T23:44:35+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-13T23:44:35+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-13T23:44:35+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-13T23:44:35+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-13T23:44:35+00:00] INFO: Chef Run complete in 21.318672213 seconds
[2018-12-13T23:44:35+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-13T23:44:35+00:00] INFO: Running report handlers
[2018-12-13T23:44:35+00:00] INFO: Creating JSON run report
[2018-12-13T23:44:36+00:00] INFO: Report handlers complete
[   96.429116] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[   96.440133] alg: No test for adler32 (adler32-zlib)
[   97.282656] Lustre: Lustre: Build Version: 2.12.0_RC2
[   97.509441] LNet: Using FMR for registration
[   97.526958] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[   97.622059] LDISKFS-fs warning (device dm-0): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait.
[   97.622059] 
[  150.306781] LDISKFS-fs (dm-0): recovery complete
[  150.312982] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  151.753295] Lustre: MGS: Connection restored to d4115fdd-865b-5f8e-f0cd-0fb158f622cd (at 0@lo)
[  152.196389] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  158.419865] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 28 clients reconnect
[  159.429689] Lustre: soaked-MDT0000: Connection restored to c330be6f-8a05-bb15-2aed-89895c05578a (at 192.168.1.117@o2ib)
[  159.441729] Lustre: Skipped 1 previous similar message
[  175.195583] Lustre: soaked-MDT0000: Connection restored to aec832c0-1660-4705-d0e5-7edc6ca07104 (at 192.168.1.137@o2ib)
[  177.248017] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[  177.256974] Lustre: Skipped 20 previous similar messages
[  186.120199] Lustre: soaked-MDT0000: Connection restored to d3f80bf0-74f8-a80e-6e41-20142fcb423a (at 192.168.1.124@o2ib)
[  186.132270] Lustre: Skipped 4 previous similar messages
[  194.577704] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[  194.588228] Lustre: Skipped 10 previous similar messages
[  201.477303] Lustre: soaked-MDT0000: Recovery over after 0:43, of 28 clients 28 recovered and 0 were evicted.
[  225.368962] Lustre: MGS: Connection restored to aec832c0-1660-4705-d0e5-7edc6ca07104 (at 192.168.1.137@o2ib)
[  225.379962] Lustre: Skipped 9 previous similar messages
[  523.260155] Lustre: 12433:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544745120/real 0]  req@ffff9a118cf06f00 x1619782232008928/t0(0) o6->soaked-OST000e-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 544/432 e 0 to 1 dl 1544745127 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[  523.291131] Lustre: soaked-OST000e-osc-MDT0000: Connection to soaked-OST000e (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[  523.450137] LNetError: 12390:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 1 seconds
[  523.461525] LNetError: 12390:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.106@o2ib (8): c: 0, oc: 0, rc: 8
[  523.948062] Lustre: 12583:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544745120/real 0]  req@ffff9a0d280b4200 x1619782232030512/t0(0) o5->soaked-OST000a-osc-MDT0000@192.168.1.106@o2ib:28/4 lens 432/432 e 0 to 1 dl 1544745127 ref 3 fl Rpc:XN/0/ffffffff rc 0/-1
[  523.979154] Lustre: 12583:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 25 previous similar messages
[  524.450062] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 2 seconds
[  525.449979] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 3 seconds
[  525.461447] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 6 previous similar messages
[  528.449714] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 6 seconds
[  528.461189] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 4 previous similar messages
[  529.449715] LustreError: 12591:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST000e-osc-MDT0000: can't precreate: rc = -11
[  529.462742] LustreError: 12591:0:(osp_precreate.c:1312:osp_precreate_thread()) soaked-OST000e-osc-MDT0000: cannot precreate objects: rc = -11
[  530.449624] LustreError: 12566:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST0002-osc-MDT0000: can't precreate: rc = -11
[  530.449645] LustreError: 12583:0:(osp_precreate.c:1312:osp_precreate_thread()) soaked-OST000a-osc-MDT0000: cannot precreate objects: rc = -11
[  530.476834] LustreError: 12566:0:(osp_precreate.c:656:osp_precreate_send()) Skipped 1 previous similar message
[  533.491393] LustreError: 12574:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST0006-osc-MDT0000: can't precreate: rc = -11
[  533.504418] LustreError: 12574:0:(osp_precreate.c:1312:osp_precreate_thread()) soaked-OST0006-osc-MDT0000: cannot precreate objects: rc = -11
[  533.518608] LustreError: 12574:0:(osp_precreate.c:1312:osp_precreate_thread()) Skipped 1 previous similar message
[  731.237378] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST0002_UUID (at 192.168.1.106@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff9a11ac459000, cur 1544745335 expire 1544745185 last 1544745107
[  733.282750] Lustre: MGS: haven't heard from client dd227e3c-a252-e5b3-dcc2-d842bcdbcbb1 (at 192.168.1.106@o2ib) in 230 seconds. I think it's dead, and I am evicting it. exp ffff9a1191c86c00, cur 1544745337 expire 1544745187 last 1544745107
[  733.306439] Lustre: Skipped 3 previous similar messages
[  776.433634] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 0 seconds
[  776.445101] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 8 previous similar messages
[  780.438753] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[  780.449067] Lustre: Skipped 30 previous similar messages
[  796.002554] LNet: Service thread pid 12630 was inactive for 200.13s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[  796.021513] Pid: 12630, comm: mdt01_004 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[  796.032048] Call Trace:
[  796.034818]  [<ffffffffc16e7bf8>] osp_precreate_reserve+0x2e8/0x800 [osp]
[  796.042487]  [<ffffffffc16dc8b9>] osp_declare_create+0x199/0x5b0 [osp]
[  796.049823]  [<ffffffffc162439f>] lod_sub_declare_create+0xdf/0x210 [lod]
[  796.057468]  [<ffffffffc161c56e>] lod_qos_declare_object_on+0xbe/0x3a0 [lod]
[  796.065399]  [<ffffffffc161f50e>] lod_alloc_rr.constprop.19+0xeee/0x1490 [lod]
[  796.073521]  [<ffffffffc162362d>] lod_qos_prep_create+0x12fd/0x1890 [lod]
[  796.081184]  [<ffffffffc1623dd5>] lod_prepare_create+0x215/0x2e0 [lod]
[  796.088553]  [<ffffffffc1613cee>] lod_declare_striped_create+0x1ee/0x980 [lod]
[  796.096710]  [<ffffffffc16185c4>] lod_declare_create+0x204/0x590 [lod]
[  796.104057]  [<ffffffffc168dad2>] mdd_declare_create_object_internal+0xe2/0x2f0 [mdd]
[  796.112838]  [<ffffffffc167d5ec>] mdd_declare_create+0x4c/0xcb0 [mdd]
[  796.120099]  [<ffffffffc16816e7>] mdd_create+0x827/0x1440 [mdd]
[  796.126762]  [<ffffffffc1524660>] mdt_reint_open+0x19d0/0x27d0 [mdt]
[  796.133974]  [<ffffffffc15175e3>] mdt_reint_rec+0x83/0x210 [mdt]
[  796.140742]  [<ffffffffc14f4133>] mdt_reint_internal+0x6e3/0xaf0 [mdt]
[  796.148097]  [<ffffffffc1500972>] mdt_intent_open+0x82/0x350 [mdt]
[  796.155033]  [<ffffffffc14fea18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[  796.162278]  [<ffffffffc0fdfec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[  796.169890]  [<ffffffffc10088a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[  796.177900]  [<ffffffffc108f302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[  796.184871]  [<ffffffffc109635a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[  796.192667]  [<ffffffffc103a92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[  796.201314]  [<ffffffffc103e25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[  796.208404]  [<ffffffff9b2c1c31>] kthread+0xd1/0xe0
[  796.213904]  [<ffffffff9b974c37>] ret_from_fork_nospec_end+0x0/0x39
[  796.220985]  [<ffffffffffffffff>] 0xffffffffffffffff
[  796.226622] LustreError: dumping log to /tmp/lustre-log.1544745399.12630
[  829.430818] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 0 seconds
[  829.442289] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 3 previous similar messages
[  934.878587] Lustre: soaked-OST0002-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[  934.890089] Lustre: Skipped 3 previous similar messages
[  998.766210] LNet: Service thread pid 12630 completed after 402.91s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
[ 1003.149924] LustreError: 11-0: soaked-OST0002-osc-MDT0000: operation ost_destroy to node 192.168.1.107@o2ib failed: rc = -107
[ 1003.150063] Lustre: soaked-OST0002-osc-MDT0000: Connection to soaked-OST0002 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1003.150067] Lustre: Skipped 3 previous similar messages
[ 1003.187038] LustreError: Skipped 7 previous similar messages
[ 1016.055823] LustreError: 11-0: soaked-OST000a-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[ 1016.068421] Lustre: soaked-OST000a-osc-MDT0000: Connection to soaked-OST000a (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1027.895392] LustreError: 11-0: soaked-OST0006-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[ 1027.907952] Lustre: soaked-OST0006-osc-MDT0000: Connection to soaked-OST0006 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1033.191085] LustreError: 11-0: soaked-OST000e-osc-MDT0000: operation ost_statfs to node 192.168.1.107@o2ib failed: rc = -107
[ 1033.203646] Lustre: soaked-OST000e-osc-MDT0000: Connection to soaked-OST000e (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1057.641517] Lustre: 12993:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 1184.060212] Lustre: soaked-OST000a-osc-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[ 1184.071694] Lustre: Skipped 9 previous similar messages
[ 4263.326307] LNetError: 12390:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[ 4263.337687] LNetError: 12390:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.107@o2ib (10): c: 1, oc: 0, rc: 8
[ 4263.351550] Lustre: 12426:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544748861/real 1544748867]  req@ffff9a1118bec500 x1619782345758320/t0(0) o13->soaked-OST0003-osc-MDT0000@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544748868 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 4263.351599] Lustre: soaked-OST000f-osc-MDT0000: Connection to soaked-OST000f (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 4263.402456] Lustre: 12426:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 13 previous similar messages
[ 4265.326234] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 1 seconds
[ 4265.337694] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[ 4480.122587] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST000b_UUID (at 192.168.1.107@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9a0a1b6eec00, cur 1544749084 expire 1544748934 last 1544748857
[ 4515.824382] Lustre: soaked-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[ 4515.834687] Lustre: Skipped 2 previous similar messages
[ 4520.318193] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 1 seconds
[ 4520.329656] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[ 4550.382477] Lustre: soaked-OST0003-osc-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[ 4550.393983] Lustre: Skipped 2 previous similar messages
[ 4570.316626] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds
[ 4570.328098] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 3 previous similar messages
[ 4601.901932] LustreError: 11-0: soaked-OST000b-osc-MDT0000: operation ost_statfs to node 192.168.1.106@o2ib failed: rc = -107
[ 4601.914503] Lustre: soaked-OST000b-osc-MDT0000: Connection to soaked-OST000b (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 4601.933168] Lustre: Skipped 2 previous similar messages
[ 4610.493793] LustreError: 11-0: soaked-OST0003-osc-MDT0000: operation ost_statfs to node 192.168.1.106@o2ib failed: rc = -107
[ 4610.506356] Lustre: soaked-OST0003-osc-MDT0000: Connection to soaked-OST0003 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 4615.479927] Lustre: soaked-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 4615.490258] Lustre: Skipped 6 previous similar messages
[ 4617.853456] LustreError: 11-0: soaked-OST000f-osc-MDT0000: operation ost_statfs to node 192.168.1.106@o2ib failed: rc = -107
[ 4617.866058] Lustre: soaked-OST000f-osc-MDT0000: Connection to soaked-OST000f (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 4631.904455] LustreError: 11-0: soaked-OST0007-osc-MDT0000: operation ost_destroy to node 192.168.1.106@o2ib failed: rc = -107
[ 4631.904575] Lustre: soaked-OST0007-osc-MDT0000: Connection to soaked-OST0007 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 4631.935747] LustreError: Skipped 6 previous similar messages
[ 4658.051087] Lustre: 12630:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 4794.331253] Lustre: soaked-OST000f-osc-MDT0000: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib)
[ 4794.342738] Lustre: Skipped 5 previous similar messages
[ 5763.695918] perf: interrupt took too long (2529 > 2500), lowering kernel.perf_event_max_sample_rate to 79000
[ 8036.200356] LNetError: 12390:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 1 seconds
[ 8036.211736] LNetError: 12390:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.109@o2ib (12): c: 7, oc: 0, rc: 8
[ 8036.225631] Lustre: 12434:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544752633/real 1544752640]  req@ffff9a10ec791800 x1619782405235200/t0(0) o41->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544752640 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 8036.257972] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 8041.200199] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds
[ 8041.211671] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[ 8055.470561] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8056.058998] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.127@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8057.079091] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8057.098915] LustreError: Skipped 4 previous similar messages
[ 8060.196946] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.136@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8060.216778] LustreError: Skipped 2 previous similar messages
[ 8064.602205] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.119@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8064.622046] LustreError: Skipped 4 previous similar messages
[ 8073.167750] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8073.187593] LustreError: Skipped 18 previous similar messages
[ 8091.198453] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds
[ 8094.825034] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.143@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8094.844849] LustreError: Skipped 5 previous similar messages
[ 8127.873787] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.116@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8127.893629] LustreError: Skipped 38 previous similar messages
[ 8141.196697] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds
[ 8195.147891] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.137@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8195.167704] LustreError: Skipped 48 previous similar messages
[ 8230.099105] Lustre: MGS: haven't heard from client ea6ef518-b1c9-118a-f6e1-5150bed2663e (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9a118cf8d000, cur 1544752834 expire 1544752684 last 1544752607
[ 8230.123002] Lustre: Skipped 4 previous similar messages
[ 8235.987064] LDISKFS-fs warning (device dm-3): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait.
[ 8235.987064] 
[ 8251.618561] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9a11ad9b3400, cur 1544752855 expire 1544752705 last 1544752628
[ 8257.499386] Lustre: 17394:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 8279.369467] LDISKFS-fs (dm-3): recovery complete
[ 8279.375740] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[ 8280.738383] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[ 8280.991283] Lustre: soaked-MDT0000: Received LWP connection from 0@lo, removing former export from 192.168.1.109@o2ib
[ 8280.992847] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900
[ 8281.008749] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[ 8281.326180] LustreError: 24368:0:(llog_osd.c:1005:llog_osd_next_block()) soaked-MDT0003-osp-MDT0001: missed desired record? 3 > 1
[ 8281.339215] LustreError: 24368:0:(lod_dev.c:428:lod_sub_recovery_thread()) soaked-MDT0003-osp-MDT0001 get update log failed: rc = -2
[ 8286.298588] Lustre: 24369:0:(ldlm_lib.c:2058:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[ 8286.311154] Lustre: soaked-MDT0001: disconnecting 28 stale clients
[ 8286.319127] Lustre: 24369:0:(ldlm_lib.c:1617:abort_req_replay_queue()) @@@ aborted:  req@ffff9a111ceabc00 x1619755516159264/t0(94530680803) o35->9b8b3b04-19ab-b251-f918-d6dd034e56b3@192.168.1.130@o2ib:246/0 lens 392/0 e 0 to 0 dl 1544752896 ref 1 fl Complete:/4/ffffffff rc 0/-1
[ 8286.346653] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[ 8302.178708] Lustre: Failing over soaked-MDT0001
[ 8302.633515] Lustre: server umount soaked-MDT0001 complete
[ 8324.039961] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 8324.059963] LustreError: Skipped 105 previous similar messages
[ 8331.137161] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[ 8331.153008] LustreError: 12815:0:(osp_object.c:594:osp_attr_get()) soaked-MDT0001-osp-MDT0000:osp_attr_get update error [0x24000bf80:0x1:0x0]: rc = -5
[ 8331.157311] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 8331.157316] Lustre: Skipped 30 previous similar messages
[ 8331.185518] LustreError: 12815:0:(osp_object.c:594:osp_attr_get()) Skipped 5 previous similar messages
[ 8383.889733] perf: interrupt took too long (3184 > 3161), lowering kernel.perf_event_max_sample_rate to 62000
[ 9992.999349] LustreError: 20252:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x20000a052:0x117fc:0x0]
[11361.097774] LNetError: 12390:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[11361.109157] LNetError: 12390:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.109@o2ib (11): c: 6, oc: 0, rc: 8
[11361.123043] Lustre: 12421:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544755960/real 1544755965]  req@ffff9a111a679500 x1619782427702256/t0(0) o41->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544755973 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[11361.155405] Lustre: 12421:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 215 previous similar messages
[11361.166498] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[11361.622723] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544755965/real 1544755965]  req@ffff9a10dea8c500 x1619782427703504/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544755972 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[11361.654096] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 3179 previous similar messages
[11362.622666] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544755966/real 1544755966]  req@ffff9a10dea8c500 x1619782427703504/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544755973 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[11362.654034] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 6818 previous similar messages
[11364.622624] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544755968/real 1544755968]  req@ffff9a10dea8c500 x1619782427703504/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544755975 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[11364.653980] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 14972 previous similar messages
[11368.622581] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544755972/real 1544755972]  req@ffff9a10dea8c500 x1619782427703504/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544755979 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[11368.653948] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 28234 previous similar messages
[11376.622278] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544755980/real 1544755980]  req@ffff9a10dea8c500 x1619782427703504/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544755987 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[11376.653647] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 58006 previous similar messages
[11383.302395] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11383.322277] LustreError: Skipped 6 previous similar messages
[11392.621811] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544755996/real 1544755996]  req@ffff9a10dea8c500 x1619782427703504/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544756003 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[11392.653166] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 115842 previous similar messages
[11424.620955] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544756028/real 1544756028]  req@ffff9a10dea8c500 x1619782427703504/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544756035 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[11424.652314] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 237862 previous similar messages
[11433.476726] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11433.496547] LustreError: Skipped 42 previous similar messages
[11488.619160] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544756092/real 1544756092]  req@ffff9a10dea8c500 x1619782427703504/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544756099 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[11488.650518] Lustre: 17728:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 489463 previous similar messages
[11498.322580] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11498.342394] LustreError: Skipped 71 previous similar messages
[11508.048615] LustreError: 17728:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 192.168.1.109@o2ib) failed to reply to completion AST (req@ffff9a10dea8c500 x1619782427703504 status 0 rc -110), evict it ns: mdt-soaked-MDT0000_UUID lock: ffff9a1110ae18c0/0x24b53928aa192275 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 32 type: IBT flags: 0x60000001000020 nid: 192.168.1.109@o2ib remote: 0x4f30e0d991fe824b expref: 24 pid: 12626 timeout: 0 lvb_type: 0
[11508.096462] LustreError: 138-a: soaked-MDT0000: A client on nid 192.168.1.109@o2ib was evicted due to a lock completion callback time out: rc -110
[11508.111244] LustreError: 12477:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 1544756112s: evicting client at 192.168.1.109@o2ib  ns: mdt-soaked-MDT0000_UUID lock: ffff9a1110ae18c0/0x24b53928aa192275 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 31 type: IBT flags: 0x60000001000020 nid: 192.168.1.109@o2ib remote: 0x4f30e0d991fe824b expref: 25 pid: 12626 timeout: 0 lvb_type: 0
[11536.398781] LNet: Service thread pid 15231 was inactive for 200.58s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[11536.417720] Pid: 15231, comm: mdt01_019 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[11536.428223] Call Trace:
[11536.430983]  [<ffffffffc0ff9031>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[11536.438786]  [<ffffffffc0ff9dcc>] ldlm_cli_enqueue_local+0x23c/0x870 [ptlrpc]
[11536.446842]  [<ffffffffc151733a>] mdt_reint_rename_or_migrate.isra.51+0x67a/0x860 [mdt]
[11536.455857]  [<ffffffffc1517553>] mdt_reint_rename+0x13/0x20 [mdt]
[11536.462819]  [<ffffffffc15175e3>] mdt_reint_rec+0x83/0x210 [mdt]
[11536.469592]  [<ffffffffc14f4133>] mdt_reint_internal+0x6e3/0xaf0 [mdt]
[11536.476930]  [<ffffffffc14ff497>] mdt_reint+0x67/0x140 [mdt]
[11536.483325]  [<ffffffffc109635a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[11536.491144]  [<ffffffffc103a92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[11536.499819]  [<ffffffffc103e25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[11536.506939]  [<ffffffff9b2c1c31>] kthread+0xd1/0xe0
[11536.512458]  [<ffffffff9b974c37>] ret_from_fork_nospec_end+0x0/0x39
[11536.519507]  [<ffffffffffffffff>] 0xffffffffffffffff
[11536.525123] LustreError: dumping log to /tmp/lustre-log.1544756140.15231
[11537.654014] LNet: Service thread pid 12814 was inactive for 201.83s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[11537.672970] Pid: 12814, comm: mdt00_016 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[11537.683487] Call Trace:
[11537.686241]  [<ffffffffc0ff9031>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[11537.694035]  [<ffffffffc0ff9dcc>] ldlm_cli_enqueue_local+0x23c/0x870 [ptlrpc]
[11537.702082]  [<ffffffffc151733a>] mdt_reint_rename_or_migrate.isra.51+0x67a/0x860 [mdt]
[11537.711117]  [<ffffffffc1517553>] mdt_reint_rename+0x13/0x20 [mdt]
[11537.718055]  [<ffffffffc15175e3>] mdt_reint_rec+0x83/0x210 [mdt]
[11537.724801]  [<ffffffffc14f4133>] mdt_reint_internal+0x6e3/0xaf0 [mdt]
[11537.732133]  [<ffffffffc14ff497>] mdt_reint+0x67/0x140 [mdt]
[11537.738489]  [<ffffffffc109635a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[11537.746266]  [<ffffffffc103a92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[11537.754881]  [<ffffffffc103e25c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[11537.761948]  [<ffffffff9b2c1c31>] kthread+0xd1/0xe0
[11537.767441]  [<ffffffff9b974c37>] ret_from_fork_nospec_end+0x0/0x39
[11537.774468]  [<ffffffffffffffff>] 0xffffffffffffffff
[11567.903237] LDISKFS-fs warning (device dm-3): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait.
[11567.903237] 
[11570.198993] Lustre: MGS: haven't heard from client f75b9ea8-f5d9-0872-3cd9-5f2b0ecee4fc (at 192.168.1.109@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffff9a0d1ffc2c00, cur 1544756174 expire 1544756024 last 1544755945
[11617.090489] LNet: 12390:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds
[11620.434792] LDISKFS-fs (dm-3): 1 truncate cleaned up
[11620.440488] LDISKFS-fs (dm-3): recovery complete
[11620.450543] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[11623.823317] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[11624.050110] Lustre: soaked-MDT0000: Received LWP connection from 0@lo, removing former export from 192.168.1.109@o2ib
[11624.057903] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900
[11624.076011] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[11624.085333] Lustre: Skipped 1 previous similar message
[11624.091373] LustreError: 29357:0:(llog_osd.c:1005:llog_osd_next_block()) soaked-MDT0003-osp-MDT0001: missed desired record? 3 > 1
[11624.104396] LustreError: 29357:0:(lod_dev.c:428:lod_sub_recovery_thread()) soaked-MDT0003-osp-MDT0001 get update log failed: rc = -2
[11624.117707] LustreError: 29357:0:(lod_dev.c:428:lod_sub_recovery_thread()) Skipped 3 previous similar messages
[11629.238739] Lustre: 29359:0:(ldlm_lib.c:2058:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[11629.250873] Lustre: 29359:0:(ldlm_lib.c:2058:target_recovery_overseer()) Skipped 2 previous similar messages
[11629.262615] Lustre: soaked-MDT0001: disconnecting 27 stale clients
[11629.270583] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[11631.843844] Lustre: soaked-MDT0001: Connection restored to b8f50791-6ca4-4134-d8ce-3947fcca4b05 (at 192.168.1.119@o2ib)
[11631.855911] Lustre: Skipped 15 previous similar messages
[11634.244433] LNet: Service thread pid 12814 completed after 298.43s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
[11634.262509] LNet: Skipped 1 previous similar message
[11641.160103] Lustre: Failing over soaked-MDT0001
[11641.175753] LustreError: 12653:0:(mdt_reint.c:2603:mdt_reint_rename_or_migrate()) soaked-MDT0001: can't lock FS for rename: rc = -5
[11641.211399] Lustre: soaked-MDT0001: Not available for connect from 192.168.1.118@o2ib (stopping)
[11641.221233] Lustre: Skipped 1 previous similar message
[11642.040411] Lustre: server umount soaked-MDT0001 complete
[11642.481819] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[11642.501633] LustreError: Skipped 102 previous similar messages
[11649.580697] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[11649.589983] Lustre: Skipped 20 previous similar messages
[11674.123320] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[11674.138952] LustreError: 17394:0:(osp_object.c:594:osp_attr_get()) soaked-MDT0001-osp-MDT0000:osp_attr_get update error [0x24000bf99:0xdc7:0x0]: rc = -5
[11674.154206] LustreError: 17394:0:(osp_object.c:594:osp_attr_get()) Skipped 2 previous similar messages
[11857.921839] Lustre: 12630:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[11;01H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [m[4;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[4;79H[m[7m[5;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [5;79H[22;1H   The selected entry will be started automatically in 5s.                     [5;79H[22;1H   The selected entry will be started automatically in 4s.                     [5;79H[22;1H   The selected entry will be started automatically in 3s.                     [5;79H[22;1H   The selected entry will be started automatically in 2s.                     [5;79H[22;1H   The selected entry will be started automatically in 1s.                     [5;79H[22;1H   The selected entry will be started automatically in 0s.                     [5;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-309-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Sat Dec 8 05:53:16 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x35bfe000-0x36df6fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 162MB of memory at 688MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff94512e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 7011916k/34603008k available (7664k kernel code, 1126748k absent, 830688k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.451 MHz processor
[    0.000175] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.90 BogoMIPS (lpj=2693451)
[    0.012078] pid_max: default: 245760 minimum: 1920
[    0.018291] Security Framework initialized
[    0.022885] SELinux:  Initializing.
[    0.027067] Yama: becoming mindful.
[    0.036265] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.058057] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.072088] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.079857] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.090153] Initializing cgroup subsys memory
[    0.095085] Initializing cgroup subsys devices
[    0.100053] Initializing cgroup subsys freezer
[    0.105021] Initializing cgroup subsys net_cls
[    0.109988] Initializing cgroup subsys blkio
[    0.114762] Initializing cgroup subsys perf_event
[    0.120064] Initializing cgroup subsys hugetlb
[    0.125031] Initializing cgroup subsys pids
[    0.129707] Initializing cgroup subsys net_prio
[    0.135061] mce: CPU supports 20 MCE banks
[    0.139678] CPU0: Thermal monitoring enabled (TM1)
[    0.145098] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.151229] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.157552] tlb_flushall_shift: 6
[    0.161334] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.172073] FEATURE SPEC_CTRL Present
[    0.176167] FEATURE IBPB_SUPPORT Present
[    0.180859] Spectre V2 : Mitigation: Full retpoline
[    0.187275] Freeing SMP alternatives: 28k freed
[    0.198702] ACPI: Core revision 20130517
[    0.294015] ACPI: All ACPI Tables successfully acquired
[    0.318844] ftrace: allocating 29187 entries in 115 pages
[    0.379412] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.386800] Switched APIC routing to physical flat.
[    0.392971] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.409683] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.420178] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.431935] ... version:                3
[    0.436404] ... bit width:              48
[    0.440977] ... generic registers:      4
[    0.445455] ... value mask:             0000ffffffffffff
[    0.451387] ... max period:             00007fffffffffff
[    0.457318] ... fixed-purpose events:   3
[    0.461795] ... event mask:             000000070000000f
[    0.476053] smpboot: Booting Node   0, Processors  #1[    0.497462] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.552148] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.691207] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.733113] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.773826] Brought up 32 CPUs
[    0.777439] smpboot: Max logical packages: 15
[    0.782313] smpboot: Total of 32 processors activated (172580.51 BogoMIPS)
[    1.039016] node 0 initialised, 2808669 pages in 137ms
[    1.076753] node 1 initialised, 3599741 pages in 169ms
[    1.083716] devtmpfs: initialized
[    1.098715] EVM: security.selinux
[    1.102422] EVM: security.ima
[    1.105736] EVM: security.capability
[    1.109992] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.118856] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.131207] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.138894] pinctrl core: initialized pinctrl subsystem
[    1.145024] RTC time:  3:14:32, date: 12/14/18
[    1.150487] NET: Registered protocol family 16
[    1.155966] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.164423] ACPI: bus type PCI registered
[    1.168902] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.176744] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.187140] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.194767] PCI: Using configuration type 1 for base access
[    1.201032] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.221637] ACPI: Added _OSI(Module Device)
[    1.226312] ACPI: Added _OSI(Processor Device)
[    1.231276] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.236528] ACPI: Added _OSI(Processor Aggregator Device)
[    1.242548] ACPI: Added _OSI(Linux-Dell-Video)
[    1.287168] ACPI: Executed 1 blocks of module-level executable AML code
[    1.576020] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.609310] ACPI: Interpreter enabled
[    1.613434] ACPI: (supports S0 S1 S5)
[    1.617526] ACPI: Using IOAPIC for interrupt routing
[    1.623195] HEST: Table parsing has been initialized.
[    1.628841] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.639108] ACPI: GPE 0x1E active on init
[    1.643620] ACPI: GPE 0x24 active on init
[    1.648122] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.713937] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.720850] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.730518] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.739004] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.747556] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.756978] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.768642] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.783500] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.798740] PCI host bridge to bus 0000:00
[    1.803311] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.810214] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.818574] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.826932] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.835292] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.843650] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.852009] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.860368] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.868726] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.877086] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.885444] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.893803] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.902160] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.910517] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.918875] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.928009] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.934664] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.941299] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.947944] pci 0000:00:02.0: System wakeup disabled by ACPI
[    1.954575] pci 0000:00:02.2: System wakeup disabled by ACPI
[    1.961210] pci 0000:00:03.0: System wakeup disabled by ACPI
[    1.971466] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    1.978136] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    1.984755] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    1.991419] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    1.997978] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.005268] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.011001] acpiphp: Slot [2] registered
[    2.015669] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.025992] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.036659] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.046994] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.057661] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.067985] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.078659] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.088984] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.101306] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.107373] acpiphp: Slot [2-2] registered
[    2.114458] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.120206] acpiphp: Slot [2-3] registered
[    2.124824] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.130543] acpiphp: Slot [2-4] registered
[    2.135463] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.141368] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.154177] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.159850] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.165831] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.172237] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.177909] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.186881] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.194785] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.202682] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.210589] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.218484] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.226385] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.234290] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.242183] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.250292] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.257202] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.266612] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.274941] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.283493] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.293069] PCI host bridge to bus 0000:80
[    2.297649] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.305232] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.312816] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.321173] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.329532] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.338665] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.345029] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.351636] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.358232] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.364817] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.373642] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.379293] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.384929] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.390576] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.407101] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.413721] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.422912] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.432582] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.439584] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.448852] PCI host bridge to bus 0000:7f
[    2.453431] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.464048] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.470658] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.479839] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.489510] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.496516] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.505791] PCI host bridge to bus 0000:ff
[    2.510369] pci_bus 0000:ff: root bus resource [bus ff]
[    2.521596] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.530658] vgaarb: loaded
[    2.533681] vgaarb: bridge control possible 0000:09:00.0
[    2.540048] SCSI subsystem initialized
[    2.544293] ACPI: bus type USB registered
[    2.548810] usbcore: registered new interface driver usbfs
[    2.554956] usbcore: registered new interface driver hub
[    2.561177] usbcore: registered new device driver usb
[    2.567356] EDAC MC: Ver: 3.0.0
[    2.571406] PCI: Using ACPI for IRQ routing
[    2.583678] NetLabel: Initializing
[    2.587478] NetLabel:  domain hash size = 128
[    2.592343] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.597927] NetLabel:  unlabeled traffic allowed by default
[    2.604479] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.611494] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.620050] amd_nb: Cannot enumerate AMD northbridges
[    2.625905] Switched to clocksource hpet
[    2.644793] pnp: PnP ACPI init
[    2.648237] ACPI: bus type PNP registered
[    2.653010] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.659632] system 00:00: [io  0xffff] has been reserved
[    2.665569] system 00:00: [io  0xffff] has been reserved
[    2.671505] system 00:00: [io  0xffff] has been reserved
[    2.677443] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.684446] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.691063] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.697679] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.704295] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.711300] system 00:00: [io  0x0cf9] could not be reserved
[    2.717834] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.726012] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.733400] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.740793] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.748178] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.755566] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.762957] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.770738] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.778509] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.786292] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.794201] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.802509] pnp: PnP ACPI: found 7 devices
[    2.807092] ACPI: bus type PNP unregistered
[    2.821156] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.826723] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.832567] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.839380] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.846974] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.852527] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.860116] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.869548] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.875106] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.880655] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.887471] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.895064] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.900616] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    2.907431] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    2.915021] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    2.924453] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.930017] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.935570] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    2.943160] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    2.951816] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    2.957599] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.963162] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.968723] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.974283] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.980220] NET: Registered protocol family 2
[    2.987232] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    2.996396] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.004144] TCP: Hash tables configured (established 262144 bind 65536)
[    3.011628] TCP: reno registered
[    3.015400] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.022560] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.031233] NET: Registered protocol family 1
[    4.135907] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.243924] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.252431] Un packing initram[    5.818614] Freeing initrd memory: 18404k freed
[    5.830784] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.837994] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff944db73c7000-ffff944dbb3c6fff]
[    5.849465] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    5.858311] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    5.864736] RAPL PMU: hw unit of domain package 2^-16 Joules
[    5.871068] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    5.890275] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    5.897103] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    5.911078] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    5.919334] Initialise system trusted keyring
[    5.924340] audit: initializing netlink socket (disabled)
[    5.930395] type=2000 audit(1544757273.459:1): initialized
[    5.992479] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    5.999591] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.009839] zpool: loaded
[    6.012784] zbud: loaded
[    6.016805] VFS: Disk quotas dquot_6.6.0
[    6.021694] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.030411] msgmni has been set to 32768
[    6.035191] Key type big_key registered
[    6.042117] NET: Registered protocol family 38
[    6.047106] Key type asymmetric registered
[    6.051693] Asymmetric key parser 'x509' registered
[    6.057314] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.065868] io scheduler noop registered
[    6.070267] io scheduler deadline registered (default)
[    6.076172] io scheduler cfq registered
[    6.080470] io scheduler mq-deadline registered
[    6.085541] io scheduler kyber registered
[    6.095907] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.103743] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.111542] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.118847] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.126153] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.133459] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.140789] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.148580] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.155939] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.163770] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.171561] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.178904] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.186695] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.194000] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.201342] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.209180] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.216971] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.224318] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.232138] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.239966] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.247784] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.255686] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.261928] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.269378] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.277677] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.285953] ACPI: Power Button [PWRF]
[    6.290141] ACPI: Requesting acpi_cpufreq
[    6.377780] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.386222] pstore: Registered erst as persistent store backend
[    6.393168] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.401666] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.429535] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.456656] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.463993] Non-volatile memory driver v1.3
[    6.468761] Linux agpgart interface v0.103
[    6.473773] crash memory driver: version 1.1
[    6.479045] rdac: device handler registered
[    6.483801] hp_sw: device handler registered
[    6.488603] emc: device handler registered
[    6.493476] alua: device handler registered
[    6.498261] libphy: Fixed MDIO Bus: probed
[    6.502947] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.510267] ehci-pci: EHCI PCI platform driver
[    6.515697] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.521685] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.529981] ehci-pci 0000:00:1a.0: debug port 2
[    6.539025] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.550970] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.557486] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.565075] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.573145] usb usb1: Product: EHCI Host Controller
[    6.578609] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.586787] usb usb1: SerialNumber: 0000:00:1a.0
[    6.592177] hub 1-0:1.0: USB hub found
[    6.596394] hub 1-0:1.0: 2 ports detected
[    6.601462] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    6.607412] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    6.615707] ehci-pci 0000:00:1d.0: debug port 2
[    6.624751] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    6.636965] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    6.643490] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    6.651069] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.659152] usb usb2: Product: EHCI Host Controller
[    6.664613] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.672784] usb usb2: SerialNumber: 0000:00:1d.0
[    6.678166] hub 2-0:1.0: USB hub found
[    6.682384] hub 2-0:1.0: 2 ports detected
[    6.687123] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    6.694063] ohci-pci: OHCI PCI platform driver
[    6.699090] uhci_hcd: USB Universal Host Controller Interface driver
[    6.706352] usbcore: registered new interface driver usbserial_generic
[    6.713666] usbserial: USB Serial support registered for generic
[    6.720445] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    6.884981] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    7.772874] i8042: No controller found
[    7.777151] Switched to clocksource tsc
[    7.777246] mousedev: PS/2 mouse device common for all mice
[    7.777315] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    7.777489] rtc_cmos 00:01: RTC can wake from S4
[    7.777734] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    7.777791] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    7.777925] intel_pstate: Intel P-state driver initializing
[    7.789239] cpuidle: using governor menu
[    7.790782] hidraw: raw HID events driver (C) Jiri Kosina
[    7.791049] usbcore: registered new interface driver usbhid
[    7.791050] usbhid: USB HID core driver
[    7.791275] drop_monitor: Initializing network drop monitor service
[    7.791814] TCP: cubic registered
[    7.791824] Initializing XFRM netlink socket
[    7.792520] NET: Registered protocol family 10
[    7.794176] NET: Registered protocol family 17
[    7.794190] mpls_gso: MPLS GSO support
[    7.795951] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    7.800462] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    7.800707] Loading compiled-in X.509 certificates
[    7.801836] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    7.802899] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    7.803939] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: d73e894149b8945b8dc07cc18b4508db322683f2'
[    7.804009] registered taskstats version 1
[    7.808221] Key type trusted registered
[    7.811705] Key type encrypted registered
[    7.811846] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.813494]   Magic number: 14:571:209
[    7.813813] acpi device:60: hash matches
[    7.815524] rtc_cmos 00:01: setting system clock to 2018-12-14 03:14:39 UTC (1544757279)
[    7.828007] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    7.902464] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    7.902468] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.902939] hub 1-1:1.0: USB hub found
[    7.903116] hub 1-1:1.0: 6 ports detected
[    7.952213] random: fast init done
[    7.952507] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    7.952511] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.952902] hub 2-1:1.0: USB hub found
[    7.953118] hub 2-1:1.0: 8 ports detected
[    8.029755] Freeing unused kernel memory: 1876k freed
[    8.036217] Write protecting the kernel read-only data: 12288k
[    8.046007] Freeing unused kernel memory: 516k freed
[    8.054569] Freeing unused kernel memory: 600k freed
[    8.073861] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.095367] systemd[1]: Detected architecture x86-64.
[    8.101032] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.117207] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.193617] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.204165] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[    8.217209] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.228045] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
[     8.235700] s
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.248120] systemd[1]: Reached target Sockets.
[[32m  OK  [0m] Reached target Sockets.
[    8.258124] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[     8.268128] sstems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.281125] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.291231] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.302137] systemd[1]: Reached target Slices.
[ [32m  OK  [0mes.
[    8.312899] systemd[1]: Starting Setup Virtual Console...
          Starting Setup     8.324873] systemd[1]: Starting Journal Service...
         Starting Journal Servic[    8.342624] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
e...
[    8.350987] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.359699] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.365833] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.372255] usb 2-1.4: SerialNumber: serial
[    8.372940] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Startin[    8.389034] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
g Create list of required st... nodes for the current kernel...
[    8.412803] systemd[1]: Starting dracut cmdline hook...
         Starting dracut cmdline hook...
[    8.424816] systemd[1]: Starting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.436488] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Setup Virtual Console.
[    8.454333] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
[[32m  OK  [0m[    8.472658] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
] Started Create[    8.487770] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
 list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Apply Kernel Variables.
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut cmdline hook.
         Starting dracut pre-udev hook...
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Show Plymouth Boot Screen...
[    8.772610] dca service started, version 1.12.1
         Starting dracut initque[    8.780669] pps_core: LinuxPPS API ver. 1 registered
ue hook...
[[[    8.786350] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
32m  OK  [0m] Reached target Sy[    8.799975] mlx_compat: loading out-of-tree module taints kernel.
stem Initializat[    8.809150] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
ion.
[[32m  O[    8.821928] PTP clock support registered
K  [0m] Started[    8.821958] Compat-mlnx-ofed backport release: b4fdfac
 Show Plymouth B[    8.821959] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
oot Screen.
[[    8.821960] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[32m  OK  [0m] Started Forward Password Requests to Plymouth Di[    8.856069] mpt2sas version 20.103.01.00 loaded
rectory Watch.[    8.862184] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control

[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Reached target Basi[    8.879101] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
c System.
[    8.879945] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32666996 kB)
[    8.897347] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.905390] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    8.906099] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    8.906135] mlx4_core: Initializing 0000:04:00.0
[    8.915529] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    8.915534] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    8.926881] scsi host1: ahci
[    8.927695] scsi host2: ahci
[    8.928062] scsi host3: ahci
[    8.929966] scsi host4: ahci
[    8.930228] scsi host5: ahci
[    8.930486] scsi host6: ahci
[    8.930560] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 41
[    8.930564] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 41
[    8.930567] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 41
[    8.930569] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 41
[    8.930572] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 41
[    8.930587] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 41
[    8.934512] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[    8.935065] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 51
[    8.935066] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 52
[    8.935066] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 53
[    8.935067] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 54
[    8.935067] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 55
[    8.935068] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 56
[    8.935068] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 57
[    8.935069] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 58
[    8.935069] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 59
[    8.935070] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 60
[    8.935070] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 61
[    8.935071] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 62
[    8.935072] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 63
[    8.935072] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 64
[    8.935073] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 65
[    8.935073] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 66
[    8.935075] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffaa2903aa0000), size(65536)
[    8.935075] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[    8.972011] igb 0000:02:00.0: added PHC on eth0
[    8.972013] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.972014] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    8.972087] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    8.972088] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.972652] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.000995] mpt2sas_cm0: sending message unit reset !!
[    9.002501] mpt2sas_cm0: message unit reset: SUCCESS
[    9.003729] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    9.003764] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.003773] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    9.003778] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    9.003786] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.003790] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.003973] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.006461] scsi host7: isci
[    9.009454] igb 0000:02:00.1: added PHC on eth1
[    9.009455] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.009456] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.009529] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.009530] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.063515] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[    9.063516] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[    9.063517] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    9.065106] igb 0000:02:00.2: added PHC on eth2
[    9.065107] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.065108] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.065181] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.065182] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.108879] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[    9.108881] mpt2sas_cm0: Protocol=(
[    9.108881] Initiator
[    9.108881] ,Target
[    9.108882] ), 
[    9.108882] Capabilities=(
[    9.108883] TLR
[    9.108883] ,EEDP
[    9.108883] ,Snapshot Buffer
[    9.108884] ,Diag Trace Buffer
[    9.108884] ,Task Set Full
[    9.108885] ,NCQ
[    9.108885] )
[    9.108930] scsi host0: Fusion MPT SAS Host
[    9.109257] mpt2sas_cm0: sending port enable !!
%G%G[    9.111827] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[    9.119921] igb 0000:02:00.3: added PHC on eth3
[    9.119922] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.119923] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.119997] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.119998] mpt2sas_cm0: port enable: SUCCESS
[    9.119999] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.120922] scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.120935] scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.120937] scsi 0:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.120939] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.237015] ata1: SATA link down (SStatus 0 SControl 300)
[    9.237044] ata5: SATA link down (SStatus 0 SControl 300)
[    9.238015] ata3: SATA link down (SStatus 0 SControl 300)
[    9.238044] ata2: SATA link down (SStatus 0 SControl 300)
[    9.239017] ata4: SATA link down (SStatus 0 SControl 300)
[    9.245014] ata6: SATA link down (SStatus 0 SControl 300)
[    9.344259] [TTM] Zone  kernel: Available graphics memory: 16333498 kiB
[    9.344259] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.344260] [TTM] Initializing pool allocator
[    9.344264] [TTM] Initializing DMA pool allocator
[    9.389924] fbcon: mgadrmfb (fb0) is primary device
[    9.418787] scsi 0:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.418793] scsi 0:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.418795] scsi 0:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.418799] scsi 0:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.443393] scsi 0:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.443402] scsi 0:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.443405] scsi 0:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.443411] scsi 0:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.462350] scsi 0:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.462358] scsi 0:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.462361] scsi 0:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.462366] scsi 0:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.498631] scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.498636] scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.498637] scsi 0:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.498640] scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.510978] scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.510982] scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.510984] scsi 0:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.510987] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.526784] scsi 0:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.526792] scsi 0:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.526796] scsi 0:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.526811] scsi 0:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.540433] scsi 0:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.540440] scsi 0:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.540443] scsi 0:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.540448] scsi 0:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.552433] scsi 0:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.552452] scsi 0:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.552454] scsi 0:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.552458] scsi 0:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.567510] scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.567519] scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.567522] scsi 0:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.567527] scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.622881] Console: switching to colour frame buffer device 128x48
[    9.677080] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.732067] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   10.680932] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   10.687169] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   10.695576] ata7.00: configured for UDMA/133
[   10.711555] scsi 7:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.437465] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.444471] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.451287] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.458504] mlx4_core: device is working in RoCE mode: Roce V1
[   15.465043] mlx4_core: UD QP Gid type is: V1
[   16.515358] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   16.928240] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   16.934489] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   16.943124] ata8.00: configured for UDMA/133
[   16.959037] scsi 7:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   16.982858] scsi 0:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   16.989124] scsi 0:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   16.995781] scsi 0:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   17.002065] scsi 0:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   17.008768] scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   17.015158] scsi 0:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   17.021388] scsi 0:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   17.027376] sd 7:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.027430] sd 7:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.027523] sd 7:0:1:0: [sdb] Write Protect is off
[   17.027563] sd 7:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.027706] sd 0:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.027758] scsi 0:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   17.027874] sd 0:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.027927] sd 0:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.028061] sd 0:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.028142] sd 0:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.028282] sd 0:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.028301] sd 0:0:1:3: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.028334] sd 0:0:1:1: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.028490] sd 0:0:1:2: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.028544] sd 0:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.029085] sd 0:0:0:0: [sdc] Write Protect is off
[   17.029380] sd 0:0:0:1: [sdd] Write Protect is off
[   17.029573] sd 0:0:0:2: [sde] Write Protect is off
[   17.029590] sd 0:0:1:0: [sdh] Write Protect is off
[   17.029685] sd 0:0:0:3: [sdf] Write Protect is off
[   17.029799] sd 0:0:1:3: [sdi] Write Protect is off
[   17.029856] sd 0:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.029907] sd 0:0:1:1: [sdj] Write Protect is off
[   17.029959] sd 0:0:0:7: [sdg] Write Protect is off
[   17.030114] sd 0:0:1:2: [sdk] Write Protect is off
[   17.030130] sd 0:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.030227] sd 0:0:1:7: [sdl] Write Protect is off
[   17.030402] sd 0:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.030412] sd 0:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.030502] sd 0:0:1:3: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.030597] sd 0:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.030682] sd 0:0:1:1: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.030687]  sdb:
[   17.030949] sd 0:0:1:2: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.030962] sd 7:0:1:0: [sdb] Attached SCSI disk
[   17.031041] sd 0:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.031256] sd 0:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.034524] Dev sdh: unable to read RDB block 0
[   17.034536]  sdh: unable to read partition table
[   17.034801] Dev sdd: unable to read RDB block 0
[   17.034815]  sdd: unable to read partition table
[   17.034974] Dev sdf: unable to read RDB block 0
[   17.034986]  sdf: unable to read partition table
[   17.035249] Dev sdk: unable to read RDB block 0
[   17.035261]  sdk: unable to read partition table
[   17.037885] sd 0:0:0:0: [sdc] Attached SCSI disk
[   17.037934] sd 0:0:1:0: [sdh] Attached SCSI disk
[   17.037979] sd 0:0:0:1: [sdd] Attached SCSI disk
[   17.038115] sd 0:0:0:3: [sdf] Attached SCSI disk
[   17.038240] sd 0:0:0:2: [sde] Attached SCSI disk
[   17.038271] sd 0:0:1:2: [sdk] Attached SCSI disk
[   17.038489] sd 0:0:1:1: [sdj] Attached SCSI disk
[   17.039303] sd 0:0:1:3: [sdi] Attached SCSI disk
[   17.255645] random: crng init done
[   17.255655]  sdg:
[   17.256882] sd 0:0:0:7: [sdg] Attached SCSI disk
[   17.399932] sd 7:0:0:0: [sda] Write Protect is off
[   17.405309] sd 7:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.433398]  sdl:
[   17.437013] sd 0:0:1:7: [sdl] Attached SCSI disk
[   17.442193]  sda: sda1 sda2
[   17.445897] sd 7:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
         Mounting /sysroot...
[   19.307868] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
[[32m  OK  [0m] Stopped target Timers.
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Swap.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped d[   19.704466] systemd-journald[283]: Received SIGTERM from PID 1 (systemd).
racut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Closed udev Kernel Socket.
[[32m  OK  [0m] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   20.025806] SELinux:  Disabled at runtime.
[   20.074265] type=1404 audit(1544757291.759:2): selinux=0 auid=4294967295 ses=4294967295
[   20.316266] ip_tables: (C) 2000-2006 Netfilter Core Team
[   20.323350] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
[[32m  OK  [0m] Listening on udev Control Socket.
         Starting Kernel Module supporting RPCSEC_GSS...
         Mounting Huge Pages File System...
[[32m  OK  [0m] Listening on udev Kernel Socket.
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
         Starting Read and set NIS domainname from /etc/sysconfig/network...
         Starting Create list of required st... nodes for the current kernel...
         Starting Availability of block devices...
         Mounting Debug File System...
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
         Starting Replay Read-Ahead Data...
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd Root File System.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] M[   21.675514] EXT4-fs (sda1): re-mounted. Opts: (null)
ounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting Flush Journal to Persistent Storage...
         Starting Configure read-only root support...
         Starting udev Coldplug all Devices...
[   21.727183] RPC: Registered named UNIX socket transport module.
[   21.733806] RPC: Registered udp transport module.
[   21.739063] RPC: Registered tcp transport module.
[   21.739064] RPC: Registered tcp NFSv4.1 backchannel transport module.
[[32m  OK  [0m] Started LVM2 metadata daemon.
[[32m  OK  [0m] Started Read[   21.758095] systemd-journald[4545]: Received request to flush runtime journal from PID 1
 and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev [   21.807103] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.815857] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   21.822985] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   21.830867] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.838465] blk_update_request: critical target error, dev sdg, sector 0
Kernel Device Ma[   21.847560] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
nager...
[   21.856241] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   21.856244] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   21.856247] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.856250] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[   21.896568] device-mapper: uevent: version 1.0.3
[   21.901931] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[[32m  OK  [0m] Started udev Kernel Device Manager.
[   22.378231] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.390320] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.407054] ipmi message handler version 39.2
[   22.414051] ipmi device interface
[   22.427326] IPMI System Interface driver.
[   22.431832] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   22.438550] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   22.445172] ipmi_si: Adding SMBIOS-specified kcs state machine
[   22.451836] ipmi_platform: probing via SPMI
[   22.456514] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   22.462934] (NULL device *): SPMI-specified kcs state machine: duplicate
[   22.470475] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   22.532649] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   22.544191] i801_smbus 0000:07:00.3: Enabling SMBus device
[   22.550411] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   22.558136] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   22.558257] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   22.560197] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   22.582563] sd 7:0:0:0: Attached scsi generic sg0 type 0
[[32m  OK  [0m[   22.588750] sd 7:0:1:0: Attached scsi generic sg1 type 0
] Found device /[   22.591432] igb 0000:02:00.0: DCA enabled
dev/ttyS0.
[   22.591471] igb 0000:02:00.1: DCA enabled
[   22.592746] igb 0000:02:00.2: DCA enabled
[   22.592772] igb 0000:02:00.3: DCA enabled
[   22.616928] sd 0:0:0:0: Attached scsi generic sg2 type 0
[   22.623037] sd 0:0:0:1: Attached scsi generic sg3 type 0
[   22.623229] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   22.624985] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   22.642979] sd 0:0:0:2: Attached scsi generic sg4 type 0
[   22.649053] sd 0:0:0:3: Attached scsi generic sg5 type 0
[   22.655099] sd 0:0:0:7: Attached scsi generic sg6 type 0
[   22.661172] sd 0:0:1:0: Attached scsi generic sg7 type 0
[   22.667220] sd 0:0:1:1: Attached scsi generic sg8 type 0
[   22.673216] IPMI SSIF Interface driver
[   22.673249] sd 0:0:1:2: Attached scsi generic sg9 type 0
[   22.673333] sd 0:0:1:3: Attached scsi generic sg10 type 0
[   22.673413] sd 0:0:1:7: Attached scsi generic sg11 type 0
[   22.696112] cryptd: max_cpu_qlen set to 1000
[   22.715253] AVX version of gcm_enc/dec engaged.
[   22.720327] AES CTR mode by8 optimization enabled
%G%G[   22.728913] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.736351] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.832089] iTCO_vendor_support: vendor-support=0
[   22.873857] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.873910] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.903560] kvm: disabled by bios
[   22.916770] kvm: disabled by bios
[   22.928685] kvm: disabled by bios
[   22.939503] kvm: disabled by bios
[   22.949531] kvm: disabled by bios
[   22.960515] kvm: disabled by bios
[   22.974074] kvm: disabled by bios
[   22.984726] kvm: disabled by bios
[   22.987789] blk_update_request: I/O error, dev sdh, sector 0
[   22.987924] blk_update_request: I/O error, dev sdd, sector 0
[   22.987927] blk_update_request: I/O error, dev sdf, sector 0
[   22.988097] blk_update_request: I/O error, dev sdk, sector 0
[   23.013941] intel_rapl: Found RAPL domain package
[   23.019207] intel_rapl: Found RAPL domain core
[   23.024180] intel_rapl: Found RAPL domain dram
[   23.029198] intel_rapl: Found RAPL domain package
[   23.034473] intel_rapl: Found RAPL domain core
[   23.039454] intel_rapl: Found RAPL domain dram
[   23.081476] blk_update_request: I/O error, dev sdk, sector 0
[   23.081948] blk_update_request: I/O error, dev sdh, sector 0
[   23.082180] blk_update_request: I/O error, dev sdd, sector 0
[   23.082204] blk_update_request: I/O error, dev sdf, sector 0
[   23.123728] device-mapper: multipath round-robin: version 1.2.0 loaded
[   23.134130] sd 0:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   23.152585] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   23.162975] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   23.173175] EDAC sbridge:  Ver: 1.1.2 
[   23.616541] sd 0:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   23.625257] sd 0:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   24.874310] device-mapper: table: 253:5: multipath: error getting device
[   24.881811] device-mapper: ioctl: error adding target to table
[   25.096201] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   25.104868] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   25.111999] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   25.119884] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   25.128097] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   25.136772] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   25.143883] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   25.151749] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   25.160091] sd 0:0:0:7: [sdg] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   25.168759] sd 0:0:0:7: [sdg] Sense Key : Illegal Request [current] 
[   25.175866] sd 0:0:0:7: [sdg] Add. Sense: Logical block address out of range
[   25.183749] sd 0:0:0:7: [sdg] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-[   25.339406] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
f59c8600579d...
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[   29.892735] sd 0:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   29.901434] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   30.597813] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   30.606526] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   31.237988] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   32.523442] sd 0:0:1:0: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   32.532125] sd 0:0:1:0: [sdh] Sense Key : Illegal Request [current] 
[   32.539239] sd 0:0:1:0: [sdh] <<vendor>>ASC=0x94 ASCQ=0x1 
[   32.545380] sd 0:0:1:0: [sdh] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   32.554704] blk_update_request: 19 callbacks suppressed
[   32.560550] blk_update_request: I/O error, dev sdh, sector 0
[   32.570705] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   32.579380] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   32.586492] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   32.594383] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   32.601972] blk_update_request: critical target error, dev sdl, sector 0
[   32.610129] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   32.618802] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   32.625901] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   32.633773] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   32.641354] blk_update_request: critical target error, dev sdl, sector 0
[   32.649548] sd 0:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   32.658213] sd 0:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   32.665318] sd 0:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   32.673192] sd 0:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   32.680781] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Import network configuration from initramfs...
         Starting Preprocess NFS configuration...
         Starting Tell Plymouth To Write Out Runtime Data...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Mounting RPC Pipe File System...
         Starting Security Auditing Service...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   32.813637] type=1305 audit(1544757304.498:3): audit_pid=9399 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting Authorization Manager...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Load CPU microcode update...
         Starting GSSAPI Proxy Daemon...
         Starting System Security Services Daemon...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting NTP client/server...
         Starting Dump dmesg to /var/log/dmesg...
         Starting Machine Check Exception Logging Daemon...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[   33.491704] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   33.580226] igb 0000:02:00.0 ens2f0: igb: ens2f0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   33.581901] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   33.586840] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   33.668706] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   33.675498] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[   33.687483] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   33.694788] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   33.704802] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   33.712387] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   33.806388] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   33.816834] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   33.935354] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   35.533943] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[   35.970656] card: mlx4_0, QP: 0x220, inline size: 120
[   35.987191] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [   35.999568] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[0m] Started mlnx_interface_mgr - configure ib0.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[   36.022037] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   36.031004] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   36.049989] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   36.075824] ib0: enabling connected mode will cause multicast packet drops
[   36.083690] ib0: mtu > 4092 will cause multicast packet drops.
[   36.107269] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   43.054736] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   43.095353] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   43.103971] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
[[32m  OK  [0m] Reached target Network is Online.
         Mounting /scratch...
         Starting NFS status monitor for NFSv2/3 locking....
    [   43.256108] FS-Cache: Loaded
     Starting Notify NFS peers of a restart...
         Starting OpenSSH server daemon...
         Starting System Logging Service...
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting MUNGE authentication service...
         Starting Postfix Mail Transport Agent...
         Starting Dynamic System Tuning Daemon...
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[   43.334899] FS-Cache: Netfs 'nfs' registered for caching
[   43.357507] Key type dns_resolver registered
[   43.392589] NFS: Registering the id_resolver key type
[   43.398252] Key type id_resolver registered
[   43.402923] Key type id_legacy registered
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Permit User Sessions...
         Starting Automounts filesystems on demand...
         Starting Crash recovery kernel arming...
[[32m  OK  [0m] Started Permit User Sessions.
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Command Scheduler.
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Started Job spooling tools.
[[32m  OK  [0m] Created slice User Slice of root.
[[32m  OK  [0m] Started Session 1 of user root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-14T03:15:27+00:00] INFO: Forking chef instance to converge...
[2018-12-14T03:15:27+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-14T03:15:27+00:00] INFO: Chef-client pid: 10994
[2018-12-14T03:15:28+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-14T03:15:28+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-14T03:15:28+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-14T03:15:28+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-14T03:15:28+00:00] INFO: Running start handlers
[2018-12-14T03:15:28+00:00] INFO: Start handlers complete.
[2018-12-14T03:15:29+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-14T03:15:29+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-14T03:15:29+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-14T03:15:29+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-14T03:15:29+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181214031529.659617
[2018-12-14T03:15:29+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181213070545.259465
[2018-12-14T03:15:29+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-14T03:15:29+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-14T03:15:34+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-14T03:15:34+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-14T03:15:34+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-14T03:15:35+00:00] INFO: service[ntpd] started
[2018-12-14T03:15:35+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-14T03:15:35+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-14T03:15:35+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-14T03:15:35+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-14T03:15:35+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-14T03:15:35+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-14T03:15:35+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-14T03:15:35+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-14T03:15:35+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-14T03:15:36+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-14T03:15:36+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-14T03:15:36+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-14T03:15:36+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-14T03:15:36+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:36+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:36+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-14T03:15:37+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-14T03:15:37+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-14T03:15:37+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-14T03:15:37+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-14T03:15:38+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-14T03:15:38+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-14T03:15:38+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-14T03:15:38+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-14T03:15:38+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-14T03:15:38+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-14T03:15:38+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-14T03:15:39+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-14T03:15:39+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-14T03:15:39+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-14T03:15:39+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-14T03:15:40+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-14T03:15:40+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-14T03:15:40+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-14T03:15:40+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-14T03:15:40+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-14T03:15:40+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-14T03:15:40+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-14T03:15:40+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-14T03:15:40+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-14T03:15:40+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-14T03:15:41+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-14T03:15:41+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-14T03:15:41+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-14T03:15:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181214031541.113181
[2018-12-14T03:15:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181213070556.593160
[2018-12-14T03:15:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-14T03:15:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-14T03:15:41+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-14T03:15:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181214031541.125847
[2018-12-14T03:15:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181213070556.600159
[2018-12-14T03:15:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-14T03:15:41+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-14T03:15:41+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-14T03:15:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-14T03:15:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-14T03:15:41+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-14T03:15:41+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T03:15:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T03:15:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T03:15:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T03:15:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T03:15:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T03:15:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T03:15:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T03:15:41+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:41+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:41+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-14T03:15:42+00:00] INFO: service[xinetd] started
[2018-12-14T03:15:42+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-14T03:15:42+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-14T03:15:42+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-14T03:15:42+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-14T03:15:42+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-14T03:15:43+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-14T03:15:43+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-14T03:15:43+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-14T03:15:43+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181214031543.247485
[2018-12-14T03:15:43+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181213070559.342942
[2018-12-14T03:15:43+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-14T03:15:43+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-14T03:15:43+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-14T03:15:43+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-14T03:15:43+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-14T03:15:43+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-14T03:15:43+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-14T03:15:43+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T03:15:43+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T03:15:43+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T03:15:43+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-14T03:15:43+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-14T03:15:43+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-14T03:15:43+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-14T03:15:44+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-14T03:15:44+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-14T03:15:44+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-14T03:15:44+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-14T03:15:44+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-14T03:15:44+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-14T03:15:45+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-14T03:15:45+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-14T03:15:45+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-14T03:15:45+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-14T03:15:45+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-14T03:15:45+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-14T03:15:45+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-14T03:15:45+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-14T03:15:45+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-14T03:15:45+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-14T03:15:45+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-14T03:15:45+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-14T03:15:45+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-14T03:15:45+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-14T03:15:46+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-14T03:15:46+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-14T03:15:46+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-14T03:15:46+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-14T03:15:46+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-14T03:15:46+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-14T03:15:46+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-14T03:15:46+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-14T03:15:46+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-14T03:15:46+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-14T03:15:46+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[2018-12-14T03:15:49+00:00] INFO: service[kdump] restarted
[2018-12-14T03:15:49+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-14T03:15:49+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-14T03:15:49+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-14T03:15:49+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-14T03:15:49+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-14T03:15:49+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-14T03:15:49+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-14T03:15:49+00:00] INFO: Chef Run complete in 20.885809046 seconds
[2018-12-14T03:15:49+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-14T03:15:49+00:00] INFO: Running report handlers
[2018-12-14T03:15:49+00:00] INFO: Creating JSON run report
[2018-12-14T03:15:50+00:00] INFO: Report handlers complete
[   79.663793] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[  246.023813] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  246.034311] alg: No test for adler32 (adler32-zlib)
[  246.913725] Lustre: Lustre: Build Version: 2.12.0_RC2
[  247.143944] LNet: Using FMR for registration
[  247.159646] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  247.252901] LDISKFS-fs warning (device dm-2): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait.
[  247.252901] 
[  299.855203] LDISKFS-fs (dm-2): recovery complete
[  299.865803] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  302.139283] Lustre: MGS: Connection restored to d96c2340-876b-16be-2011-390ee4423005 (at 0@lo)
[  302.980692] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  306.568775] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[  308.329100] Lustre: MGS: Connection restored to 8689af0a-2d0f-1602-d90f-ba958e860414 (at 192.168.1.122@o2ib)
[  314.351020] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 28 clients reconnect
[  315.361244] Lustre: soaked-MDT0000: Connection restored to 49b12ac6-5556-4d5f-3b26-2f6549981e88 (at 192.168.1.120@o2ib)
[  315.373283] Lustre: Skipped 4 previous similar messages
[  326.540499] Lustre: soaked-MDT0000: Connection restored to b1a10261-dfdd-cb5c-a7c6-b0b4ee43ecc1 (at 192.168.1.118@o2ib)
[  326.552573] Lustre: Skipped 2 previous similar messages
[  334.690860] Lustre: soaked-MDT0000: Connection restored to e886e3d3-3ebf-375d-809a-3a736449e0f7 (at 192.168.1.135@o2ib)
[  334.702950] Lustre: Skipped 19 previous similar messages
[  352.835974] Lustre: soaked-MDT0000: Connection restored to 1899ab43-b2ec-6924-59ec-29066d379d58 (at 192.168.1.125@o2ib)
[  352.848202] Lustre: Skipped 14 previous similar messages
[  357.907887] Lustre: soaked-MDT0000: Recovery over after 0:44, of 28 clients 28 recovered and 0 were evicted.
[  384.865183] Lustre: MGS: Connection restored to e886e3d3-3ebf-375d-809a-3a736449e0f7 (at 192.168.1.135@o2ib)
[  384.876189] Lustre: Skipped 24 previous similar messages
[  867.138373] sd 0:0:1:1: attempting task abort! scmd(ffff9450ebafabc0)
[  867.145585] sd 0:0:1:1: [sdj] CDB: Write(16) 8a 00 00 00 00 00 00 28 67 b8 00 00 03 38 00 00
[  867.155006] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[  867.163751] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[  867.277733] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9450ebafabc0)
[  867.284676] sd 0:0:1:1: attempting task abort! scmd(ffff9450ebafaa00)
[  867.291900] sd 0:0:1:1: [sdj] CDB: Write(16) 8a 00 00 00 00 00 00 28 66 38 00 00 01 78 00 00
[  867.301343] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[  867.310094] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[  867.888824] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9450ebafaa00)
[  867.895773] sd 0:0:1:1: attempting task abort! scmd(ffff9450ebafa680)
[  867.902978] sd 0:0:1:1: [sdj] CDB: Write(16) 8a 00 00 00 00 00 00 28 63 b0 00 00 02 88 00 00
[  867.912412] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[  867.921155] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[  868.302196] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9450ebafa680)
[  868.309137] sd 0:0:1:1: attempting task abort! scmd(ffff9450ebafa4c0)
[  868.316341] sd 0:0:1:1: [sdj] CDB: Write(16) 8a 00 00 00 00 00 00 28 5f b0 00 00 04 00 00 00
[  868.325771] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[  868.334515] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[  868.600065] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9450ebafa4c0)
[  868.607021] sd 0:0:1:1: attempting task abort! scmd(ffff9450ebafa300)
[  868.614237] sd 0:0:1:1: [sdj] CDB: Write(16) 8a 00 00 00 00 00 00 28 5b b0 00 00 04 00 00 00
[  868.623672] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[  868.632417] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[  869.594264] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9450ebafa300)
[  869.601213] sd 0:0:1:1: attempting task abort! scmd(ffff9450ebafa140)
[  869.608428] sd 0:0:1:1: [sdj] CDB: Write(16) 8a 00 00 00 00 00 00 28 57 b0 00 00 04 00 00 00
[  869.617859] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[  869.626600] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[  869.879270] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9450ebafa140)
[  869.886206] sd 0:0:1:1: attempting task abort! scmd(ffff9450ebaf9f80)
[  869.893416] sd 0:0:1:1: [sdj] CDB: Write(16) 8a 00 00 00 00 00 00 28 53 b0 00 00 04 00 00 00
[  869.902852] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[  869.911595] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[  869.919965] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9450ebaf9f80)
[  870.142262] sd 0:0:1:1: attempting task abort! scmd(ffff9450ebafad80)
[  870.149481] sd 0:0:1:1: [sdj] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00
[  870.158924] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0)
[  870.167667] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) 
[  870.513839] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9450ebafad80)
[ 1551.103207] LNetError: 12349:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[ 1551.114597] LNetError: 12349:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.111@o2ib (5): c: 5, oc: 0, rc: 8
[ 1551.128302] Lustre: 12382:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544758817/real 1544758822]  req@ffff9454bd8cc500 x1619795681353728/t0(0) o41->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544758861 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 1551.160638] Lustre: 12382:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[ 1551.171446] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 1553.103221] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 1 seconds
[ 1553.114793] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544758822/real 1544758824]  req@ffff9450e8fb4800 x1619795681353680/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544758829 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[ 1556.136217] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544758824/real 1544758827]  req@ffff9450e8fb4800 x1619795681353680/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544758831 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[ 1561.176142] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544758827/real 1544758832]  req@ffff9450e8fb4800 x1619795681353680/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544758834 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[ 1566.216096] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544758832/real 1544758837]  req@ffff9450e8fb4800 x1619795681353680/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544758839 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[ 1572.102809] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1573.102805] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 1 seconds
[ 1576.263840] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544758844/real 1544758847]  req@ffff9450e8fb4800 x1619795681353680/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544758851 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[ 1576.295205] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
[ 1582.102632] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1587.102529] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 5 seconds
[ 1587.114000] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 3 previous similar messages
[ 1593.102484] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544758863/real 1544758864]  req@ffff9450e8fb4800 x1619795681353680/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544758870 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[ 1593.133880] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 12 previous similar messages
[ 1596.102324] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 14 seconds
[ 1596.113884] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 6 previous similar messages
[ 1612.101996] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 6 seconds
[ 1612.113456] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 9 previous similar messages
[ 1625.101806] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544758894/real 1544758896]  req@ffff9450e8fb4800 x1619795681353680/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544758901 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[ 1625.133215] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 27 previous similar messages
[ 1645.101283] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 39 seconds
[ 1645.112841] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 25 previous similar messages
[ 1689.100347] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544758959/real 1544758960]  req@ffff9450e8fb4800 x1619795681353680/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 1 dl 1544758966 ref 1 fl Rpc:eX/2/ffffffff rc 0/-1
[ 1689.131760] Lustre: 12623:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 63 previous similar messages
[ 1709.099808] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 53 seconds
[ 1709.111366] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 51 previous similar messages
[ 1758.237431] Lustre: MGS: haven't heard from client fa2e55ac-3d49-84a1-44bc-922f6f5cf68d (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff944e78f62000, cur 1544759029 expire 1544758879 last 1544758802
[ 1774.446912] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff9454d4ea9000, cur 1544759045 expire 1544758895 last 1544758817
[ 1846.159362] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[ 1846.172061] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[ 1846.182378] Lustre: Skipped 8 previous similar messages
[ 1857.096167] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1857.107629] LNet: 12349:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 54 previous similar messages
[ 1974.191308] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 1974.200583] Lustre: Skipped 1 previous similar message
[ 1975.040355] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.111@o2ib, removing former export from same NID
[ 1975.053075] Lustre: Skipped 1 previous similar message
[ 2065.580576] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 2065.592053] Lustre: Skipped 2 previous similar messages
[ 2790.300280] Lustre: 14012:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[11;01H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [m[4;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[4;79H[m[7m[5;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [5;79H[22;1H   The selected entry will be started automatically in 5s.                     [5;79H[22;1H   The selected entry will be started automatically in 4s.                     [5;79H[22;1H   The selected entry will be started automatically in 3s.                     [5;79H[22;1H   The selected entry will be started automatically in 2s.                     [5;79H[22;1H   The selected entry will be started automatically in 1s.                     [5;79H[22;1H   The selected entry will be started automatically in 0s.                     [5;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-309-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Sat Dec 8 05:53:16 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x35bfe000-0x36df6fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 162MB of memory at 688MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff95382e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 6993108k/34603008k available (7664k kernel code, 1126748k absent, 830688k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.352 MHz processor
[    0.000180] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.70 BogoMIPS (lpj=2693352)
[    0.012082] pid_max: default: 245760 minimum: 1920
[    0.018305] Security Framework initialized
[    0.022912] SELinux:  Initializing.
[    0.027101] Yama: becoming mindful.
[    0.036355] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.058376] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.072175] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.079945] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.090271] Initializing cgroup subsys memory
[    0.095201] Initializing cgroup subsys devices
[    0.100183] Initializing cgroup subsys freezer
[    0.105157] Initializing cgroup subsys net_cls
[    0.110128] Initializing cgroup subsys blkio
[    0.114910] Initializing cgroup subsys perf_event
[    0.120311] Initializing cgroup subsys hugetlb
[    0.125298] Initializing cgroup subsys pids
[    0.129973] Initializing cgroup subsys net_prio
[    0.135330] mce: CPU supports 20 MCE banks
[    0.139946] CPU0: Thermal monitoring enabled (TM1)
[    0.145395] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.151527] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.157864] tlb_flushall_shift: 6
[    0.161653] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.172415] FEATURE SPEC_CTRL Present
[    0.176524] FEATURE IBPB_SUPPORT Present
[    0.181249] Spectre V2 : Mitigation: Full retpoline
[    0.189544] Freeing SMP alternatives: 28k freed
[    0.200974] ACPI: Core revision 20130517
[    0.296413] ACPI: All ACPI Tables successfully acquired
[    0.319496] ftrace: allocating 29187 entries in 115 pages
[    0.381357] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.388769] Switched APIC routing to physical flat.
[    0.394951] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.411676] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.422210] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.434041] ... version:                3
[    0.438519] ... bit width:              48
[    0.443093] ... generic registers:      4
[    0.447576] ... value mask:             0000ffffffffffff
[    0.453511] ... max period:             00007fffffffffff
[    0.459447] ... fixed-purpose events:   3
[    0.463924] ... event mask:             000000070000000f
[    0.478460] smpboot: Booting Node   0, Processors  #1[    0.500225] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.555134] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.694148] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.736101] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.776690] Brought up 32 CPUs
[    0.780325] smpboot: Max logical packages: 15
[    0.785212] smpboot: Total of 32 processors activated (172568.99 BogoMIPS)
[    1.042585] node 0 initialised, 2813371 pages in 136ms
[    1.080303] node 1 initialised, 3599741 pages in 168ms
[    1.087262] devtmpfs: initialized
[    1.102727] EVM: security.selinux
[    1.106431] EVM: security.ima
[    1.109745] EVM: security.capability
[    1.114006] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.122871] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.135296] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.142982] pinctrl core: initialized pinctrl subsystem
[    1.149103] RTC time:  4:26:46, date: 12/14/18
[    1.154572] NET: Registered protocol family 16
[    1.160062] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.168521] ACPI: bus type PCI registered
[    1.173001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.180840] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.191238] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.198858] PCI: Using configuration type 1 for base access
[    1.205127] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.225769] ACPI: Added _OSI(Module Device)
[    1.230445] ACPI: Added _OSI(Processor Device)
[    1.235407] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.240660] ACPI: Added _OSI(Processor Aggregator Device)
[    1.246691] ACPI: Added _OSI(Linux-Dell-Video)
[    1.291356] ACPI: Executed 1 blocks of module-level executable AML code
[    1.580402] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.613558] ACPI: Interpreter enabled
[    1.617683] ACPI: (supports S0 S1 S5)
[    1.621773] ACPI: Using IOAPIC for interrupt routing
[    1.627438] HEST: Table parsing has been initialized.
[    1.633085] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.643356] ACPI: GPE 0x1E active on init
[    1.647871] ACPI: GPE 0x24 active on init
[    1.652375] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.718025] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.724940] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.734598] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.743080] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.751634] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.761065] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.772729] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.787592] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.802835] PCI host bridge to bus 0000:00
[    1.807415] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.814319] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.822677] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.831036] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.839395] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.847754] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.856112] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.864470] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.872829] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.881191] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.889549] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.897907] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.906267] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.914624] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.922985] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.932123] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.938794] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.945418] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.952047] pci 0000:00:02.0: System wakeup disabled by ACPI
[    1.958663] pci 0000:00:02.2: System wakeup disabled by ACPI
[    1.965290] pci 0000:00:03.0: System wakeup disabled by ACPI
[    1.975502] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    1.982146] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    1.988754] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    1.995409] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.001962] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.009233] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.014959] acpiphp: Slot [2] registered
[    2.019629] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.029954] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.040617] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.050943] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.061610] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.071936] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.082598] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.092921] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.106251] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.112307] acpiphp: Slot [2-2] registered
[    2.119322] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.125061] acpiphp: Slot [2-3] registered
[    2.129669] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.135373] acpiphp: Slot [2-4] registered
[    2.140275] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.146174] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.158963] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.164639] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.170618] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.177019] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.182695] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.191692] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.199598] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.207497] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.215405] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.223307] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.231211] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.239125] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.247019] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.255107] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.262017] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.271428] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.279756] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.288310] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.297872] PCI host bridge to bus 0000:80
[    2.302455] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.310039] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.317623] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.325982] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.334341] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.343476] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.349832] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.356430] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.363021] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.369616] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.378441] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.384088] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.389726] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.395351] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.411922] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.418543] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.427736] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.437409] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.444411] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.453667] PCI host bridge to bus 0000:7f
[    2.458248] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.468889] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.475508] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.484691] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.494363] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.501368] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.510633] PCI host bridge to bus 0000:ff
[    2.515214] pci_bus 0000:ff: root bus resource [bus ff]
[    2.526435] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.535496] vgaarb: loaded
[    2.538521] vgaarb: bridge control possible 0000:09:00.0
[    2.544891] SCSI subsystem initialized
[    2.549136] ACPI: bus type USB registered
[    2.553656] usbcore: registered new interface driver usbfs
[    2.559803] usbcore: registered new interface driver hub
[    2.566025] usbcore: registered new device driver usb
[    2.572224] EDAC MC: Ver: 3.0.0
[    2.576289] PCI: Using ACPI for IRQ routing
[    2.588608] NetLabel: Initializing
[    2.592409] NetLabel:  domain hash size = 128
[    2.597276] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.602858] NetLabel:  unlabeled traffic allowed by default
[    2.609413] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.616428] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.624996] amd_nb: Cannot enumerate AMD northbridges
[    2.630846] Switched to clocksource hpet
[    2.649791] pnp: PnP ACPI init
[    2.653248] ACPI: bus type PNP registered
[    2.658037] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.664661] system 00:00: [io  0xffff] has been reserved
[    2.670607] system 00:00: [io  0xffff] has been reserved
[    2.676544] system 00:00: [io  0xffff] has been reserved
[    2.682495] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.689513] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.696136] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.702764] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.709386] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.716394] system 00:00: [io  0x0cf9] could not be reserved
[    2.722942] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.731109] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.738508] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.745917] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.753307] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.760704] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.768105] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.775891] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.783684] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.791471] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.799376] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.807681] pnp: PnP ACPI: found 7 devices
[    2.812264] ACPI: bus type PNP unregistered
[    2.826311] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.831888] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.837736] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.844549] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.852144] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.857710] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.865307] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.874731] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.880298] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.885854] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.892671] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.900265] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.905818] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    2.912637] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    2.920226] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    2.929660] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.935230] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.940792] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    2.948387] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    2.957033] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    2.962820] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.968383] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.973944] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.979504] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.985438] NET: Registered protocol family 2
[    2.992488] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.001672] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.009430] TCP: Hash tables configured (established 262144 bind 65536)
[    3.016931] TCP: reno registered
[    3.020702] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.027876] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.036561] NET: Registered protocol family 1
[    4.141920] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.249977] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.258497] Un packing initram[    5.820603] Freeing initrd memory: 18404k freed
[    5.832762] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.839987] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff9534b73c7000-ffff9534bb3c6fff]
[    5.851495] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    5.860341] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    5.866764] RAPL PMU: hw unit of domain package 2^-16 Joules
[    5.873093] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    5.892229] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    5.899069] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    5.913051] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    5.921320] Initialise system trusted keyring
[    5.926336] audit: initializing netlink socket (disabled)
[    5.932421] type=2000 audit(1544761607.456:1): initialized
[    5.994604] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.001718] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.012020] zpool: loaded
[    6.014962] zbud: loaded
[    6.018977] VFS: Disk quotas dquot_6.6.0
[    6.023871] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.032573] msgmni has been set to 32768
[    6.037349] Key type big_key registered
[    6.044288] NET: Registered protocol family 38
[    6.049277] Key type asymmetric registered
[    6.053865] Asymmetric key parser 'x509' registered
[    6.059493] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.068045] io scheduler noop registered
[    6.072428] io scheduler deadline registered (default)
[    6.078328] io scheduler cfq registered
[    6.082634] io scheduler mq-deadline registered
[    6.087709] io scheduler kyber registered
[    6.098069] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.105890] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.113684] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.120985] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.128286] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.135587] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.142921] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.150708] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.158051] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.165869] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.173655] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.180992] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.188777] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.196079] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.203409] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.211235] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.219026] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.226365] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.234193] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.242023] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.249844] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.257741] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.263986] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.271427] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.279733] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.288012] ACPI: Power Button [PWRF]
[    6.292197] ACPI: Requesting acpi_cpufreq
[    6.379796] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.388225] pstore: Registered erst as persistent store backend
[    6.395183] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.403664] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.431535] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.458675] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.465968] Non-volatile memory driver v1.3
[    6.470717] Linux agpgart interface v0.103
[    6.475713] crash memory driver: version 1.1
[    6.480967] rdac: device handler registered
[    6.485726] hp_sw: device handler registered
[    6.490521] emc: device handler registered
[    6.495388] alua: device handler registered
[    6.500171] libphy: Fixed MDIO Bus: probed
[    6.504856] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.512165] ehci-pci: EHCI PCI platform driver
[    6.517601] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.523581] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.531889] ehci-pci 0000:00:1a.0: debug port 2
[    6.540925] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.553052] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.559572] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.567159] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.575235] usb usb1: Product: EHCI Host Controller
[    6.580697] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.588877] usb usb1: SerialNumber: 0000:00:1a.0
[    6.594280] hub 1-0:1.0: USB hub found
[    6.598494] hub 1-0:1.0: 2 ports detected
[    6.603566] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    6.609514] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    6.617817] ehci-pci 0000:00:1d.0: debug port 2
[    6.626872] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    6.639056] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    6.645575] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    6.653162] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.661245] usb usb2: Product: EHCI Host Controller
[    6.666709] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.674881] usb usb2: SerialNumber: 0000:00:1d.0
[    6.680266] hub 2-0:1.0: USB hub found
[    6.684478] hub 2-0:1.0: 2 ports detected
[    6.689230] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    6.696165] ohci-pci: OHCI PCI platform driver
[    6.701189] uhci_hcd: USB Universal Host Controller Interface driver
[    6.708452] usbcore: registered new interface driver usbserial_generic
[    6.715774] usbserial: USB Serial support registered for generic
[    6.722570] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    6.886103] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    7.775076] i8042: No controller found
[    7.779351] Switched to clocksource tsc
[    7.779452] mousedev: PS/2 mouse device common for all mice
[    7.779640] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    7.779710] rtc_cmos 00:01: RTC can wake from S4
[    7.779946] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    7.780000] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    7.780136] intel_pstate: Intel P-state driver initializing
[    7.791880] cpuidle: using governor menu
[    7.793427] hidraw: raw HID events driver (C) Jiri Kosina
[    7.793687] usbcore: registered new interface driver usbhid
[    7.793688] usbhid: USB HID core driver
[    7.793909] drop_monitor: Initializing network drop monitor service
[    7.794511] TCP: cubic registered
[    7.794520] Initializing XFRM netlink socket
[    7.795213] NET: Registered protocol family 10
[    7.796807] NET: Registered protocol family 17
[    7.796820] mpls_gso: MPLS GSO support
[    7.798557] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    7.802651] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    7.802866] Loading compiled-in X.509 certificates
[    7.803953] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    7.805009] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    7.806048] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: d73e894149b8945b8dc07cc18b4508db322683f2'
[    7.806112] registered taskstats version 1
[    7.810437] Key type trusted registered
[    7.814360] Key type encrypted registered
[    7.814497] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.816150]   Magic number: 14:883:413
[    7.816245] clockevents clockevent122: hash matches
[    7.817732] rtc_cmos 00:01: setting system clock to 2018-12-14 04:26:53 UTC (1544761613)
[    7.830156] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    7.906581] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    7.906585] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.907143] hub 1-1:1.0: USB hub found
[    7.907319] hub 1-1:1.0: 6 ports detected
[    7.956259] random: fast init done
[    7.956579] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    7.956583] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.956943] hub 2-1:1.0: USB hub found
[    7.957075] hub 2-1:1.0: 8 ports detected
[    8.033245] Freeing unused kernel memory: 1876k freed
[    8.039666] Write protecting the kernel read-only data: 12288k
[    8.049283] Freeing unused kernel memory: 516k freed
[    8.057630] Freeing unused kernel memory: 600k freed
[    8.076999] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.098496] systemd[1]: Detected architecture x86-64.
[    8.104170] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.120359] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.198258] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.208275] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.221558] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.232196] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
[     8.239877] s[32m  OK  [0m] Listening on Journal Socket.
[    8.252390] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.263281] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.274231] systemd[1]: Starting Journ al Service...
ce...
[    8.285272] systemd[1]: Starting dracut cmdline hook...
         Starting dracut cmdline hook...
[    8.297183] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Starting Create list of required  st... nodes foel...
[    8.317520] systemd[1]: Listening on udev Kernel Socket.
[[32m  O K  [0m] Listen[     8.330973] sApply Kernel Variables...
          Startin[    8.342271] systemd[1]: Reached target Timers.
[[32m  OK  [0m[    8.348715] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
] Reached target[    8.356655] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
 Timers.
[    8.366363] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.373424] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.379849] usb 2-1.4: SerialNumber: serial
[    8.385228] systemd[1]: Starting Setup Virtual Console ...
[    8.386nc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
         Starting Setup Virtual Console...
[    8.411321] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.433301] systemd[1]: Reached target Sockets.
[[32m  OK  [0m[    8.438814] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
] Reached target[    8.458104] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
 Sockets.
[    8.473245] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
[    8.490830] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started dracut cmdline hook.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Setup Virtual Console.
         Starting Create Static Device Nodes in /dev...
         Starting dracut pre-udev hook...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting dracut initqueue hook...
[[32m  OK  [0m] Reached target System Initialization.
         Starting Show Plymouth Boot Screen...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Reached ta[    8.754686] mlx_compat: loading out-of-tree module taints kernel.
rget Basic System.
[    8.765924] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    8.777890] Compat-mlnx-ofed backport release: b4fdfac
[    8.783641] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    8.791038] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    8.797443] dca service started, version 1.12.1
[    8.804878] pps_core: LinuxPPS API ver. 1 registered
[    8.810420] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    8.822688] mpt2sas version 20.103.01.00 loaded
[    8.828052] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[    8.837350] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32666996 kB)
[    8.847989] PTP clock support registered
[    8.862656] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    8.869327] mlx4_core: Initializing 0000:04:00.0
[    8.878773] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    8.886042] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    8.893063] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    8.904764] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[    8.905535] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 40
[    8.905536] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 41
[    8.905536] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 42
[    8.905537] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 43
[    8.905538] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 44
[    8.905539] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 45
[    8.905540] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 46
[    8.905540] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 47
[    8.905541] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 48
[    8.905542] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 49
[    8.905543] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 50
[    8.905544] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 51
[    8.905544] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 52
[    8.905545] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 53
[    8.905546] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 54
[    8.905547] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 55
[    8.905548] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffb9e1c3b60000), size(65536)
[    8.905549] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[    8.928552] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    8.928648] isci 0000:07:00.0: OEM parameter table found in OROM
[    8.928654] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    8.928891] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    8.931318] scsi host1: isci
[    8.956820] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    8.956821] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.957675] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    8.958687] mpt2sas_cm0: sending message unit reset !!
[    8.960180] mpt2sas_cm0: message unit reset: SUCCESS
[    8.967275] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    8.967278] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    8.977730] scsi host2: ahci
[    8.977841] scsi host3: ahci
[    8.977942] scsi host4: ahci
[    8.978029] scsi host5: ahci
[    8.978110] scsi host6: ahci
[    8.978196] scsi host7: ahci
[    8.978236] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 59
[    8.978238] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 59
[    8.978241] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 59
[    8.978243] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 59
[    8.978246] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 59
[    8.978249] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 59
[    8.995258] igb 0000:02:00.0: added PHC on eth0
[    8.995260] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.995262] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    8.995335] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    8.995336] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.995912] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    9.021140] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[    9.021140] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[    9.021141] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    9.032566] igb 0000:02:00.1: added PHC on eth1
[    9.032567] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.032569] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.032641] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.032643] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.066574] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[    9.066575] mpt2sas_cm0: Protocol=(
[    9.066576] Initiator
[    9.066576] ,Target
[    9.066576] ), 
[    9.066577] Capabilities=(
[    9.066577] TLR
[    9.066577] ,EEDP
[    9.066578] ,Snapshot Buffer
[    9.066578] ,Diag Trace Buffer
[    9.066579] ,Task Set Full
[    9.066579] ,NCQ
[    9.066579] )
[    9.066624] scsi host0: Fusion MPT SAS Host
[    9.066853] mpt2sas_cm0: sending port enable !!
[    9.069404] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[    9.078181] mpt2sas_cm0: port enable: SUCCESS
[    9.078814] scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.078819] scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.078820] scsi 0:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
%G%G[    9.078823] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.087090] igb 0000:02:00.2: added PHC on eth2
[    9.087091] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.087093] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.087165] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.087167] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.142297] igb 0000:02:00.3: added PHC on eth3
[    9.142299] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.142300] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.142373] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.142374] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.283212] ata3: SATA link down (SStatus 0 SControl 300)
[    9.285210] ata1: SATA link down (SStatus 0 SControl 300)
[    9.285237] ata2: SATA link down (SStatus 0 SControl 300)
[    9.285263] ata4: SATA link down (SStatus 0 SControl 300)
[    9.285288] ata5: SATA link down (SStatus 0 SControl 300)
[    9.285315] ata6: SATA link down (SStatus 0 SControl 300)
[    9.308123] [TTM] Zone  kernel: Available graphics memory: 16333498 kiB
[    9.308123] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.308124] [TTM] Initializing pool allocator
[    9.308127] [TTM] Initializing DMA pool allocator
[    9.373551] fbcon: mgadrmfb (fb0) is primary device
[    9.411978] scsi 0:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.411985] scsi 0:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.411988] scsi 0:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.411991] scsi 0:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.440557] scsi 0:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.440562] scsi 0:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.440564] scsi 0:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.440567] scsi 0:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.487581] scsi 0:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.487589] scsi 0:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.487593] scsi 0:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.487598] scsi 0:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.502631] scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.502651] scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.502654] scsi 0:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.502659] scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.515317] scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.515324] scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.515327] scsi 0:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.515332] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.528034] scsi 0:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.528041] scsi 0:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.528044] scsi 0:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.528049] scsi 0:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.539683] scsi 0:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.539690] scsi 0:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.539693] scsi 0:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.539698] scsi 0:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.551654] scsi 0:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.551661] scsi 0:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.551664] scsi 0:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.551669] scsi 0:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.572657] scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.572663] scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.572667] scsi 0:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.572672] scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.611549] Console: switching to colour frame buffer device 128x48
[    9.667015] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.708283] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   10.603172] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   10.609409] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   10.617830] ata7.00: configured for UDMA/133
[   10.633703] scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.408926] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.415921] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.422722] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.429916] mlx4_core: device is working in RoCE mode: Roce V1
[   15.436433] mlx4_core: UD QP Gid type is: V1
[   16.491073] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   16.905690] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   16.911928] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   16.920504] ata8.00: configured for UDMA/133
[   16.936863] scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   16.958403] scsi 0:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   16.964739] scsi 0:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   16.971409] scsi 0:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   16.977711] scsi 0:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   16.984619] scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   16.991339] scsi 0:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   16.997587] scsi 0:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   17.004081] sd 1:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.004114] scsi 0:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   17.004287] sd 1:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.004511] sd 1:0:1:0: [sdb] Write Protect is off
[   17.004576] sd 0:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.004627] sd 0:0:1:3: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.004634] sd 1:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.004672] sd 0:0:0:1: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.005126] sd 0:0:1:7: [sdj] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.005324] sd 0:0:0:2: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.005338] sd 0:0:0:3: [sdg] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.005435] sd 0:0:1:1: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.005593] sd 0:0:1:0: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.005674] sd 0:0:1:3: [sdd] Write Protect is off
[   17.005883] sd 0:0:0:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.005957] sd 0:0:0:0: [sdc] Write Protect is off
[   17.005981] sd 0:0:1:2: [sdl] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.006032] sd 0:0:0:1: [sde] Write Protect is off
[   17.006230] sd 0:0:1:3: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.006463] sd 0:0:1:7: [sdj] Write Protect is off
[   17.006666] sd 0:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.006731] sd 0:0:0:1: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.006825] sd 0:0:0:3: [sdg] Write Protect is off
[   17.007230] sd 0:0:1:1: [sdk] Write Protect is off
[   17.007400] sd 0:0:1:7: [sdj] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.007435] sd 0:0:1:0: [sdi] Write Protect is off
[   17.007587] sd 0:0:0:2: [sdf] Write Protect is off
[   17.007763] sd 0:0:0:3: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.007822] sd 0:0:0:7: [sdh] Write Protect is off
[   17.007901] sd 0:0:1:2: [sdl] Write Protect is off
[   17.008050] sd 0:0:1:1: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.008163] sd 0:0:1:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.008344] sd 0:0:0:2: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.008459] sd 0:0:0:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.008740] sd 0:0:1:2: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.011299] Dev sde: unable to read RDB block 0
[   17.011309]  sde: unable to read partition table
[   17.011971] Dev sdg: unable to read RDB block 0
[   17.011984]  sdg: unable to read partition table
[   17.012625] Dev sdi: unable to read RDB block 0
[   17.012634]  sdi: unable to read partition table
[   17.013230] Dev sdl: unable to read RDB block 0
[   17.013240]  sdl: unable to read partition table
[   17.014721] sd 0:0:0:1: [sde] Attached SCSI disk
[   17.014723] sd 0:0:1:3: [sdd] Attached SCSI disk
[   17.015110] sd 0:0:0:3: [sdg] Attached SCSI disk
[   17.015113]  sdb:
[   17.015131] sd 0:0:0:0: [sdc] Attached SCSI disk
[   17.015344] sd 0:0:0:2: [sdf] Attached SCSI disk
[   17.015472] sd 1:0:1:0: [sdb] Attached SCSI disk
[   17.015759] sd 0:0:1:0: [sdi] Attached SCSI disk
[   17.015846] sd 0:0:1:1: [sdk] Attached SCSI disk
[   17.015933] sd 0:0:1:2: [sdl] Attached SCSI disk
[   17.228213]  sdj:
[   17.229527] sd 0:0:1:7: [sdj] Attached SCSI disk
[   17.372862] sd 1:0:0:0: [sda] Write Protect is off
[   17.378249] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.390090]  sdh:
[   17.393723] sd 0:0:0:7: [sdh] Attached SCSI disk
[   17.409725]  sda: sda1 sda2
[   17.413312] sd 1:0:0:0: [sda] Attached SCSI disk
[   17.450465] random: crng init done
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
[[32m  OK  [0m] Started dracut initqueue hook.
         Mounting /sysroot...
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
[   19.346717] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped target Timers.
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target System Initialization.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK [   19.739899] systemd-journald[280]: Received SIGTERM from PID 1 (systemd).
 [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Closed udev Kernel Socket.
[[32m  OK  [0m] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   20.081241] SELinux:  Disabled at runtime.
[   20.129862] type=1404 audit(1544761625.811:2): selinux=0 auid=4294967295 ses=4294967295
[   20.371672] ip_tables: (C) 2000-2006 Netfilter Core Team
[   20.378754] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
         Mounting Debug File System...
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
         Starting Create list of required st... nodes for the current kernel...
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
         Starting Availability of block devices...
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd Root File System.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Reached target Slices.
         Mounting Huge Pages File System...
         Starting Replay R[   21.335647] RPC: Registered named UNIX socket transport module.
ead-Ahead Data..[   21.342712] RPC: Registered udp transport module.
.
[[32m  OK  [   21.349485] RPC: Registered tcp transport module.
[0m] Listening [   21.356272] RPC: Registered tcp NFSv4.1 backchannel transport module.
on LVM2 metadata daemon socket.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Create Static Device Nodes in /dev...
         Starting Apply Kernel Variables...
         Starting Remount Root and Kernel File Systems...
[[32m  OK  [0m] Started Journal Service.
[   21.483089] EXT4-fs (sda1): re-mounted. Opts: (null)
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting Configure read-only root support...
         Starting Flush Journal to Persistent Storage...
         Starting udev Coldplug all Devices...
[[32m  OK  [0m] Started LVM2 metadata daemon.
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[   21.695062] systemd-journald[4551]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[   21.838450] device-mapper: uevent: version 1.0.3
[   21.843794] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[   21.890505] sd 0:0:0:7: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.899180] sd 0:0:0:7: [sdh] Sense Key : Illegal Request [current] 
[   21.906282] sd 0:0:0:7: [sdh] Add. Sense: Logical block address out of range
[   21.914162] sd 0:0:0:7: [sdh] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.921747] blk_update_request: critical target error, dev sdh, sector 0
[   21.929269] sd 0:0:1:7: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.937939] sd 0:0:1:7: [sdj] Sense Key : Illegal Request [current] 
[   21.945047] sd 0:0:1:7: [sdj] Add. Sense: Logical block address out of range
[   21.952946] sd 0:0:1:7: [sdj] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.960536] blk_update_request: critical target error, dev sdj, sector 0
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[[32m  OK  [0m] Started udev Kernel Device Manager.
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[   22.426347] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   22.434051] igb 0000:02:00.0: DCA enabled
[   22.434204] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.434206] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.462665] igb 0000:02:00.1: DCA enabled
[   22.468044] igb 0000:02:00.2: DCA enabled
[   22.472600] igb 0000:02:00.3: DCA enabled
[   22.481270] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   22.490877] i801_smbus 0000:07:00.3: Enabling SMBus device
[   22.497698] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   22.498022] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   22.514883] ipmi message handler version 39.2
[   22.525498] ipmi device interface
[   22.541335] IPMI System Interface driver.
[   22.545895] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   22.552631] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   22.559478] ipmi_si: Adding SMBIOS-specified kcs state machine
[   22.567167] ipmi_platform: probing via SPMI
[   22.571850] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   22.578317] (NULL device *): SPMI-specified kcs state machine: duplicate
[   22.585931] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[[32m  OK  [0m] Found device /dev/ttyS0.
[   22.661494] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   22.720074] cryptd: max_cpu_qlen set to 1000
%G[   22.729937] ipmi_si ipmi_si.0: IPMI kcs interface initialized
%G[   22.740888] IPMI SSIF Interface driver
[   22.745849] AVX version of gcm_enc/dec engaged.
[   22.750916] AES CTR mode by8 optimization enabled
[   22.759212] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.766478] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.790412] sd 1:0:0:0: Attached scsi generic sg0 type 0
[   22.796430] sd 1:0:1:0: Attached scsi generic sg1 type 0
[   22.802421] sd 0:0:0:0: Attached scsi generic sg2 type 0
[   22.808412] sd 0:0:0:1: Attached scsi generic sg3 type 0
[   22.814434] sd 0:0:0:2: Attached scsi generic sg4 type 0
[   22.814504] sd 0:0:0:3: Attached scsi generic sg5 type 0
[   22.814572] sd 0:0:0:7: Attached scsi generic sg6 type 0
[   22.814644] sd 0:0:1:0: Attached scsi generic sg7 type 0
[   22.814714] sd 0:0:1:1: Attached scsi generic sg8 type 0
[   22.814779] sd 0:0:1:2: Attached scsi generic sg9 type 0
[   22.814848] sd 0:0:1:3: Attached scsi generic sg10 type 0
[   22.814917] sd 0:0:1:7: Attached scsi generic sg11 type 0
[   22.827993] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   22.878006] iTCO_vendor_support: vendor-support=0
[   22.922700] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.929039] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.962496] kvm: disabled by bios
[   22.991013] kvm: disabled by bios
[   23.050613] blk_update_request: I/O error, dev sdl, sector 0
[   23.050622] blk_update_request: I/O error, dev sdi, sector 0
[   23.050903] blk_update_request: I/O error, dev sde, sector 0
[   23.051069] blk_update_request: I/O error, dev sdg, sector 0
[   23.076154] intel_rapl: Found RAPL domain package
[   23.081412] intel_rapl: Found RAPL domain core
[   23.086379] intel_rapl: Found RAPL domain dram
[   23.088651] blk_update_request: I/O error, dev sdi, sector 0
[   23.088842] blk_update_request: I/O error, dev sdg, sector 0
[   23.089544] blk_update_request: I/O error, dev sdl, sector 0
[   23.089968] blk_update_request: I/O error, dev sde, sector 0
[   23.110384] intel_rapl: Found RAPL domain package
[   23.110386] intel_rapl: Found RAPL domain core
[   23.110390] intel_rapl: Found RAPL domain dram
[   23.137532] device-mapper: multipath round-robin: version 1.2.0 loaded
[   23.147820] sd 0:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   23.249400] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   23.259785] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   23.269984] EDAC sbridge:  Ver: 1.1.2 
[   23.599282] sd 0:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   23.608007] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   24.257324] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.266115] sd 0:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   25.113201] device-mapper: table: 253:5: multipath: error getting device
[   25.120708] device-mapper: ioctl: error adding target to table
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...[   25.557652] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS

[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[   26.163141] sd 0:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   26.168108] sd 0:0:0:2: [sdf] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.168115] sd 0:0:0:2: [sdf] Sense Key : Illegal Request [current] 
[   26.168123] sd 0:0:0:2: [sdf] <<vendor>>ASC=0x94 ASCQ=0x1 
[   26.168128] sd 0:0:0:2: [sdf] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   26.169718] sd 0:0:0:7: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.169721] sd 0:0:0:7: [sdh] Sense Key : Illegal Request [current] 
[   26.169724] sd 0:0:0:7: [sdh] Add. Sense: Logical block address out of range
[   26.169727] sd 0:0:0:7: [sdh] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.170090] sd 0:0:0:7: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.170093] sd 0:0:0:7: [sdh] Sense Key : Illegal Request [current] 
[   26.170095] sd 0:0:0:7: [sdh] Add. Sense: Logical block address out of range
[   26.170098] sd 0:0:0:7: [sdh] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.170427] sd 0:0:0:7: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.170429] sd 0:0:0:7: [sdh] Sense Key : Illegal Request [current] 
[   26.170432] sd 0:0:0:7: [sdh] Add. Sense: Logical block address out of range
[   26.170434] sd 0:0:0:7: [sdh] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   26.296616] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   26.830913] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   26.839630] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   27.479146] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   28.285627] sd 0:0:1:0: [sdi] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   28.294303] sd 0:0:1:0: [sdi] Sense Key : Illegal Request [current] 
[   28.301418] sd 0:0:1:0: [sdi] <<vendor>>ASC=0x94 ASCQ=0x1 
[   28.307555] sd 0:0:1:0: [sdi] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   28.316894] blk_update_request: 20 callbacks suppressed
[   28.322735] blk_update_request: I/O error, dev sdi, sector 0
[   28.330427] sd 0:0:1:7: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   28.339090] sd 0:0:1:7: [sdj] Sense Key : Illegal Request [current] 
[   28.346208] sd 0:0:1:7: [sdj] Add. Sense: Logical block address out of range
[   28.354088] sd 0:0:1:7: [sdj] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   28.361685] blk_update_request: critical target error, dev sdj, sector 0
[   28.369703] sd 0:0:1:7: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   28.378359] sd 0:0:1:7: [sdj] Sense Key : Illegal Request [current] 
[   28.385481] sd 0:0:1:7: [sdj] Add. Sense: Logical block address out of range
[   28.393369] sd 0:0:1:7: [sdj] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   28.400955] blk_update_request: critical target error, dev sdj, sector 0
[   28.408934] sd 0:0:1:7: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   28.417586] sd 0:0:1:7: [sdj] Sense Key : Illegal Request [current] 
[   28.424699] sd 0:0:1:7: [sdj] Add. Sense: Logical block address out of range
[   28.432582] sd 0:0:1:7: [sdj] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   28.440168] blk_update_request: critical target error, dev sdj, sector 0
[   28.952225] sd 0:0:1:2: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   28.960885] sd 0:0:1:2: [sdl] Sense Key : Illegal Request [current] 
[   28.967985] sd 0:0:1:2: [sdl] <<vendor>>ASC=0x94 ASCQ=0x1 
[   28.974127] sd 0:0:1:2: [sdl] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   28.983462] blk_update_request: I/O error, dev sdl, sector 0
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Import network configuration from initramfs...
         Starting Preprocess NFS configuration...
         Starting Tell Plymouth To Write Out Runtime Data...
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Starting Security Auditing Service...
         Mounting RPC Pipe File System...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   29.095043] type=1305 audit(1544761634.775:3): audit_pid=9362 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
[[32m  OK  [0m] Started irqbalance daemon.
         Starting Authorization Manager...
         Starting NTP client/server...
         Starting Load CPU microcode update...
         Starting Machine Check Exception Logging Daemon...
         Starting GSSAPI Proxy Daemon...
         Starting Dump dmesg to /var/log/dmesg...
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting System Security Services Daemon...
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[   29.779325] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   29.867423] igb 0000:02:00.0 ens2f0: igb: ens2f0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   29.867829] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   29.874975] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   29.898030] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   29.908106] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   29.915691] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   29.956571] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   29.963331] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[   29.974570] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   30.093339] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   30.103568] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   30.192940] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[   30.222363] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   30.791872] card: mlx4_0, QP: 0x220, inline size: 120
[   30.807910] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_inte[   30.817850] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
rface_mgr.slice.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib0.
[   30.836974] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[32m  OK  [0m] Started mlnx_interface_mgr - c[   30.852180] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
onfigure ib1.
[   30.871506] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   30.900331] ib0: enabling connected mode will cause multicast packet drops
[   30.908145] ib0: mtu > 4092 will cause multicast packet drops.
[   30.929616] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   37.873005] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   37.911910] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   37.919987] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting MUNGE authentication service...
         Starting Postfix Mail Transport Agent...
         Starting Xinetd A Powerful Replacement For Inetd...
         Starting Dynamic System Tuning Daemon...
         Starting OpenSSH server daemon...
[[32m  OK  [0m] Reached target Network is Online.
         Mounting /scratch...
         Starting NFS status monitor for NFSv2/3 locking....
         Sta[   38.432811] FS-Cache: Loaded
rting System Logging Service...
         Starting Notify NFS peers of a restart...
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Starte[   38.475161] FS-Cache: Netfs 'nfs' registered for caching
d NFS status monitor for NFSv2/3 locking..
[   38.499050] Key type dns_resolver registered
[   38.564724] NFS: Registering the id_resolver key type
[   38.570372] Key type id_resolver registered
[   38.575050] Key type id_legacy registered
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Crash recovery kernel arming...
         Starting Automounts filesystems on demand...
         Starting Permit User Sessions...
[[32m  OK  [0m] Started Permit User Sessions.
[[32m  OK  [0m] Started Command Scheduler.
         Starting Terminate Plymouth Boot Screen...
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Started Job spooling tools.
[[32m  OK  [0m] Created slice User Slice of root.
[[32m  OK  [0m] Started Session 1 of user root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-14T04:27:36+00:00] INFO: Forking chef instance to converge...
[2018-12-14T04:27:36+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-14T04:27:36+00:00] INFO: Chef-client pid: 10965
[2018-12-14T04:27:38+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-14T04:27:38+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-14T04:27:38+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-14T04:27:38+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-14T04:27:38+00:00] INFO: Running start handlers
[2018-12-14T04:27:38+00:00] INFO: Start handlers complete.
[2018-12-14T04:27:38+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-14T04:27:38+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-14T04:27:38+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-14T04:27:38+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-14T04:27:38+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181214042738.844055
[2018-12-14T04:27:38+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181213071127.058284
[2018-12-14T04:27:38+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-14T04:27:38+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-14T04:27:44+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-14T04:27:44+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-14T04:27:44+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-14T04:27:44+00:00] INFO: service[ntpd] started
[2018-12-14T04:27:44+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-14T04:27:45+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-14T04:27:45+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-14T04:27:45+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-14T04:27:45+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-14T04:27:45+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-14T04:27:45+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-14T04:27:45+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-14T04:27:45+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-14T04:27:45+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-14T04:27:46+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-14T04:27:46+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-14T04:27:46+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-14T04:27:46+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:46+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:46+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-14T04:27:46+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-14T04:27:47+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-14T04:27:47+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-14T04:27:47+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-14T04:27:47+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-14T04:27:48+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-14T04:27:48+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-14T04:27:48+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-14T04:27:48+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-14T04:27:48+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-14T04:27:48+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-14T04:27:48+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-14T04:27:49+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-14T04:27:49+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-14T04:27:49+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-14T04:27:49+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-14T04:27:49+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-14T04:27:49+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-14T04:27:49+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-14T04:27:49+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-14T04:27:49+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-14T04:27:49+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-14T04:27:49+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-14T04:27:49+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-14T04:27:50+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-14T04:27:50+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-14T04:27:50+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-14T04:27:50+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-14T04:27:50+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181214042750.691009
[2018-12-14T04:27:50+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181213071139.462423
[2018-12-14T04:27:50+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-14T04:27:50+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-14T04:27:50+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-14T04:27:50+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181214042750.698254
[2018-12-14T04:27:50+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181213071139.470027
[2018-12-14T04:27:50+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-14T04:27:50+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-14T04:27:50+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-14T04:27:50+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:50+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:50+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-14T04:27:50+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:50+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:50+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-14T04:27:50+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-14T04:27:50+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-14T04:27:50+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-14T04:27:50+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T04:27:50+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:50+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:50+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T04:27:50+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:50+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:50+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T04:27:50+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:50+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:50+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T04:27:50+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:51+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:51+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T04:27:51+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:51+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:51+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T04:27:51+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:51+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:51+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T04:27:51+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:51+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:51+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T04:27:51+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:51+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:51+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-14T04:27:51+00:00] INFO: service[xinetd] started
[2018-12-14T04:27:51+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-14T04:27:52+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-14T04:27:52+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-14T04:27:52+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-14T04:27:52+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-14T04:27:53+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-14T04:27:53+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-14T04:27:53+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-14T04:27:53+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181214042753.102960
[2018-12-14T04:27:53+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181213071141.548617
[2018-12-14T04:27:53+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-14T04:27:53+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-14T04:27:53+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-14T04:27:53+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-14T04:27:53+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T04:27:53+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T04:27:53+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-14T04:27:53+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-14T04:27:53+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-14T04:27:53+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-14T04:27:53+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-14T04:27:53+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-14T04:27:53+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-14T04:27:54+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-14T04:27:54+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-14T04:27:55+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-14T04:27:55+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-14T04:27:55+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-14T04:27:55+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-14T04:27:55+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-14T04:27:55+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-14T04:27:55+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-14T04:27:55+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-14T04:27:55+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-14T04:27:55+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-14T04:27:55+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-14T04:27:55+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-14T04:27:55+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-14T04:27:55+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-14T04:27:55+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-14T04:27:55+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-14T04:27:55+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-14T04:27:55+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-14T04:27:55+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-14T04:27:56+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-14T04:27:56+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-14T04:27:56+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-14T04:27:56+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-14T04:27:56+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[   72.367760] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[2018-12-14T04:27:59+00:00] INFO: service[kdump] restarted
[2018-12-14T04:27:59+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-14T04:27:59+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-14T04:27:59+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-14T04:27:59+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-14T04:27:59+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-14T04:27:59+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-14T04:27:59+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-14T04:27:59+00:00] INFO: Chef Run complete in 21.351556761 seconds
[2018-12-14T04:27:59+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-14T04:27:59+00:00] INFO: Running report handlers
[2018-12-14T04:27:59+00:00] INFO: Creating JSON run report
[2018-12-14T04:27:59+00:00] INFO: Report handlers complete
[  170.545027] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[  170.554545] alg: No test for adler32 (adler32-zlib)
[  171.439876] Lustre: Lustre: Build Version: 2.12.0_RC2
[  171.662724] LNet: Using FMR for registration
[  171.680326] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[  172.179474] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  172.455944] Lustre: MGS: Connection restored to 6c2176fc-4fb8-0c42-c9f3-53f29cb6e762 (at 0@lo)
[  172.851492] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[  176.543555] Lustre: MGS: Connection restored to dbdd0530-41b3-3b2f-f94d-112c395d2c2c (at 192.168.1.142@o2ib)
[  177.788159] Lustre: MGS: Connection restored to 43f5e77c-b75b-4455-c2b1-1534adccc551 (at 192.168.1.143@o2ib)
[  177.799166] Lustre: Skipped 3 previous similar messages
[  177.905689] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 28 clients reconnect
[  180.261222] Lustre: soaked-MDT0000: Connection restored to 48785ecb-744d-03cb-fb87-75d935fc28dd (at 192.168.1.144@o2ib)
[  180.273342] Lustre: Skipped 7 previous similar messages
[  184.889354] Lustre: soaked-MDT0000: Connection restored to 3e9a71ba-2002-760e-43b3-36407c1daa95 (at 192.168.1.125@o2ib)
[  184.901484] Lustre: Skipped 9 previous similar messages
[  197.886729] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[  197.895732] Lustre: Skipped 8 previous similar messages
[  213.900890] Lustre: MGS: Connection restored to 9b8c5f00-bd96-1510-ca47-3d5c932a303b (at 192.168.1.126@o2ib)
[  213.911903] Lustre: Skipped 26 previous similar messages
[  222.921496] LustreError: 11-0: soaked-MDT0002-osp-MDT0000: operation mds_connect to node 192.168.1.110@o2ib failed: rc = -114
[  273.097990] LustreError: 11-0: soaked-MDT0002-osp-MDT0000: operation mds_connect to node 192.168.1.110@o2ib failed: rc = -114
[  292.867084] Lustre: 12527:0:(ldlm_lib.c:1771:extend_recovery_timer()) soaked-MDT0000: extended recovery timer reaching hard limit: 900, extend: 1
[  323.344275] Lustre: soaked-MDT0000: Recovery over after 2:25, of 28 clients 28 recovered and 0 were evicted.
[ 2056.599356] Lustre: 14480:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 2848.687996] LNetError: 12313:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 1 seconds
[ 2848.699381] LNetError: 12313:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.105@o2ib (10): c: 0, oc: 0, rc: 8
[ 2848.713207] Lustre: 12353:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544764447/real 1544764454]  req@ffff953bf0abb300 x1619800232961856/t0(0) o6->soaked-OST000d-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 544/432 e 0 to 1 dl 1544764454 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 2848.713250] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 2848.764104] Lustre: 12353:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 35 previous similar messages
[ 3061.513224] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST0005_UUID (at 192.168.1.105@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9537ed3ed800, cur 1544764667 expire 1544764517 last 1544764440
[ 3104.214112] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 3104.224461] Lustre: Skipped 21 previous similar messages
[ 3126.196338] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 3147.734545] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 3153.692759] LNet: 12313:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds
[ 3154.692789] LNet: 12313:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds
[ 3167.719435] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 3267.830142] Lustre: soaked-OST0009-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[ 3267.841630] Lustre: Skipped 1 previous similar message
[ 3328.247815] LustreError: 11-0: soaked-OST0009-osc-MDT0000: operation ost_create to node 192.168.1.104@o2ib failed: rc = -19
[ 3328.260289] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 3328.278932] Lustre: Skipped 3 previous similar messages
[ 3328.284790] LustreError: 12502:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST0009-osc-MDT0000: can't precreate: rc = -19
[ 3328.297819] LustreError: 12502:0:(osp_precreate.c:1312:osp_precreate_thread()) soaked-OST0009-osc-MDT0000: cannot precreate objects: rc = -19
[ 3342.187421] Lustre: MGS: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 3342.196671] Lustre: Skipped 2 previous similar messages
[ 3347.162779] LustreError: 11-0: soaked-OST0001-osc-MDT0000: operation ost_create to node 192.168.1.104@o2ib failed: rc = -107
[ 3347.175368] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 3347.194094] LustreError: 12484:0:(osp_precreate.c:656:osp_precreate_send()) soaked-OST0001-osc-MDT0000: can't precreate: rc = -107
[ 3352.671892] LustreError: 11-0: soaked-OST0005-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -19
[ 3352.684337] Lustre: soaked-OST0005-osc-MDT0000: Connection to soaked-OST0005 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 3363.296025] LustreError: 11-0: soaked-OST000d-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107
[ 3363.308567] Lustre: soaked-OST000d-osc-MDT0000: Connection to soaked-OST000d (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 3481.277365] INFO: task mdt01_011:12571 blocked for more than 120 seconds.
[ 3481.284971] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 3481.293750] mdt01_011       D ffff9538271c5140     0 12571      2 0x00000080
[ 3481.301724] Call Trace:
[ 3481.304481]  [<ffffffffad967bc9>] schedule+0x29/0x70
[ 3481.310050]  [<ffffffffad9694b5>] rwsem_down_write_failed+0x225/0x3a0
[ 3481.317289]  [<ffffffffad586db7>] call_rwsem_down_write_failed+0x17/0x30
[ 3481.324798]  [<ffffffffad966ecd>] down_write+0x2d/0x3d
[ 3481.330567]  [<ffffffffc16322f7>] lod_qos_statfs_update+0x97/0x2b0 [lod]
[ 3481.338088]  [<ffffffffc163449a>] lod_qos_prep_create+0x16a/0x1890 [lod]
[ 3481.345613]  [<ffffffffc122e181>] ? qsd_op_begin+0xb1/0x4b0 [lquota]
[ 3481.352766]  [<ffffffffc138ad10>] ? osd_declare_qid+0x200/0x4a0 [osd_ldiskfs]
[ 3481.360765]  [<ffffffffc138b25b>] ? osd_declare_inode_qid+0x2ab/0x400 [osd_ldiskfs]
[ 3481.369359]  [<ffffffffc1635dd5>] lod_prepare_create+0x215/0x2e0 [lod]
[ 3481.376697]  [<ffffffffc1625cee>] lod_declare_striped_create+0x1ee/0x980 [lod]
[ 3481.384783]  [<ffffffffc163639f>] ? lod_sub_declare_create+0xdf/0x210 [lod]
[ 3481.392574]  [<ffffffffc162a5c4>] lod_declare_create+0x204/0x590 [lod]
[ 3481.399885]  [<ffffffffc16191b3>] ? lod_striping_from_default+0x93/0x5d0 [lod]
[ 3481.408033]  [<ffffffffc0e07be9>] ? lu_context_refill+0x19/0x50 [obdclass]
[ 3481.415744]  [<ffffffffc169fad2>] mdd_declare_create_object_internal+0xe2/0x2f0 [mdd]
[ 3481.424512]  [<ffffffffc168f5ec>] mdd_declare_create+0x4c/0xcb0 [mdd]
[ 3481.431734]  [<ffffffffc16936e7>] mdd_create+0x827/0x1440 [mdd]
[ 3481.438383]  [<ffffffffc1536660>] mdt_reint_open+0x19d0/0x27d0 [mdt]
[ 3481.445519]  [<ffffffffc0e1c518>] ? upcall_cache_get_entry+0x218/0x8b0 [obdclass]
[ 3481.453901]  [<ffffffffc15295e3>] mdt_reint_rec+0x83/0x210 [mdt]
[ 3481.460624]  [<ffffffffc1506133>] mdt_reint_internal+0x6e3/0xaf0 [mdt]
[ 3481.467929]  [<ffffffffc1512706>] ? mdt_intent_fixup_resent+0x36/0x220 [mdt]
[ 3481.475816]  [<ffffffffc1512972>] mdt_intent_open+0x82/0x350 [mdt]
[ 3481.482752]  [<ffffffffc0de6929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
[ 3481.490739]  [<ffffffffc1510a18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[ 3481.497970]  [<ffffffffc15128f0>] ? mdt_intent_fixup_resent+0x220/0x220 [mdt]
[ 3481.506034]  [<ffffffffc0ff1ec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[ 3481.513539]  [<ffffffffc0c8efa3>] ? cfs_hash_bd_add_locked+0x63/0x80 [libcfs]
[ 3481.521537]  [<ffffffffc0c9272e>] ? cfs_hash_add+0xbe/0x1a0 [libcfs]
[ 3481.528667]  [<ffffffffc101a8a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[ 3481.536572]  [<ffffffffc10427f0>] ? lustre_swab_ldlm_lock_desc+0x30/0x30 [ptlrpc]
[ 3481.545003]  [<ffffffffc10a1302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[ 3481.551875]  [<ffffffffc10a835a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[ 3481.559600]  [<ffffffffc1081a51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
[ 3481.568089]  [<ffffffffc0c83bde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
[ 3481.575997]  [<ffffffffc104c92b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[ 3481.584580]  [<ffffffffc10497b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
[ 3481.592171]  [<ffffffffad2d67c2>] ? default_wake_function+0x12/0x20
[ 3481.599192]  [<ffffffffad2cba9b>] ? __wake_up_common+0x5b/0x90
[ 3481.605740]  [<ffffffffc105025c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[ 3481.612793]  [<ffffffffc104f760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
[ 3481.621067]  [<ffffffffad2c1c31>] kthread+0xd1/0xe0
[ 3481.626540]  [<ffffffffad2c1b60>] ? insert_kthread_work+0x40/0x40
[ 3481.633347]  [<ffffffffad974c37>] ret_from_fork_nospec_begin+0x21/0x21
[ 3481.640658]  [<ffffffffad2c1b60>] ? insert_kthread_work+0x40/0x40
[ 3513.690208] Lustre: soaked-OST0001-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[ 3513.701697] Lustre: Skipped 6 previous similar messages
[ 4414.795719] perf: interrupt took too long (2554 > 2500), lowering kernel.perf_event_max_sample_rate to 78000
[ 5471.389304] LustreError: 12448:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x20000b7c8:0x24ca:0x0]
[ 5656.200079] Lustre: 12892:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [02;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [m[4;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[4;79H[m[7m[5;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [5;79H[22;1H   The selected entry will be started automatically in 5s.                     [5;79H[22;1H   The selected entry will be started automatically in 4s.                     [5;79H[22;1H   The selected entry will be started automatically in 3s.                     [5;79H[22;1H   The selected entry will be started automatically in 2s.                     [5;79H[22;1H   The selected entry will be started automatically in 1s.                     [5;79H[22;1H   The selected entry will be started automatically in 0s.                     [5;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-309-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Sat Dec 8 05:53:16 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x35bfe000-0x36df6fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 162MB of memory at 688MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff90596e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 7011916k/34603008k available (7664k kernel code, 1126748k absent, 830688k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.444 MHz processor
[    0.000176] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.88 BogoMIPS (lpj=2693444)
[    0.012133] pid_max: default: 245760 minimum: 1920
[    0.018347] Security Framework initialized
[    0.022940] SELinux:  Initializing.
[    0.027121] Yama: becoming mindful.
[    0.036339] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.058139] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.071950] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.079733] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.090023] Initializing cgroup subsys memory
[    0.094959] Initializing cgroup subsys devices
[    0.099927] Initializing cgroup subsys freezer
[    0.104895] Initializing cgroup subsys net_cls
[    0.109862] Initializing cgroup subsys blkio
[    0.114645] Initializing cgroup subsys perf_event
[    0.119950] Initializing cgroup subsys hugetlb
[    0.124919] Initializing cgroup subsys pids
[    0.129594] Initializing cgroup subsys net_prio
[    0.134940] mce: CPU supports 20 MCE banks
[    0.139583] CPU0: Thermal monitoring enabled (TM1)
[    0.145014] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.151145] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.157469] tlb_flushall_shift: 6
[    0.161245] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.171983] FEATURE SPEC_CTRL Present
[    0.176076] FEATURE IBPB_SUPPORT Present
[    0.180767] Spectre V2 : Mitigation: Full retpoline
[    0.188315] Freeing SMP alternatives: 28k freed
[    0.199534] ACPI: Core revision 20130517
[    0.294928] ACPI: All ACPI Tables successfully acquired
[    0.317100] ftrace: allocating 29187 entries in 115 pages
[    0.377620] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.385011] Switched APIC routing to physical flat.
[    0.391182] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.407892] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.418370] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.430140] ... version:                3
[    0.434609] ... bit width:              48
[    0.439183] ... generic registers:      4
[    0.443661] ... value mask:             0000ffffffffffff
[    0.449593] ... max period:             00007fffffffffff
[    0.455525] ... fixed-purpose events:   3
[    0.460002] ... event mask:             000000070000000f
[    0.474393] smpboot: Booting Node   0, Processors  #1[    0.495806] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.550501] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.690565] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.732458] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.773161] Brought up 32 CPUs
[    0.776775] smpboot: Max logical packages: 15
[    0.781649] smpboot: Total of 32 processors activated (172581.44 BogoMIPS)
[    1.040417] node 0 initialised, 2808669 pages in 137ms
[    1.077903] node 1 initialised, 3599741 pages in 169ms
[    1.084872] devtmpfs: initialized
[    1.100407] EVM: security.selinux
[    1.104113] EVM: security.ima
[    1.107429] EVM: security.capability
[    1.111678] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.120542] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.132899] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.140584] pinctrl core: initialized pinctrl subsystem
[    1.146703] RTC time:  6:19:14, date: 12/14/18
[    1.152162] NET: Registered protocol family 16
[    1.157628] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.166086] ACPI: bus type PCI registered
[    1.170566] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.178405] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.188804] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.196436] PCI: Using configuration type 1 for base access
[    1.202702] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.223337] ACPI: Added _OSI(Module Device)
[    1.228006] ACPI: Added _OSI(Processor Device)
[    1.232968] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.238221] ACPI: Added _OSI(Processor Aggregator Device)
[    1.244252] ACPI: Added _OSI(Linux-Dell-Video)
[    1.288870] ACPI: Executed 1 blocks of module-level executable AML code
[    1.578236] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.611579] ACPI: Interpreter enabled
[    1.615711] ACPI: (supports S0 S1 S5)
[    1.619802] ACPI: Using IOAPIC for interrupt routing
[    1.625470] HEST: Table parsing has been initialized.
[    1.631117] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.641388] ACPI: GPE 0x1E active on init
[    1.645902] ACPI: GPE 0x24 active on init
[    1.650405] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.716137] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.723051] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.732717] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.741202] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.749755] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.759179] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.770830] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.785683] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.800930] PCI host bridge to bus 0000:00
[    1.805512] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.812416] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.820774] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.829132] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.837491] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.845848] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.854205] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.862563] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.870919] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.879276] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.887633] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.895990] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.904348] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.912706] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.921065] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.930201] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.936864] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.943496] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.950144] pci 0000:00:02.0: System wakeup disabled by ACPI
[    1.956762] pci 0000:00:02.2: System wakeup disabled by ACPI
[    1.963396] pci 0000:00:03.0: System wakeup disabled by ACPI
[    1.973634] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    1.980288] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    1.986907] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    1.993570] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.000141] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.007429] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.013164] acpiphp: Slot [2] registered
[    2.017834] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.028157] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.038838] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.049161] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.059834] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.070158] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.080830] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.091153] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.103477] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.109553] acpiphp: Slot [2-2] registered
[    2.116591] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.122339] acpiphp: Slot [2-3] registered
[    2.126958] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.132683] acpiphp: Slot [2-4] registered
[    2.137589] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.143503] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.156306] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.161979] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.167959] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.174361] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.180035] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.189011] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.196913] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.204818] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.212726] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.220612] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.228507] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.236415] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.244309] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.252422] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.259333] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.268743] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.277074] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.285627] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.295201] PCI host bridge to bus 0000:80
[    2.299782] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.307367] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.314950] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.323308] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.331665] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.340800] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.347158] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.353750] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.360347] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.366947] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.375790] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.381433] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.387068] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.392691] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.409243] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.415861] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.425046] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.434715] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.441715] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.450980] PCI host bridge to bus 0000:7f
[    2.455560] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.466154] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.472774] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.481967] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.491635] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.498638] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.507906] PCI host bridge to bus 0000:ff
[    2.512485] pci_bus 0000:ff: root bus resource [bus ff]
[    2.523702] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.532763] vgaarb: loaded
[    2.535787] vgaarb: bridge control possible 0000:09:00.0
[    2.542148] SCSI subsystem initialized
[    2.546400] ACPI: bus type USB registered
[    2.550926] usbcore: registered new interface driver usbfs
[    2.557078] usbcore: registered new interface driver hub
[    2.563303] usbcore: registered new device driver usb
[    2.569496] EDAC MC: Ver: 3.0.0
[    2.573558] PCI: Using ACPI for IRQ routing
[    2.585843] NetLabel: Initializing
[    2.589644] NetLabel:  domain hash size = 128
[    2.594510] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.600104] NetLabel:  unlabeled traffic allowed by default
[    2.606650] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.613674] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.622233] amd_nb: Cannot enumerate AMD northbridges
[    2.628100] Switched to clocksource hpet
[    2.647368] pnp: PnP ACPI init
[    2.650823] ACPI: bus type PNP registered
[    2.655742] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.662365] system 00:00: [io  0xffff] has been reserved
[    2.668305] system 00:00: [io  0xffff] has been reserved
[    2.674244] system 00:00: [io  0xffff] has been reserved
[    2.680174] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.687179] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.693796] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.700411] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.707029] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.714048] system 00:00: [io  0x0cf9] could not be reserved
[    2.720599] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.728848] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.736248] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.743641] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.751025] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.758423] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.765817] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.773598] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.781378] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.789158] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.797110] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.805469] pnp: PnP ACPI: found 7 devices
[    2.810054] ACPI: bus type PNP unregistered
[    2.823531] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.829102] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.834943] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.841757] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.849352] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.854904] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.862494] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.871926] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.877487] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.883036] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.889857] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.897452] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.903002] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    2.909816] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    2.917406] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    2.926842] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.932406] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.937961] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    2.945548] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    2.954198] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    2.959982] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.965543] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.971105] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.976667] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.982611] NET: Registered protocol family 2
[    2.989684] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    2.998864] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.006630] TCP: Hash tables configured (established 262144 bind 65536)
[    3.014138] TCP: reno registered
[    3.017925] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.025101] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.033812] NET: Registered protocol family 1
[    4.139093] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.247119] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.255609] Un packing initram[    5.821803] Freeing initrd memory: 18404k freed
[    5.834595] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.841822] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff9055f73c7000-ffff9055fb3c6fff]
[    5.853322] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    5.862173] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    5.868599] RAPL PMU: hw unit of domain package 2^-16 Joules
[    5.874935] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    5.893831] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    5.900672] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    5.914607] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    5.922877] Initialise system trusted keyring
[    5.927912] audit: initializing netlink socket (disabled)
[    5.933992] type=2000 audit(1544768356.464:1): initialized
[    5.995675] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.002787] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.013135] zpool: loaded
[    6.016070] zbud: loaded
[    6.020103] VFS: Disk quotas dquot_6.6.0
[    6.024996] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.033700] msgmni has been set to 32768
[    6.038489] Key type big_key registered
[    6.045389] NET: Registered protocol family 38
[    6.050386] Key type asymmetric registered
[    6.054978] Asymmetric key parser 'x509' registered
[    6.060600] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.069159] io scheduler noop registered
[    6.073575] io scheduler deadline registered (default)
[    6.079475] io scheduler cfq registered
[    6.083782] io scheduler mq-deadline registered
[    6.088865] io scheduler kyber registered
[    6.099240] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.107069] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.114848] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.122136] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.129439] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.136734] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.144092] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.151873] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.159218] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.167043] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.174823] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.182188] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.189967] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.197264] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.204612] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.212436] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.220220] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.227573] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.235417] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.243253] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.251093] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.259002] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.265255] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.272695] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.281025] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.289306] ACPI: Power Button [PWRF]
[    6.293501] ACPI: Requesting acpi_cpufreq
[    6.381337] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.389712] pstore: Registered erst as persistent store backend
[    6.396651] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.405116] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.432992] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.460130] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.467420] Non-volatile memory driver v1.3
[    6.472187] Linux agpgart interface v0.103
[    6.477209] crash memory driver: version 1.1
[    6.482458] rdac: device handler registered
[    6.487228] hp_sw: device handler registered
[    6.492020] emc: device handler registered
[    6.496866] alua: device handler registered
[    6.501646] libphy: Fixed MDIO Bus: probed
[    6.506321] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.513651] ehci-pci: EHCI PCI platform driver
[    6.519093] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.525079] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.533384] ehci-pci 0000:00:1a.0: debug port 2
[    6.542432] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.554166] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.560688] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.568275] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.576346] usb usb1: Product: EHCI Host Controller
[    6.581810] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.589984] usb usb1: SerialNumber: 0000:00:1a.0
[    6.595379] hub 1-0:1.0: USB hub found
[    6.599582] hub 1-0:1.0: 2 ports detected
[    6.604648] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    6.610598] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    6.618901] ehci-pci 0000:00:1d.0: debug port 2
[    6.627927] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    6.640162] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    6.646694] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    6.654281] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.662352] usb usb2: Product: EHCI Host Controller
[    6.667810] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.675984] usb usb2: SerialNumber: 0000:00:1d.0
[    6.681355] hub 2-0:1.0: USB hub found
[    6.685565] hub 2-0:1.0: 2 ports detected
[    6.690317] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    6.697254] ohci-pci: OHCI PCI platform driver
[    6.702286] uhci_hcd: USB Universal Host Controller Interface driver
[    6.709543] usbcore: registered new interface driver usbserial_generic
[    6.716857] usbserial: USB Serial support registered for generic
[    6.723646] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    6.888192] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    7.776180] i8042: No controller found
[    7.780476] Switched to clocksource tsc
[    7.780537] mousedev: PS/2 mouse device common for all mice
[    7.780731] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    7.780821] rtc_cmos 00:01: RTC can wake from S4
[    7.781079] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    7.781133] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    7.781278] intel_pstate: Intel P-state driver initializing
[    7.793601] cpuidle: using governor menu
[    7.795094] hidraw: raw HID events driver (C) Jiri Kosina
[    7.795345] usbcore: registered new interface driver usbhid
[    7.795346] usbhid: USB HID core driver
[    7.795551] drop_monitor: Initializing network drop monitor service
[    7.796068] TCP: cubic registered
[    7.796077] Initializing XFRM netlink socket
[    7.796735] NET: Registered protocol family 10
[    7.798316] NET: Registered protocol family 17
[    7.798331] mpls_gso: MPLS GSO support
[    7.800078] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    7.803541] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    7.803761] Loading compiled-in X.509 certificates
[    7.804859] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    7.805923] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    7.806968] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: d73e894149b8945b8dc07cc18b4508db322683f2'
[    7.807019] registered taskstats version 1
[    7.811364] Key type trusted registered
[    7.815207] Key type encrypted registered
[    7.815340] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.816958]   Magic number: 14:992:316
[    7.817079] tty tty41: hash matches
[    7.817333] memory memory170: hash matches
[    7.818806] rtc_cmos 00:01: setting system clock to 2018-12-14 06:19:21 UTC (1544768361)
[    7.831244] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    7.907676] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    7.907679] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.908247] hub 1-1:1.0: USB hub found
[    7.908401] hub 1-1:1.0: 6 ports detected
[    7.943496] random: fast init done
[    7.957615] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    7.957619] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.958097] hub 2-1:1.0: USB hub found
[    7.958301] hub 2-1:1.0: 8 ports detected
[    8.037717] Freeing unused kernel memory: 1876k freed
[    8.044148] Write protecting the kernel read-only data: 12288k
[    8.053801] Freeing unused kernel memory: 516k freed
[    8.062402] Freeing unused kernel memory: 600k freed
[    8.082292] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.103783] systemd[1]: Detected architecture x86-64.
[    8.109446] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.125395] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.201363] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.214328] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.224614] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.233283] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
[     8.242163] s.
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.255445] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.266418] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal So cket.
[    8.2rting Apply Kernel Variables...
         Starting Apply Kernel Variables...
[    8.290296] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Starting Create list of  required st... current kernel...
[    8.310381] systemd[1]: Listening on udev Kernel Socket.
[ [32m  OK  [0mt .
[    8.32334 target Sockets.
[ [32m  OK  [0m[    8.334202] systemd[1]: Starting Journal Service...
         Startin[    8.340553] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
g Journal Servic[    8.349108] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
e...
[    8.358795] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.365476] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.371895] usb 2-1.4: SerialNumber: serial
[    8.377348] systemd[1]: Starting dracut cmdline hook...
[    8.378125 ] input: Americ and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
         Starting dracut cmdline hook...
[    8.402849] systemd[1]: Starting Setup Virtual Console...
         Starting Setup Virtual Console...
[    8.414378] systemd[1]: Reached target Slices.
[    8.428748] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
[[32m  OK  [0m[    8.446569] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
] Reached target[    8.461830] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
 Slices.
[    8.481260] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    8.491608] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started dracut cmdline hook.
[[32m  OK  [0m] Started Setup Virtual Console.
         Starting dracut pre-udev hook...
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Show Plymouth Boot Screen...
         Starting dracut initqueue hook...
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Reached target Basic System.
[    8.750313] dca service started, version 1.12.1
[    8.757331] mlx_compat: loading out-of-tree module taints kernel.
[    8.765175] pps_core: LinuxPPS API ver. 1 registered
[    8.770726] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    8.781228] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    8.796465] PTP clock support registered
[    8.802661] Compat-mlnx-ofed backport release: b4fdfac
[    8.808408] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    8.815802] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    8.827918] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    8.835699] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.842795] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    8.854971] mpt2sas version 20.103.01.00 loaded
[    8.860164] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[    8.871250] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    8.871803] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32666996 kB)
[    8.889534] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    8.890125] igb 0000:02:00.0: added PHC on eth0
[    8.890127] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.890129] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    8.890203] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    8.890205] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.891311] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    8.926208] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[    8.926848] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 60
[    8.926848] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 61
[    8.926849] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 62
[    8.926850] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 63
[    8.926851] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 64
[    8.926852] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 65
[    8.926853] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 66
[    8.926853] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 67
[    8.926854] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 68
[    8.926855] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 69
[    8.926856] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 70
[    8.926856] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 71
[    8.926857] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 72
[    8.926858] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 73
[    8.926859] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 74
[    8.926859] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 75
[    8.926861] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffa2b643aa0000), size(65536)
[    8.926862] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[    8.928791] igb 0000:02:00.1: added PHC on eth1
[    8.928793] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    8.928794] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    8.928867] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    8.928868] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.957693] scsi host1: ahci
[    8.957797] scsi host2: ahci
[    8.957889] scsi host3: ahci
[    8.957976] scsi host4: ahci
[    8.958053] scsi host5: ahci
[    8.958134] scsi host6: ahci
[    8.958173] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 48
[    8.958176] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 48
[    8.958178] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 48
[    8.958181] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 48
[    8.958184] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 48
[    8.958187] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 48
[    8.962004] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    8.962032] mlx4_core: Initializing 0000:04:00.0
[    8.981197] mpt2sas_cm0: sending message unit reset !!
[    8.982703] mpt2sas_cm0: message unit reset: SUCCESS
[    8.986104] igb 0000:02:00.2: added PHC on eth2
[    8.986106] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    8.986107] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    8.986179] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    8.986181] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.043120] igb 0000:02:00.3: added PHC on eth3
[    9.043121] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
[    9.043122] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.043198] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.043200] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.044179] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
%G%G[    9.044181] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[    9.044182] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    9.089585] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[    9.089587] mpt2sas_cm0: Protocol=(
[    9.089587] Initiator
[    9.089587] ,Target
[    9.089588] ), 
[    9.089588] Capabilities=(
[    9.089588] TLR
[    9.089589] ,EEDP
[    9.089589] ,Snapshot Buffer
[    9.089589] ,Diag Trace Buffer
[    9.089590] ,Task Set Full
[    9.089590] ,NCQ
[    9.089590] )
[    9.089635] scsi host0: Fusion MPT SAS Host
[    9.089925] mpt2sas_cm0: sending port enable !!
[    9.092163] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    9.092218] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    9.092226] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    9.092231] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    9.092233] isci 0000:07:00.0: OEM parameter table found in OROM
[    9.092236] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    9.092438] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    9.094592] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[    9.094910] scsi host7: isci
[    9.108204] mpt2sas_cm0: port enable: SUCCESS
[    9.108884] scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.108888] scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.108890] scsi 0:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.108892] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.203443] [TTM] Zone  kernel: Available graphics memory: 16333498 kiB
[    9.203444] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.203444] [TTM] Initializing pool allocator
[    9.203448] [TTM] Initializing DMA pool allocator
[    9.260639] fbcon: mgadrmfb (fb0) is primary device
[    9.268244] ata5: SATA link down (SStatus 0 SControl 300)
[    9.268283] ata1: SATA link down (SStatus 0 SControl 300)
[    9.268310] ata6: SATA link down (SStatus 0 SControl 300)
[    9.268345] ata3: SATA link down (SStatus 0 SControl 300)
[    9.268372] ata2: SATA link down (SStatus 0 SControl 300)
[    9.273231] ata4: SATA link down (SStatus 0 SControl 300)
[    9.294989] scsi 0:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.294993] scsi 0:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.294995] scsi 0:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.294997] scsi 0:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.321588] scsi 0:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.321597] scsi 0:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.321601] scsi 0:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.321616] scsi 0:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.367641] scsi 0:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.367651] scsi 0:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.367654] scsi 0:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.367660] scsi 0:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.383628] scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.383648] scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.383651] scsi 0:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.383654] scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.398314] scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.398322] scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.398325] scsi 0:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.398330] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.414002] scsi 0:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.414010] scsi 0:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.414013] scsi 0:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.414018] scsi 0:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.425695] scsi 0:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.425702] scsi 0:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.425706] scsi 0:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.425710] scsi 0:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.437634] scsi 0:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.437640] scsi 0:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.437643] scsi 0:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.437647] scsi 0:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.458671] scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.458678] scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.458681] scsi 0:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.458686] scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.473986] scsi 0:0:0:0: rdac: LUN 0 (RDAC) (owned)
[    9.474664] scsi 0:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[    9.475393] scsi 0:0:0:2: rdac: LUN 2 (RDAC) (owned)
[    9.476063] scsi 0:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[    9.476984] scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[    9.477660] scsi 0:0:1:1: rdac: LUN 1 (RDAC) (owned)
[    9.478378] scsi 0:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[    9.479056] scsi 0:0:1:3: rdac: LUN 3 (RDAC) (owned)
[    9.494607] Console: switching to colour frame buffer device 128x48
[    9.549508] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.586271] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   10.770236] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   10.776481] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   10.784966] ata7.00: configured for UDMA/133
[   10.790294] scsi 7:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.491879] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.498875] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.505682] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.512872] mlx4_core: device is working in RoCE mode: Roce V1
[   15.519381] mlx4_core: UD QP Gid type is: V1
[   16.578033] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   16.988477] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   16.994725] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   17.003384] ata8.00: configured for UDMA/133
[   17.019185] scsi 7:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   17.060483] sd 0:0:0:0: [sda] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.060637] sd 0:0:0:1: [sdb] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.060655] sd 0:0:0:2: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.060782] sd 0:0:0:3: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.060816] sd 0:0:1:0: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.060874] sd 0:0:0:7: [sde] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.060941] sd 0:0:1:1: [sdg] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.061113] sd 0:0:1:2: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.061301] sd 0:0:1:3: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   17.061831] sd 0:0:0:1: [sdb] Write Protect is off
[   17.061896] sd 0:0:0:2: [sdc] Write Protect is off
[   17.061986] sd 0:0:1:0: [sdf] Write Protect is off
[   17.062093] sd 0:0:0:3: [sdd] Write Protect is off
[   17.062237] sd 0:0:0:7: [sde] Write Protect is off
[   17.062239] sd 0:0:1:1: [sdg] Write Protect is off
[   17.062420] sd 0:0:0:1: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.062466] sd 0:0:0:2: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.062494] sd 0:0:1:2: [sdh] Write Protect is off
[   17.062585] sd 0:0:1:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.062630] sd 0:0:0:3: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.062765] sd 0:0:1:1: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.063002] sd 0:0:0:7: [sde] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.063122] sd 0:0:1:3: [sdi] Write Protect is off
[   17.063180] sd 0:0:1:2: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.063776] sd 0:0:1:3: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.064016] sd 7:0:0:0: [sdk] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.064062] sd 7:0:0:0: [sdk] Write Protect is off
[   17.064080] sd 7:0:0:0: [sdk] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.064805] sd 0:0:1:7: [sdj] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   17.065799] Dev sdb: unable to read RDB block 0
[   17.065810]  sdb: unable to read partition table
[   17.066053] sd 7:0:1:0: [sdl] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   17.066097] sd 0:0:1:7: [sdj] Write Protect is off
[   17.066101] sd 7:0:1:0: [sdl] Write Protect is off
[   17.066123] sd 7:0:1:0: [sdl] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.066578] Dev sdd: unable to read RDB block 0
[   17.066590]  sdd: unable to read partition table
[   17.066656] sd 0:0:1:7: [sdj] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   17.066846] Dev sdh: unable to read RDB block 0
[   17.066859]  sdh: unable to read partition table
[   17.066921] Dev sdf: unable to read RDB block 0
[   17.066931]  sdf: unable to read partition table
[   17.068392] sd 0:0:0:1: [sdb] Attached SCSI disk
[   17.069090] sd 0:0:0:2: [sdc] Attached SCSI disk
[   17.069168] sd 0:0:0:3: [sdd] Attached SCSI disk
[   17.070654] sd 0:0:1:2: [sdh] Attached SCSI disk
[   17.070675] sd 0:0:1:0: [sdf] Attached SCSI disk
[   17.070756] sd 0:0:1:3: [sdi] Attached SCSI disk
[   17.072291] sd 0:0:1:1: [sdg] Attached SCSI disk
[   17.073689]  sdl:
[   17.074090] sd 7:0:1:0: [sdl] Attached SCSI disk
[   17.079783]  sdk: sdk1 sdk2
[   17.080523] sd 7:0:0:0: [sdk] Attached SCSI disk
[   17.162446] random: crng init done
[   17.273114]  sde:
[   17.274341] sd 0:0:0:7: [sde] Attached SCSI disk
[   17.431873] sd 0:0:0:0: [sda] Write Protect is off
[   17.437323]  sdj:
[   17.437572] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   17.440815] sd 0:0:0:0: [sda] Attached SCSI disk
[   17.455554] sd 0:0:1:7: [sdj] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
         Mounting /sysroot...
[   19.266823] EXT4-fs (sdk1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
[[32m  OK  [0m] Stopped target Timers.
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped target Swap.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped udev Kernel Device Manager.
[[32m  OK  [0m] Stopped C[   19.659243] systemd-journald[283]: Received SIGTERM from PID 1 (systemd).
reate Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Closed udev Kernel Socket.
[[32m  OK  [0m] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.967806] SELinux:  Disabled at runtime.
[   20.015522] type=1404 audit(1544768373.696:2): selinux=0 auid=4294967295 ses=4294967295
[   20.258530] ip_tables: (C) 2000-2006 Netfilter Core Team
[   20.265457] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
         Mounting Huge Pages File System...
[[32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
         Starting Read and set NIS domainname from /etc/sysconfig/network...
[[32m  OK  [0m] Reached target RPC Port Mapper.
[[32m  OK  [0m] Created slice system-getty.slice.
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Listening on udev Control Socket.
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[[32m  OK  [0m] Stopped target Initrd Root File System.
         Starting Replay Read-Ahead Data...
         Starting Create list of required st... nodes for the current kernel...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Listening on udev Kernel Socket.
         Starting Availability of block devices...
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
[[32m  OK  [0m] Reached target Paths.
         Mounting Debug File System...
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Create Static Device Nodes in /dev...
[   21.230716] RPC: Registered named UNIX socket transport module.
[   21.237345] RPC: Registered udp transport module.
[   21.242608] RPC: Registered tcp transport module.
[   21.247862] RPC: Registered tcp NFSv4.1 backchannel transport module.
         Starting Apply Kernel Variables...
         Starting Remount Root and Kernel File Systems...
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started LVM2 metadata d[   21.362893] EXT4-fs (sdk1): re-mounted. Opts: (null)
aemon.
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting Configure read-only root support...
         Starting Flush Journal to Persistent Storage...
         Starting udev Coldplug all Devices...
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[   21.580661] sd 0:0:0:7: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.589323] sd 0:0:0:7: [sde] Sense Key : Illegal Request [current] 
[   21.596429] sd 0:0:0:7: [sde] Add. Sense: Logical block address out of range
[   21.604302] sd 0:0:0:7: [sde] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.611881] blk_update_request: critical target error, dev sde, sector 0
[   21.619399] sd 0:0:1:7: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.628059] sd 0:0:1:7: [sdj] Sense Key : Illegal Request [current] 
[   21.628063] sd 0:0:1:7: [sdj] Add. Sense: Logical block address out of range
[   21.628066] sd 0:0:1:7: [sdj] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.628068] blk_update_request: critical target error, dev sdj, sector 0
[[32m  OK  [0m] Started udev Coldplug all Devi[   21.662644] systemd-journald[4543]: Received request to flush runtime journal from PID 1
ces.
         Starting Device-Mapper Multipath Device Controller...
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[   21.926620] device-mapper: uevent: version 1.0.3
[   21.932072] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[[32m  OK  [0m] Started udev Kernel Device Manager.
[   22.252689] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   22.260044] igb 0000:02:00.0: DCA enabled
[   22.264556] igb 0000:02:00.1: DCA enabled
[   22.273076] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.273419] igb 0000:02:00.2: DCA enabled
[   22.273537] igb 0000:02:00.3: DCA enabled
[   22.294077] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.344422] ipmi message handler version 39.2
[   22.351842] ipmi device interface
[   22.367576] IPMI System Interface driver.
[   22.372141] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   22.378854] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   22.386308] ipmi_si: Adding SMBIOS-specified kcs state machine
[   22.392887] ipmi_platform: probing via SPMI
[   22.397573] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   22.406274] (NULL device *): SPMI-specified kcs state machine: duplicate
[   22.413903] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   22.431709] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[[32m  OK  [0m[   22.439944] sd 0:0:0:0: Attached scsi generic sg0 type 0
] Found device /[   22.441617] i801_smbus 0000:07:00.3: Enabling SMBus device
dev/ttyS0.
[   22.441661] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   22.462038] sd 0:0:0:1: Attached scsi generic sg1 type 0
[   22.468133] sd 0:0:0:2: Attached scsi generic sg2 type 0
[   22.474413] sd 0:0:0:3: Attached scsi generic sg3 type 0
[   22.474523] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   22.478256] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[   22.497464] sd 0:0:0:7: Attached scsi generic sg4 type 0
[   22.503550] sd 0:0:1:0: Attached scsi generic sg5 type 0
[   22.509647] sd 0:0:1:1: Attached scsi generic sg6 type 0
[   22.515836] sd 0:0:1:2: Attached scsi generic sg7 type 0
[   22.521920] sd 0:0:1:3: Attached scsi generic sg8 type 0
[   22.523579] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   22.534437] sd 0:0:1:7: Attached scsi generic sg9 type 0
[   22.540646] IPMI SSIF Interface driver
[   22.541351] sd 7:0:0:0: Attached scsi generic sg10 type 0
[   22.541449] sd 7:0:1:0: Attached scsi generic sg11 type 0
[   22.557365] cryptd: max_cpu_qlen set to 1000
[   22.580071] AVX version of gcm_enc/dec engaged.
[   22.585139] AES CTR mode by8 optimization enabled
%G%G[   22.594764] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.602157] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   22.654418] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   22.662806] sd 0:0:0:7: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   22.671474] sd 0:0:0:7: [sde] Sense Key : Illegal Request [current] 
[   22.678570] sd 0:0:0:7: [sde] Add. Sense: Logical block address out of range
[   22.686448] sd 0:0:0:7: [sde] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   22.694033] blk_update_request: critical target error, dev sde, sector 0
[   22.701823] sd 0:0:0:7: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   22.710485] sd 0:0:0:7: [sde] Sense Key : Illegal Request [current] 
[   22.710488] sd 0:0:0:7: [sde] Add. Sense: Logical block address out of range
[   22.710495] sd 0:0:0:7: [sde] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   22.710498] blk_update_request: critical target error, dev sde, sector 0
[   22.710879] sd 0:0:0:7: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   22.710882] sd 0:0:0:7: [sde] Sense Key : Illegal Request [current] 
[   22.710886] sd 0:0:0:7: [sde] Add. Sense: Logical block address out of range
[   22.710889] sd 0:0:0:7: [sde] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   22.710891] blk_update_request: critical target error, dev sde, sector 0
[   22.711745] iTCO_vendor_support: vendor-support=0
[   22.722369] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.722449] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.780015] kvm: disabled by bios
[   22.813231] blk_update_request: I/O error, dev sdb, sector 0
[   22.813450] blk_update_request: I/O error, dev sdf, sector 0
[   22.813512] blk_update_request: I/O error, dev sdd, sector 0
[   22.813541] blk_update_request: I/O error, dev sdh, sector 0
[   22.850082] intel_rapl: Found RAPL domain package
[   22.850085] intel_rapl: Found RAPL domain core
[   22.850092] intel_rapl: Found RAPL domain dram
[   22.850135] intel_rapl: Found RAPL domain package
[   22.850139] intel_rapl: Found RAPL domain core
[   22.850143] intel_rapl: Found RAPL domain dram
[   22.898898] blk_update_request: I/O error, dev sdb, sector 0
[   22.962404] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.972882] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.983097] EDAC sbridge:  Ver: 1.1.2 
[   23.015404] device-mapper: multipath round-robin: version 1.2.0 loaded
[   23.039170] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   23.490632] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   23.499333] sd 0:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   24.170650] sd 0:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   24.179390] sd 0:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   24.441494] device-mapper: table: 253:5: multipath: error getting device
[   24.448999] device-mapper: ioctl: error adding target to table
[   24.814341] sd 0:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.823089] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-[   24.900225] Adding 16253948k swap on /dev/sdk2.  Priority:-2 extents:1 across:16253948k FS
f59c8600579d...
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[   25.485471] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   25.494236] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   26.230717] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   26.239488] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   26.903809] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   27.022401] sd 0:0:1:2: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.031064] sd 0:0:1:2: [sdh] Sense Key : Illegal Request [current] 
[   27.038173] sd 0:0:1:2: [sdh] <<vendor>>ASC=0x94 ASCQ=0x1 
[   27.044304] sd 0:0:1:2: [sdh] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   27.053633] blk_update_request: 19 callbacks suppressed
[   27.059489] blk_update_request: I/O error, dev sdh, sector 0
[   27.067748] sd 0:0:1:7: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.076412] sd 0:0:1:7: [sdj] Sense Key : Illegal Request [current] 
[   27.083540] sd 0:0:1:7: [sdj] Add. Sense: Logical block address out of range
[   27.091425] sd 0:0:1:7: [sdj] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.099014] blk_update_request: critical target error, dev sdj, sector 0
[   27.106934] sd 0:0:1:7: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.115618] sd 0:0:1:7: [sdj] Sense Key : Illegal Request [current] 
[   27.122721] sd 0:0:1:7: [sdj] Add. Sense: Logical block address out of range
[   27.130622] sd 0:0:1:7: [sdj] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.138221] blk_update_request: critical target error, dev sdj, sector 0
[   27.146063] sd 0:0:1:7: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.154720] sd 0:0:1:7: [sdj] Sense Key : Illegal Request [current] 
[   27.161824] sd 0:0:1:7: [sdj] Add. Sense: Logical block address out of range
[   27.169698] sd 0:0:1:7: [sdj] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.177304] blk_update_request: critical target error, dev sdj, sector 0
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Import network configuration from initramfs...
         Starting Preprocess NFS configuration...
         Starting Tell Plymouth To Write Out Runtime Data...
[[32m  OK  [0m] Started Import network configuration from initramfs.
[[32m  OK  [0m] Started Preprocess NFS configuration.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Starting Security Auditing Service...
         Mounting RPC Pipe File System...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   27.617062] type=1305 audit(1544768381.297:3): audit_pid=9375 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting GSSAPI Proxy Daemon...
         Starting Network Manager...
         Starting Dump dmesg to /var/log/dmesg...
         Starting System Security Services Daemon...
[[32m  OK  [0m] Started irqbalance daemon.
         Starting NTP client/server...
         Starting Authorization Manager...
         Starting Load CPU microcode update...
         Starting Machine Check Exception Logging Daemon...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[   28.348226] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   28.436387] igb 0000:02:00.0 ens2f0: igb: ens2f0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   28.436952] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   28.443409] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   28.525085] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   28.532182] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[   28.541581] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   28.548870] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   28.558806] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   28.566394] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   28.660609] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   28.670403] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   28.770902] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[   28.788480] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   29.313461] card: mlx4_0, QP: 0x220, inline size: 120
[[32m  OK  [0m[   29.330372] card: mlx4_0, QP: 0x300, inline size: 120
] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [   29.342990] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[0m] Started mlnx_interface_mgr - configure ib0.
[   29.361872] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[   29.391842] ib0: enabling connected mode will cause multicast packet drops
[   29.399644] ib0: mtu > 4092 will cause multicast packet drops.
[   29.406484] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   29.424964] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   29.445820] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   36.399409] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   36.443150] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   36.452558] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting MUNGE authentication service...
         Starting Postfix Mail Transport Agent...
[[32m  OK  [0m] Reached target Network is Online.
         Starting NFS statu[   36.623660] FS-Cache: Loaded
s monitor for NFSv2/3 locking....
         Starting System Logging Service...
         Starting Notify NFS peers of a restart...
         Starting OpenSSH server daemon...
         Starting Xinetd A Powerful Replacement For Inetd...
         Mounting /scratch...
         Starting Dynamic System Tuning Daemon...
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[   36.698601] FS-Cache: Netfs 'nfs' registered for caching
[   36.727531] Key type dns_resolver registered
[   36.763094] NFS: Registering the id_resolver key type
[   36.768749] Key type id_resolver registered
[   36.773430] Key type id_legacy registered
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Crash recovery kernel arming...
         Starting Automounts filesystems on demand...
         Starting Permit User Sessions...
[[32m  OK  [0m] Started Permit User Sessions.
         Starting Wait for Plymouth Boot Screen to Quit...
         Starting Terminate Plymouth Boot Screen...
[[32m  OK  [0m] Started Command Scheduler.
[[32m  OK  [0m] Started Job spooling tools.
[[32m  OK  [0m] Created slice User Slice of root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-14T06:20:02+00:00] INFO: Forking chef instance to converge...
[2018-12-14T06:20:02+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-14T06:20:02+00:00] INFO: Chef-client pid: 10976
[2018-12-14T06:20:04+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-14T06:20:04+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-14T06:20:04+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-14T06:20:04+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-14T06:20:04+00:00] INFO: Running start handlers
[2018-12-14T06:20:04+00:00] INFO: Start handlers complete.
[2018-12-14T06:20:05+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-14T06:20:05+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-14T06:20:05+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-14T06:20:05+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-14T06:20:05+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181214062005.052958
[2018-12-14T06:20:05+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181213072303.008658
[2018-12-14T06:20:05+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-14T06:20:05+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-14T06:20:10+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-14T06:20:10+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-14T06:20:10+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-14T06:20:10+00:00] INFO: service[ntpd] started
[2018-12-14T06:20:10+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-14T06:20:11+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-14T06:20:11+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-14T06:20:11+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-14T06:20:11+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-14T06:20:11+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-14T06:20:11+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-14T06:20:11+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-14T06:20:11+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-14T06:20:11+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-14T06:20:12+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-14T06:20:12+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-14T06:20:12+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-14T06:20:12+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:12+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:12+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-14T06:20:12+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-14T06:20:13+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-14T06:20:13+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-14T06:20:13+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-14T06:20:13+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-14T06:20:14+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-14T06:20:14+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-14T06:20:14+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-14T06:20:14+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-14T06:20:14+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-14T06:20:14+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-14T06:20:14+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-14T06:20:15+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-14T06:20:15+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-14T06:20:15+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-14T06:20:15+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-14T06:20:15+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-14T06:20:15+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-14T06:20:15+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-14T06:20:15+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-14T06:20:15+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-14T06:20:15+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-14T06:20:15+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-14T06:20:15+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-14T06:20:16+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-14T06:20:16+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-14T06:20:16+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-14T06:20:16+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-14T06:20:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181214062016.647536
[2018-12-14T06:20:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181213072316.194601
[2018-12-14T06:20:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-14T06:20:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-14T06:20:16+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-14T06:20:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181214062016.653898
[2018-12-14T06:20:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181213072316.210759
[2018-12-14T06:20:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-14T06:20:16+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-14T06:20:16+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-14T06:20:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:16+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-14T06:20:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:16+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-14T06:20:16+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-14T06:20:16+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-14T06:20:16+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-14T06:20:16+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:20:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:16+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:20:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:16+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:20:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:16+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:20:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:16+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:20:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:16+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:16+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:20:16+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:17+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:17+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:20:17+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:17+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:17+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:20:17+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:17+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:17+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-14T06:20:17+00:00] INFO: service[xinetd] started
[2018-12-14T06:20:17+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-14T06:20:18+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-14T06:20:18+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-14T06:20:18+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-14T06:20:18+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-14T06:20:19+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-14T06:20:19+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-14T06:20:19+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-14T06:20:19+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181214062019.292591
[2018-12-14T06:20:19+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181213072318.084521
[2018-12-14T06:20:19+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-14T06:20:19+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-14T06:20:19+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-14T06:20:19+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-14T06:20:19+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-14T06:20:19+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-14T06:20:19+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-14T06:20:19+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:20:19+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:20:19+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:20:19+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-14T06:20:19+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-14T06:20:19+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-14T06:20:19+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-14T06:20:20+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-14T06:20:20+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-14T06:20:20+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-14T06:20:20+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-14T06:20:20+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-14T06:20:20+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-14T06:20:21+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-14T06:20:21+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[   68.068568] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[   68.078836] alg: No test for adler32 (adler32-zlib)
[2018-12-14T06:20:22+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-14T06:20:22+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-14T06:20:22+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-14T06:20:22+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-14T06:20:22+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-14T06:20:22+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-14T06:20:22+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-14T06:20:22+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-14T06:20:22+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-14T06:20:22+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-14T06:20:22+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-14T06:20:22+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-14T06:20:22+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-14T06:20:22+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-14T06:20:22+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-14T06:20:22+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-14T06:20:22+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-14T06:20:22+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-14T06:20:22+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-14T06:20:22+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-14T06:20:22+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[201[   68.933752] Lustre: Lustre: Build Version: 2.12.0_RC2
8-12-14T06:20:22+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-14T06:20:22+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[   69.162687] LNet: Using FMR for registration
[   69.179943] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[   69.300917] LDISKFS-fs warning (device dm-2): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait.
[   69.300917] 
[   71.102750] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[  115.022930] LDISKFS-fs (dm-2): recovery complete
[  115.028498] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  116.164052] Lustre: MGS: Connection restored to ad02047b-d66c-8812-2b98-c3f30ebbb89b (at 0@lo)
[  116.528469] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[2018-12-14T06:21:11+00:00] INFO: service[kdump] restarted
[2018-12-14T06:21:11+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-14T06:21:11+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-14T06:21:11+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-14T06:21:11+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-14T06:21:11+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-14T06:21:11+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-14T06:21:11+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-14T06:21:11+00:00] INFO: Chef Run complete in 67.491618112 seconds
[2018-12-14T06:21:11+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-14T06:21:11+00:00] INFO: Running report handlers
[2018-12-14T06:21:11+00:00] INFO: Creating JSON run report
[2018-12-14T06:21:12+00:00] INFO: Report handlers complete
[  124.901208] Lustre: MGS: Connection restored to c330be6f-8a05-bb15-2aed-89895c05578a (at 192.168.1.117@o2ib)
[  126.058623] Lustre: MGS: Connection restored to 673a19c6-f837-0512-126c-a5e9f3f036b0 (at 192.168.1.130@o2ib)
[  126.069627] Lustre: Skipped 2 previous similar messages
[  128.100848] Lustre: MGS: Connection restored to b686608b-3da0-f6b8-e69b-4a833f1555c6 (at 192.168.1.126@o2ib)
[  128.111854] Lustre: Skipped 3 previous similar messages
[  131.582897] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 28 clients reconnect
[  132.172810] Lustre: MGS: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib)
[  132.182066] Lustre: Skipped 2 previous similar messages
[  141.619941] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[  141.628907] Lustre: Skipped 19 previous similar messages
[  175.028406] Lustre: soaked-MDT0000: Connection restored to b1a10261-dfdd-cb5c-a7c6-b0b4ee43ecc1 (at 192.168.1.118@o2ib)
[  175.040465] Lustre: Skipped 11 previous similar messages
[  186.710324] Lustre: soaked-MDT0000: Recovery over after 0:55, of 28 clients 28 recovered and 0 were evicted.
[ 1035.681063] LustreError: 22586:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x20000a04f:0x1a752:0x0]
[ 1159.533225] LustreError: 22586:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x20000a04f:0x1fb9a:0x0]
[ 1217.788295] LustreError: 23091:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x20000bf84:0x26ba:0x0]
[ 1483.596205] LustreError: 24017:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x20000bf84:0xa8f3:0x0]
l Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
                                                                        [02;00H                                                                                [03;00HMPT2BIOS-7.29.00.00 (2012.11.12)                                                [04;00HCopyright 2000-2012 LSI Corporation.                                            [05;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [11;00H                                                                                [12;00H                                                                                [13;00H                                                                                [14;00H                                                                                [15;00H                                                                                [16;00H                                                                                [17;00H                                                                                [18;00H                                                                                [19;00H                                                                                [20;00H                                                                                [21;00H                                                                                [22;00H                                                                                [23;00H                                                                                [24;00H                                                                               [24;00H[06;01H[02;00HLSI Corporation MPT SAS2 BIOS                                                   [06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;01H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing../                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..-                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..\                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;00HInitializing..|                                                                 [06;16H[06;16H[06;16H[06;16H[06;16H[06;16H[06;01H[06;00H                                                                                [07;00HPress Ctrl-C to start LSI Corp Configuration Utility...                         [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HSearching for devices at HBA 0...                                               [07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;01H[07;00HPCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    [08;00HSLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    [09;00H---- ---- --- -------- ---------------- ----------- ----------                  [10;00H  3           LSI      SAS2308-IT       20.00.07.00  14:01:00:06                [11;00H  3    7   0  LSI      INF-01-00        0820         3.252 TiB                  [12;00H  3    3   0  LSI      INF-01-00        0820         3.252 TiB                  [13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[13;01H[14;00HLSI Corporation MPT2 boot ROM successfully installed!                           [00;01H[02;00H                                                                                [03;00H[0m[2m  RAID Volumes:[0m[2m                                                                 [04;00H  None defined.                                                                 [06;00H[0m[2m  Physical Devices:[0m[2m                                                              [07;00H[0m[2m  ID   Device Model     Serial #                     Size Type/Status(Vol ID)[0m[2m   [08;00H  0    ST500NM0011      Z1M0X1LS                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [09;00H  1    ST500NM0011      Z1M0X1MX                  465.7GB [0m[1mNon-RAID Disk[0m[2m         [10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility..[0m[2m                                 [11;00H                                                                                [12;00H                                                                                [14;00H                                                                                [10;48H[01;00HCopyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   [10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;48H[10;00H[0m[2mPress [0m[1m<CTRL-I>[0m[2m to enter Configuration Utility...[0m[2m                                [10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[10;49H[01;00H                                                                                [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;00HPress Ctrl+S to enter the Setup Menu.                                           [04;00H                                                                                [06;00H                                                                                [07;00H                                                                                [08;00H                                                                                [09;00H                                                                                [10;00H                                                                                [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [02;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [02;00HPXE 2.1 Build 091 (WfM 2.0)                                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[01;00H                                                                                [03;00HPress Ctrl+S to enter the Setup Menu.                                           [03;38H[01;00HInitializing Intel(R) Boot Agent GE v1.4.04                                     [03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;38H[03;00HPress Ctrl+S to enter the Setup Menu..                                          [03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[03;39H[3;1H[3;1HBios Version: SE5C600.86B.01.08.0003.022620131521                               [4;1H[4;1HBMC Firmware Version: 1.17.4207                                                 [5;1H[5;1HSDR Version: SDR Package 1.09                                                   [6;1H[6;1HME Firmware Version: 2.1.7.112                                                  [7;1H[7;1HPlatform ID: S2600GZ                                                            [8;1H[8;1HSystem memory detected: 32768 MB                                                [9;1H[9;1HCurrent memory speed: 1333 MT/s                                                 [10;1H[10;1HIntel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        [11;1H[11;1HNumber of physical processors identified: 2                                     [12;1H[12;1H********************************************************************************[13;1H[13;1HAHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          [14;1H[14;1HSAS/SATA Capable Controller configured with 4 ports in SATA mode                [15;1H[15;1H********************************************************************************[16;1H[16;1HUSB Keyboard detected                                                           [17;1H[17;1HUSB Mouse detected                                                              [18;1H[18;1H                                                                                [19;1H[19;1HPress <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                   [17;1H[17;1H                  [2J[1;1H[2J[1;1H[H[J[1;1H[?25l[m[H[J[1;1H[20;7H[mUse the ^ and v keys to change the selection.                       
      Press 'e' to edit the selected item, or 'c' for a command prompt.   [4;80H [m[4;1H      CentOS Linux (3.10.0-957.1.3.el7.x86_64) 7 (Core)                        [m[4;79H[m[7m[5;1H      CentOS Linux (3.10.0-957.el7_lustre.x86_64) 7 (Core)                     [m[5;79H[m[m[6;1H      CentOS Linux (0-rescue-be1f6da1219043d0bb700d4b5365bef1) 7 (Core)        [m[6;79H[m[m[7;1H                                                                               [m[7;79H[m[m[8;1H                                                                               [m[8;79H[m[m[9;1H                                                                               [m[9;79H[m[m[10;1H                                                                               [m[10;79H[m[m[11;1H                                                                               [m[11;79H[m[m[12;1H                                                                               [m[12;79H[m[m[13;1H                                                                               [m[13;79H[m[m[14;1H                                                                               [m[14;79H[m[m[15;1H                                                                               [m[15;79H[m[m[16;1H                                                                               [m[16;79H[m[m[17;1H                                                                               [m[17;79H[m[m[18;1H                                                                               [m[18;79H[m[18;80H [5;79H[22;1H   The selected entry will be started automatically in 5s.                     [5;79H[22;1H   The selected entry will be started automatically in 4s.                     [5;79H[22;1H   The selected entry will be started automatically in 3s.                     [5;79H[22;1H   The selected entry will be started automatically in 2s.                     [5;79H[22;1H   The selected entry will be started automatically in 1s.                     [5;79H[22;1H   The selected entry will be started automatically in 0s.                     [5;79H[?25h[H[J[1;1H[H[J[1;1H[    0.000000] microcode: microcode updated early to revision 0x714, date = 2018-05-08
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-309-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Sat Dec 8 05:53:16 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x35bfe000-0x36df6fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x83ffd8000-0x83fffefff]
[    0.000000] Reserving 162MB of memory at 688MB for crashkernel (System RAM: 32691MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x83fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x00100000-0xbb3c6fff]
[    0.000000]   node   0: [mem 0xbdfac000-0xbdffffff]
[    0.000000]   node   0: [mem 0x100000000-0x43fffffff]
[    0.000000]   node   1: [mem 0x440000000-0x83fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff]
[    0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff]
[    0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff]
[    0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff9fcb2e000000 s118784 r8192 d28672 u262144
[    0.000000] Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8238275
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 root=UUID=d96e5058-1804-4e26-b981-0e374bf4b059 ro crashkernel=auto console=ttyS0,115200
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 7011916k/34603008k available (7664k kernel code, 1126748k absent, 830688k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[    0.000000] NR_IRQS:327936 nr_irqs:3160 0
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 134217728 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.375 MHz processor
[    0.000180] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.75 BogoMIPS (lpj=2693375)
[    0.012179] pid_max: default: 245760 minimum: 1920
[    0.018412] Security Framework initialized
[    0.023015] SELinux:  Initializing.
[    0.027205] Yama: becoming mindful.
[    0.036451] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.058241] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.072261] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.080030] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.090349] Initializing cgroup subsys memory
[    0.095288] Initializing cgroup subsys devices
[    0.100262] Initializing cgroup subsys freezer
[    0.105230] Initializing cgroup subsys net_cls
[    0.110203] Initializing cgroup subsys blkio
[    0.114977] Initializing cgroup subsys perf_event
[    0.120281] Initializing cgroup subsys hugetlb
[    0.125262] Initializing cgroup subsys pids
[    0.129946] Initializing cgroup subsys net_prio
[    0.135361] mce: CPU supports 20 MCE banks
[    0.139976] CPU0: Thermal monitoring enabled (TM1)
[    0.145425] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.151556] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.157893] tlb_flushall_shift: 6
[    0.161679] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.172441] FEATURE SPEC_CTRL Present
[    0.176549] FEATURE IBPB_SUPPORT Present
[    0.181241] Spectre V2 : Mitigation: Full retpoline
[    0.187900] Freeing SMP alternatives: 28k freed
[    0.199560] ACPI: Core revision 20130517
[    0.294930] ACPI: All ACPI Tables successfully acquired
[    0.323458] ftrace: allocating 29187 entries in 115 pages
[    0.385043] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.392445] Switched APIC routing to physical flat.
[    0.398625] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.415356] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.425874] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.437709] ... version:                3
[    0.442187] ... bit width:              48
[    0.446766] ... generic registers:      4
[    0.451243] ... value mask:             0000ffffffffffff
[    0.457178] ... max period:             00007fffffffffff
[    0.463116] ... fixed-purpose events:   3
[    0.467594] ... event mask:             000000070000000f
[    0.482095] smpboot: Booting Node   0, Processors  #1[    0.503738] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
 #2 #3 #4 #5 #6 #7 OK
[    0.558713] smpboot: Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 OK
[    0.698705] smpboot: Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 OK
[    0.740654] smpboot: Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
[    0.781256] Brought up 32 CPUs
[    0.784894] smpboot: Max logical packages: 15
[    0.789784] smpboot: Total of 32 processors activated (172569.44 BogoMIPS)
[    1.047287] node 0 initialised, 2813371 pages in 136ms
[    1.085322] node 1 initialised, 3595039 pages in 169ms
[    1.092303] devtmpfs: initialized
[    1.107943] EVM: security.selinux
[    1.111647] EVM: security.ima
[    1.114969] EVM: security.capability
[    1.119252] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    1.128129] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    1.140551] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    1.148239] pinctrl core: initialized pinctrl subsystem
[    1.154377] RTC time:  6:47:07, date: 12/14/18
[    1.159850] NET: Registered protocol family 16
[    1.165335] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.173793] ACPI: bus type PCI registered
[    1.178281] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.186113] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    1.196511] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    1.204128] PCI: Using configuration type 1 for base access
[    1.210397] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.231037] ACPI: Added _OSI(Module Device)
[    1.235714] ACPI: Added _OSI(Processor Device)
[    1.240679] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.245934] ACPI: Added _OSI(Processor Aggregator Device)
[    1.251964] ACPI: Added _OSI(Linux-Dell-Video)
[    1.296562] ACPI: Executed 1 blocks of module-level executable AML code
[    1.585447] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.618568] ACPI: Interpreter enabled
[    1.622694] ACPI: (supports S0 S1 S5)
[    1.626787] ACPI: Using IOAPIC for interrupt routing
[    1.632457] HEST: Table parsing has been initialized.
[    1.638104] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.648390] ACPI: GPE 0x1E active on init
[    1.652907] ACPI: GPE 0x24 active on init
[    1.657406] ACPI: Enabled 9 GPEs in block 00 to 3F
[    1.723152] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    1.730066] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.739724] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    1.748216] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.756769] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.766200] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    1.777864] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    1.792725] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    1.807964] PCI host bridge to bus 0000:00
[    1.812545] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    1.819450] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.827808] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    1.836167] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.844526] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    1.852885] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    1.861241] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    1.869599] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    1.877957] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    1.886316] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    1.894674] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    1.903033] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    1.911391] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    1.919751] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    1.928112] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    1.937247] pci_bus 0000:00: root bus resource [bus 00-7e]
[    1.943918] pci 0000:00:01.0: System wakeup disabled by ACPI
[    1.950546] pci 0000:00:01.1: System wakeup disabled by ACPI
[    1.957174] pci 0000:00:02.0: System wakeup disabled by ACPI
[    1.963792] pci 0000:00:02.2: System wakeup disabled by ACPI
[    1.970417] pci 0000:00:03.0: System wakeup disabled by ACPI
[    1.980640] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    1.987299] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    1.993906] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    2.000566] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    2.007133] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    2.014412] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.020135] acpiphp: Slot [2] registered
[    2.024806] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    2.035138] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    2.045808] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    2.056144] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    2.066811] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    2.077144] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    2.087811] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    2.098140] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    2.111472] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.117543] acpiphp: Slot [2-2] registered
[    2.124617] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.130363] acpiphp: Slot [2-3] registered
[    2.134981] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.140704] acpiphp: Slot [2-4] registered
[    2.145624] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.151534] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    2.164324] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.169998] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.175979] pci 0000:09:00.0: System wakeup disabled by ACPI
[    2.182391] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.188065] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    2.197068] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.204981] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.212899] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.220802] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.228705] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
[    2.236606] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
[    2.244503] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.252395] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    2.260500] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.267411] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.276822] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    2.285143] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.293697] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.303259] PCI host bridge to bus 0000:80
[    2.307840] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    2.315428] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    2.323013] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.331371] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    2.339730] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    2.348864] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.355221] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.361825] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.368416] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.375015] pci 0000:80:03.2: System wakeup disabled by ACPI
[    2.383844] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.389486] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.395130] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.400754] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.417309] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    2.423930] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.433122] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.442798] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    2.449801] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.459059] PCI host bridge to bus 0000:7f
[    2.463638] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.474274] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    2.480893] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.490074] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    2.499745] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    2.506748] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.516017] PCI host bridge to bus 0000:ff
[    2.520597] pci_bus 0000:ff: root bus resource [bus ff]
[    2.531808] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.540870] vgaarb: loaded
[    2.543894] vgaarb: bridge control possible 0000:09:00.0
[    2.550267] SCSI subsystem initialized
[    2.554513] ACPI: bus type USB registered
[    2.559030] usbcore: registered new interface driver usbfs
[    2.565180] usbcore: registered new interface driver hub
[    2.571392] usbcore: registered new device driver usb
[    2.577584] EDAC MC: Ver: 3.0.0
[    2.581643] PCI: Using ACPI for IRQ routing
[    2.593951] NetLabel: Initializing
[    2.597754] NetLabel:  domain hash size = 128
[    2.602619] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.608208] NetLabel:  unlabeled traffic allowed by default
[    2.614784] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.621817] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.630397] amd_nb: Cannot enumerate AMD northbridges
[    2.636244] Switched to clocksource hpet
[    2.655312] pnp: PnP ACPI init
[    2.658765] ACPI: bus type PNP registered
[    2.663539] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.670161] system 00:00: [io  0xffff] has been reserved
[    2.676103] system 00:00: [io  0xffff] has been reserved
[    2.682046] system 00:00: [io  0xffff] has been reserved
[    2.687992] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.695004] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.701625] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.708250] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.714867] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.721870] system 00:00: [io  0x0cf9] could not be reserved
[    2.728426] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.736603] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.744000] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.751409] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.758807] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.766214] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.773613] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.781393] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.789178] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.796959] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.804857] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.813161] pnp: PnP ACPI: found 7 devices
[    2.817745] ACPI: bus type PNP unregistered
[    2.831823] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.837404] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.843247] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.850063] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.857656] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.863216] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.870811] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.880251] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.885825] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.891374] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.898202] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.905795] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.911350] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    2.918176] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    2.925771] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    2.935224] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.940793] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.946351] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    2.953948] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    2.962611] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    2.968404] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.973973] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.979532] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.985093] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.991027] NET: Registered protocol family 2
[    2.998067] TCP established hash table entries: 262144 (order: 9, 2097152 bytes)
[    3.007255] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.014998] TCP: Hash tables configured (established 262144 bind 65536)
[    3.022480] TCP: reno registered
[    3.026267] UDP hash table entries: 16384 (order: 7, 524288 bytes)
[    3.033432] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes)
[    3.042140] NET: Registered protocol family 1
[    4.147292] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.255344] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
[    5.263860] Un packing initram[    5.827023] Freeing initrd memory: 18404k freed
[    5.839129] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.846349] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff9fc7b73c7000-ffff9fc7bb3c6fff]
[    5.857863] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    5.866708] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    5.873134] RAPL PMU: hw unit of domain package 2^-16 Joules
[    5.879465] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    5.898767] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    5.905591] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    5.919580] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[    5.927830] Initialise system trusted keyring
[    5.932843] audit: initializing netlink socket (disabled)
[    5.938931] type=2000 audit(1544770028.457:1): initialized
[    6.000821] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    6.007934] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    6.018194] zpool: loaded
[    6.021144] zbud: loaded
[    6.025172] VFS: Disk quotas dquot_6.6.0
[    6.030056] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.038763] msgmni has been set to 32768
[    6.043533] Key type big_key registered
[    6.050471] NET: Registered protocol family 38
[    6.055454] Key type asymmetric registered
[    6.060044] Asymmetric key parser 'x509' registered
[    6.065661] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    6.074202] io scheduler noop registered
[    6.078597] io scheduler deadline registered (default)
[    6.084496] io scheduler cfq registered
[    6.088795] io scheduler mq-deadline registered
[    6.093863] io scheduler kyber registered
[    6.104248] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    6.112070] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    6.119857] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    6.127157] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    6.134456] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    6.141758] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    6.149098] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    6.156875] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    6.164208] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    6.172026] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    6.179812] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    6.187149] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    6.194935] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    6.202234] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    6.209577] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    6.217406] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    6.225194] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    6.232538] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    6.240362] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    6.248187] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    6.256006] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    6.263905] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    6.270153] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    6.277606] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    6.285921] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    6.294203] ACPI: Power Button [PWRF]
[    6.298395] ACPI: Requesting acpi_cpufreq
[    6.387237] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.395664] pstore: Registered erst as persistent store backend
[    6.402636] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.411122] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.439018] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    6.466163] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    6.473476] Non-volatile memory driver v1.3
[    6.478219] Linux agpgart interface v0.103
[    6.483226] crash memory driver: version 1.1
[    6.488506] rdac: device handler registered
[    6.493261] hp_sw: device handler registered
[    6.498057] emc: device handler registered
[    6.502920] alua: device handler registered
[    6.507705] libphy: Fixed MDIO Bus: probed
[    6.512404] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    6.519724] ehci-pci: EHCI PCI platform driver
[    6.525162] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    6.531149] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    6.539455] ehci-pci 0000:00:1a.0: debug port 2
[    6.548492] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    6.560421] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    6.566947] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    6.574534] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.582605] usb usb1: Product: EHCI Host Controller
[    6.588067] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.596239] usb usb1: SerialNumber: 0000:00:1a.0
[    6.601645] hub 1-0:1.0: USB hub found
[    6.605860] hub 1-0:1.0: 2 ports detected
[    6.610938] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    6.616888] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    6.625191] ehci-pci 0000:00:1d.0: debug port 2
[    6.634207] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    6.646412] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    6.652922] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    6.660512] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.668595] usb usb2: Product: EHCI Host Controller
[    6.674053] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    6.682226] usb usb2: SerialNumber: 0000:00:1d.0
[    6.687610] hub 2-0:1.0: USB hub found
[    6.691824] hub 2-0:1.0: 2 ports detected
[    6.696577] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    6.703515] ohci-pci: OHCI PCI platform driver
[    6.708536] uhci_hcd: USB Universal Host Controller Interface driver
[    6.715795] usbcore: registered new interface driver usbserial_generic
[    6.723110] usbserial: USB Serial support registered for generic
[    6.729898] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    6.895453] tsc: Refined TSC clocksource calibration: 2693.509 MHz
[    7.782357] i8042: No controller found
[    7.786610] Switched to clocksource tsc
[    7.786685] mousedev: PS/2 mouse device common for all mice
[    7.786812] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    7.786928] rtc_cmos 00:01: RTC can wake from S4
[    7.787170] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    7.787224] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    7.787355] intel_pstate: Intel P-state driver initializing
[    7.798928] cpuidle: using governor menu
[    7.800465] hidraw: raw HID events driver (C) Jiri Kosina
[    7.800725] usbcore: registered new interface driver usbhid
[    7.800725] usbhid: USB HID core driver
[    7.800945] drop_monitor: Initializing network drop monitor service
[    7.801514] TCP: cubic registered
[    7.801524] Initializing XFRM netlink socket
[    7.802212] NET: Registered protocol family 10
[    7.803865] NET: Registered protocol family 17
[    7.803879] mpls_gso: MPLS GSO support
[    7.805636] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    7.809910] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    7.810150] Loading compiled-in X.509 certificates
[    7.811265] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    7.812318] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    7.813365] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: d73e894149b8945b8dc07cc18b4508db322683f2'
[    7.813418] registered taskstats version 1
[    7.818006] Key type trusted registered
[    7.822018] Key type encrypted registered
[    7.822149] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.823748]   Magic number: 14:957:771
[    7.823929] pci 0000:00:05.2: hash matches
[    7.823941] acpi LNXCPU:5f: hash matches
[    7.824988] rtc_cmos 00:01: setting system clock to 2018-12-14 06:47:14 UTC (1544770034)
[    7.837498] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    7.911007] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    7.911011] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.911360] hub 1-1:1.0: USB hub found
[    7.911489] hub 1-1:1.0: 6 ports detected
[    7.962704] random: fast init done
[    7.962875] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    7.962879] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.963284] hub 2-1:1.0: USB hub found
[    7.963497] hub 2-1:1.0: 8 ports detected
[    8.043906] Freeing unused kernel memory: 1876k freed
[    8.050294] Write protecting the kernel read-only data: 12288k
[    8.060029] Freeing unused kernel memory: 516k freed
[    8.068676] Freeing unused kernel memory: 600k freed
[    8.087971] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    8.109471] systemd[1]: Detected architecture x86-64.
[    8.115128] systemd[1]: Running in initial RAM disk.

Welcome to [0;34mCentOS Linux 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    8.130708] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    8.208373] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    8.221627] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    8.231633] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target[    8.238500] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
 Tim ers.
[    8.24e Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    8.260744] systemd[1]: Created slice System Slice.
[[32m  OK  [0m] Created slice System Slice.
[    8.271627] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    8.28 1701] systemd[1
[[32m  OK  [0m] Listening on udev Control Socket.
[    8.294704] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    8.306441] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    8.317744] systemd[1]: Starting dracut cmdline hook.. .
         Staine hook...
[    8.329354] systemd[1]: Starting Apply Kernel Variables...
          Startin[     8.341455] slist of required static device nodes for the current kernel...
          Startinodes for the current kernel...[    8.358888] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10

[    8.367629] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.375872] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    8.382008] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    8.388435] usb 2-1.4: SerialNumber: serial
[    8.389098] systemd[1]: Starting Setup Virtual Console...
         Startin[    8.400814] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1
g Setup Virtual Console...
[    8.418669] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[    8.438579] systemd[1]: Reached target Sockets.
[[32m  OK  [0m] Reached target Sockets.
[    8.448908] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
[[32m  OK  [0m] Started dracut cmdline hook.
[[32m  OK  [0m[    8.466964] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
] Started Apply [    8.486454] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
Kernel Variables[    8.501547] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
.
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Setup Virtual Console.
         Starting Create Static Device Nodes in /dev...
         Starting dracut pre-udev hook...
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
[[32m  OK  [0m] Started dracut pre-udev hook.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
         Mounting Configuration File System...
[[32m  OK  [0m] Mounted Configuration File System.
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Show Plymouth Boot Screen...
[[32m  OK  [0m] Reached target System Initialization.
         Starting dracut initqueue hook...
[[32m  OK  [0m] Started Show Plymouth Boot Screen.
[[32m  OK  [0m] Started Forward Password Requests to Plymouth Directory Watch.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Reached target Basic System.
[    8.753645] dca service started, version 1.12.1
[    8.753682] mlx_compat: loading out-of-tree module taints kernel.
[    8.753958] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[    8.781418] pps_core: LinuxPPS API ver. 1 registered
[    8.783820] Compat-mlnx-ofed backport release: b4fdfac
[    8.783820] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac
[    8.783821] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git
[    8.806171] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    8.819315] PTP clock support registered
[    8.846528] mpt2sas version 20.103.01.00 loaded
[    8.847575] mlx4_core: Mellanox ConnectX core driver v4.5-1.0.1
[    8.847609] mlx4_core: Initializing 0000:04:00.0
[    8.857582] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    8.857587] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
[    8.868732] scsi host0: ahci
[    8.869141] scsi host1: ahci
[    8.869359] scsi host2: ahci
[    8.869671] scsi host3: ahci
[    8.871838] scsi host4: ahci
[    8.871989] scsi host5: ahci
[    8.872053] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 38
[    8.872055] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 38
[    8.872058] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 38
[    8.872061] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 38
[    8.872064] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 38
[    8.872066] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 38
[    8.925830] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control
[    8.926169] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32666996 kB)
[    8.950529] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0
[    8.950553] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    8.950553] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.950565] isci 0000:07:00.0: driver configured for rev: 6 silicon
[    8.950575] resource sanity check: requesting [mem 0x000ce000-0x000d7bff], which spans more than PCI Bus 0000:00 [mem 0x000d0000-0x000d3fff window]
[    8.950581] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs
[    8.950588] isci 0000:07:00.0: OEM parameter table found in OROM
[    8.950605] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
[    8.951445] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session.
[    8.951460] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
[    8.953960] scsi host7: isci
[    8.988405] igb 0000:02:00.0: added PHC on eth0
[    8.988407] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.988408] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6b
[    8.988481] igb 0000:02:00.0: eth0: PBA No: 100000-000
[    8.988482] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.989046] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session.
[    8.990521] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
[    8.991017] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 63
[    8.991018] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 64
[    8.991018] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 65
[    8.991019] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 66
[    8.991020] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 67
[    8.991020] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 68
[    8.991021] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 69
[    8.991021] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 70
[    8.991022] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 71
[    8.991022] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 72
[    8.991023] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 73
[    8.991023] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 74
[    8.991024] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 75
[    8.991024] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 76
[    8.991025] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 77
[    8.991025] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 78
[    8.991027] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffbbd083b40000), size(65536)
[    8.991027] mpt2sas_cm0: ioport(0x0000000000002000), size(256)
[    9.025927] igb 0000:02:00.1: added PHC on eth1
[    9.025928] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
[    9.025930] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6c
[    9.026002] igb 0000:02:00.1: eth1: PBA No: 100000-000
[    9.026003] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.063533] mpt2sas_cm0: sending message unit reset !!
[    9.065038] mpt2sas_cm0: message unit reset: SUCCESS
[    9.081447] igb 0000:02:00.2: added PHC on eth2
[    9.081448] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
[    9.081450] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6d
[    9.081525] igb 0000:02:00.2: eth2: PBA No: 100000-000
[    9.081526] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.139793] mpt2sas_cm0: Allocated physical memory: size(18690 kB)
[    9.139793] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[    9.139794] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    9.148734] igb 0000:02:00.3: added PHC on eth3
[    9.148736] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
%G%G[    9.148738] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:24:6e
[    9.148811] igb 0000:02:00.3: eth3: PBA No: 100000-000
[    9.148812] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    9.175546] ata3: SATA link down (SStatus 0 SControl 300)
[    9.176545] ata1: SATA link down (SStatus 0 SControl 300)
[    9.177539] ata4: SATA link down (SStatus 0 SControl 300)
[    9.177565] ata6: SATA link down (SStatus 0 SControl 300)
[    9.181539] ata5: SATA link down (SStatus 0 SControl 300)
[    9.181566] ata2: SATA link down (SStatus 0 SControl 300)
[    9.187903] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
[    9.187905] mpt2sas_cm0: Protocol=(
[    9.187905] Initiator
[    9.187906] ,Target
[    9.187906] ), 
[    9.187906] Capabilities=(
[    9.187907] TLR
[    9.187907] ,EEDP
[    9.187908] ,Snapshot Buffer
[    9.187908] ,Diag Trace Buffer
[    9.187908] ,Task Set Full
[    9.187909] ,NCQ
[    9.187909] )
[    9.187954] scsi host6: Fusion MPT SAS Host
[    9.188230] mpt2sas_cm0: sending port enable !!
[    9.190797] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e9a0), phys(8)
[    9.198524] mpt2sas_cm0: port enable: SUCCESS
[    9.199245] scsi 6:0:0:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.199249] scsi 6:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.199251] scsi 6:0:0:0: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.199254] scsi 6:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.277805] [TTM] Zone  kernel: Available graphics memory: 16333498 kiB
[    9.277806] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    9.277806] [TTM] Initializing pool allocator
[    9.277810] [TTM] Initializing DMA pool allocator
[    9.328888] fbcon: mgadrmfb (fb0) is primary device
[    9.356404] scsi 6:0:0:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.356411] scsi 6:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.356414] scsi 6:0:0:1: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.356418] scsi 6:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.380923] scsi 6:0:0:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.380933] scsi 6:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.380936] scsi 6:0:0:2: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.380953] scsi 6:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.398906] scsi 6:0:0:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.398914] scsi 6:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.398917] scsi 6:0:0:3: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.398922] scsi 6:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.435010] scsi 6:0:0:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.435017] scsi 6:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82000), phy(4), device_name(0x50080e52ffd82000)
[    9.435020] scsi 6:0:0:7: enclosure logical id (0x500605b005d6e9a0), slot(7) 
[    9.435026] scsi 6:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.447689] scsi 6:0:1:0: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.447693] scsi 6:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.447695] scsi 6:0:1:0: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.447698] scsi 6:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.463334] scsi 6:0:1:1: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.463342] scsi 6:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.463346] scsi 6:0:1:1: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.463351] scsi 6:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.476994] scsi 6:0:1:2: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.477002] scsi 6:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.477018] scsi 6:0:1:2: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.477023] scsi 6:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.489972] scsi 6:0:1:3: Direct-Access     LSI      INF-01-00        0820 PQ: 0 ANSI: 5
[    9.489992] scsi 6:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.489995] scsi 6:0:1:3: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.490000] scsi 6:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.501972] scsi 6:0:1:7: Direct-Access     LSI      Universal Xport  0820 PQ: 0 ANSI: 5
[    9.501978] scsi 6:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0004), phy(0), device_name(0x50080e52ff4f0004)
[    9.501981] scsi 6:0:1:7: enclosure logical id (0x500605b005d6e9a0), slot(3) 
[    9.501986] scsi 6:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
[    9.561715] Console: switching to colour frame buffer device 128x48
[    9.614584] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    9.665613] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[   10.629552] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   10.635788] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   10.644196] ata7.00: configured for UDMA/133
[   10.660127] scsi 7:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   15.379941] mlx4_core 0000:04:00.0: Old device ETS support detected
[   15.386937] mlx4_core 0000:04:00.0: Consider upgrading device FW.
[   15.393744] mlx4_core 0000:04:00.0: DMFS high rate mode not supported
[   15.400942] mlx4_core: device is working in RoCE mode: Roce V1
[   15.407458] mlx4_core: UD QP Gid type is: V1
[   16.467147] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[   16.879929] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133
[   16.886163] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[   16.894755] ata8.00: configured for UDMA/133
[   16.910802] scsi 7:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
[   16.941713] scsi 6:0:0:0: rdac: LUN 0 (RDAC) (owned)
[   16.948017] scsi 6:0:0:1: rdac: LUN 1 (RDAC) (unowned)
[   16.954656] scsi 6:0:0:2: rdac: LUN 2 (RDAC) (owned)
[   16.960987] scsi 6:0:0:3: rdac: LUN 3 (RDAC) (unowned)
[   16.967719] scsi 6:0:1:0: rdac: LUN 0 (RDAC) (unowned)
[   16.974069] sd 7:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   16.974108] scsi 6:0:1:1: rdac: LUN 1 (RDAC) (owned)
[   16.974120] sd 7:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[   16.974229] sd 7:0:1:0: [sdb] Write Protect is off
[   16.974260] sd 7:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   16.974392] sd 6:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.974405] sd 6:0:1:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.974552] sd 6:0:0:1: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.974789] sd 6:0:0:2: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.974934] sd 6:0:0:3: [sdg] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.975119] sd 6:0:1:0: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.975149] sd 6:0:0:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   16.975230] sd 6:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.975284] sd 6:0:1:2: rdac: LUN 2 (RDAC) (unowned)
[   16.975365] sd 6:0:1:1: [sdd] Write Protect is off
[   16.975643] sd 6:0:0:0: [sdc] Write Protect is off
[   16.975833] sd 6:0:1:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.976013] sd 6:0:0:1: [sde] Write Protect is off
[   16.976317] sd 6:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.976488] sd 6:0:0:2: [sdf] Write Protect is off
[   16.976714] sd 6:0:0:3: [sdg] Write Protect is off
[   16.976731] sd 6:0:1:0: [sdi] Write Protect is off
[   16.976756] scsi 6:0:1:3: rdac: LUN 3 (RDAC) (owned)
[   16.976827] sd 6:0:1:2: [sdj] Write Protect is off
[   16.976974] sd 6:0:0:1: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.977081] sd 6:0:0:7: [sdh] Write Protect is off
[   16.977332] sd 6:0:1:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.977335] sd 6:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB)
[   16.977422] sd 6:0:0:2: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.977606] sd 6:0:0:3: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.977969] sd 6:0:0:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   16.977981] sd 6:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.978227] sd 6:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
[   16.978777] sd 6:0:1:3: [sdk] Write Protect is off
[   16.979252] sd 6:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   16.980080] sd 6:0:1:7: [sdl] Write Protect is off
[   16.980732] sd 6:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA
[   16.981044] Dev sde: unable to read RDB block 0
[   16.981056]  sde: unable to read partition table
[   16.981286] Dev sdi: unable to read RDB block 0
[   16.981305]  sdi: unable to read partition table
[   16.982621] Dev sdg: unable to read RDB block 0
[   16.982632]  sdg: unable to read partition table
[   16.982833]  sdb:
[   16.982906] Dev sdj: unable to read RDB block 0
[   16.982922]  sdj: unable to read partition table
[   16.983075] sd 7:0:1:0: [sdb] Attached SCSI disk
[   16.983510] sd 6:0:1:1: [sdd] Attached SCSI disk
[   16.984014] sd 6:0:0:0: [sdc] Attached SCSI disk
[   16.984214] sd 6:0:0:1: [sde] Attached SCSI disk
[   16.984524] sd 6:0:1:0: [sdi] Attached SCSI disk
[   16.984646] sd 6:0:0:2: [sdf] Attached SCSI disk
[   16.985147] sd 6:0:0:3: [sdg] Attached SCSI disk
[   16.985632] sd 6:0:1:2: [sdj] Attached SCSI disk
[   16.986045] sd 6:0:1:3: [sdk] Attached SCSI disk
[   17.064653] random: crng init done
[   17.199010]  sdh:
[   17.200219] sd 6:0:0:7: [sdh] Attached SCSI disk
[   17.358600] sd 7:0:0:0: [sda] Write Protect is off
[   17.363993] sd 7:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   17.365239]  sdl:
[   17.366457] sd 6:0:1:7: [sdl] Attached SCSI disk
[   17.398140]  sda: sda1 sda2
[   17.401706] sd 7:0:0:0: [sda] Attached SCSI disk
[[32m  OK  [0m] Found device ST500NM0011 1.
         Starting File System Check on /dev/...8-1804-4e26-b981-0e374bf4b059...
[[32m  OK  [0m] Started File System Check on /dev/d...058-1804-4e26-b981-0e374bf4b059.
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Reached target Remote File Systems.
         Mounting /sysroot...
[   19.185601] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[[32m  OK  [0m] Mounted /sysroot.
[[32m  OK  [0m] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[[32m  OK  [0m] Started Reload Configuration from the Real Root.
[[32m  OK  [0m] Reached target Initrd File Systems.
[[32m  OK  [0m] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[[32m  OK  [0m] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
         Starting Plymouth switch root service...
[[32m  OK  [0m] Stopped target Timers.
[[32m  OK  [0m] Stopped Cleaning Up and Shutting Down Daemons.
[[32m  OK  [0m] Stopped dracut pre-pivot and cleanup hook.
[[32m  OK  [0m] Stopped target Remote File Systems.
[[32m  OK  [0m] Stopped target Remote File Systems (Pre).
[[32m  OK  [0m] Stopped dracut initqueue hook.
[[32m  OK  [0m] Stopped target Initrd Default Target.
[[32m  OK  [0m] Stopped target Basic System.
[[32m  OK  [0m] Stopped target Sockets.
[[32m  OK  [0m] Stopped target Slices.
[[32m  OK  [0m] Stopped target System Initialization.
[[32m  OK  [0m] Stopped target Local File Systems.
[[32m  OK  [0m] Stopped target Swap.
[[32m  OK  [0m] Stopped Apply Kernel Variables.
         Stopping udev Kernel Device Manager...
[[32m  OK  [0m] Stopped udev Coldplug all Devices.
[[32m  OK  [0m] Stopped target Paths.
[[32m  OK  [0m] Stopped udev Kern[   19.575857] systemd-journald[279]: Received SIGTERM from PID 1 (systemd).
el Device Manager.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[[32m  OK  [0m] Stopped Create Static Device Nodes in /dev.
[[32m  OK  [0m] Stopped Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Closed udev Kernel Socket.
[[32m  OK  [0m] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[[32m  OK  [0m] Started Cleanup udevd DB.
[[32m  OK  [0m] Reached target Switch Root.
[[32m  OK  [0m] Started Plymouth switch root service.
         Starting Switch Root...
[   19.911283] SELinux:  Disabled at runtime.
[   19.957100] type=1404 audit(1544770046.631:2): selinux=0 auid=4294967295 ses=4294967295
[   20.193653] ip_tables: (C) 2000-2006 Netfilter Core Team
[   20.200691] systemd[1]: Inserted module 'ip_tables'

Welcome to [0;31mCentOS Linux 7 (Core)[0m!

[[32m  OK  [0m] Stopped Switch Root.
[[32m  OK  [0m] Stopped Journal Service.
         Starting Journal Service...
         Starting Read and set NIS domainname from /etc/sysconfig/network...
         Starting Availability of block devices...
         Mounting Huge Pages File System...
         Mounting Debug File System...
[[32m  OK  [0m] Listening on LVM2 metadata daemon socket.
         Starting Replay Read-Ahead Data...
         Mounting POSIX Message Queue File System...
[[32m  OK  [0m] Reached target Local Encrypted Volumes.
[[32m  OK  [0m] Created slice system-getty.slice.
[[32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[[32m  OK  [0m] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[[32m  OK  [0m] Created slice User and Session Slice.
[[32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[[32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[[32m  OK  [0m] Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on Delayed Shutdown Socket.
[[32m  OK  [0m] Reached target Slices.
[[32m  OK  [0m] Listening on udev Control Socket.
[[32m  OK  [0m] Listening on LVM2 poll daemon socket.
[[32m  OK  [0m] Reached target Paths.
[[32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[[32m  OK  [0m] Stopped target Switch Root.
[[32m  OK  [0m] Stopped target Initrd File Systems.
[[32m  OK  [0m] Listening on D[   21.120449] RPC: Registered named UNIX socket transport module.
evice-mapper eve[   21.128496] RPC: Registered udp transport module.
nt daemon FIFOs.[   21.135289] RPC: Registered tcp transport module.

[[32m  OK  [   21.142096] RPC: Registered tcp NFSv4.1 backchannel transport module.
[0m] Reached target Host and Network Name Lookups.
[[32m  OK  [0m] Stopped target Initrd Root File System.
[[32m  OK  [0m] Reached target RPC Port Mapper.
         Starting Create list of required st... nodes for the current kernel...
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
         Starting Kernel Module supporting RPCSEC_GSS...
[[32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[[32m  OK  [0m] Started Availability of block devices.
[[32m  OK  [0m] Started Replay Read-Ahead Data.
         Starting Remount Root and Kernel File Systems...
         Starting Create Static Device Nodes in /dev...
         Starting Apply Kernel Variables...
[[32m  OK  [0m] Started Apply Kernel Variables.
[[32m  OK  [0m] Started Kernel Module supporting RPCSEC_GSS.
[[32m  OK  [0m] Mounted POSIX Message Queue File System.
[[32m  OK  [0m] Mounted Debug File System.
[[32m  OK  [0m] Mounted Huge Pages File System.
[   21.395672] EXT4-fs (sda1): re-mounted. Opts: (null)
[[32m  OK  [0m] Started Remount Root and Kernel File Systems.
         Starting udev Coldplug all Devices...
         Starting Configure read-only root support...
[[32m  OK  [0m] Started LVM2 metadata daemon.
[[32m  OK  [0m] Started Journal Service.
         Starting Flush Journal to Persistent Storage...
[[32m  OK  [0m] Started Read and set NIS domainname from /etc/sysconfig/network.
[[32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[   21.592176] systemd-journald[4539]: Received request to flush runtime journal from PID 1
[[32m  OK  [0m] Started udev Coldplug all Devices.
         Starting Device-Mapper Multipath Device Controller...
[   21.658419] sd 6:0:0:7: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.667076] sd 6:0:0:7: [sdh] Sense Key : Illegal Request [current] 
[   21.674189] sd 6:0:0:7: [sdh] Add. Sense: Logical block address out of range
[   21.682063] sd 6:0:0:7: [sdh] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.689654] blk_update_request: critical target error, dev sdh, sector 0
[   21.690701] sd 6:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   21.690704] sd 6:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   21.690707] sd 6:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   21.690710] sd 6:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   21.690712] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started Configure read-only root support.
[[32m  OK  [0m] Started Flush Journal to Persistent Storage.
         Starting Load/Save Random Seed...
[   21.751889] device-mapper: uevent: version 1.0.3
[   21.758278] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[[32m  OK  [0m] Started udev Kernel Device Manager.
[[32m  OK  [0m] Started Load/Save Random Seed.
[[32m  OK  [0m] Started Device-Mapper Multipath Device Controller.
[   21.941002] ipmi message handler version 39.2
[   21.948239] ipmi device interface
[   21.962148] IPMI System Interface driver.
[   21.966651] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS
[   21.973368] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   21.980048] ipmi_si: Adding SMBIOS-specified kcs state machine
[   21.986611] ipmi_platform: probing via SPMI
[   21.991294] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[   21.997721] (NULL device *): SPMI-specified kcs state machine: duplicate
[   22.005301] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   22.017624] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   22.025435] igb 0000:02:00.0: DCA enabled
[   22.030129] igb 0000:02:00.1: DCA enabled
[   22.035991] igb 0000:02:00.2: DCA enabled
[   22.040716] igb 0000:02:00.3: DCA enabled
[   22.047729] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.059789] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00)
[   22.078527] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   22.088645] i801_smbus 0000:07:00.3: Enabling SMBus device
[   22.095291] i801_smbus 0000:07:00.3: SMBus using PCI interrupt
[   22.112555] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21)
[[32m  OK  [0m] Found device /dev/ttyS0.
[   22.131371] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   22.168725] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[   22.179709] IPMI SSIF Interface driver
[   22.184288] input: PC Speaker as /devices/platform/pcspkr/input/input3
[   22.224967] cryptd: max_cpu_qlen set to 1000
[   22.243789] AVX version of gcm_enc/dec engaged.
[   22.248884] AES CTR mode by8 optimization enabled
[   22.252190] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   22.252262] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
%G%G[   22.349599] sd 7:0:0:0: Attached scsi generic sg0 type 0
[   22.355629] sd 7:0:1:0: Attached scsi generic sg1 type 0
[   22.361670] sd 6:0:0:0: Attached scsi generic sg2 type 0
[   22.367701] sd 6:0:0:1: Attached scsi generic sg3 type 0
[   22.373747] sd 6:0:0:2: Attached scsi generic sg4 type 0
[   22.379772] sd 6:0:0:3: Attached scsi generic sg5 type 0
[   22.385819] sd 6:0:0:7: Attached scsi generic sg6 type 0
[   22.391850] sd 6:0:1:0: Attached scsi generic sg7 type 0
[   22.397860] sd 6:0:1:1: Attached scsi generic sg8 type 0
[   22.403868] iTCO_vendor_support: vendor-support=0
[   22.403874] sd 6:0:1:2: Attached scsi generic sg9 type 0
[   22.403946] sd 6:0:1:3: Attached scsi generic sg10 type 0
[   22.404226] sd 6:0:1:7: Attached scsi generic sg11 type 0
[   22.442496] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.448805] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.473224] kvm: disabled by bios
[   22.497435] kvm: disabled by bios
[   22.513560] kvm: disabled by bios
[   22.526458] kvm: disabled by bios
[   22.530357] intel_rapl: Found RAPL domain package
[   22.535615] intel_rapl: Found RAPL domain core
[   22.540588] intel_rapl: Found RAPL domain dram
[   22.545614] intel_rapl: Found RAPL domain package
[   22.550903] intel_rapl: Found RAPL domain core
[   22.555883] intel_rapl: Found RAPL domain dram
[   22.747921] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0
[   22.758313] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0
[   22.768511] EDAC sbridge:  Ver: 1.1.2 
[   22.812008] blk_update_request: I/O error, dev sdg, sector 0
[   22.812027] blk_update_request: I/O error, dev sde, sector 0
[   22.812050] blk_update_request: I/O error, dev sdi, sector 0
[   22.812646] blk_update_request: I/O error, dev sdj, sector 0
[   22.890596] blk_update_request: I/O error, dev sdg, sector 0
[   22.890812] blk_update_request: I/O error, dev sdi, sector 0
[   22.893051] blk_update_request: I/O error, dev sde, sector 0
[   22.893985] blk_update_request: I/O error, dev sdj, sector 0
[   22.950976] device-mapper: multipath round-robin: version 1.2.0 loaded
[   22.961391] sd 6:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   23.369804] sd 6:0:1:0: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   23.378524] sd 6:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   24.004293] sd 6:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   24.013012] sd 6:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   24.591099] device-mapper: table: 253:5: multipath: error getting device
[   24.598600] device-mapper: ioctl: error adding target to table
[   24.678091] sd 6:0:0:1: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   24.686810] sd 6:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[   25.029753] sd 6:0:0:7: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   25.038410] sd 6:0:0:7: [sdh] Sense Key : Illegal Request [current] 
[   25.045519] sd 6:0:0:7: [sdh] Add. Sense: Logical block address out of range
[   25.053401] sd 6:0:0:7: [sdh] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   25.061666] sd 6:0:0:7: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   25.070364] sd 6:0:0:7: [sdh] Sense Key : Illegal Request [current] 
[   25.077483] sd 6:0:0:7: [sdh] Add. Sense: Logical block address out of range
[   25.085391] sd 6:0:0:7: [sdh] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   25.093697] sd 6:0:0:7: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   25.102371] sd 6:0:0:7: [sdh] Sense Key : Illegal Request [current] 
[   25.109478] sd 6:0:0:7: [sdh] Add. Sense: Logical block address out of range
[   25.117356] sd 6:0:0:7: [sdh] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[[32m  OK  [0m] Found device ST500NM0011 2.
         Activating swap /dev/disk/by-uuid/5...1-459a-4b67-8a02-f59c8600579d...
[   25.169477] Adding 16253948k swap on /dev/sda2.  Priority:-2 extents:1 across:16253948k FS
[[32m  OK  [0m] Activated swap /dev/disk/by-uuid/5c46ff21-459a-4b67-8a02-f59c8600579d.
[[32m  OK  [0m] Reached target Swap.
[   25.299354] sd 6:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[   25.308069] sd 6:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[   26.050022] sd 6:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[   26.838051] sd 6:0:1:0: [sdi] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   26.846737] sd 6:0:1:0: [sdi] Sense Key : Illegal Request [current] 
[   26.853853] sd 6:0:1:0: [sdi] <<vendor>>ASC=0x94 ASCQ=0x1 
[   26.859987] sd 6:0:1:0: [sdi] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   26.869319] blk_update_request: 19 callbacks suppressed
[   26.875170] blk_update_request: I/O error, dev sdi, sector 0
[   27.387985] sd 6:0:1:2: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.396642] sd 6:0:1:2: [sdj] Sense Key : Illegal Request [current] 
[   27.403760] sd 6:0:1:2: [sdj] <<vendor>>ASC=0x94 ASCQ=0x1 
[   27.409889] sd 6:0:1:2: [sdj] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00
[   27.419217] blk_update_request: I/O error, dev sdj, sector 0
[   27.427134] sd 6:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.435824] sd 6:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.442958] sd 6:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.450856] sd 6:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.458446] blk_update_request: critical target error, dev sdl, sector 0
[   27.466333] sd 6:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.475032] sd 6:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.482137] sd 6:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.490040] sd 6:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.497642] blk_update_request: critical target error, dev sdl, sector 0
[   27.505514] sd 6:0:1:7: [sdl] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[   27.514202] sd 6:0:1:7: [sdl] Sense Key : Illegal Request [current] 
[   27.521320] sd 6:0:1:7: [sdl] Add. Sense: Logical block address out of range
[   27.529197] sd 6:0:1:7: [sdl] CDB: Read(10) 28 00 00 00 00 00 00 01 00 00
[   27.536789] blk_update_request: critical target error, dev sdl, sector 0
[[32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[32m  OK  [0m] Reached target Local File Systems (Pre).
[[32m  OK  [0m] Reached target Local File Systems.
         Starting Import network configuration from initramfs...
         Starting Tell Plymouth To Write Out Runtime Data...
         Starting Preprocess NFS configuration...
[[32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[32m  OK  [0m] Started Preprocess NFS configuration.
[[32m  OK  [0m] Started Import network configuration from initramfs.
         Starting Create Volatile Files and Directories...
[[32m  OK  [0m] Started Create Volatile Files and Directories.
         Starting Security Auditing Service...
         Mounting RPC Pipe File System...
[[32m  OK  [0m] Mounted RPC Pipe File System.
[[32m  OK  [0m] Reached target rpc_pipefs.target.
[   27.704362] type=1305 audit(1544770054.377:3): audit_pid=9369 old=0 auid=4294967295 ses=4294967295 res=1
[[32m  OK  [0m] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[[32m  OK  [0m] Started Update UTMP about System Boot/Shutdown.
[[32m  OK  [0m] Reached target System Initialization.
         Starting openibd - configure Mellanox devices...
[[32m  OK  [0m] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[[32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[32m  OK  [0m] Listening on Remote Shell Facilities Activation Socket.
[[32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[32m  OK  [0m] Reached target Timers.
[[32m  OK  [0m] Listening on Remote Login Facilities Activation Socket.
[[32m  OK  [0m] Reached target Sockets.
[[32m  OK  [0m] Reached target Basic System.
         Starting GSSAPI Proxy Daemon...
         Starting NTP client/server...
         Starting Dump dmesg to /var/log/dmesg...
         Starting Authorization Manager...
         Starting System Security Services Daemon...
         Starting Load CPU microcode update...
[[32m  OK  [0m] Started irqbalance daemon.
[[32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Network Manager...
         Starting Machine Check Exception Logging Daemon...
[[32m  OK  [0m] Started RPC bind service.
[[32m  OK  [0m] Started GSSAPI Proxy Daemon.
[[32m  OK  [0m] Started Dump dmesg to /var/log/dmesg.
         Starting RPC security service for NFS client and server...
[[32m  OK  [0m] Started RPC security service for NFS client and server.
[[32m  OK  [0m] Reached target NFS client services.
[[32m  OK  [0m] Started Machine Check Exception Logging Daemon.
[[32m  OK  [0m] Started Load CPU microcode update.
[[32m  OK  [0m] Started Authorization Manager.
[[32m  OK  [0m] Started NTP client/server.
[[32m  OK  [0m] Started Network Manager.
         Starting Network Manager Wait Online...
         Starting Hostname Service...
[[32m  OK  [0m] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[[32m  OK  [0m] Started Network Manager Script Dispatcher Service.
[[32m  OK  [0m] Started System Security Services Daemon.
[[32m  OK  [0m] Reached target User and Group Name Lookups.
         Starting Login Service...
[[32m  OK  [0m] Started Login Service.
[   28.451919] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   28.540142] igb 0000:02:00.0 ens2f0: igb: ens2f0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   28.540931] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready
[   28.547135] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   28.629233] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready
[   28.636020] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready
[   28.649263] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   28.661463] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.5-1.0.1
[   28.671486] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   28.679076] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   28.768811] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready
[   28.779008] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   28.896019] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.5-1.0.1
[   28.897293] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready
[   29.441605] card: mlx4_0, QP: 0x220, inline size: 120
[   29.457599] card: mlx4_0, QP: 0x300, inline size: 120
[[32m  OK  [0m] Created slice system-mlnx_interface_mgr.slice.
[[32m  OK  [   29.470188] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[0m] Started mlnx_interface_mgr - configure ib0.
[[32m  OK  [0m] Started mlnx_interface_mgr - configure ib1.
[   29.492111] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   29.500794] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   29.519193] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready
[   29.547914] ib0: enabling connected mode will cause multicast packet drops
[   29.555717] ib0: mtu > 4092 will cause multicast packet drops.
[   29.577431] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[32m  OK  [0m] Started openibd - configure Mellanox devices.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
[[32m  OK  [0m] Started Network Manager Wait Online.
         Starting LSB: Bring up/down networking...
[   36.495763] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   36.541489] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[   36.550915] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready
[[1;31mFAILED[0m] Failed to start LSB: Bring up/down networking.
See 'systemctl status network.service' for details.
[[32m  OK  [0m] Reached target Network.
         Starting OpenSSH server daemon...
         Starting Dynamic System Tuning Daemon...
         Starting MUNGE authentication service...
         Starting Postfix Mail Transport Agent...
         Starting Xinetd A Powerful Replacement For Inetd...
[[32m  OK  [0m] Reached target [   36.733637] FS-Cache: Loaded
Network is Online.
         Starting NFS status monitor for NFSv2/3 locking....
         Starting System Logging Service...
         Mounting /scratch...
         Starting Notify NFS peers of a restart...
[[32m  OK  [0m] Started OpenSSH server daemon.
[[32m  OK  [0m] Started System Logging Service.
[[32m  OK  [0m] Started MUNGE authentication service.
[[32m  OK  [0m] Started Xinetd A Powerful Replacement For Inetd.
[[32m  OK  [0m] Started Notify NFS peers of a restart.
[[32m  OK  [0m] Started NFS status monitor for NFSv2/3 locking..
[   36.794891] FS-Cache: Netfs 'nfs' registered for caching
[   36.813033] Key type dns_resolver registered
[   36.848136] NFS: Registering the id_resolver key type
[   36.853787] Key type id_resolver registered
[   36.858464] Key type id_legacy registered
[[32m  OK  [0m] Started Postfix Mail Transport Agent.
[[32m  OK  [0m] Mounted /scratch.
[[32m  OK  [0m] Reached target Remote File Systems.
         Starting Crash recovery kernel arming...
         Starting Permit User Sessions...
         Starting Automounts filesystems on demand...
[[32m  OK  [0m] Started Permit User Sessions.
[[32m  OK  [0m] Started Job spooling tools.
[[32m  OK  [0m] Started Command Scheduler.
         Starting Terminate Plymouth Boot Screen...
         Starting Wait for Plymouth Boot Screen to Quit...
[[32m  OK  [0m] Created slice User Slice of root.
[[32m  OK  [0m] Started Session 1 of user root.

CentOS Linux 7 (Core)
Kernel 3.10.0-957.el7_lustre.x86_64 on an x86_64

soak-8 login: [2018-12-14T06:47:55+00:00] INFO: Forking chef instance to converge...
[2018-12-14T06:47:55+00:00] INFO: *** Chef 12.4.3 ***
[2018-12-14T06:47:55+00:00] INFO: Chef-client pid: 14040
[2018-12-14T06:47:56+00:00] INFO: Setting the run_list to ["role[spirit_config]", "role[spirit_cobbler_config]", "role[spirit_nodes_config]", "role[test_node]"] from CLI options
[2018-12-14T06:47:56+00:00] INFO: Run List is [role[spirit_config], role[spirit_cobbler_config], role[spirit_nodes_config], role[test_node]]
[2018-12-14T06:47:56+00:00] INFO: Run List expands to [yum, local_repos::local_repos_only, solo_data_bags, resolver, timezone, sudo, ntp, freeipa_or_sssd, autofs, mail::client, munge, mrsh::server, ssh::server, install_packages, rsyslog::client, rsh::server, test_node, kdump, mcelog, openmpi, openmpi::test_node]
[2018-12-14T06:47:56+00:00] INFO: Starting Chef Run for soak-8.spirit.whamcloud.com
[2018-12-14T06:47:56+00:00] INFO: Running start handlers
[2018-12-14T06:47:56+00:00] INFO: Start handlers complete.
[2018-12-14T06:47:57+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action enable (test_node::default line 292)
[2018-12-14T06:47:57+00:00] INFO: Disabling Chef::Handler::JsonFile as a report handler.
[2018-12-14T06:47:57+00:00] INFO: Enabling Chef::Handler::JsonFile as a report handler.
[2018-12-14T06:47:57+00:00] INFO: Processing template[/etc/resolv.conf] action create (resolver::default line 23)
[2018-12-14T06:47:57+00:00] INFO: template[/etc/resolv.conf] backed up to /var/chef/backup/etc/resolv.conf.chef-20181214064757.670354
[2018-12-14T06:47:57+00:00] INFO: template[/etc/resolv.conf] removed backup at /var/chef/backup/etc/resolv.conf.chef-20181213221629.371960
[2018-12-14T06:47:57+00:00] INFO: template[/etc/resolv.conf] updated file contents /etc/resolv.conf
[2018-12-14T06:47:57+00:00] INFO: Processing yum_package[sudo] action install (sudo::default line 20)
[2018-12-14T06:48:04+00:00] INFO: Processing template[/etc/sudoers] action create (sudo::default line 24)
[2018-12-14T06:48:04+00:00] INFO: Processing yum_package[ntp] action install (ntp::default line 31)
[2018-12-14T06:48:04+00:00] INFO: Processing service[ntpd] action start (ntp::default line 33)
[2018-12-14T06:48:05+00:00] INFO: service[ntpd] started
[2018-12-14T06:48:05+00:00] INFO: Processing service[ntpd] action enable (ntp::default line 33)
[2018-12-14T06:48:05+00:00] INFO: Processing cookbook_file[/etc/sysconfig/ntpd] action create (ntp::default line 46)
[2018-12-14T06:48:05+00:00] INFO: Processing template[/etc/ntp.conf] action create (ntp::default line 53)
[2018-12-14T06:48:05+00:00] INFO: Processing yum_package[ipa-client] action install (freeipa::client line 19)
[2018-12-14T06:48:05+00:00] INFO: Processing bash[Uninstall_freeipa_client] action run (freeipa::client line 31)
[2018-12-14T06:48:05+00:00] INFO: Processing bash[configure_freeipa_client] action run (freeipa::client line 39)
[2018-12-14T06:48:05+00:00] INFO: Processing directory[/scratch] action create (freeipa::client line 55)
[2018-12-14T06:48:05+00:00] INFO: Processing directory[/shared_test] action create (freeipa::client line 55)
[2018-12-14T06:48:05+00:00] INFO: Processing service[nscd] action disable (sssd::default line 10)
[2018-12-14T06:48:06+00:00] INFO: Processing service[nscd] action stop (sssd::default line 10)
[2018-12-14T06:48:06+00:00] INFO: Processing yum_package[sssd] action install (sssd::default line 20)
[2018-12-14T06:48:06+00:00] INFO: Processing template[/etc/sssd/sssd.conf] action create (sssd::default line 34)
[2018-12-14T06:48:06+00:00] INFO: Processing execute[authconfig-tui-sssd] action run (sssd::default line 64)
[2018-12-14T06:48:06+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:06+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:06+00:00] INFO: Processing service[sssd] action enable (sssd::default line 102)
[2018-12-14T06:48:07+00:00] INFO: Processing service[sssd] action start (sssd::default line 102)
[2018-12-14T06:48:07+00:00] INFO: Processing service[nfs-server] action nothing (nfs::default line 29)
[2018-12-14T06:48:07+00:00] INFO: Processing yum_package[nfs-utils] action install (nfs::default line 35)
[2018-12-14T06:48:07+00:00] INFO: Processing service[rpcbind] action enable (nfs::default line 39)
[2018-12-14T06:48:08+00:00] INFO: Processing service[rpcbind] action start (nfs::default line 39)
[2018-12-14T06:48:08+00:00] INFO: Processing template[/etc/idmapd.conf] action create (nfs::default line 45)
[2018-12-14T06:48:08+00:00] INFO: Processing yum_package[autofs] action install (autofs::default line 17)
[2018-12-14T06:48:08+00:00] INFO: Processing template[/etc/sysconfig/autofs] action create (autofs::default line 33)
[2018-12-14T06:48:08+00:00] INFO: Processing cookbook_file[/etc/auto.master] action create (autofs::default line 40)
[2018-12-14T06:48:08+00:00] INFO: Processing bash[nsswitch-automount] action run (autofs::default line 47)
[2018-12-14T06:48:08+00:00] INFO: Processing service[autofs] action enable (autofs::default line 63)
[2018-12-14T06:48:09+00:00] INFO: Processing service[autofs] action start (autofs::default line 63)
[2018-12-14T06:48:09+00:00] INFO: Processing yum_package[sendmail] action remove (mail::default line 16)
[2018-12-14T06:48:09+00:00] INFO: Processing yum_package[postfix] action install (postfix::default line 21)
[2018-12-14T06:48:09+00:00] INFO: Processing service[postfix] action enable (postfix::default line 25)
[2018-12-14T06:48:10+00:00] INFO: Processing template[/etc/postfix/main.cf] action create (postfix::default line 30)
[2018-12-14T06:48:10+00:00] INFO: Processing template[/etc/postfix/master.cf] action create (postfix::default line 30)
[2018-12-14T06:48:10+00:00] INFO: Processing yum_package[mailx] action install (mail::default line 27)
[2018-12-14T06:48:10+00:00] INFO: Processing execute[newaliases] action nothing (mail::default line 30)
[2018-12-14T06:48:10+00:00] INFO: Processing template[/etc/aliases] action create (mail::default line 35)
[2018-12-14T06:48:10+00:00] INFO: Processing yum_package[munge] action install (munge::default line 20)
[2018-12-14T06:48:10+00:00] INFO: Processing cookbook_file[/etc/munge/munge.key] action create (munge::default line 47)
[2018-12-14T06:48:10+00:00] INFO: Processing template[/etc/sysconfig/munge] action create (munge::default line 54)
[2018-12-14T06:48:10+00:00] INFO: Processing service[munge] action enable (munge::default line 63)
[2018-12-14T06:48:10+00:00] INFO: Processing service[munge] action start (munge::default line 63)
[2018-12-14T06:48:11+00:00] INFO: Processing yum_package[mrsh-server] action install (mrsh::default line 24)
[2018-12-14T06:48:11+00:00] INFO: Processing yum_package[mrsh] action install (mrsh::default line 25)
[2018-12-14T06:48:11+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrlogind] action create (mrsh::server line 15)
[2018-12-14T06:48:11+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] backed up to /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181214064811.073386
[2018-12-14T06:48:11+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] removed backup at /var/chef/backup/etc/xinetd.d/mrlogind.chef-20181213221641.740636
[2018-12-14T06:48:11+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] updated file contents /etc/xinetd.d/mrlogind
[2018-12-14T06:48:11+00:00] INFO: cookbook_file[/etc/xinetd.d/mrlogind] mode changed to 644
[2018-12-14T06:48:11+00:00] INFO: Processing cookbook_file[/etc/xinetd.d/mrshd] action create (mrsh::server line 22)
[2018-12-14T06:48:11+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] backed up to /var/chef/backup/etc/xinetd.d/mrshd.chef-20181214064811.088621
[2018-12-14T06:48:11+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] removed backup at /var/chef/backup/etc/xinetd.d/mrshd.chef-20181213221641.747387
[2018-12-14T06:48:11+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] updated file contents /etc/xinetd.d/mrshd
[2018-12-14T06:48:11+00:00] INFO: cookbook_file[/etc/xinetd.d/mrshd] mode changed to 644
[2018-12-14T06:48:11+00:00] INFO: Processing execute[add_mrsh_to_securetty] action run (mrsh::server line 33)
[2018-12-14T06:48:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[add_mrlogin_to_securetty] action run (mrsh::server line 33)
[2018-12-14T06:48:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[enable mrshd] action run (mrsh::server line 50)
[2018-12-14T06:48:11+00:00] INFO: execute[enable mrshd] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[enable mrlogind] action run (mrsh::server line 50)
[2018-12-14T06:48:11+00:00] INFO: execute[enable mrlogind] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[add_pts0_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:48:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[add_pts1_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:48:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[add_pts2_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:48:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[add_pts3_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:48:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[add_pts4_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:48:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[add_pts5_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:48:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[add_pts6_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:48:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing execute[add_pts7_to_securetty_mrsh] action run (mrsh::server line 64)
[2018-12-14T06:48:11+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:11+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:11+00:00] INFO: Processing service[xinetd] action start (mrsh::server line 70)
[2018-12-14T06:48:11+00:00] INFO: service[xinetd] started
[2018-12-14T06:48:11+00:00] INFO: Processing service[xinetd] action enable (mrsh::server line 70)
[2018-12-14T06:48:12+00:00] INFO: Processing yum_package[openssh-clients] action install (ssh::default line 9)
[2018-12-14T06:48:12+00:00] INFO: Processing yum_package[openssh-server] action install (ssh::server line 14)
[2018-12-14T06:48:12+00:00] INFO: Processing service[sshd] action start (ssh::server line 19)
[2018-12-14T06:48:12+00:00] INFO: Processing service[sshd] action enable (ssh::server line 19)
[2018-12-14T06:48:13+00:00] INFO: Processing template[/etc/ssh/sshd_config] action create (ssh::server line 29)
[2018-12-14T06:48:13+00:00] INFO: Processing directory[/root/.ssh/] action create (ssh::server line 36)
[2018-12-14T06:48:13+00:00] INFO: Processing template[/root/.ssh/authorized_keys] action create (ssh::server line 52)
[2018-12-14T06:48:13+00:00] INFO: template[/root/.ssh/authorized_keys] backed up to /var/chef/backup/root/.ssh/authorized_keys.chef-20181214064813.153828
[2018-12-14T06:48:13+00:00] INFO: template[/root/.ssh/authorized_keys] removed backup at /var/chef/backup/root/.ssh/authorized_keys.chef-20181213221643.856548
[2018-12-14T06:48:13+00:00] INFO: template[/root/.ssh/authorized_keys] updated file contents /root/.ssh/authorized_keys
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[rsyslog] action install (rsyslog::client line 12)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[ed] action install (rsyslog::client line 13)
[2018-12-14T06:48:13+00:00] INFO: Processing service[rsyslog] action nothing (rsyslog::client line 22)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[configure_remote_syslog] action run (rsyslog::client line 26)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[rsh] action install (rsh::default line 9)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[rsh-server] action install (rsh::server line 11)
[2018-12-14T06:48:13+00:00] INFO: Processing service[rsh.socket] action enable (rsh::server line 17)
[2018-12-14T06:48:13+00:00] INFO: Processing service[rsh.socket] action start (rsh::server line 17)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[add_rsh_to_securetty] action run (rsh::server line 40)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rsh] action run (rsh::server line 45)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[enable_promiscuous_pam_for_rsh] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing service[rlogin.socket] action enable (rsh::server line 17)
[2018-12-14T06:48:13+00:00] INFO: Processing service[rlogin.socket] action start (rsh::server line 17)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[add_rlogin_to_securetty] action run (rsh::server line 40)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing execute[enable_promiscuous_pam_for_rlogin] action run (rsh::server line 45)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[enable_promiscuous_pam_for_rlogin] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing execute[add_pts0_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing execute[add_pts1_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing execute[add_pts2_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing execute[add_pts3_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing execute[add_pts4_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing execute[add_pts5_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing execute[add_pts6_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing execute[add_pts7_to_securetty_rsh] action run (rsh::server line 53)
[2018-12-14T06:48:13+00:00] INFO: Processing execute[Guard resource] action run (dynamically defined)
[2018-12-14T06:48:13+00:00] INFO: execute[Guard resource] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing cookbook_file[/root/.rhosts] action create (rsh::server line 59)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[openmpi] action install (openmpi::default line 20)
[2018-12-14T06:48:13+00:00] INFO: Processing cookbook_file[/etc/profile.d/openmpi.sh] action create (openmpi::default line 26)
[2018-12-14T06:48:13+00:00] INFO: Processing bash[install_autotest_ssh_key] action run (test_node::add_key line 7)
[2018-12-14T06:48:13+00:00] INFO: bash[install_autotest_ssh_key] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing bash[install_user_ssh_key] action run (test_node::add_key line 17)
[2018-12-14T06:48:13+00:00] INFO: bash[install_user_ssh_key] ran successfully
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[cvs] action install (test_node::default line 14)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[bc] action install (test_node::default line 15)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[expect] action install (test_node::default line 16)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[make] action install (test_node::default line 17)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[gcc] action install (test_node::default line 18)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[sg3_utils] action install (test_node::default line 19)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[patch] action install (test_node::default line 20)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[setools-console] action install (test_node::default line 24)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[logwatch] action remove (test_node::default line 26)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[mlocate] action remove (test_node::default line 26)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[libyaml] action install (test_node::default line 32)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[libyaml-devel] action install (test_node::default line 33)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[powerman] action install (test_node::default line 35)
[2018-12-14T06:48:13+00:00] INFO: Processing yum_package[compat-glibc-headers] action install (test_node::default line 41)
[2018-12-14T06:48:13+00:00] INFO: Processing service[abrtd] action disable (test_node::default line 58)
[2018-12-14T06:48:14+00:00] INFO: Processing service[abrtd] action stop (test_node::default line 58)
[2018-12-14T06:48:14+00:00] INFO: Processing service[openibd] action enable (test_node::default line 66)
[2018-12-14T06:48:15+00:00] INFO: Processing service[openibd] action start (test_node::default line 66)
[2018-12-14T06:48:15+00:00] INFO: Processing directory[/mnt/lustre] action create (test_node::default line 130)
[2018-12-14T06:48:15+00:00] INFO: Processing group[quota_usr] action create (test_node::default line 134)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota_usr] action create (test_node::default line 138)
[2018-12-14T06:48:15+00:00] INFO: Processing group[quota_2usr] action create (test_node::default line 144)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota_2usr] action create (test_node::default line 148)
[2018-12-14T06:48:15+00:00] INFO: Processing group[sanityusr] action create (test_node::default line 154)
[2018-12-14T06:48:15+00:00] INFO: Processing user[sanityusr] action create (test_node::default line 158)
[2018-12-14T06:48:15+00:00] INFO: Processing group[sanityusr1] action create (test_node::default line 164)
[2018-12-14T06:48:15+00:00] INFO: Processing user[sanityusr1] action create (test_node::default line 168)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_1] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_2] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_3] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_4] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_5] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_6] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_7] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_8] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_9] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_10] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_11] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_12] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_13] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_14] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_15] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_16] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_17] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_18] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_19] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_20] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_21] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_22] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_23] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_24] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_25] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_26] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_27] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_28] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_29] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing user[quota15_30] action create (test_node::default line 175)
[2018-12-14T06:48:15+00:00] INFO: Processing directory[/localhome] action create (test_node::default line 182)
[2018-12-14T06:48:15+00:00] INFO: Processing group[chromatest] action create (test_node::default line 188)
[2018-12-14T06:48:15+00:00] INFO: Processing user[chromatest] action create (test_node::default line 192)
[2018-12-14T06:48:15+00:00] INFO: Processing bash[set_hostid] action run (test_node::default line 198)
[2018-12-14T06:48:15+00:00] INFO: Processing bash[increase_memlock_limits] action run (test_node::default line 207)
[2018-12-14T06:48:15+00:00] INFO: Processing directory[/etc/sysctl.d] action create (test_node::default line 274)
[2018-12-14T06:48:15+00:00] INFO: Processing chef_handler[Chef::Handler::JsonFile] action nothing (test_node::default line 292)
[2018-12-14T06:48:15+00:00] INFO: Processing execute[testnode disable systemd readahead] action run (test_node::default line 305)
[2018-12-14T06:48:15+00:00] INFO: Processing yum_package[kexec-tools] action install (kdump::default line 10)
[2018-12-14T06:48:15+00:00] INFO: Processing bash[add filesystem to /etc/fstab for kdump] action run (kdump::default line 14)
[2018-12-14T06:48:15+00:00] INFO: Processing bash[ensure filesystem is mounted for kdumps] action run (kdump::default line 21)
[2018-12-14T06:48:16+00:00] INFO: bash[ensure filesystem is mounted for kdumps] ran successfully
[2018-12-14T06:48:16+00:00] INFO: Processing directory[/scratch/dumps/soak-8.spirit.whamcloud.com] action create (kdump::default line 29)
[2018-12-14T06:48:16+00:00] INFO: Processing template[/etc/kdump.conf] action create (kdump::default line 51)
[2018-12-14T06:48:16+00:00] INFO: Processing template[/root/kdump-post.sh] action create (kdump::default line 68)
[2018-12-14T06:48:16+00:00] INFO: Processing service[kdump] action restart (kdump::default line 78)
[   71.473157] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[   84.523097] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2
[   84.532473] alg: No test for adler32 (adler32-zlib)
[   85.341996] Lustre: Lustre: Build Version: 2.12.0_RC2
[   85.500866] LNet: Using FMR for registration
[   85.514389] LNet: Added LNI 192.168.1.108@o2ib [8/256/0/180]
[   85.561561] LDISKFS-fs warning (device dm-2): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait.
[   85.561561] 
[  129.777347] LDISKFS-fs (dm-2): recovery complete
[  129.783101] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[  131.025871] Lustre: MGS: Connection restored to 1c12fce0-5ab6-a055-cb00-2452d61672e0 (at 0@lo)
[  131.492036] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[2018-12-14T06:49:18+00:00] INFO: service[kdump] restarted
[2018-12-14T06:49:18+00:00] INFO: Processing yum_package[mcelog] action install (mcelog::default line 11)
[2018-12-14T06:49:18+00:00] INFO: Processing service[mcelog.service] action start (mcelog::default line 15)
[2018-12-14T06:49:18+00:00] INFO: Processing user[mpiuser] action create (openmpi::test_node line 10)
[2018-12-14T06:49:18+00:00] INFO: Processing group[mpiuser] action create (openmpi::test_node line 29)
[2018-12-14T06:49:18+00:00] INFO: Processing directory[/localhome/mpiuser] action create (openmpi::test_node line 39)
[2018-12-14T06:49:18+00:00] INFO: Processing execute[add_rhosts_to_mpiuser] action run (openmpi::test_node line 44)
[2018-12-14T06:49:18+00:00] INFO: Processing bash[use_rsh_for_mpi] action run (openmpi::test_node line 49)
[2018-12-14T06:49:18+00:00] INFO: Chef Run complete in 81.973620721 seconds
[2018-12-14T06:49:18+00:00] INFO: Skipping removal of unused files from the cache
[2018-12-14T06:49:18+00:00] INFO: Running report handlers
[2018-12-14T06:49:18+00:00] INFO: Creating JSON run report
[2018-12-14T06:49:19+00:00] INFO: Report handlers complete
[  140.849490] Lustre: MGS: Connection restored to b592c7bc-4773-1346-22f6-1bc75cd12459 (at 192.168.1.138@o2ib)
[  145.638815] Lustre: MGS: Connection restored to 77ba5f62-c579-661f-6603-d752c3c9d6fa (at 192.168.1.129@o2ib)
[  147.288023] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 28 clients reconnect
[  148.177165] Lustre: MGS: Connection restored to 36961c02-5f3c-5cd7-150e-2b8003fb1644 (at 192.168.1.116@o2ib)
[  148.188323] Lustre: Skipped 2 previous similar messages
[  152.179210] Lustre: MGS: Connection restored to 43f5e77c-b75b-4455-c2b1-1534adccc551 (at 192.168.1.143@o2ib)
[  152.190209] Lustre: Skipped 14 previous similar messages
[  160.285153] Lustre: soaked-MDT0000: Connection restored to 4e3cfb5f-567b-929b-da71-cf4a99e98b0b (at 192.168.1.118@o2ib)
[  160.297235] Lustre: Skipped 22 previous similar messages
[  176.667175] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[  176.677523] Lustre: Skipped 8 previous similar messages
[  182.137665] Lustre: soaked-MDT0000: Recovery over after 0:35, of 28 clients 28 recovered and 0 were evicted.
[  225.807348] Lustre: MGS: Connection restored to 65ca4c0f-9053-3f36-91a2-79b4641ed043 (at 192.168.1.128@o2ib)
[  225.818350] Lustre: Skipped 19 previous similar messages
[  278.894709] LustreError: 31735:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x20000a058:0x1008c:0x0]
[  413.165009] LustreError: 31420:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x20000bf86:0xf343:0x0]
[  482.937097] LustreError: 31422:0:(mdt_io.c:442:mdt_preprw_write()) soaked-MDT0000: BRW to missing obj [0x20000a058:0x14b44:0x0]
[  782.502030] LNetError: 28111:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[  782.513422] LNetError: 28111:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.111@o2ib (8): c: 5, oc: 0, rc: 8
[  782.527261] Lustre: 28156:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544770803/real 1544770808]  req@ffff9fcef3fde600 x1619808899175984/t0(0) o41->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544770810 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[  782.559598] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[  835.744856] Lustre: 31675:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[  981.573787] Lustre: MGS: haven't heard from client b1895668-2fe3-f466-7a53-2415dc117d94 (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9fcb16369000, cur 1544771008 expire 1544770858 last 1544770781
[ 1003.546787] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib) in 230 seconds. I think it's dead, and I am evicting it. exp ffff9fcf1de8c000, cur 1544771030 expire 1544770880 last 1544770800
[ 1003.570776] LustreError: 32626:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff9fcf06631200 x1619808903909872/t0(0) o105->soaked-MDT0000@192.168.1.111@o2ib:15/16 lens 304/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
[ 1038.503250] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1089.503649] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1139.504076] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1189.504498] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1239.504958] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1290.505390] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 1 seconds
[ 1339.506378] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1389.507711] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1490.509988] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 1490.521469] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[ 1634.369468] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[ 1634.379795] Lustre: Skipped 5 previous similar messages
[ 1634.436216] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.110@o2ib, removing former export from 192.168.1.111@o2ib
[ 1641.512633] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 1 seconds
[ 1641.524102] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 2 previous similar messages
[ 1662.260743] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 1662.270019] Lustre: Skipped 1 previous similar message
[ 1844.687705] LNet: Service thread pid 31397 was inactive for 200.07s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
[ 1844.706659] Pid: 31397, comm: mdt00_001 3.10.0-957.el7_lustre.x86_64 #1 SMP Sat Dec 8 05:53:16 UTC 2018
[ 1844.717171] Call Trace:
[ 1844.719941]  [<ffffffffc1034031>] ldlm_completion_ast+0x5b1/0x920 [ptlrpc]
[ 1844.727765]  [<ffffffffc1034dcc>] ldlm_cli_enqueue_local+0x23c/0x870 [ptlrpc]
[ 1844.735857]  [<ffffffffc14574ab>] mdt_object_local_lock+0x50b/0xb20 [mdt]
[ 1844.743517]  [<ffffffffc1457b30>] mdt_object_lock_internal+0x70/0x3e0 [mdt]
[ 1844.751340]  [<ffffffffc1458d1a>] mdt_getattr_name_lock+0x90a/0x1c30 [mdt]
[ 1844.759068]  [<ffffffffc1460bb5>] mdt_intent_getattr+0x2b5/0x480 [mdt]
[ 1844.766406]  [<ffffffffc145da18>] mdt_intent_policy+0x2e8/0xd00 [mdt]
[ 1844.773635]  [<ffffffffc101aec6>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc]
[ 1844.781197]  [<ffffffffc10438a7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc]
[ 1844.789148]  [<ffffffffc10ca302>] tgt_enqueue+0x62/0x210 [ptlrpc]
[ 1844.796046]  [<ffffffffc10d135a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[ 1844.803853]  [<ffffffffc107592b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[ 1844.812507]  [<ffffffffc107925c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[ 1844.819593]  [<ffffffff9fcc1c31>] kthread+0xd1/0xe0
[ 1844.825082]  [<ffffffffa0374c37>] ret_from_fork_nospec_end+0x0/0x39
[ 1844.832140]  [<ffffffffffffffff>] 0xffffffffffffffff
[ 1844.837786] LustreError: dumping log to /tmp/lustre-log.1544771871.31397
[ 1885.268866] LNet: Service thread pid 31397 completed after 240.65s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
[ 1886.416558] LustreError: 167-0: soaked-MDT0003-osp-MDT0000: This client was evicted by soaked-MDT0003; in progress operations using this service will fail.
[ 1886.432444] LustreError: 32399:0:(osp_object.c:594:osp_attr_get()) soaked-MDT0003-osp-MDT0000:osp_attr_get update error [0x2c000cf22:0x1:0x0]: rc = -5
[ 1886.436867] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 1886.436870] Lustre: Skipped 2 previous similar messages
[ 1886.464865] LustreError: 32399:0:(osp_object.c:594:osp_attr_get()) Skipped 2 previous similar messages
[ 4033.500047] LNetError: 28111:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[ 4033.511429] LNetError: 28111:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.109@o2ib (10): c: 6, oc: 0, rc: 8
[ 4033.525330] Lustre: 28148:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544774054/real 1544774059]  req@ffff9fc7a7ae0300 x1619808911082928/t0(0) o41->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544774061 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 4033.557685] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 4034.500201] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 1 seconds
[ 4057.853442] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.123@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4058.626164] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4058.644671] LustreError: Skipped 1 previous similar message
[ 4062.361895] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.111@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4062.381729] LustreError: Skipped 1 previous similar message
[ 4066.624048] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4071.743217] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.106@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4071.743219] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.106@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4071.782866] LustreError: Skipped 2 previous similar messages
[ 4079.995495] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.140@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4080.015350] LustreError: Skipped 25 previous similar messages
[ 4107.967798] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.123@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4107.987633] LustreError: Skipped 8 previous similar messages
[ 4142.114068] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.138@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4142.133884] LustreError: Skipped 37 previous similar messages
[ 4208.324356] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.123@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4208.344235] LustreError: Skipped 47 previous similar messages
[ 4208.842952] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4209.354042] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4209.364574] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4209.874703] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4209.885245] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4210.395601] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4210.406137] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4210.925755] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4210.936281] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4211.446622] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4211.457160] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4211.981472] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4211.992011] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4212.510557] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4212.521082] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4213.039187] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4213.049715] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4213.572891] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4213.583416] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4214.103549] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4214.114070] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4214.631532] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4214.642059] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4215.161218] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4215.171748] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4215.695244] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4215.705768] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4216.238840] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4216.249372] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4216.764606] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4216.775146] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4217.309494] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4217.320020] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4217.881555] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4217.892069] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4218.412318] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4218.422839] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4218.952482] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4218.963010] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4219.506097] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4219.516627] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4220.045810] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4220.056325] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4220.622571] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4220.633098] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4221.161268] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4221.171803] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4221.706425] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4221.716973] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4222.253449] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4222.263972] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4222.859909] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4222.870441] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4223.396537] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4223.407061] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4223.949714] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4223.960243] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4224.501808] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4224.512342] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4225.105536] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4225.116065] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4225.661891] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4225.672423] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4226.187974] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4226.198490] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4226.747324] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4226.757857] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4227.318486] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4227.329028] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4227.863629] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4227.874156] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4228.454376] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4228.464901] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4229.039357] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4229.049897] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4229.640067] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4229.650597] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4230.174431] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4230.184983] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4230.732641] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4230.743168] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4231.267326] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4231.277865] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4231.848443] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4231.858973] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4232.485117] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4232.495639] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4233.013088] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4233.023616] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4233.554674] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4233.565198] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4234.108735] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4234.119275] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4234.630628] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4234.641168] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4235.659904] sd 6:0:1:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 4235.663780] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4235.663789] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4235.688401] sd 6:0:1:1: [sdd] Sense Key : Illegal Request [current] 
[ 4235.695514] sd 6:0:1:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 4235.701652] sd 6:0:1:1: [sdd] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00
[ 4235.711081] blk_update_request: I/O error, dev sdd, sector 11608952
[ 4235.718110] device-mapper: multipath: Failing path 8:48.
[ 4236.164577] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4236.175100] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4236.690887] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 4236.701401] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 4236.713138] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[ 4236.721845] sd 6:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command
[ 4236.732747] sd 6:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed
[ 4239.894590] device-mapper: multipath: Reinstating path 8:48.
[ 4248.480957] Lustre: MGS: haven't heard from client a9dad556-1640-87ba-fcde-16e54f4d132c (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9fcf2cbcec00, cur 1544774274 expire 1544774124 last 1544774047
[ 4251.277443] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff9fcf1de8bc00, cur 1544774277 expire 1544774127 last 1544774049
[ 4251.301424] LustreError: 31369:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff9fcae14b1200 x1619808911096448/t0(0) o105->soaked-MDT0000@192.168.1.109@o2ib:15/16 lens 304/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
[ 4251.325670] LustreError: 31369:0:(client.c:1175:ptlrpc_import_delay_req()) Skipped 3 previous similar messages
[ 4289.498150] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds
[ 4367.905183] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.138@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 4367.925039] LustreError: Skipped 123 previous similar messages
[ 4386.104689] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 4392.750143] Lustre: soaked-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 4394.309062] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.109@o2ib, removing former export from same NID
[ 4409.808395] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[ 4409.824174] LustreError: 31695:0:(osp_object.c:594:osp_attr_get()) soaked-MDT0001-osp-MDT0000:osp_attr_get update error [0x24000cf36:0x151e4:0x0]: rc = -5
[ 4409.827516] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 4409.827519] Lustre: Skipped 1 previous similar message
[ 4435.299045] Lustre: 31685:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 7605.483732] LNetError: 28111:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[ 7605.495120] LNetError: 28111:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.109@o2ib (11): c: 6, oc: 0, rc: 8
[ 7605.509074] Lustre: 28142:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544777626/real 1544777631]  req@ffff9fcae08b0300 x1619808924191184/t0(0) o41->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544777642 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 7605.541462] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 7628.775019] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7628.794837] LustreError: Skipped 29 previous similar messages
[ 7665.799880] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.142@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7665.819700] LustreError: Skipped 36 previous similar messages
[ 7730.994994] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7731.013478] LustreError: Skipped 48 previous similar messages
[ 7778.613761] sd 6:0:1:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 7778.622437] sd 6:0:1:1: [sdd] Sense Key : Illegal Request [current] 
[ 7778.629556] sd 6:0:1:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 7778.635699] sd 6:0:1:1: [sdd] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00
[ 7778.645135] blk_update_request: I/O error, dev sdd, sector 11608952
[ 7778.652463] device-mapper: multipath: Failing path 8:48.
[ 7778.962524] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 7779.472355] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 7779.482870] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 7779.692533] sd 6:0:0:1: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 7779.701204] sd 6:0:0:1: [sde] Sense Key : Illegal Request [current] 
[ 7779.708319] sd 6:0:0:1: [sde] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 7779.714455] sd 6:0:0:1: [sde] CDB: Write(16) 8a 00 00 00 00 00 b6 d0 01 48 00 00 00 08 00 00
[ 7779.723877] blk_update_request: I/O error, dev sde, sector 3067085128
[ 7779.731114] sd 6:0:0:1: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 7779.739773] sd 6:0:0:1: [sde] Sense Key : Illegal Request [current] 
[ 7779.746886] sd 6:0:0:1: [sde] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 7779.753026] sd 6:0:0:1: [sde] CDB: Write(16) 8a 00 00 00 00 00 b6 c0 01 00 00 00 00 28 00 00
[ 7779.762456] blk_update_request: I/O error, dev sde, sector 3066036480
[ 7779.769666] sd 6:0:0:1: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 7779.778324] sd 6:0:0:1: [sde] Sense Key : Illegal Request [current] 
[ 7779.785431] sd 6:0:0:1: [sde] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 7779.791572] sd 6:0:0:1: [sde] CDB: Write(16) 8a 00 00 00 00 00 b6 c0 00 80 00 00 00 08 00 00
[ 7779.801005] blk_update_request: I/O error, dev sde, sector 3066036352
[ 7779.808213] sd 6:0:0:1: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 7779.816872] sd 6:0:0:1: [sde] Sense Key : Illegal Request [current] 
[ 7779.823978] sd 6:0:0:1: [sde] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 7779.830113] sd 6:0:0:1: [sde] CDB: Write(16) 8a 00 00 00 00 00 00 ea ac 78 00 00 00 08 00 00
[ 7779.839546] blk_update_request: I/O error, dev sde, sector 15379576
[ 7779.846564] sd 6:0:0:1: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 7779.855219] sd 6:0:0:1: [sde] Sense Key : Illegal Request [current] 
[ 7779.862323] sd 6:0:0:1: [sde] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 7779.868456] sd 6:0:0:1: [sde] CDB: Write(16) 8a 00 00 00 00 00 01 56 63 38 00 00 00 08 00 00
[ 7779.877879] blk_update_request: I/O error, dev sde, sector 22438712
[ 7779.884887] sd 6:0:0:1: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 7779.893547] sd 6:0:0:1: [sde] Sense Key : Illegal Request [current] 
[ 7779.900650] sd 6:0:0:1: [sde] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 7779.906773] sd 6:0:0:1: [sde] CDB: Write(16) 8a 00 00 00 00 00 00 b1 50 28 00 00 00 08 00 00
[ 7779.916199] blk_update_request: I/O error, dev sde, sector 11620392
[ 7779.923209] sd 6:0:0:1: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 7779.931862] sd 6:0:0:1: [sde] Sense Key : Illegal Request [current] 
[ 7779.938964] sd 6:0:0:1: [sde] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 7779.945095] sd 6:0:0:1: [sde] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 88 00 00 00 08 00 00
[ 7779.954525] blk_update_request: I/O error, dev sde, sector 11608968
[ 7779.961525] sd 6:0:0:1: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 7779.970179] sd 6:0:0:1: [sde] Sense Key : Illegal Request [current] 
[ 7779.977279] sd 6:0:0:1: [sde] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 7779.983412] sd 6:0:0:1: [sde] CDB: Write(16) 8a 00 00 00 00 00 00 b1 50 38 00 00 00 10 00 00
[ 7779.992835] blk_update_request: I/O error, dev sde, sector 11620408
[ 7779.999835] sd 6:0:0:1: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 7780.008490] sd 6:0:0:1: [sde] Sense Key : Illegal Request [current] 
[ 7780.015587] sd 6:0:0:1: [sde] <<vendor>>ASC=0x94 ASCQ=0x1 
[ 7780.021714] sd 6:0:0:1: [sde] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 98 00 00 00 08 00 00
[ 7780.031143] blk_update_request: I/O error, dev sde, sector 11608984
[ 7780.038150] device-mapper: multipath: Failing path 8:64.
[ 7780.502974] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36
[ 7780.513519] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command
[ 7780.525509] sd 6:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed
[ 7782.957243] device-mapper: multipath: Reinstating path 8:48.
[ 7783.964652] device-mapper: multipath: Reinstating path 8:64.
[ 7807.337341] Lustre: MGS: haven't heard from client 84e07a11-3364-8171-8862-04fd2880a4ea (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9fcae4af6000, cur 1544777833 expire 1544777683 last 1544777606
[ 7807.794280] LDISKFS-fs warning (device dm-4): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait.
[ 7807.794280] 
[ 7860.086598] LDISKFS-fs (dm-4): recovery complete
[ 7860.092416] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc
[ 7861.483500] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds
[ 7862.541578] Lustre: soaked-MDT0000: Received LWP connection from 0@lo, removing former export from 192.168.1.109@o2ib
[ 7862.553671] Lustre: soaked-MDT0000: Connection restored to 192.168.1.108@o2ib (at 0@lo)
[ 7862.701833] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900
[ 7862.721406] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect
[ 7862.730004] LustreError: 41371:0:(llog_osd.c:1005:llog_osd_next_block()) soaked-MDT0003-osp-MDT0001: missed desired record? 3 > 1
[ 7862.730014] LustreError: 41371:0:(lod_dev.c:428:lod_sub_recovery_thread()) soaked-MDT0003-osp-MDT0001 get update log failed: rc = -2
[ 7862.757053] Lustre: 41373:0:(ldlm_lib.c:2058:target_recovery_overseer()) recovery is aborted, evict exports in recovery
[ 7862.782527] Lustre: soaked-MDT0001: disconnecting 28 stale clients
[ 7864.137762] Lustre: Failing over soaked-MDT0001
[ 7864.606110] Lustre: server umount soaked-MDT0001 complete
[ 7866.502538] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.142@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[ 7866.522379] LustreError: Skipped 122 previous similar messages
[ 7867.365500] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 7867.374779] Lustre: Skipped 1 previous similar message
[ 7897.720476] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.111@o2ib, removing former export from same NID
[ 7897.733211] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[ 7897.743523] Lustre: Skipped 2 previous similar messages
[ 7912.882274] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[ 7912.898140] LustreError: 31695:0:(osp_object.c:594:osp_attr_get()) soaked-MDT0001-osp-MDT0000:osp_attr_get update error [0x24000e691:0x1:0x0]: rc = -5
[ 7912.902688] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[ 8034.815116] Lustre: 32404:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[ 9579.482756] LNetError: 28111:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[ 9579.494150] LNetError: 28111:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.111@o2ib (8): c: 6, oc: 0, rc: 8
[ 9579.507959] Lustre: 28165:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544779600/real 1544779605]  req@ffff9fcf06891500 x1619808934597488/t0(0) o41->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544779607 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[ 9579.540359] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[ 9782.294441] Lustre: MGS: haven't heard from client 1bebb440-8d5f-0473-872e-d359dc011ede (at 192.168.1.111@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff9fcadc293000, cur 1544779808 expire 1544779658 last 1544779580
[ 9834.482800] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 9885.482786] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 1 seconds
[ 9934.482835] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[ 9984.482840] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[10035.482795] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[10085.482788] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[10135.482791] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[10237.482806] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[10237.494274] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[10279.935064] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.110@o2ib, removing former export from 192.168.1.111@o2ib
[10279.948294] Lustre: Skipped 1 previous similar message
[10279.954305] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[10285.383608] LNet: 186:0:(o2iblnd_cb.c:2575:kiblnd_passive_connect()) Conn stale 192.168.1.111@o2ib version 12/12 incarnation 1544780311168040/1544780311168040
[10285.411895] Lustre: MGS: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[10285.421158] Lustre: Skipped 1 previous similar message
[10285.482772] LNet: 28111:0:(o2iblnd_cb.c:1484:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.111@o2ib: connected
[10382.257482] LustreError: 167-0: soaked-MDT0003-osp-MDT0000: This client was evicted by soaked-MDT0003; in progress operations using this service will fail.
[10382.273394] LustreError: 32399:0:(osp_object.c:594:osp_attr_get()) soaked-MDT0003-osp-MDT0000:osp_attr_get update error [0x2c000c750:0x2930:0x0]: rc = -5
[10382.278354] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[10382.278357] Lustre: Skipped 2 previous similar messages
[10382.306083] LustreError: 32399:0:(osp_object.c:594:osp_attr_get()) Skipped 4 previous similar messages
[11635.345052] Lustre: 31718:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[13456.462402] LNetError: 28111:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: tx_queue, 0 seconds
[13456.473594] LNetError: 28111:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.104@o2ib (6): c: 0, oc: 0, rc: 8
[13456.487380] Lustre: 28153:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544783477/real 1544783482]  req@ffff9fceb9be1b00 x1619808988704768/t0(0) o6->soaked-OST0000-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 544/432 e 0 to 1 dl 1544783563 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[13456.487420] Lustre: soaked-OST0004-osc-MDT0000: Connection to soaked-OST0004 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[13456.538297] Lustre: 28153:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
[13457.462449] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 1 seconds
[13457.474078] Lustre: 28163:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544783477/real 1544783483]  req@ffff9fce95790900 x1619808988705968/t0(0) o6->soaked-OST0008-osc-MDT0000@192.168.1.104@o2ib:28/4 lens 544/432 e 0 to 1 dl 1544783563 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[13457.506321] Lustre: 28163:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 6 previous similar messages
[13459.241361] Lustre: 28150:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1544783478/real 0]  req@ffff9fcf08350300 x1619808988729984/t0(0) o13->soaked-OST0008-osc-MDT0000@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1544783485 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
[13459.272338] Lustre: 28150:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 1 previous similar message
[13460.462457] Lustre: soaked-OST000c-osc-MDT0000: Connection to soaked-OST000c (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[13460.481181] Lustre: Skipped 2 previous similar messages
[13512.461513] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 10 seconds
[13512.473091] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 23 previous similar messages
[13537.643140] Lustre: 28142:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544783477/real 1544783477]  req@ffff9fca5deabf00 x1619808988704304/t0(0) o6->soaked-OST000c-osc-MDT0000@192.168.1.105@o2ib:28/4 lens 544/432 e 0 to 1 dl 1544783564 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
[13537.674990] Lustre: 28142:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
[13561.460775] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 9 seconds
[13561.472245] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[13661.459261] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 9 seconds
[13661.470734] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 7 previous similar messages
[13671.535381] Lustre: MGS: haven't heard from client 1b1055dc-2fee-a3d6-11b6-ff38f714aae7 (at 192.168.1.104@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9fcae5bc0000, cur 1544783698 expire 1544783548 last 1544783471
[13713.327401] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[13730.403968] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[13741.187607] Lustre: soaked-OST0000-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[13758.151879] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[13769.044293] Lustre: soaked-OST0004-osc-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[13816.457041] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds
[13816.468520] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 6 previous similar messages
[13899.143252] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib)
[13935.909702] LustreError: 11-0: soaked-OST0008-osc-MDT0000: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -19
[13935.922230] Lustre: soaked-OST0008-osc-MDT0000: Connection to soaked-OST0008 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[13969.938717] Lustre: MGS: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[13969.947978] Lustre: Skipped 2 previous similar messages
[13976.565112] LustreError: 11-0: soaked-OST0000-osc-MDT0000: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107
[13976.577701] Lustre: soaked-OST0000-osc-MDT0000: Connection to soaked-OST0000 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[13984.404995] LustreError: 11-0: soaked-OST0004-osc-MDT0000: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107
[13984.417615] Lustre: soaked-OST0004-osc-MDT0000: Connection to soaked-OST0004 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[13988.111075] LustreError: 11-0: soaked-OST000c-osc-MDT0000: operation ost_destroy to node 192.168.1.105@o2ib failed: rc = -19
[13995.075114] LustreError: 11-0: soaked-OST000c-osc-MDT0000: operation ost_create to node 192.168.1.105@o2ib failed: rc = -19
[13995.087584] LustreError: Skipped 7 previous similar messages
[13995.093961] LustreError: 31479:0:(osp_precreate.c:940:osp_precreate_cleanup_orphans()) soaked-OST000c-osc-MDT0000: cannot cleanup orphans: rc = -19
[14184.466690] Lustre: soaked-OST0008-osc-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib)
[14184.478175] Lustre: Skipped 6 previous similar messages
[15015.443194] LNetError: 28111:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[15015.454581] LNetError: 28111:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.111@o2ib (11): c: 7, oc: 0, rc: 8
[15015.468414] Lustre: 28158:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544785036/real 1544785041]  req@ffff9fceffc63f00 x1619809014027440/t0(0) o41->soaked-MDT0003-osp-MDT0000@192.168.1.111@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544785043 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[15015.500764] Lustre: 28158:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 6 previous similar messages
[15015.511666] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[15015.530324] Lustre: Skipped 1 previous similar message
[15215.541195] Lustre: MGS: haven't heard from client 6eaa78d0-b61e-775d-3f32-c237d4a77eb7 (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9fcae5ac2800, cur 1544785242 expire 1544785092 last 1544785015
[15215.564940] Lustre: Skipped 4 previous similar messages
[15234.916794] Lustre: 31685:0:(mdd_device.c:1808:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1
[15271.441192] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[15271.452657] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 2 previous similar messages
[15321.440820] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[15422.440064] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds
[15422.451534] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[15451.670956] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.110@o2ib, removing former export from 192.168.1.111@o2ib
[15451.684194] Lustre: Skipped 1 previous similar message
[15451.690144] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[15451.700491] Lustre: Skipped 1 previous similar message
[15511.584183] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[15511.595672] Lustre: Skipped 1 previous similar message
[15521.621602] LustreError: 11-0: soaked-MDT0003-osp-MDT0000: operation mds_statfs to node 192.168.1.110@o2ib failed: rc = -107
[15521.634141] Lustre: soaked-MDT0003-osp-MDT0000: Connection to soaked-MDT0003 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[15707.369657] Lustre: soaked-MDT0003-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib)
[15707.381177] Lustre: Skipped 3 previous similar messages
[16820.438035] perf: interrupt took too long (2505 > 2500), lowering kernel.perf_event_max_sample_rate to 79000
[18264.423099] LNetError: 28111:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds
[18264.434489] LNetError: 28111:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 192.168.1.109@o2ib (8): c: 6, oc: 0, rc: 8
[18264.448319] Lustre: 28143:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1544788285/real 1544788290]  req@ffff9fca58294500 x1619809062185536/t0(0) o41->soaked-MDT0001-osp-MDT0000@192.168.1.109@o2ib:24/4 lens 224/368 e 0 to 1 dl 1544788337 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
[18264.480696] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete
[18289.525341] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[18289.543862] LustreError: Skipped 15 previous similar messages
[18323.349548] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.135@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[18323.369403] LustreError: Skipped 37 previous similar messages
[18389.876788] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
[18389.895254] LustreError: Skipped 47 previous similar messages
[18440.504960] scsi_io_completion: 1 callbacks suppressed
[18440.510727] sd 6:0:1:1: [sdd] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[18440.519385] sd 6:0:1:1: [sdd] Sense Key : Illegal Request [current] 
[18440.526488] sd 6:0:1:1: [sdd] <<vendor>>ASC=0x94 ASCQ=0x1 
[18440.532624] sd 6:0:1:1: [sdd] CDB: Write(16) 8a 00 00 00 00 00 00 9b e2 98 00 00 02 60 00 00
[18440.542046] blk_update_request: 1 callbacks suppressed
[18440.547783] blk_update_request: I/O error, dev sdd, sector 10216088
[18440.555111] device-mapper: multipath: Failing path 8:48.
[18443.445653] sd 6:0:0:1: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[18443.454325] sd 6:0:0:1: [sde] Sense Key : Illegal Request [current] 
[18443.461427] sd 6:0:0:1: [sde] <<vendor>>ASC=0x94 ASCQ=0x1 
[18443.467578] sd 6:0:0:1: [sde] CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00
[18443.477003] blk_update_request: I/O error, dev sde, sector 11608952
[18443.484022] device-mapper: multipath: Failing path 8:64.
[18445.129969] device-mapper: multipath: Reinstating path 8:48.
[18448.137301] device-mapper: multipath: Reinstating path 8:64.
[18476.473668] Lustre: MGS: haven't heard from client 8e54524b-a52c-7091-0e06-f2d4a89dd59c (at 192.168.1.109@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9fcae4159400, cur 1544788503 expire 1544788353 last 1544788276
[18520.421813] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds
[18520.433290] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message
[18521.243163] LustreError: 137-5: soaked-MDT0001_UUID: not available for connect from 192.168.1.126@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server.
[18521.263041] LustreError: Skipped 122 previous similar messages
[18571.421594] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 1 seconds
[18620.421324] LNet: 28111:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds
[18703.424361] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib)
[18704.407564] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.109@o2ib, removing former export from same NID
[18737.363675] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID
[18737.376324] Lustre: Skipped 1 previous similar message
[18737.382130] Lustre: soaked-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib)
[18737.392457] Lustre: Skipped 2 previous similar messages
[18737.423007] LustreError: 31941:0:(osd_oi.c:761:osd_oi_insert()) dm-2: the FID [0x20000c768:0x179ce:0x0] is used by two objects: 402128901/3006680378 357564421/3006680381
[18737.440029] LNet: 28116:0:(o2iblnd_cb.c:408:kiblnd_handle_rx()) PUT_NACK from 192.168.1.110@o2ib
[18741.123580] LustreError: 167-0: soaked-MDT0001-osp-MDT0000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail.
[18753.014392] BUG: unable to handle kernel NULL pointer dereference at           (null)
[18753.023170] IP: [<          (null)>]           (null)
[18753.028819] PGD 0 
[18753.031075] Oops: 0010 [#1] SMP 
[18753.034700] Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) fid(OE) fld(OE) ko2iblnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) mlx5_ib(OE) ib_uverbs(OE) mlx5_core(OE) mlxfw(OE) mlx4_en(OE) mlx4_ib(OE) ib_core(OE) dm_round_robin sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm iTCO_wdt irqbypass iTCO_vendor_support sg crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr ipmi_ssif mei_me mei lpc_ich wmi i2c_i801 ioatdma ipmi_si ipmi_devintf ipmi_msghandler dm_multipath dm_mod auth_rpcgss sunrpc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic mgag200 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops isci igb ttm mpt2sas ahci crct10dif_pclmul crct10dif_common libsas libahci crc32c_intel ptp drm mlx4_core(OE) raid_class libata pps_core drm_panel_orientation_quirks scsi_transport_sas mlx_compat(OE) dca devlink i2c_algo_bit
[18753.146014] CPU: 0 PID: 43000 Comm: mdt_out00_019 Kdump: loaded Tainted: G           OE  ------------   3.10.0-957.el7_lustre.x86_64 #1
[18753.159604] Hardware name: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[18753.172121] task: ffff9fcf2591e180 ti: ffff9fcad0a8c000 task.ti: ffff9fcad0a8c000
[18753.180476] RIP: 0010:[<0000000000000000>]  [<          (null)>]           (null)
[18753.188859] RSP: 0018:ffff9fcad0a8fb60  EFLAGS: 00010246
[18753.194788] RAX: 0000000000000000 RBX: ffff9fc7a8190000 RCX: 0000000000000002
[18753.202754] RDX: ffffffffc12dc770 RSI: ffff9fcad0a8fb68 RDI: ffff9fc7a8190008
[18753.210718] RBP: ffff9fcad0a8fba0 R08: 0000000000000004 R09: 0000000000000000
[18753.218682] R10: 0000000000000001 R11: 00000000007fffff R12: ffff9fc736087300
[18753.226645] R13: ffff9fcb00494c48 R14: ffff9fcefba3a200 R15: ffff9fc7a8190008
[18753.234611] FS:  0000000000000000(0000) GS:ffff9fcb2e000000(0000) knlGS:0000000000000000
[18753.243647] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[18753.250052] CR2: 0000000000000000 CR3: 0000000551a10000 CR4: 00000000000607f0
[18753.258016] Call Trace:
[18753.260766]  [<ffffffffc12dabee>] ? osd_ldiskfs_it_fill+0xbe/0x260 [osd_ldiskfs]
[18753.269028]  [<ffffffffc12dadc7>] osd_it_ea_load+0x37/0x100 [osd_ldiskfs]
[18753.276640]  [<ffffffffc0e84038>] dt_index_walk+0xf8/0x430 [obdclass]
[18753.283850]  [<ffffffffc0e84370>] ? dt_index_walk+0x430/0x430 [obdclass]
[18753.291350]  [<ffffffffc0e85444>] dt_index_read+0x394/0x6a0 [obdclass]
[18753.298701]  [<ffffffffc10ceb32>] tgt_obd_idx_read+0x612/0x860 [ptlrpc]
[18753.306117]  [<ffffffffc10d135a>] tgt_request_handle+0xaea/0x1580 [ptlrpc]
[18753.313825]  [<ffffffffc10aaa51>] ? ptlrpc_nrs_req_get_nolock0+0xd1/0x170 [ptlrpc]
[18753.322284]  [<ffffffffc0bdebde>] ? ktime_get_real_seconds+0xe/0x10 [libcfs]
[18753.330186]  [<ffffffffc107592b>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
[18753.338795]  [<ffffffffc10727b5>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc]
[18753.346380]  [<ffffffff9fcd67c2>] ? default_wake_function+0x12/0x20
[18753.353379]  [<ffffffff9fccba9b>] ? __wake_up_common+0x5b/0x90
[18753.359934]  [<ffffffffc107925c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc]
[18753.366951]  [<ffffffffc1078760>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc]
[18753.375209]  [<ffffffff9fcc1c31>] kthread+0xd1/0xe0
[18753.380662]  [<ffffffff9fcc1b60>] ? insert_kthread_work+0x40/0x40
[18753.387480]  [<ffffffffa0374c37>] ret_from_fork_nospec_begin+0x21/0x21
[18753.394766]  [<ffffffff9fcc1b60>] ? insert_kthread_work+0x40/0x40
[18753.401564] Code:  Bad RIP value.
[18753.405279] RIP  [<          (null)>]           (null)
[18753.411023]  RSP <ffff9fcad0a8fb60>
[18753.414916] CR2: 0000000000000000
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.el7_lustre.x86_64 (jenkins@trevis-309-el7-x8664-2.trevis.whamcloud.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Sat Dec 8 05:53:16 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 ro console=ttyS0,115200 irqpoll nr_cpus=1 reset_devices cgroup_disable=memory mce=off numa=off udev.children-max=2 panic=10 rootflags=nofail acpi_no_memhotplug transparent_hugepage=never nokaslr disable_cpu_apicid=0 elfcorehdr=869816K
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x0000000000000fff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000001000-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000002b000000-0x000000003516dfff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013
[    0.000000] e820: last_pfn = 0x3516e max_arch_pfn = 0x400000000
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffffffffff200d70]
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x32252000-0x339fffff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
[    0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672)
[    0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
[    0.000000] ACPI: FACS 00000000bdfa9f40 00040
[    0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
[    0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
[    0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
[    0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
[    0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
[    0.000000] NUMA turned off
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000003516dfff]
[    0.000000] NODE_DATA(0) allocated [mem 0x35147000-0x3516dfff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0008efff]
[    0.000000]   node   0: [mem 0x2b000000-0x3516dfff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x3516dfff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 1/0x2 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 2/0x4 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 3/0x6 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 4/0x8 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 5/0xa ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 6/0xc ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 7/0xe ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 8/0x20 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 9/0x22 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 10/0x24 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 11/0x26 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 12/0x28 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 13/0x2a ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 14/0x2c ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 15/0x2e ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 16/0x1 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 17/0x3 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 18/0x5 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 19/0x7 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 20/0x9 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 21/0xb ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 22/0xd ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 23/0xf ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 24/0x21 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 25/0x23 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 26/0x25 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 27/0x27 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 28/0x29 ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 29/0x2b ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 30/0x2d ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
[    0.000000] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 31/0x2f ignored.
[    0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
[    0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
[    0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
[    0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
[    0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: 240 Processors exceeds NR_CPUS limit of 1
[    0.000000] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x00100000-0x2affffff]
[    0.000000] e820: [mem 0x3516e000-0xbb3c6fff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1
[    0.000000] PERCPU: Embedded 38 pages/cpu @ffff880034e00000 s118784 r8192 d28672 u2097152
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 40798
[    0.000000] Policy zone: DMA32
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7_lustre.x86_64 ro console=ttyS0,115200 irqpoll nr_cpus=1 reset_devices cgroup_disable=memory mce=off numa=off udev.children-max=2 panic=10 rootflags=nofail acpi_no_memhotplug transparent_hugepage=never nokaslr disable_cpu_apicid=0 elfcorehdr=869816K
[    0.000000] Misrouted IRQ fixup and polling support enabled
[    0.000000] This may significantly impact system performance
[    0.000000] Disabling memory control group subsystem
[    0.000000] PID hash table entries: 1024 (order: 1, 8192 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 116044k/869816k available (7664k kernel code, 703944k absent, 49828k reserved, 6055k data, 1876k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=1.
[    0.000000] NR_IRQS:327936 nr_irqs:256 0
[    0.000000] Spurious LAPIC timer interrupt on cpu 0
[    0.000000] do_IRQ: 0.147 No irq handler for vector (irq -1)
[    0.000000] Console: colour dummy device 80x25
[    0.000000] console [ttyS0] enabled
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2693.599 MHz processor
[    0.000035] Calibrating delay loop (skipped), value calculated using timer frequency.. 5387.19 BogoMIPS (lpj=2693599)
[    0.011922] pid_max: default: 32768 minimum: 301
[    0.017105] Security Framework initialized
[    0.021698] SELinux:  Initializing.
[    0.025608] Yama: becoming mindful.
[    0.029555] Dentry cache hash table entries: 32768 (order: 6, 262144 bytes)
[    0.037398] Inode-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.045111] Mount-cache hash table entries: 512 (order: 0, 4096 bytes)
[    0.052405] Mountpoint-cache hash table entries: 512 (order: 0, 4096 bytes)
[    0.060337] Initializing cgroup subsys memory
[    0.065218] Initializing cgroup subsys devices
[    0.070192] Initializing cgroup subsys freezer
[    0.075165] Initializing cgroup subsys net_cls
[    0.080138] Initializing cgroup subsys blkio
[    0.084913] Initializing cgroup subsys perf_event
[    0.090177] Initializing cgroup subsys hugetlb
[    0.095152] Initializing cgroup subsys pids
[    0.099829] Initializing cgroup subsys net_prio
[    0.104924] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[    0.111055] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[    0.117379] tlb_flushall_shift: 6
[    0.121098] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.131814] FEATURE SPEC_CTRL Present
[    0.135914] FEATURE IBPB_SUPPORT Present
[    0.140436] Spectre V2 : Mitigation: Full retpoline
[    0.160051] Freeing SMP alternatives: 28k freed
[    0.167941] ACPI: Core revision 20130517
[    0.210928] ACPI: All ACPI Tables successfully acquired
[    0.216838] ftrace: allocating 29187 entries in 115 pages
[    0.248028] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[    0.256032] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.272748] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07)
[    0.283212] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Broken BIOS detected, complain to your hardware vendor.
[    0.298658] [Firmware Bug]: the BIOS has corrupted hw-PMU resources (MSR 38d is b0)
[    0.307209] Intel PMU driver.
[    0.310533] ... version:                3
[    0.315007] ... bit width:              48
[    0.319577] ... generic registers:      4
[    0.324048] ... value mask:             0000ffffffffffff
[    0.329981] ... max period:             00007fffffffffff
[    0.335908] ... fixed-purpose events:   3
[    0.340379] ... event mask:             000000070000000f
[    0.347549] Brought up 1 CPUs
[    0.350868] smpboot: Max logical packages: 1
[    0.355637] smpboot: Total of 1 processors activated (5387.19 BogoMIPS)
[    0.363054] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.374769] devtmpfs: initialized
[    0.381539] EVM: security.selinux
[    0.385234] EVM: security.ima
[    0.388549] EVM: security.capability
[    0.392635] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes)
[    0.401481] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes)
[    0.411540] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    0.419224] pinctrl core: initialized pinctrl subsystem
[    0.425105] RTC time: 11:59:43, date: 12/14/18
[    0.430152] NET: Registered protocol family 16
[    0.435373] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    0.443838] ACPI: bus type PCI registered
[    0.448317] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.455566] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000)
[    0.465962] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820
[    0.473558] PCI: Using configuration type 1 for base access
[    0.479870] core: PMU erratum BJ122, BV98, HSD29 workaround disabled, HT off
[    0.487786] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.497925] ACPI: Added _OSI(Module Device)
[    0.502600] ACPI: Added _OSI(Processor Device)
[    0.507558] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.512819] ACPI: Added _OSI(Processor Aggregator Device)
[    0.518853] ACPI: Added _OSI(Linux-Dell-Video)
[    0.538221] ACPI: Executed 1 blocks of module-level executable AML code
[    0.667613] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    0.682718] ACPI: Interpreter enabled
[    0.686826] ACPI: (supports S0 S1 S5)
[    0.690919] ACPI: Using IOAPIC for interrupt routing
[    0.696517] HEST: Table parsing has been initialized.
[    0.702169] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.712411] ACPI: GPE 0x1E active on init
[    0.716917] ACPI: Enabled 9 GPEs in block 00 to 3F
[    0.746617] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    0.753529] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.762913] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER]
[    0.771172] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    0.779719] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    0.788996] acpi PNP0A08:00: host bridge window expanded to [io  0x0000-0xbfff]; [io  0x0000-0xbfff window] ignored
[    0.800638] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff])
[    0.815494] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
[    0.830525] PCI host bridge to bus 0000:00
[    0.835104] pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
[    0.842009] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.850361] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window]
[    0.858719] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    0.867076] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window]
[    0.875436] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window]
[    0.883795] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    0.892154] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    0.900514] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    0.908872] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    0.917223] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window]
[    0.925576] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window]
[    0.933936] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window]
[    0.942287] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window]
[    0.950639] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window]
[    0.959775] pci_bus 0000:00: root bus resource [bus 00-7e]
[    0.966203] pci 0000:00:01.0: System wakeup disabled by ACPI
[    0.972698] pci 0000:00:01.1: System wakeup disabled by ACPI
[    0.979196] pci 0000:00:02.0: System wakeup disabled by ACPI
[    0.985685] pci 0000:00:02.2: System wakeup disabled by ACPI
[    0.992182] pci 0000:00:03.0: System wakeup disabled by ACPI
[    1.000637] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    1.007178] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    1.013664] pci 0000:00:1c.7: System wakeup disabled by ACPI
[    1.020171] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    1.026606] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    1.033446] pci 0000:00:01.0: PCI bridge to [bus 01]
[    1.039076] acpiphp: Slot [2] registered
[    1.043639] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs)
[    1.053962] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs)
[    1.064486] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs)
[    1.074803] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs)
[    1.085332] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs)
[    1.095648] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs)
[    1.106167] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs)
[    1.116475] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs)
[    1.128803] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    1.134755] acpiphp: Slot [2-2] registered
[    1.141372] pci 0000:00:02.0: PCI bridge to [bus 04]
[    1.147016] acpiphp: Slot [2-3] registered
[    1.151603] pci 0000:00:02.2: PCI bridge to [bus 05]
[    1.157226] acpiphp: Slot [2-4] registered
[    1.161974] pci 0000:00:03.0: PCI bridge to [bus 06]
[    1.167771] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x38007fc10000-0x38007fc8bfff 64bit pref] (contains BAR0 for 31 VFs)
[    1.180403] pci 0000:00:11.0: PCI bridge to [bus 07]
[    1.186022] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    1.191888] pci 0000:09:00.0: System wakeup disabled by ACPI
[    1.198247] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    1.203865] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    1.212079] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15), disabled.
[    1.220999] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15), disabled.
[    1.229892] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15), disabled.
[    1.238793] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15), disabled.
[    1.247703] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15), disabled.
[    1.256596] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15), disabled.
[    1.265503] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15), disabled.
[    1.274397] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15), disabled.
[    1.283405] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    1.290306] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.299554] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER]
[    1.307727] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.316273] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.325588] PCI host bridge to bus 0000:80
[    1.330162] pci_bus 0000:80: root bus resource [io  0x03b0-0x03df window]
[    1.337737] pci_bus 0000:80: root bus resource [io  0xc000-0xffff window]
[    1.345313] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.353666] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window]
[    1.362017] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window]
[    1.371158] pci_bus 0000:80: root bus resource [bus 80-fe]
[    1.377421] pci 0000:80:01.0: System wakeup disabled by ACPI
[    1.383909] pci 0000:80:02.0: System wakeup disabled by ACPI
[    1.390393] pci 0000:80:03.0: System wakeup disabled by ACPI
[    1.396882] pci 0000:80:03.2: System wakeup disabled by ACPI
[    1.404638] pci 0000:80:01.0: PCI bridge to [bus 81]
[    1.410219] pci 0000:80:02.0: PCI bridge to [bus 82]
[    1.415824] pci 0000:80:03.0: PCI bridge to [bus 83]
[    1.421423] pci 0000:80:03.2: PCI bridge to [bus 84]
[    1.427369] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 240/0x1 ignored.
[    1.436309] ACPI: Unable to map lapic to logical cpu number
[    1.442696] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 241/0x2 ignored.
[    1.451630] ACPI: Unable to map lapic to logical cpu number
[    1.457999] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 242/0x3 ignored.
[    1.466932] ACPI: Unable to map lapic to logical cpu number
[    1.473302] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 243/0x4 ignored.
[    1.482236] ACPI: Unable to map lapic to logical cpu number
[    1.488613] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 244/0x5 ignored.
[    1.497546] ACPI: Unable to map lapic to logical cpu number
[    1.503924] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 245/0x6 ignored.
[    1.512856] ACPI: Unable to map lapic to logical cpu number
[    1.519229] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 246/0x7 ignored.
[    1.528161] ACPI: Unable to map lapic to logical cpu number
[    1.534537] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 247/0x8 ignored.
[    1.543471] ACPI: Unable to map lapic to logical cpu number
[    1.549841] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 248/0x9 ignored.
[    1.558774] ACPI: Unable to map lapic to logical cpu number
[    1.565153] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 249/0xa ignored.
[    1.574085] ACPI: Unable to map lapic to logical cpu number
[    1.580461] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 250/0xb ignored.
[    1.589393] ACPI: Unable to map lapic to logical cpu number
[    1.595768] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 251/0xc ignored.
[    1.604700] ACPI: Unable to map lapic to logical cpu number
[    1.611075] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 252/0xd ignored.
[    1.620009] ACPI: Unable to map lapic to logical cpu number
[    1.626394] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 253/0xe ignored.
[    1.635318] ACPI: Unable to map lapic to logical cpu number
[    1.641692] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 254/0xf ignored.
[    1.650617] ACPI: Unable to map lapic to logical cpu number
[    1.657470] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 255/0x20 ignored.
[    1.666492] ACPI: Unable to map lapic to logical cpu number
[    1.672861] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 256/0x21 ignored.
[    1.681893] ACPI: Unable to map lapic to logical cpu number
[    1.688279] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 257/0x22 ignored.
[    1.697308] ACPI: Unable to map lapic to logical cpu number
[    1.703685] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 258/0x23 ignored.
[    1.712706] ACPI: Unable to map lapic to logical cpu number
[    1.719083] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 259/0x24 ignored.
[    1.728120] ACPI: Unable to map lapic to logical cpu number
[    1.734496] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 260/0x25 ignored.
[    1.743526] ACPI: Unable to map lapic to logical cpu number
[    1.749912] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 261/0x26 ignored.
[    1.758947] ACPI: Unable to map lapic to logical cpu number
[    1.765323] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 262/0x27 ignored.
[    1.774354] ACPI: Unable to map lapic to logical cpu number
[    1.780737] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 263/0x28 ignored.
[    1.789768] ACPI: Unable to map lapic to logical cpu number
[    1.796137] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 264/0x29 ignored.
[    1.805167] ACPI: Unable to map lapic to logical cpu number
[    1.811565] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 265/0x2a ignored.
[    1.820597] ACPI: Unable to map lapic to logical cpu number
[    1.826973] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 266/0x2b ignored.
[    1.836003] ACPI: Unable to map lapic to logical cpu number
[    1.842372] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 267/0x2c ignored.
[    1.851403] ACPI: Unable to map lapic to logical cpu number
[    1.857772] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 268/0x2d ignored.
[    1.866804] ACPI: Unable to map lapic to logical cpu number
[    1.873182] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 269/0x2e ignored.
[    1.882211] ACPI: Unable to map lapic to logical cpu number
[    1.888583] ACPI: NR_CPUS/possible_cpus limit of 1 reached.  Processor 270/0x2f ignored.
[    1.897613] ACPI: Unable to map lapic to logical cpu number
[    1.904352] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
[    1.910960] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.920119] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    1.929760] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability]
[    1.936761] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.945950] PCI host bridge to bus 0000:7f
[    1.950522] pci_bus 0000:7f: root bus resource [bus 7f]
[    1.958494] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
[    1.965103] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    1.974255] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug SHPCHotplug PME AER]
[    1.983896] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability]
[    1.990894] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.000082] PCI host bridge to bus 0000:ff
[    2.004653] pci_bus 0000:ff: root bus resource [bus ff]
[    2.013074] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
[    2.022110] vgaarb: loaded
[    2.025128] vgaarb: bridge control possible 0000:09:00.0
[    2.031133] SCSI subsystem initialized
[    2.035348] ACPI: bus type USB registered
[    2.039849] usbcore: registered new interface driver usbfs
[    2.045994] usbcore: registered new interface driver hub
[    2.051937] usbcore: registered new device driver usb
[    2.057641] EDAC MC: Ver: 3.0.0
[    2.061442] PCI: Using ACPI for IRQ routing
[    2.070751] NetLabel: Initializing
[    2.074548] NetLabel:  domain hash size = 128
[    2.079413] NetLabel:  protocols = UNLABELED CIPSOv4
[    2.084983] NetLabel:  unlabeled traffic allowed by default
[    2.091310] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.098303] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.106834] amd_nb: Cannot enumerate AMD northbridges
[    2.112485] Switched to clocksource hpet
[    2.121192] pnp: PnP ACPI init
[    2.124625] ACPI: bus type PNP registered
[    2.129229] system 00:00: [io  0x0680-0x069f] has been reserved
[    2.135848] system 00:00: [io  0xffff] has been reserved
[    2.141786] system 00:00: [io  0xffff] has been reserved
[    2.147717] system 00:00: [io  0xffff] has been reserved
[    2.153647] system 00:00: [io  0x0400-0x0453] could not be reserved
[    2.160651] system 00:00: [io  0x0458-0x047f] has been reserved
[    2.167266] system 00:00: [io  0x0500-0x057f] has been reserved
[    2.173881] system 00:00: [io  0x0600-0x061f] has been reserved
[    2.180495] system 00:00: [io  0x0ca2-0x0ca5] could not be reserved
[    2.187493] system 00:00: [io  0x0cf9] could not be reserved
[    2.193907] system 00:02: [io  0x0454-0x0457] has been reserved
[    2.201213] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    2.208609] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved
[    2.216001] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved
[    2.223393] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[    2.230778] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[    2.238169] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[    2.245946] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[    2.253724] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved
[    2.261501] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved
[    2.269116] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved
[    2.277136] pnp: PnP ACPI: found 7 devices
[    2.281710] ACPI: bus type PNP unregistered
[    2.292365] pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.297924] pci 0000:00:01.1: PCI bridge to [bus 02-03]
[    2.303759] pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
[    2.310565] pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
[    2.318148] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.323704] pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
[    2.331290] pci 0000:00:02.0:   bridge window [mem 0x38007f000000-0x38007f7fffff 64bit pref]
[    2.340720] pci 0000:00:02.2: PCI bridge to [bus 05]
[    2.346275] pci 0000:00:03.0: PCI bridge to [bus 06]
[    2.351824] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.358627] pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
[    2.366210] pci 0000:00:11.0: PCI bridge to [bus 07]
[    2.371753] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    2.378558] pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
[    2.386142] pci 0000:00:11.0:   bridge window [mem 0x38007f800000-0x38007fcfffff 64bit pref]
[    2.395572] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    2.401129] pci 0000:00:1c.7: PCI bridge to [bus 09]
[    2.406674] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
[    2.414255] pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
[    2.422907] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    2.428572] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.434129] pci 0000:80:02.0: PCI bridge to [bus 82]
[    2.439679] pci 0000:80:03.0: PCI bridge to [bus 83]
[    2.445228] pci 0000:80:03.2: PCI bridge to [bus 84]
[    2.450830] NET: Registered protocol family 2
[    2.455842] TCP established hash table entries: 2048 (order: 2, 16384 bytes)
[    2.463727] TCP bind hash table entries: 2048 (order: 3, 32768 bytes)
[    2.470929] TCP: Hash tables configured (established 2048 bind 2048)
[    2.478046] TCP: reno registered
[    2.481658] UDP hash table entries: 256 (order: 1, 8192 bytes)
[    2.488177] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[    2.495212] NET: Registered protocol family 1
[    2.500681] Unpacking initramfs...
[    2.850521] Freeing initrd memory: 24248k freed
[    2.861254] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    2.870120] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    2.876549] RAPL PMU: hw unit of domain package 2^-16 Joules
[    2.882873] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    2.889034] snbep_uncore: probe of 0000:ff:0e.1 failed with error -22
[    2.896250] snbep_uncore: probe of 0000:ff:10.0 failed with error -22
[    2.903452] snbep_uncore: probe of 0000:ff:10.1 failed with error -22
[    2.910653] snbep_uncore: probe of 0000:ff:10.4 failed with error -22
[    2.917854] snbep_uncore: probe of 0000:ff:10.5 failed with error -22
[    2.925053] snbep_uncore: probe of 0000:ff:13.1 failed with error -22
[    2.932244] snbep_uncore: probe of 0000:ff:13.5 failed with error -22
[    2.939433] snbep_uncore: probe of 0000:ff:13.6 failed with error -22
[    2.946898] sha1_ssse3: Using AVX optimized SHA-1 implementation
[    2.953669] sha256_ssse3: Using AVX optimized SHA-256 implementation
[    2.960990] futex hash table entries: 256 (order: 2, 16384 bytes)
[    2.967816] Initialise system trusted keyring
[    2.972715] audit: initializing netlink socket (disabled)
[    2.978766] type=2000 audit(1544788781.439:1): initialized
[    3.009531] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    3.016630] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    3.024978] zpool: loaded
[    3.027923] zbud: loaded
[    3.031013] VFS: Disk quotas dquot_6.6.0
[    3.035434] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    3.043001] msgmni has been set to 274
[    3.047245] Key type big_key registered
[    3.051961] NET: Registered protocol family 38
[    3.056945] Key type asymmetric registered
[    3.061538] Asymmetric key parser 'x509' registered
[    3.067021] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    3.075305] io scheduler noop registered
[    3.079701] io scheduler deadline registered (default)
[    3.085471] io scheduler cfq registered
[    3.089761] io scheduler mq-deadline registered
[    3.094827] io scheduler kyber registered
[    3.101374] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    3.109175] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt
[    3.116956] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[    3.124252] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt
[    3.131547] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt
[    3.138840] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt
[    3.146146] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[    3.153925] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt
[    3.161236] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[    3.169040] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt
[    3.176821] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt
[    3.184134] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt
[    3.191920] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt
[    3.199212] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt
[    3.206532] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    3.214330] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt
[    3.222099] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt
[    3.229427] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt
[    3.237233] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt
[    3.245038] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt
[    3.252831] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt
[    3.260649] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    3.266884] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    3.274302] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    3.282004] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    3.290280] ACPI: Power Button [PWRF]
[    3.294414] ACPI: Requesting acpi_cpufreq
[    3.300114] ERST: Error Record Serialization Table (ERST) support is initialized.
[    3.308488] pstore: Registered erst as persistent store backend
[    3.315281] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    3.323631] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    3.351295] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    3.378192] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[    3.384875] Non-volatile memory driver v1.3
[    3.389583] Linux agpgart interface v0.103
[    3.394330] crash memory driver: version 1.1
[    3.399189] rdac: device handler registered
[    3.403885] hp_sw: device handler registered
[    3.408670] emc: device handler registered
[    3.413260] alua: device handler registered
[    3.417982] libphy: Fixed MDIO Bus: probed
[    3.422602] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    3.429900] ehci-pci: EHCI PCI platform driver
[    3.434997] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    3.440877] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    3.449159] ehci-pci 0000:00:1a.0: debug port 2
[    3.458128] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000
[    3.470465] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    3.476931] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    3.484510] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.492578] usb usb1: Product: EHCI Host Controller
[    3.498030] usb usb1: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    3.506191] usb usb1: SerialNumber: 0000:00:1a.0
[    3.511465] hub 1-0:1.0: USB hub found
[    3.515672] hub 1-0:1.0: 2 ports detected
[    3.520349] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    3.526240] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    3.534516] ehci-pci 0000:00:1d.0: debug port 2
[    3.543513] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000
[    3.555461] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    3.561914] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    3.569497] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.577566] usb usb2: Product: EHCI Host Controller
[    3.583017] usb usb2: Manufacturer: Linux 3.10.0-957.el7_lustre.x86_64 ehci_hcd
[    3.591182] usb usb2: SerialNumber: 0000:00:1d.0
[    3.596424] hub 2-0:1.0: USB hub found
[    3.600633] hub 2-0:1.0: 2 ports detected
[    3.605216] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    3.612139] ohci-pci: OHCI PCI platform driver
[    3.617114] uhci_hcd: USB Universal Host Controller Interface driver
[    3.624302] usbcore: registered new interface driver usbserial_generic
[    3.631605] usbserial: USB Serial support registered for generic
[    3.638350] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    4.682794] i8042: No controller found
[    4.687030] mousedev: PS/2 mouse device common for all mice
[    4.693347] rtc_cmos 00:01: RTC can wake from S4
[    4.698645] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    4.705498] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    4.714118] intel_pstate: Intel P-state driver initializing
[    4.720509] cpuidle: using governor menu
[    4.725553] hidraw: raw HID events driver (C) Jiri Kosina
[    4.731715] usbcore: registered new interface driver usbhid
[    4.737954] usbhid: USB HID core driver
[    4.742326] drop_monitor: Initializing network drop monitor service
[    4.749408] TCP: cubic registered
[    4.753118] Initializing XFRM netlink socket
[    4.757998] NET: Registered protocol family 10
[    4.763135] NET: Registered protocol family 17
[    4.768119] mpls_gso: MPLS GSO support
[    4.772321] mce: Unable to init device /dev/mcelog (rc: -5)
[    4.778642] microcode: sig=0x206d7, pf=0x1, revision=0x714
[    4.784812] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    4.794740] Loading compiled-in X.509 certificates
[    4.800621] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80'
[    4.814041] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8'
[    4.826413] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: d73e894149b8945b8dc07cc18b4508db322683f2'
[    4.838277] registered taskstats version 1
[    4.843056] Key type trusted registered
[    4.847467] Key type encrypted registered
[    4.851993] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[    4.859721]   Magic number: 14:696:984
[    4.864060] rtc_cmos 00:01: setting system clock to 2018-12-14 11:59:48 UTC (1544788788)
[    4.873981] Freeing unused kernel memory: 1876k freed
[    4.880076] Write protecting the kernel read-only data: 12288k
[    4.887878] Freeing unused kernel memory: 516k freed
[    4.894828] Freeing unused kernel memory: 600k freed
[    4.903456] random: systemd: uninitialized urandom read (16 bytes read)
[    4.911340] random: systemd: uninitialized urandom read (16 bytes read)
[    4.919443] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    4.939705] systemd[1]: Detected architecture x86-64.
[    4.945366] systemd[1]: Running in initial RAM disk.

Welcome to [0[    4.951135] tsc: Refined TSC clocksource calibration: 2693.509 MHz
;34mCentOS Linux[    4.959592] Switched to clocksource tsc
 7 (Core) dracut-033-554.el7 (Initramfs)[0m!

[    4.971459] systemd[1]: Set hostname to <soak-8.spirit.whamcloud.com>.
[    4.979914] systemd[63]: Failed to execute /usr/lib/systemd/system-generators/dracut-rootfs-generator: No space left on device
[    4.993872] systemd[61]: /usr/lib/systemd/system-generators/dracut-rootfs-generator failed with error code 1.
[    5.005167] random: systemd: uninitialized urandom read (16 bytes read)
[    5.012586] random: systemd: uninitialized urandom read (16 bytes read)
[    5.020014] random: systemd: uninitialized urandom read (16 bytes read)
[    5.028282] random: systemd: uninitialized urandom read (16 bytes read)
[    5.035828] random: systemd: uninitialized urandom read (16 bytes read)
[    5.043568] random: systemd: uninitialized urandom read (16 bytes read)
[    5.051258] random: systemd: uninitialized urandom read (16 bytes read)
[    5.059111] random: systemd: uninitialized urandom read (16 bytes read)
[    5.069334] systemd[1]: Cannot add dependency job for unit network-online.target, ignoring: Unit not found.
[    5.080235] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    5.087742] systemd[1]: Reached target Timers.
[[32m  OK  [0m] Reached target Timers.
[    5.097441] systemd[1]: Reached target Local File Systems.
[[32m  OK  [0m] Reached target Local File Systems.
[    5.110477] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[[32m  OK  [0m] Started Dispatch Password Requests to Console Directory Watch.
[    5.129439] systemd[1]: Reached target Paths.
[[32m  OK  [0m] Reached target Paths.
[    5.139435] systemd[1]: Reached target Swap.
[[32m  OK  [0m] Reached target Swap.
[    5.149548] systemd[1]: Created slice Root Slice.
[[32m  OK  [0m] Created slice Root Slice.
[    5.161468] systemd[1]: Listening on udev Kernel Socket.
[[32m  OK  [0m] Listening on u[    5.170387] usb 2-1: new high-speed USB device number 2 using ehci-pci
dev Kernel Socket.
[    5.181480] systemd[1]: Listening on Journal Socket.
[[32m  OK  [0m] Listening on Journal Socket.
[    5.193464] systemd[1]: Listening on udev Control Socket.
[[32m  OK  [0m] Listening on udev Control Socket.
[    5.205449] systemd[1]: Reached target Sockets.
[    5.210617] random: fast init done
[[32m  OK  [0m] Reached target Sockets.
[    5.219499] systemd[1]: Created slice System Slice.
[[32m  OK  [0m[    5.225798] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
] Created slice [    5.234156] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
System Slice.
[    5.244075] hub 1-1:1.0: USB hub found
[    5.249424] hub 1-1:1.0: 6 ports detected
[    5.253958] systemd[1]: Reached target Slices.
[[32m  OK  [0m] Reached target Slices.
[    5.263869] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Starting Create list of required st... nodes for the current kernel...
[    5.285928] systemd[1]: Starting dracut cmdline hook...
         Starting dracut cmdline hook...
[    5.297817] systemd[1]: Starting Journal Service...
         Startin[    5.306796] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
g Journal Servic[    5.315631] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
e...
[    5.326804] systemd[1]: Starting Apply Kernel Variables...
[    5.339647] hub 2-1:1.0: USB hub found
         Starting Apply Kernel Variables...
[    5.348707] systemd[1]: kmod-static-nodes.service: main process exited, code=exited, status=203/EXEC
[    5.359399] hub 2-1:1.0: 8 ports detected
[    5.371558] systemd[1]: Failed to start Create list of required static device nodes for the current kernel.
[[1;31mFAILED[0m] Failed to start Create list of requ...ce nodes for the current kernel.
See 'systemctl status kmod-static-nodes.service' for details.
[    5.412422] systemd[1]: Unit kmod-static-nodes.service entered failed state.
[    5.420439] systemd[1]: kmod-static-nodes.service failed.
[    5.426647] systemd[1]: Started dracut cmdline hook.
[[32m  OK  [0m] Started dracut cmdline hook.
[    5.437612] systemd[1]: Started Apply Kernel Variables.
[[32m  OK  [0m] Started Apply Kernel Variables.
[    5.449549] systemd[1]: Started Journal Service.
[[32m  OK  [0m] Started Journal Service.
         Starting dracut pre-udev hook...
         Starting Create Static Device Nodes in /dev...
[[32m  OK  [0m] Started dracut pre-udev hook.
[[1;31mFAILED[0m] Failed to start Create Static Device Nodes in /dev.
See 'systemctl status systemd-tmpfiles-setup-dev.service' for details.
         Starting udev Kernel Device Manager...
[[32m  OK  [0m] Started udev Kernel Device Manager.
         Starting udev Coldplug all Devices...
[[1;31mFAILED[0m] Failed to start udev Coldplug all Devices.
See 'systemctl status systemd-udev-trigger.service' for details.
[[32m  OK  [0m] Reached target System Initialization.
[[32m  OK  [0m] Reached target Basic System.
         Starting dracut initqueue hook...
[[32m  OK  [0m] Started dracut initqueue hook.
[[32m  OK  [0m] Reached target Remote File Systems (Pre).
         Mounting /kdumproot/scra tch...
[[32m      Starting Reload Configuration from the Real Root...
[[1;31mFAILED[0m] Failed to mount /kdumproot/scratch.
See 'systemctl status kdumproot-scratch.mount' for details.
[[1;33mDEPEND[0m] Dependency failed for Remote File Systems.
[[1;31mFAILED[0m] Failed to start Reload Configuration from the Real Root.
See 'systemctl status initrd-parse-etc.service' for details.
[[32m  OK  [0m] Stopped dracut pre-udev hook.
[[32m  OK  [0m] Stopped dracut cmdline hook.
[    5.643371] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
[ [32m  OK  [0m[[32m  OK  [0m] Stopped target System Initialization.
         Starting Kdump Emergency...
[[32m  OK  [0m] Stopped dracut initqueue hook.
         Starting Setup Virtual Console...
[[32m  OK  [0m] Reached target Initrd File Systems.
[ [32m  OK  [0msole.
[[1;31mFAILED[0m] Failed to start Kdump Emergency.
See 'systemctl status emergency.service' for details.
[[1;33mDEPEND[0m] Dependency failed for Emergency Mode.
[    5.753156] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
[    5.760833] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    5.769002] usb 2-1.4: Product: Virtual Keyboard and Mouse
[    5.775134] usb 2-1.4: Manufacturer: American Megatrends Inc.
[    5.781557] usb 2-1.4: SerialNumber: serial
[    5.787953] input: American Megatrends Inc. Virtual Keyboard and Mouse as /dev ices/pci0000:000/input/input1
[    5.853772] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
[    5.871641] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2
[    5.886278] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1