Apr 7 03:55:09 warble1 kernel: Lustre: 143632:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply#012 req@ffff885e93a50450 x1594462407981744/t0(0) o35->02c65d3d-616e-a18f-3474-eecff1778104@192.168.44.14@o2ib44:729/0 lens 512/696 e 24 to 0 dl 1523037314 ref 2 fl Interpret:/0/0 rc 0/0 Apr 7 03:56:13 warble1 kernel: Lustre: 143632:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply#012 req@ffff88bd7a4de000 x1594462408051392/t0(0) o35->02c65d3d-616e-a18f-3474-eecff1778104@192.168.44.14@o2ib44:38/0 lens 512/696 e 8 to 0 dl 1523037378 ref 2 fl Interpret:/0/0 rc 0/0 Apr 7 03:58:05 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 03:58:05 warble1 kernel: Lustre: Skipped 3 previous similar messages Apr 7 03:58:05 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 03:58:05 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 03:59:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 03:59:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 03:59:08 warble1 pengine[13946]: notice: Calculated transition 3070, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 03:59:08 warble1 crmd[13947]: notice: Transition 3070 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 03:59:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 04:08:06 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 04:08:06 warble1 kernel: Lustre: Skipped 3 previous similar messages Apr 7 04:08:06 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 04:08:06 warble1 kernel: Lustre: Skipped 3 previous similar messages Apr 7 04:14:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 04:14:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 04:14:08 warble1 pengine[13946]: notice: Calculated transition 3071, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 04:14:08 warble1 crmd[13947]: notice: Transition 3071 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 04:14:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 04:18:07 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 04:18:07 warble1 kernel: Lustre: Skipped 3 previous similar messages Apr 7 04:18:07 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 04:18:07 warble1 kernel: Lustre: Skipped 3 previous similar messages Apr 7 04:28:08 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 04:28:08 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 04:28:08 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 04:28:08 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 04:29:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 04:29:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 04:29:08 warble1 pengine[13946]: notice: Calculated transition 3072, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 04:29:08 warble1 crmd[13947]: notice: Transition 3072 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 04:29:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 04:38:09 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 04:38:09 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 04:38:09 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 04:38:09 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 04:44:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 04:44:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 04:44:08 warble1 pengine[13946]: notice: Calculated transition 3073, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 04:44:08 warble1 crmd[13947]: notice: Transition 3073 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 04:44:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 04:48:11 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 04:48:11 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 04:48:11 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 04:48:11 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 04:58:12 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 04:58:12 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 04:58:12 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 04:58:12 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 04:59:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 04:59:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 04:59:08 warble1 pengine[13946]: notice: Calculated transition 3074, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 04:59:08 warble1 crmd[13947]: notice: Transition 3074 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 04:59:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 05:08:13 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 05:08:13 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 05:08:13 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 05:08:13 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 05:14:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 05:14:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 05:14:08 warble1 pengine[13946]: notice: Calculated transition 3075, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 05:14:08 warble1 crmd[13947]: notice: Transition 3075 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 05:14:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 05:18:14 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 05:18:14 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 05:18:14 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 05:18:14 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 05:28:15 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 05:28:15 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 05:28:15 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 05:28:15 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 05:29:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 05:29:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 05:29:08 warble1 pengine[13946]: notice: Calculated transition 3076, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 05:29:08 warble1 crmd[13947]: notice: Transition 3076 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 05:29:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 05:38:16 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 05:38:16 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 05:38:16 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 05:38:16 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 05:44:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 05:44:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 05:44:08 warble1 pengine[13946]: notice: Calculated transition 3077, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 05:44:08 warble1 crmd[13947]: notice: Transition 3077 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 05:44:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 05:48:17 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 05:48:17 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 05:48:17 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 05:48:17 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 05:58:18 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 05:58:18 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 05:58:18 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 05:58:18 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 05:59:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 05:59:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 05:59:08 warble1 pengine[13946]: notice: Calculated transition 3078, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 05:59:08 warble1 crmd[13947]: notice: Transition 3078 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 05:59:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 06:08:19 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 06:08:19 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 06:08:19 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 06:08:19 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 06:14:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 06:14:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 06:14:08 warble1 pengine[13946]: notice: Calculated transition 3079, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 06:14:08 warble1 crmd[13947]: notice: Transition 3079 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 06:14:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 06:18:20 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 06:18:20 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 06:18:20 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 06:18:20 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 06:28:21 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 06:28:21 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 06:28:21 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 06:28:21 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 06:29:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 06:29:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 06:29:08 warble1 pengine[13946]: notice: Calculated transition 3080, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 06:29:08 warble1 crmd[13947]: notice: Transition 3080 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 06:29:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 06:38:22 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 06:38:22 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 06:38:22 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 06:38:22 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 06:44:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 06:44:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 06:44:08 warble1 pengine[13946]: notice: Calculated transition 3081, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 06:44:08 warble1 crmd[13947]: notice: Transition 3081 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 06:44:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 06:48:23 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 06:48:23 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 06:48:23 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 06:48:23 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 06:58:24 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 06:58:24 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 06:58:24 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 06:58:24 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 06:59:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 06:59:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 06:59:08 warble1 pengine[13946]: notice: Calculated transition 3082, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 06:59:08 warble1 crmd[13947]: notice: Transition 3082 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 06:59:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 07:08:25 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 07:08:25 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 07:08:25 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 07:08:25 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 07:14:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 07:14:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 07:14:08 warble1 pengine[13946]: notice: Calculated transition 3083, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 07:14:08 warble1 crmd[13947]: notice: Transition 3083 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 07:14:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 07:18:26 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 07:18:26 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 07:18:26 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 07:18:26 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 07:28:27 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 07:28:27 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 07:28:27 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 07:28:27 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 07:29:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 07:29:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 07:29:08 warble1 pengine[13946]: notice: Calculated transition 3084, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 07:29:08 warble1 crmd[13947]: notice: Transition 3084 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 07:29:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 07:38:28 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 07:38:28 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 07:38:28 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 07:38:28 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 07:44:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 07:44:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 07:44:08 warble1 pengine[13946]: notice: Calculated transition 3085, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 07:44:08 warble1 crmd[13947]: notice: Transition 3085 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 07:44:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 07:48:29 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 07:48:29 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 07:48:29 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 07:48:29 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 07:58:30 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 07:58:30 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 07:58:30 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 07:58:30 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 07:59:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 07:59:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 07:59:08 warble1 pengine[13946]: notice: Calculated transition 3086, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 07:59:08 warble1 crmd[13947]: notice: Transition 3086 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 07:59:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 08:08:31 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 08:08:31 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 08:08:31 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 08:08:31 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 08:14:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 08:14:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 08:14:08 warble1 pengine[13946]: notice: Calculated transition 3087, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 08:14:08 warble1 crmd[13947]: notice: Transition 3087 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 08:14:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 08:18:32 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 08:18:32 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 08:18:32 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 08:18:32 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 08:28:33 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 08:28:33 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 08:28:33 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 08:28:33 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 08:29:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 08:29:08 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 08:29:08 warble1 pengine[13946]: notice: Calculated transition 3088, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 08:29:08 warble1 crmd[13947]: notice: Transition 3088 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 08:29:08 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 08:30:48 warble1 systemd: Starting Cleanup of Temporary Directories... Apr 7 08:30:48 warble1 systemd: Started Cleanup of Temporary Directories. Apr 7 08:38:34 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 08:38:34 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 08:38:34 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 08:38:34 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 08:44:08 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 08:44:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 08:44:09 warble1 pengine[13946]: notice: Calculated transition 3089, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 08:44:09 warble1 crmd[13947]: notice: Transition 3089 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 08:44:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 08:48:35 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 08:48:35 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 08:48:35 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 08:48:35 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 08:58:36 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 08:58:36 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 08:58:36 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 08:58:36 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 08:59:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 08:59:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 08:59:09 warble1 pengine[13946]: notice: Calculated transition 3090, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 08:59:09 warble1 crmd[13947]: notice: Transition 3090 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 08:59:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 09:08:37 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 09:08:37 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 09:08:37 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 09:08:38 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 09:14:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 09:14:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 09:14:09 warble1 pengine[13946]: notice: Calculated transition 3091, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 09:14:09 warble1 crmd[13947]: notice: Transition 3091 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 09:14:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 09:18:39 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 09:18:39 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 09:18:39 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 09:18:39 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 09:28:40 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 09:28:40 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 09:28:40 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 09:28:40 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 09:29:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 09:29:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 09:29:09 warble1 pengine[13946]: notice: Calculated transition 3092, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 09:29:09 warble1 crmd[13947]: notice: Transition 3092 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 09:29:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 09:38:41 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 09:38:41 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 09:38:41 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 09:38:41 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 09:44:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 09:44:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 09:44:09 warble1 pengine[13946]: notice: Calculated transition 3093, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 09:44:09 warble1 crmd[13947]: notice: Transition 3093 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 09:44:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 09:48:42 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 09:48:42 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 09:48:42 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 09:48:42 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 09:58:43 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 09:58:43 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 09:58:43 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 09:58:43 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 09:59:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 09:59:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 09:59:09 warble1 pengine[13946]: notice: Calculated transition 3094, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 09:59:09 warble1 crmd[13947]: notice: Transition 3094 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 09:59:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 10:08:44 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 10:08:44 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 10:08:44 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 10:08:44 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 10:14:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 10:14:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 10:14:09 warble1 pengine[13946]: notice: Calculated transition 3095, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 10:14:09 warble1 crmd[13947]: notice: Transition 3095 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 10:14:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 10:18:45 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 10:18:45 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 10:18:45 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 10:18:45 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 10:28:46 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 10:28:46 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 10:28:46 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 10:28:46 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 10:29:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 10:29:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 10:29:09 warble1 pengine[13946]: notice: Calculated transition 3096, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 10:29:09 warble1 crmd[13947]: notice: Transition 3096 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 10:29:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 10:38:47 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 10:38:47 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 10:38:47 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 10:38:47 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 10:44:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 10:44:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 10:44:09 warble1 pengine[13946]: notice: Calculated transition 3097, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 10:44:09 warble1 crmd[13947]: notice: Transition 3097 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 10:44:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 10:48:48 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 10:48:48 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 10:48:48 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 10:48:48 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 10:58:49 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 10:58:49 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 10:58:49 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 10:58:49 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 10:59:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 10:59:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 10:59:09 warble1 pengine[13946]: notice: Calculated transition 3098, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 10:59:09 warble1 crmd[13947]: notice: Transition 3098 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 10:59:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 11:08:50 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 11:08:50 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 11:08:50 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 11:08:50 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 11:14:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 11:14:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 11:14:09 warble1 pengine[13946]: notice: Calculated transition 3099, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 11:14:09 warble1 crmd[13947]: notice: Transition 3099 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 11:14:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 11:18:51 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 11:18:51 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 11:18:51 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 11:18:51 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 11:28:52 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 11:28:52 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 11:28:52 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 11:28:52 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 11:29:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 11:29:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 11:29:09 warble1 pengine[13946]: notice: Calculated transition 3100, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 11:29:09 warble1 crmd[13947]: notice: Transition 3100 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 11:29:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 11:38:53 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 11:38:53 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 11:38:53 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 11:38:53 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 11:41:00 warble2 systemd: Starting Cleanup of Temporary Directories... Apr 7 11:41:00 warble2 systemd: Started Cleanup of Temporary Directories. Apr 7 11:44:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 11:44:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 11:44:09 warble1 pengine[13946]: notice: Calculated transition 3101, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 11:44:09 warble1 crmd[13947]: notice: Transition 3101 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 11:44:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 11:48:54 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 11:48:54 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 11:48:54 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 11:48:54 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 11:58:55 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 11:58:55 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 11:58:55 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 11:58:55 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 11:59:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 11:59:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 11:59:09 warble1 pengine[13946]: notice: Calculated transition 3102, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 11:59:09 warble1 crmd[13947]: notice: Transition 3102 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 11:59:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 12:08:56 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 12:08:56 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 12:08:56 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 12:08:56 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 12:14:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 12:14:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 12:14:09 warble1 pengine[13946]: notice: Calculated transition 3103, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 12:14:09 warble1 crmd[13947]: notice: Transition 3103 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 12:14:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 12:18:57 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 12:18:57 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 12:18:57 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 12:18:57 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 12:28:58 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 12:28:58 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 12:28:58 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 12:28:58 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 12:29:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 12:29:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 12:29:09 warble1 pengine[13946]: notice: Calculated transition 3104, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 12:29:09 warble1 crmd[13947]: notice: Transition 3104 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 12:29:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 12:38:59 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 12:38:59 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 12:38:59 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 12:38:59 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 12:44:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 12:44:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 12:44:09 warble1 pengine[13946]: notice: Calculated transition 3105, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 12:44:09 warble1 crmd[13947]: notice: Transition 3105 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 12:44:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 12:49:00 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 12:49:00 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 12:49:00 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 12:49:00 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 12:59:01 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 12:59:01 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 12:59:01 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 12:59:01 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 12:59:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 12:59:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 12:59:09 warble1 pengine[13946]: notice: Calculated transition 3106, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 12:59:09 warble1 crmd[13947]: notice: Transition 3106 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 12:59:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 13:09:02 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 13:09:02 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 13:09:02 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 13:09:02 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 13:14:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 13:14:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 13:14:09 warble1 pengine[13946]: notice: Calculated transition 3107, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 13:14:09 warble1 crmd[13947]: notice: Transition 3107 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 13:14:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 13:19:03 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 13:19:03 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 13:19:03 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 13:19:03 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 13:29:04 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 13:29:04 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 13:29:04 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 13:29:04 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 13:29:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 13:29:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 13:29:09 warble1 pengine[13946]: notice: Calculated transition 3108, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 13:29:09 warble1 crmd[13947]: notice: Transition 3108 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 13:29:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 13:39:06 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 13:39:06 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 13:39:06 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 13:39:06 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 13:44:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 13:44:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 13:44:09 warble1 pengine[13946]: notice: Calculated transition 3109, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 13:44:09 warble1 crmd[13947]: notice: Transition 3109 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 13:44:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 13:49:07 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 13:49:07 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 13:49:07 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 13:49:07 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 13:59:08 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 13:59:08 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 13:59:08 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 13:59:08 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 13:59:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 13:59:09 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 13:59:09 warble1 pengine[13946]: notice: Calculated transition 3110, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 13:59:09 warble1 crmd[13947]: notice: Transition 3110 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 13:59:09 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 14:09:09 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 14:09:09 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 14:09:09 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 14:09:09 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 14:14:09 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 14:14:10 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 14:14:10 warble1 pengine[13946]: notice: Calculated transition 3111, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 14:14:10 warble1 crmd[13947]: notice: Transition 3111 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 14:14:10 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 14:19:10 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 14:19:10 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 14:19:10 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 14:19:10 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 14:29:10 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 14:29:10 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 14:29:10 warble1 pengine[13946]: notice: Calculated transition 3112, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 14:29:10 warble1 crmd[13947]: notice: Transition 3112 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 14:29:10 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 14:29:11 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 14:29:11 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 14:29:11 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 14:29:11 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 14:39:12 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 14:39:12 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 14:39:12 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 14:39:12 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 14:44:10 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 14:44:10 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 14:44:10 warble1 pengine[13946]: notice: Calculated transition 3113, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 14:44:10 warble1 crmd[13947]: notice: Transition 3113 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 14:44:10 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 14:49:13 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 14:49:13 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 14:49:13 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 14:49:13 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 14:59:10 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 14:59:10 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 14:59:10 warble1 pengine[13946]: notice: Calculated transition 3114, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 14:59:10 warble1 crmd[13947]: notice: Transition 3114 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 14:59:10 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 14:59:14 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 14:59:14 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 14:59:14 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 14:59:14 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 15:09:15 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 15:09:15 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 15:09:15 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 15:09:15 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 15:14:10 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 15:14:10 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 15:14:10 warble1 pengine[13946]: notice: Calculated transition 3115, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 15:14:10 warble1 crmd[13947]: notice: Transition 3115 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 15:14:10 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 15:19:16 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 15:19:16 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 15:19:16 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 15:19:16 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 15:29:10 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 15:29:10 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 15:29:10 warble1 pengine[13946]: notice: Calculated transition 3116, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 15:29:10 warble1 crmd[13947]: notice: Transition 3116 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 15:29:10 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 15:29:17 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 15:29:17 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 15:29:17 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 15:29:17 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 15:39:18 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 15:39:18 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 15:39:18 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 15:39:18 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 15:44:10 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 15:44:10 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 15:44:10 warble1 pengine[13946]: notice: Calculated transition 3117, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 15:44:10 warble1 crmd[13947]: notice: Transition 3117 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 15:44:10 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 15:49:19 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 15:49:19 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 15:49:19 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 15:49:19 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 15:59:10 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 15:59:10 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 15:59:10 warble1 pengine[13946]: notice: Calculated transition 3118, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 15:59:10 warble1 crmd[13947]: notice: Transition 3118 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 15:59:10 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 15:59:20 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 15:59:20 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 15:59:20 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 15:59:20 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:08:15 warble1 kernel: LNet: Service thread pid 364509 was inactive for 200.47s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Apr 7 16:08:15 warble1 kernel: Pid: 364509, comm: mdt00_046 Apr 7 16:08:15 warble1 kernel: #012Call Trace: Apr 7 16:08:15 warble1 kernel: [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] Apr 7 16:08:15 warble1 kernel: [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] Apr 7 16:08:15 warble1 kernel: [] schedule+0x29/0x70 Apr 7 16:08:15 warble1 kernel: [] schedule_timeout+0x174/0x2c0 Apr 7 16:08:15 warble1 kernel: [] ? process_timeout+0x0/0x10 Apr 7 16:08:15 warble1 kernel: [] ? ldlm_expired_completion_wait+0x0/0x240 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] ldlm_completion_ast+0x5b1/0x920 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] ? ldlm_resource_add_lock+0x6a/0x1b0 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] ? default_wake_function+0x0/0x20 Apr 7 16:08:15 warble1 kernel: [] ldlm_cli_enqueue_fini+0x938/0xdb0 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] Apr 7 16:08:15 warble1 kernel: [] ldlm_cli_enqueue+0x6c2/0x810 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] Apr 7 16:08:15 warble1 kernel: [] osp_md_object_lock+0x172/0x2e0 [osp] Apr 7 16:08:15 warble1 kernel: [] lod_object_lock+0xf0/0x950 [lod] Apr 7 16:08:15 warble1 kernel: [] ? htable_lookup+0x9d/0x170 [obdclass] Apr 7 16:08:15 warble1 kernel: [] mdd_object_lock+0x3b/0xd0 [mdd] Apr 7 16:08:15 warble1 kernel: [] mdt_remote_object_lock+0x1e2/0x710 [mdt] Apr 7 16:08:15 warble1 kernel: [] mdt_reint_rename_or_migrate.isra.39+0x36a/0x860 [mdt] Apr 7 16:08:15 warble1 kernel: [] ? strlcpy+0x42/0x60 Apr 7 16:08:15 warble1 kernel: [] mdt_reint_rename+0x13/0x20 [mdt] Apr 7 16:08:15 warble1 kernel: [] mdt_reint_rec+0x80/0x210 [mdt] Apr 7 16:08:15 warble1 kernel: [] mdt_reint_internal+0x5fb/0x9c0 [mdt] Apr 7 16:08:15 warble1 kernel: [] mdt_reint+0x67/0x140 [mdt] Apr 7 16:08:15 warble1 kernel: [] tgt_request_handle+0x925/0x1370 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] ptlrpc_server_handle_request+0x236/0xa90 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] ? default_wake_function+0x12/0x20 Apr 7 16:08:15 warble1 kernel: [] ? __wake_up_common+0x58/0x90 Apr 7 16:08:15 warble1 kernel: [] ptlrpc_main+0xa92/0x1e40 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] ? ptlrpc_main+0x0/0x1e40 [ptlrpc] Apr 7 16:08:15 warble1 kernel: [] kthread+0xcf/0xe0 Apr 7 16:08:15 warble1 kernel: [] ? kthread+0x0/0xe0 Apr 7 16:08:15 warble1 kernel: [] ret_from_fork+0x58/0x90 Apr 7 16:08:15 warble1 kernel: [] ? kthread+0x0/0xe0 Apr 7 16:08:15 warble1 kernel: Apr 7 16:08:15 warble1 kernel: LustreError: dumping log to /tmp/lustre-log.1523081295.364509 Apr 7 16:09:21 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 16:09:21 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:09:21 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 16:09:21 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:09:54 warble2 kernel: Lustre: dagg-MDT0000: Received new LWP connection from 192.168.44.21@o2ib44, removing former export from same NID Apr 7 16:09:54 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 192.168.44.21@o2ib44 (at 192.168.44.21@o2ib44) Apr 7 16:09:55 warble1 kernel: Lustre: dagg-MDT0000-osp-MDT0001: Connection to dagg-MDT0000 (at 192.168.44.22@o2ib44) was lost; in progress operations using this service will wait for recovery to complete Apr 7 16:09:55 warble1 kernel: LustreError: 364509:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1523081094, 300s ago), entering recovery for dagg-MDT0000_UUID@192.168.44.22@o2ib44 ns: dagg-MDT0000-osp-MDT0001 lock: ffff885e17acba00/0xe8af92334ef209b6 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2 rrc: 2 type: IBT flags: 0x1000001000000 nid: local remote: 0xaea67cc1322b9dc0 expref: -99 pid: 364509 timeout: 0 lvb_type: 0 Apr 7 16:10:19 warble2 kernel: LNet: Service thread pid 102678 was inactive for 200.46s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Apr 7 16:10:19 warble2 kernel: Pid: 102678, comm: mdt01_111 Apr 7 16:10:19 warble2 kernel: #012Call Trace: Apr 7 16:10:19 warble2 kernel: [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] Apr 7 16:10:19 warble2 kernel: [] schedule+0x29/0x70 Apr 7 16:10:19 warble2 kernel: [] schedule_timeout+0x174/0x2c0 Apr 7 16:10:19 warble2 kernel: [] ? process_timeout+0x0/0x10 Apr 7 16:10:19 warble2 kernel: [] ? cfs_block_sigsinv+0x71/0xa0 [libcfs] Apr 7 16:10:19 warble2 kernel: [] ? ldlm_expired_completion_wait+0x0/0x240 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] ldlm_completion_ast+0x5b1/0x920 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] ? default_wake_function+0x0/0x20 Apr 7 16:10:19 warble2 kernel: [] ldlm_cli_enqueue_local+0x230/0x860 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] ? ldlm_blocking_ast+0x0/0x170 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] mdt_reint_rename_or_migrate.isra.39+0x67c/0x860 [mdt] Apr 7 16:10:19 warble2 kernel: [] ? ldlm_blocking_ast+0x0/0x170 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] mdt_reint_rename+0x13/0x20 [mdt] Apr 7 16:10:19 warble2 kernel: [] mdt_reint_rec+0x80/0x210 [mdt] Apr 7 16:10:19 warble2 kernel: [] mdt_reint_internal+0x5fb/0x9c0 [mdt] Apr 7 16:10:19 warble2 kernel: [] mdt_reint+0x67/0x140 [mdt] Apr 7 16:10:19 warble2 kernel: [] tgt_request_handle+0x925/0x1370 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] ptlrpc_server_handle_request+0x236/0xa90 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] ? default_wake_function+0x12/0x20 Apr 7 16:10:19 warble2 kernel: [] ? __wake_up_common+0x58/0x90 Apr 7 16:10:19 warble2 kernel: [] ptlrpc_main+0xa92/0x1e40 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] ? ptlrpc_main+0x0/0x1e40 [ptlrpc] Apr 7 16:10:19 warble2 kernel: [] kthread+0xcf/0xe0 Apr 7 16:10:19 warble2 kernel: [] ? kthread+0x0/0xe0 Apr 7 16:10:19 warble2 kernel: [] ret_from_fork+0x58/0x90 Apr 7 16:10:19 warble2 kernel: [] ? kthread+0x0/0xe0 Apr 7 16:10:19 warble2 kernel: Apr 7 16:10:19 warble2 kernel: LustreError: dumping log to /tmp/lustre-log.1523081419.102678 Apr 7 16:11:58 warble2 kernel: LustreError: 102678:0:(ldlm_request.c:130:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1523081218, 300s ago); not entering recovery in server code, just going back to sleep ns: mdt-dagg-MDT0000_UUID lock: ffff88bae3edba00/0xaea67cc1322ba465 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2 rrc: 4 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102678 timeout: 0 lvb_type: 0 Apr 7 16:11:58 warble2 kernel: LustreError: dumping log to /tmp/lustre-log.1523081518.102678 Apr 7 16:14:10 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 16:14:10 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 16:14:10 warble1 pengine[13946]: notice: Calculated transition 3119, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 16:14:10 warble1 crmd[13947]: notice: Transition 3119 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 16:14:10 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:14:49 warble1 kernel: Lustre: 150602:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply#012 req@ffff885c96c7b000 x1594462426718320/t0(0) o36->02c65d3d-616e-a18f-3474-eecff1778104@192.168.44.14@o2ib44:564/0 lens 768/3128 e 24 to 0 dl 1523081694 ref 2 fl Interpret:/0/0 rc 0/0 Apr 7 16:16:53 warble2 kernel: Lustre: 102661:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply#012 req@ffff88bc0642bf00 x1594465554616000/t0(0) o36->bd95096f-2790-2a0e-d286-cdfd62034abc@192.168.44.13@o2ib44:688/0 lens 752/3128 e 24 to 0 dl 1523081818 ref 2 fl Interpret:/0/0 rc 0/0 Apr 7 16:16:59 warble2 kernel: Lustre: dagg-MDT0000: Client bd95096f-2790-2a0e-d286-cdfd62034abc (at 192.168.44.13@o2ib44) reconnecting Apr 7 16:16:59 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to fcef106e-d6cd-4e67-23c7-bc318374c9d5 (at 192.168.44.13@o2ib44) Apr 7 16:19:22 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 16:19:22 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 16:19:22 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 16:19:22 warble1 kernel: Lustre: Skipped 3 previous similar messages Apr 7 16:29:10 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 16:29:10 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 16:29:10 warble1 pengine[13946]: notice: Calculated transition 3120, saving inputs in /var/lib/pacemaker/pengine/pe-input-28.bz2 Apr 7 16:29:10 warble1 crmd[13947]: notice: Transition 3120 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-28.bz2): Complete Apr 7 16:29:10 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:29:23 warble1 kernel: Lustre: dagg-MDT0002: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 16:29:23 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 16:29:23 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 95c61da7-ad27-b822-2f72-0782ea5197ce (at 192.168.44.199@o2ib44) Apr 7 16:29:23 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 16:35:33 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 16:35:34 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:34 warble1 pengine[13946]: notice: * Move warble2-ipmi ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:35:34 warble1 pengine[13946]: notice: * Move warble2-zfs-dagg-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:35:34 warble1 pengine[13946]: notice: * Move warble2-dagg-MDT0 ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:35:34 warble1 pengine[13946]: notice: * Stop healthLUSTRE:0 ( warble2-host.oob ) due to node availability Apr 7 16:35:34 warble1 pengine[13946]: notice: * Stop healthLNET:0 ( warble2-host.oob ) due to node availability Apr 7 16:35:34 warble1 pengine[13946]: notice: * Move warble2-zfs-apps-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:35:34 warble1 pengine[13946]: notice: * Move warble2-apps-MDT0 ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:35:34 warble1 pengine[13946]: notice: * Move warble2-zfs-home-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:35:34 warble1 pengine[13946]: notice: * Move warble2-home-MDT0 ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:35:34 warble1 pengine[13946]: notice: Calculated transition 3121, saving inputs in /var/lib/pacemaker/pengine/pe-input-29.bz2 Apr 7 16:35:34 warble1 crmd[13947]: notice: Initiating stop operation warble2-ipmi_stop_0 on warble2-host.oob Apr 7 16:35:34 warble1 crmd[13947]: notice: Initiating stop operation warble2-dagg-MDT0_stop_0 on warble2-host.oob Apr 7 16:35:34 warble1 crmd[13947]: notice: Initiating stop operation warble2-apps-MDT0_stop_0 on warble2-host.oob Apr 7 16:35:34 warble1 crmd[13947]: notice: Initiating stop operation warble2-home-MDT0_stop_0 on warble2-host.oob Apr 7 16:35:34 warble1 crmd[13947]: notice: Initiating stop operation healthLUSTRE_stop_0 on warble2-host.oob Apr 7 16:35:34 warble1 crmd[13947]: notice: Initiating stop operation healthLNET_stop_0 on warble2-host.oob Apr 7 16:35:34 warble2 crmd[14247]: notice: Result of stop operation for warble2-ipmi on warble2-host.oob: 0 (ok) Apr 7 16:35:34 warble1 crmd[13947]: notice: Initiating start operation warble2-ipmi_start_0 locally on warble1-host.oob Apr 7 16:35:34 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:34 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:34 warble2 Lustre(warble2-dagg-MDT0)[421111 INFO: Starting to unmount warble2-dagg-MDT0-pool/MDT0 Apr 7 16:35:34 warble2 Lustre(warble2-apps-MDT0)[421112 INFO: Starting to unmount warble2-apps-MDT0-pool/MDT0 Apr 7 16:35:34 warble2 Lustre(warble2-home-MDT0)[421113 INFO: Starting to unmount warble2-home-MDT0-pool/MDT0 Apr 7 16:35:34 warble2 crmd[14247]: notice: Result of stop operation for healthLUSTRE on warble2-host.oob: 0 (ok) Apr 7 16:35:34 warble1 crmd[13947]: notice: Transition aborted by deletion of nvpair[@id='status-2-lustred']: Transient attribute change Apr 7 16:35:34 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:34 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:34 warble2 crmd[14247]: notice: Result of stop operation for healthLNET on warble2-host.oob: 0 (ok) Apr 7 16:35:34 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:34 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:34 warble2 kernel: Lustre: Failing over apps-MDT0000 Apr 7 16:35:34 warble2 kernel: Lustre: Skipped 2 previous similar messages Apr 7 16:35:34 warble2 kernel: Lustre: dagg-MDT0000: Not available for connect from 192.168.44.191@o2ib44 (stopping) Apr 7 16:35:34 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:35:34 warble2 kernel: LustreError: 102678:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88bad4b49500 x1594152428476992/t0(0) o1000->dagg-MDT0001-osp-MDT0000@192.168.44.21@o2ib44:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:/0/ffffffff rc 0/-1 Apr 7 16:35:34 warble2 kernel: LustreError: 102678:0:(osp_object.c:582:osp_attr_get()) dagg-MDT0001-osp-MDT0000:osp_attr_get update error [0x28001c98e:0x1685b:0x0]: rc = -5 Apr 7 16:35:34 warble2 kernel: Lustre: 102678:0:(service.c:2112:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (600:1116s); client may timeout. req@ffff88bc0642bf00 x1594465554616000/t0(0) o36->bd95096f-2790-2a0e-d286-cdfd62034abc@192.168.44.13@o2ib44:688/0 lens 752/424 e 24 to 0 dl 1523081818 ref 1 fl Complete:/0/0 rc -19/-19 Apr 7 16:35:34 warble2 kernel: LNet: Service thread pid 102678 completed after 1715.57s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). Apr 7 16:35:34 warble2 kernel: Lustre: apps-MDT0000: Not available for connect from 192.168.44.178@o2ib44 (stopping) Apr 7 16:35:34 warble2 kernel: Lustre: Skipped 8 previous similar messages Apr 7 16:35:34 warble2 kernel: LustreError: 14885:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88bad4b4c200 x1594152428477120/t0(0) o13->apps-OST0000-osc-MDT0000@192.168.44.51@o2ib44:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 Apr 7 16:35:34 warble2 kernel: LustreError: 14885:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 1 previous similar message Apr 7 16:35:34 warble2 kernel: Lustre: server umount dagg-MDT0000 complete Apr 7 16:35:34 warble2 Lustre(warble2-dagg-MDT0)[421111 INFO: warble2-dagg-MDT0-pool/MDT0 unmounted successfully Apr 7 16:35:34 warble2 crmd[14247]: notice: Result of stop operation for warble2-dagg-MDT0 on warble2-host.oob: 0 (ok) Apr 7 16:35:34 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:34 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:35 warble1 crmd[13947]: notice: Result of start operation for warble2-ipmi on warble1-host.oob: 0 (ok) Apr 7 16:35:35 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:35 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:35 warble2 kernel: LustreError: 137-5: dagg-MDT0000_UUID: not available for connect from 192.168.44.122@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:35:35 warble2 kernel: Lustre: home-MDT0000: Not available for connect from 192.168.44.179@o2ib44 (stopping) Apr 7 16:35:35 warble2 kernel: Lustre: Skipped 21 previous similar messages Apr 7 16:35:36 warble2 kernel: Lustre: server umount home-MDT0000 complete Apr 7 16:35:36 warble2 Lustre(warble2-home-MDT0)[421113 INFO: warble2-home-MDT0-pool/MDT0 unmounted successfully Apr 7 16:35:36 warble2 crmd[14247]: notice: Result of stop operation for warble2-home-MDT0 on warble2-host.oob: 0 (ok) Apr 7 16:35:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:36 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:36 warble2 Lustre(warble2-apps-MDT0)[421112 INFO: warble2-apps-MDT0-pool/MDT0 unmounted successfully Apr 7 16:35:36 warble2 crmd[14247]: notice: Result of stop operation for warble2-apps-MDT0 on warble2-host.oob: 0 (ok) Apr 7 16:35:36 warble1 crmd[13947]: notice: Transition 3121 (Complete=14, Pending=0, Fired=0, Skipped=4, Incomplete=26, Source=/var/lib/pacemaker/pengine/pe-input-29.bz2): Stopped Apr 7 16:35:36 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:36 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:36 warble1 pengine[13946]: notice: * Move warble2-zfs-dagg-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:35:36 warble1 pengine[13946]: notice: * Start warble2-dagg-MDT0 ( warble1-host.oob ) Apr 7 16:35:36 warble1 pengine[13946]: notice: * Move warble2-zfs-apps-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:35:36 warble1 pengine[13946]: notice: * Start warble2-apps-MDT0 ( warble1-host.oob ) Apr 7 16:35:36 warble1 pengine[13946]: notice: * Move warble2-zfs-home-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:35:36 warble1 pengine[13946]: notice: * Start warble2-home-MDT0 ( warble1-host.oob ) Apr 7 16:35:36 warble1 pengine[13946]: notice: Calculated transition 3122, saving inputs in /var/lib/pacemaker/pengine/pe-input-30.bz2 Apr 7 16:35:36 warble1 crmd[13947]: notice: Initiating monitor operation warble2-ipmi_monitor_60000 locally on warble1-host.oob Apr 7 16:35:36 warble1 crmd[13947]: notice: Initiating stop operation warble2-zfs-dagg-MDT0-pool_stop_0 on warble2-host.oob Apr 7 16:35:36 warble1 crmd[13947]: notice: Initiating stop operation warble2-zfs-apps-MDT0-pool_stop_0 on warble2-host.oob Apr 7 16:35:36 warble1 crmd[13947]: notice: Initiating stop operation warble2-zfs-home-MDT0-pool_stop_0 on warble2-host.oob Apr 7 16:35:36 warble2 zed: eid=22 class=pool_export pool_guid=0xFC863664CC04C875 Apr 7 16:35:36 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:39 warble1 crmd[13947]: notice: Transition aborted by deletion of nvpair[@id='status-2-pingd']: Transient attribute change Apr 7 16:35:39 warble2 crmd[14247]: notice: Result of stop operation for warble2-zfs-dagg-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 16:35:39 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:39 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:39 warble2 zed: eid=23 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 16:35:39 warble2 zed: eid=24 class=pool_export pool_guid=0xCF79F68EBE891CC3 Apr 7 16:35:42 warble2 crmd[14247]: notice: Result of stop operation for warble2-zfs-apps-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 16:35:42 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:42 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:42 warble2 zed: eid=25 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 16:35:42 warble2 zed: eid=26 class=pool_export pool_guid=0x979BA0B2D95A8C68 Apr 7 16:35:43 warble2 crmd[14247]: notice: Result of stop operation for warble2-zfs-home-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 16:35:43 warble1 crmd[13947]: notice: Transition 3122 (Complete=14, Pending=0, Fired=0, Skipped=3, Incomplete=15, Source=/var/lib/pacemaker/pengine/pe-input-30.bz2): Stopped Apr 7 16:35:43 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:43 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:43 warble2 zed: eid=27 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 16:35:43 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:43 warble1 pengine[13946]: notice: * Start warble2-zfs-dagg-MDT0-pool ( warble1-host.oob ) Apr 7 16:35:43 warble1 pengine[13946]: notice: * Start warble2-dagg-MDT0 ( warble1-host.oob ) Apr 7 16:35:43 warble1 pengine[13946]: notice: * Start warble2-zfs-apps-MDT0-pool ( warble1-host.oob ) Apr 7 16:35:43 warble1 pengine[13946]: notice: * Start warble2-apps-MDT0 ( warble1-host.oob ) Apr 7 16:35:43 warble1 pengine[13946]: notice: * Start warble2-zfs-home-MDT0-pool ( warble1-host.oob ) Apr 7 16:35:43 warble1 pengine[13946]: notice: * Start warble2-home-MDT0 ( warble1-host.oob ) Apr 7 16:35:43 warble1 pengine[13946]: notice: Calculated transition 3123, saving inputs in /var/lib/pacemaker/pengine/pe-input-31.bz2 Apr 7 16:35:43 warble1 crmd[13947]: notice: Initiating start operation warble2-zfs-dagg-MDT0-pool_start_0 locally on warble1-host.oob Apr 7 16:35:43 warble1 crmd[13947]: notice: Initiating start operation warble2-zfs-apps-MDT0-pool_start_0 locally on warble1-host.oob Apr 7 16:35:43 warble1 crmd[13947]: notice: Initiating start operation warble2-zfs-home-MDT0-pool_start_0 locally on warble1-host.oob Apr 7 16:35:44 warble1 zed: eid=61 class=history_event pool_guid=0x979BA0B2D95A8C68 Apr 7 16:35:44 warble1 zed: eid=62 class=config_cache_write pool_guid=0x979BA0B2D95A8C68 Apr 7 16:35:44 warble1 zed: eid=63 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 16:35:44 warble1 zed: eid=64 class=pool_import pool_guid=0x979BA0B2D95A8C68 Apr 7 16:35:45 warble1 zed: eid=65 class=history_event pool_guid=0xFC863664CC04C875 Apr 7 16:35:45 warble1 zed: eid=66 class=config_cache_write pool_guid=0xFC863664CC04C875 Apr 7 16:35:45 warble1 zed: eid=67 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 16:35:45 warble1 zed: eid=68 class=pool_import pool_guid=0xFC863664CC04C875 Apr 7 16:35:45 warble1 zed: eid=69 class=history_event pool_guid=0x979BA0B2D95A8C68 Apr 7 16:35:45 warble1 zed: eid=70 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 16:35:45 warble1 zed: eid=71 class=history_event pool_guid=0xCF79F68EBE891CC3 Apr 7 16:35:45 warble1 zed: eid=72 class=config_cache_write pool_guid=0xCF79F68EBE891CC3 Apr 7 16:35:45 warble1 zed: eid=73 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 16:35:45 warble1 zed: eid=74 class=pool_import pool_guid=0xCF79F68EBE891CC3 Apr 7 16:35:45 warble1 lrmd[13944]: notice: warble2-zfs-home-MDT0-pool_start_0:36843:stderr [ cannot open 'warble2-home-MDT0-pool': no such pool ] Apr 7 16:35:45 warble1 lrmd[13944]: notice: warble2-zfs-dagg-MDT0-pool_start_0:36841:stderr [ cannot open 'warble2-dagg-MDT0-pool': no such pool ] Apr 7 16:35:45 warble1 lrmd[13944]: notice: warble2-zfs-apps-MDT0-pool_start_0:36842:stderr [ cannot open 'warble2-apps-MDT0-pool': no such pool ] Apr 7 16:35:45 warble1 crmd[13947]: notice: Result of start operation for warble2-zfs-home-MDT0-pool on warble1-host.oob: 0 (ok) Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 zed: eid=75 class=history_event pool_guid=0xFC863664CC04C875 Apr 7 16:35:45 warble1 crmd[13947]: notice: Result of start operation for warble2-zfs-dagg-MDT0-pool on warble1-host.oob: 0 (ok) Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 crmd[13947]: notice: Result of start operation for warble2-zfs-apps-MDT0-pool on warble1-host.oob: 0 (ok) Apr 7 16:35:45 warble1 crmd[13947]: notice: Initiating monitor operation warble2-zfs-dagg-MDT0-pool_monitor_5000 locally on warble1-host.oob Apr 7 16:35:45 warble1 crmd[13947]: notice: Initiating start operation warble2-dagg-MDT0_start_0 locally on warble1-host.oob Apr 7 16:35:45 warble1 crmd[13947]: notice: Initiating monitor operation warble2-zfs-home-MDT0-pool_monitor_5000 locally on warble1-host.oob Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 crmd[13947]: notice: Initiating start operation warble2-home-MDT0_start_0 locally on warble1-host.oob Apr 7 16:35:45 warble1 crmd[13947]: notice: Initiating monitor operation warble2-zfs-apps-MDT0-pool_monitor_5000 locally on warble1-host.oob Apr 7 16:35:45 warble1 crmd[13947]: notice: Initiating start operation warble2-apps-MDT0_start_0 locally on warble1-host.oob Apr 7 16:35:45 warble1 zed: eid=76 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 16:35:45 warble1 Lustre(warble2-dagg-MDT0)[39005] INFO: Starting to mount warble2-dagg-MDT0-pool/MDT0 Apr 7 16:35:45 warble1 Lustre(warble2-home-MDT0)[39008] INFO: Starting to mount warble2-home-MDT0-pool/MDT0 Apr 7 16:35:45 warble1 Lustre(warble2-apps-MDT0)[39012] INFO: Starting to mount warble2-apps-MDT0-pool/MDT0 Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 zed: eid=77 class=history_event pool_guid=0xCF79F68EBE891CC3 Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 zed: eid=78 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 16:35:45 warble1 kernel: Lustre: dagg-MDT0000: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 Apr 7 16:35:45 warble1 Lustre(warble2-dagg-MDT0)[39005] INFO: warble2-dagg-MDT0-pool/MDT0 mounted successfully Apr 7 16:35:45 warble1 crmd[13947]: notice: Result of start operation for warble2-dagg-MDT0 on warble1-host.oob: 0 (ok) Apr 7 16:35:45 warble1 crmd[13947]: notice: Initiating monitor operation warble2-dagg-MDT0_monitor_20000 locally on warble1-host.oob Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 Lustre(warble2-home-MDT0)[39008] INFO: warble2-home-MDT0-pool/MDT0 mounted successfully Apr 7 16:35:45 warble1 crmd[13947]: notice: Result of start operation for warble2-home-MDT0 on warble1-host.oob: 0 (ok) Apr 7 16:35:45 warble1 crmd[13947]: notice: Initiating monitor operation warble2-home-MDT0_monitor_20000 locally on warble1-host.oob Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 Lustre(warble2-apps-MDT0)[39012] INFO: warble2-apps-MDT0-pool/MDT0 mounted successfully Apr 7 16:35:45 warble1 crmd[13947]: notice: Result of start operation for warble2-apps-MDT0 on warble1-host.oob: 0 (ok) Apr 7 16:35:45 warble1 crmd[13947]: notice: Initiating monitor operation warble2-apps-MDT0_monitor_20000 locally on warble1-host.oob Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble1 crmd[13947]: notice: Transition 3123 (Complete=18, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-31.bz2): Complete Apr 7 16:35:45 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:35:45 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:35:50 warble1 zed: eid=79 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 16:35:50 warble1 zed: eid=80 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 16:35:50 warble1 zed: eid=81 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 16:35:50 warble1 kernel: Lustre: apps-MDT0000: Will be in recovery for at least 2:30, or until 122 clients reconnect Apr 7 16:35:50 warble1 kernel: Lustre: 14246:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523082945/real 1523082945] req@ffff885c1a3b3300 x1594142133135296/t0(0) o38->dagg-MDT0000-lwp-MDT0000@192.168.44.22@o2ib44:12/10 lens 520/544 e 0 to 1 dl 1523082950 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 16:35:50 warble1 kernel: Lustre: 14246:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages Apr 7 16:35:51 warble1 kernel: Lustre: dagg-MDT0000-lwp-MDT0001: Connection to dagg-MDT0000 (at 192.168.44.22@o2ib44) was lost; in progress operations using this service will wait for recovery to complete Apr 7 16:35:51 warble1 kernel: Lustre: dagg-MDT0000-osp-MDT0001: Connection to dagg-MDT0000 (at 192.168.44.22@o2ib44) was lost; in progress operations using this service will wait for recovery to complete Apr 7 16:35:51 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:35:58 warble1 kernel: Lustre: 14246:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523082951/real 1523082951] req@ffff88bc111de900 x1594142133144016/t0(0) o38->dagg-MDT0000-osp-MDT0001@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523082957 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 16:35:58 warble1 kernel: Lustre: 14246:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages Apr 7 16:36:00 warble1 kernel: Lustre: apps-MDT0000: Recovery over after 0:10, of 122 clients 122 recovered and 0 were evicted. Apr 7 16:36:00 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:36:02 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 16:36:02 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:02 warble1 pengine[13946]: notice: * Start healthLUSTRE:1 ( warble2-host.oob ) Apr 7 16:36:02 warble1 pengine[13946]: notice: * Start healthLNET:1 ( warble2-host.oob ) Apr 7 16:36:02 warble1 pengine[13946]: notice: Calculated transition 3124, saving inputs in /var/lib/pacemaker/pengine/pe-input-32.bz2 Apr 7 16:36:02 warble1 crmd[13947]: notice: Initiating start operation healthLUSTRE:1_start_0 on warble2-host.oob Apr 7 16:36:02 warble1 crmd[13947]: notice: Initiating start operation healthLNET:1_start_0 on warble2-host.oob Apr 7 16:36:02 warble1 crmd[13947]: notice: Transition aborted by status-2-lustred doing create lustred=1: Transient attribute change Apr 7 16:36:02 warble2 crmd[14247]: notice: Result of start operation for healthLUSTRE on warble2-host.oob: 0 (ok) Apr 7 16:36:02 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:02 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:02 warble2 crmd[14247]: notice: Result of start operation for healthLNET on warble2-host.oob: 0 (ok) Apr 7 16:36:02 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:02 warble1 crmd[13947]: notice: Transition 3124 (Complete=6, Pending=0, Fired=0, Skipped=2, Incomplete=2, Source=/var/lib/pacemaker/pengine/pe-input-32.bz2): Stopped Apr 7 16:36:02 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:02 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:02 warble1 pengine[13946]: notice: Calculated transition 3125, saving inputs in /var/lib/pacemaker/pengine/pe-input-33.bz2 Apr 7 16:36:02 warble1 crmd[13947]: notice: Initiating monitor operation healthLUSTRE_monitor_10000 on warble2-host.oob Apr 7 16:36:02 warble1 crmd[13947]: notice: Initiating monitor operation healthLNET_monitor_20000 on warble2-host.oob Apr 7 16:36:02 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:02 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:02 warble1 crmd[13947]: notice: Transition 3125 (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-33.bz2): Complete Apr 7 16:36:02 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:02 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:36:02 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:07 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 16:36:07 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 16:36:07 warble1 pengine[13946]: notice: Calculated transition 3126, saving inputs in /var/lib/pacemaker/pengine/pe-input-34.bz2 Apr 7 16:36:07 warble1 crmd[13947]: notice: Transition 3126 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-34.bz2): Complete Apr 7 16:36:07 warble1 crmd[13947]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:36:17 warble1 kernel: LustreError: 167-0: dagg-MDT0000-lwp-MDT0001: This client was evicted by dagg-MDT0000; in progress operations using this service will fail. Apr 7 16:36:17 warble1 kernel: LustreError: Skipped 1 previous similar message Apr 7 16:36:17 warble1 kernel: Lustre: dagg-MDT0000: Recovery over after 0:27, of 124 clients 124 recovered and 0 were evicted. Apr 7 16:36:23 warble1 kernel: Lustre: 14249:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523082976/real 1523082976] req@ffff8853881e9800 x1594142133147328/t0(0) o400->dagg-MDT0000-lwp-MDT0002@192.168.44.22@o2ib44:12/10 lens 224/224 e 0 to 1 dl 1523082983 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 16:36:23 warble1 kernel: Lustre: 14249:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Apr 7 16:36:23 warble1 kernel: Lustre: dagg-MDT0000-lwp-MDT0002: Connection to dagg-MDT0000 (at 192.168.44.22@o2ib44) was lost; in progress operations using this service will wait for recovery to complete Apr 7 16:36:48 warble1 kernel: LustreError: 167-0: dagg-MDT0000-lwp-MDT0002: This client was evicted by dagg-MDT0000; in progress operations using this service will fail. Apr 7 16:38:03 warble1 crmd[13947]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 16:38:03 warble1 pengine[13946]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble1-ipmi ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble2-ipmi ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble1-zfs-MGT-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble1-MGT ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble2-zfs-dagg-MDT0-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble2-dagg-MDT0 ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Stop healthLUSTRE:1 ( warble1-host.oob ) due to node availability Apr 7 16:38:03 warble1 pengine[13946]: notice: * Stop healthLNET:1 ( warble1-host.oob ) due to node availability Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble1-zfs-dagg-MDT2-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble1-dagg-MDT2 ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble1-zfs-dagg-MDT1-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble1-dagg-MDT1 ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble1-zfs-images-MDT0-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble1-images-MDT0 ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble2-zfs-apps-MDT0-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble2-apps-MDT0 ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble2-zfs-home-MDT0-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: * Move warble2-home-MDT0 ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:03 warble1 pengine[13946]: notice: Calculated transition 3127, saving inputs in /var/lib/pacemaker/pengine/pe-input-35.bz2 Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation warble1-ipmi_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation warble2-ipmi_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation warble1-MGT_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation warble2-dagg-MDT0_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation warble1-dagg-MDT2_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation warble1-dagg-MDT1_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation warble1-images-MDT0_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation warble2-apps-MDT0_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation warble2-home-MDT0_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Result of stop operation for warble1-ipmi on warble1-host.oob: 0 (ok) Apr 7 16:38:03 warble1 crmd[13947]: notice: Result of stop operation for warble2-ipmi on warble1-host.oob: 0 (ok) Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation healthLUSTRE_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating stop operation healthLNET_stop_0 locally on warble1-host.oob Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating start operation warble1-ipmi_start_0 on warble2-host.oob Apr 7 16:38:03 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:03 warble1 crmd[13947]: notice: Initiating start operation warble2-ipmi_start_0 on warble2-host.oob Apr 7 16:38:03 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:03 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:03 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:03 warble1 Lustre(warble1-MGT)[49224]: INFO: Starting to unmount warble1-MGT-pool/MGT Apr 7 16:38:03 warble1 Lustre(warble1-dagg-MDT2)[49226] INFO: Starting to unmount warble1-dagg-MDT2-pool/MDT2 Apr 7 16:38:03 warble1 Lustre(warble2-dagg-MDT0)[49225] INFO: Starting to unmount warble2-dagg-MDT0-pool/MDT0 Apr 7 16:38:03 warble1 Lustre(warble1-dagg-MDT1)[49227] INFO: Starting to unmount warble1-dagg-MDT1-pool/MDT1 Apr 7 16:38:03 warble1 Lustre(warble1-images-MDT0)[4922 INFO: Starting to unmount warble1-images-MDT0-pool/MDT0 Apr 7 16:38:03 warble1 Lustre(warble2-apps-MDT0)[49229] INFO: Starting to unmount warble2-apps-MDT0-pool/MDT0 Apr 7 16:38:03 warble1 Lustre(warble2-home-MDT0)[49234] INFO: Starting to unmount warble2-home-MDT0-pool/MDT0 Apr 7 16:38:03 warble1 crmd[13947]: notice: Result of stop operation for healthLUSTRE on warble1-host.oob: 0 (ok) Apr 7 16:38:03 warble1 crmd[13947]: notice: Transition aborted by deletion of nvpair[@id='status-1-lustred']: Transient attribute change Apr 7 16:38:03 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:03 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:03 warble1 crmd[13947]: notice: Result of stop operation for healthLNET on warble1-host.oob: 0 (ok) Apr 7 16:38:03 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:03 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:04 warble1 kernel: Lustre: Failing over dagg-MDT0002 Apr 7 16:38:04 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:38:04 warble1 kernel: LustreError: 11-0: dagg-MDT0000-lwp-MDT0001: operation mds_disconnect to node 0@lo failed: rc = -19 Apr 7 16:38:04 warble1 kernel: Lustre: 49321:0:(lwp_dev.c:187:lwp_disconnect()) dagg-MDT0000-lwp-MDT0001: can't disconnect: rc = -19 Apr 7 16:38:04 warble1 kernel: LustreError: 49321:0:(obd_mount_server.c:973:lustre_disconnect_lwp()) dagg-MDT0000-lwp-MDT0001: fail to disconnect LWP: rc = -19 Apr 7 16:38:04 warble1 kernel: Lustre: 49321:0:(obd_mount_server.c:1542:server_put_super()) dagg-MDT0001: failed to disconnect lwp: rc= -19 Apr 7 16:38:04 warble1 kernel: LustreError: 49321:0:(osp_dev.c:487:osp_disconnect()) dagg-MDT0000-osp-MDT0001: can't disconnect: rc = -19 Apr 7 16:38:04 warble1 kernel: LustreError: 49321:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-osp-MDT0001: namespace resource [0x200000004:0x1:0x0].0x0 (ffff88b8bb2b8300) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 16:38:04 warble1 kernel: LustreError: 49321:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000004:0x1:0x0].0x0 (ffff88b8bb2b8300) refcount = 2 Apr 7 16:38:04 warble1 kernel: LustreError: 49321:0:(ldlm_resource.c:1703:ldlm_resource_dump()) Waiting locks: Apr 7 16:38:04 warble1 kernel: LustreError: 49321:0:(ldlm_resource.c:1705:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-osp-MDT0001 lock: ffff885e17acba00/0xe8af92334ef209b6 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2 rrc: 3 type: IBT flags: 0x1106401000000 nid: local remote: 0xe8af92335017fc0a expref: -99 pid: 364509 timeout: 0 lvb_type: 0 Apr 7 16:38:04 warble1 kernel: LustreError: 49321:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000004:0x1:0x0].0x0 (ffff88b8bb2b8300) refcount = 2 Apr 7 16:38:04 warble1 kernel: LustreError: 49321:0:(ldlm_resource.c:1703:ldlm_resource_dump()) Waiting locks: Apr 7 16:38:04 warble1 kernel: LustreError: 364509:0:(mdt_reint.c:2158:mdt_reint_rename_or_migrate()) dagg-MDT0001: can't lock FS for rename: rc = -5 Apr 7 16:38:04 warble1 kernel: Lustre: 364509:0:(service.c:2112:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (600:1389s); client may timeout. req@ffff885c96c7b000 x1594462426718320/t0(0) o36->02c65d3d-616e-a18f-3474-eecff1778104@192.168.44.14@o2ib44:564/0 lens 768/424 e 24 to 0 dl 1523081694 ref 1 fl Complete:/0/0 rc -19/-19 Apr 7 16:38:04 warble1 kernel: LNet: Service thread pid 364509 completed after 1988.88s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). Apr 7 16:38:04 warble1 kernel: LustreError: 49321:0:(lod_dev.c:264:lod_sub_process_config()) dagg-MDT0001-mdtlov: error cleaning up LOD index 0: cmd 0xcf031: rc = -19 Apr 7 16:38:04 warble1 kernel: Lustre: dagg-MDT0001: Not available for connect from 192.168.44.14@o2ib44 (stopping) Apr 7 16:38:04 warble1 kernel: Lustre: Skipped 5 previous similar messages Apr 7 16:38:04 warble1 kernel: Lustre: server umount MGS complete Apr 7 16:38:04 warble1 kernel: LustreError: 364505:0:(ldlm_lockd.c:1415:ldlm_handle_enqueue0()) ### lock on destroyed export ffff88bc9f8a2000 ns: mdt-dagg-MDT0001_UUID lock: ffff885a0c043e00/0xe8af9233502838cf lrc: 3/0,0 mode: CR/CR res: [0x28001c990:0x13ea2:0x0].0x0 bits 0x9 rrc: 2 type: IBT flags: 0x50200000000000 nid: 192.168.44.101@o2ib44 remote: 0x843c7e7fdf92eb47 expref: 12 pid: 364505 timeout: 0 lvb_type: 0 Apr 7 16:38:04 warble1 kernel: LustreError: 23452:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff885c13862100 x1594142133171184/t0(0) o1000->dagg-MDT0000-osp-MDT0001@0@lo:24/4 lens 328/4320 e 0 to 0 dl 0 ref 2 fl Rpc:/0/ffffffff rc 0/-1 Apr 7 16:38:04 warble1 kernel: LustreError: 23452:0:(lod_qos.c:208:lod_statfs_and_check()) dagg-MDT0001-mdtlov: statfs: rc = -108 Apr 7 16:38:04 warble1 Lustre(warble1-MGT)[49224]: INFO: warble1-MGT-pool/MGT unmounted successfully Apr 7 16:38:04 warble1 crmd[13947]: notice: Result of stop operation for warble1-MGT on warble1-host.oob: 0 (ok) Apr 7 16:38:04 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:04 warble1 kernel: LustreError: 49317:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000004:0x1:0x0].0x0 (ffff885defb6ecc0) refcount = 2 Apr 7 16:38:04 warble1 kernel: LustreError: 49317:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 16:38:04 warble1 kernel: LustreError: 49317:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-osp-MDT0002 lock: ffff885d3a5f9200/0xe8af923330876ab2 lrc: 2/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2 rrc: 3 type: IBT flags: 0x1506401000000 nid: local remote: 0xe8af92335017fc18 expref: -99 pid: 145064 timeout: 0 lvb_type: 0 Apr 7 16:38:04 warble1 kernel: LustreError: 49317:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x20001072d:0xeafc:0x0].0x0 (ffff885defb6e540) refcount = 2 Apr 7 16:38:04 warble1 kernel: LustreError: 49317:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 16:38:04 warble1 kernel: LustreError: 49317:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000004:0x1:0x0].0x0 (ffff885defb6ecc0) refcount = 2 Apr 7 16:38:04 warble1 kernel: LustreError: 49317:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 16:38:04 warble1 kernel: LustreError: 49317:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x20001072d:0xeafc:0x0].0x0 (ffff885defb6e540) refcount = 2 Apr 7 16:38:04 warble1 kernel: LustreError: 49317:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 16:38:04 warble1 Lustre(warble2-dagg-MDT0)[49225] INFO: warble2-dagg-MDT0-pool/MDT0 unmounted successfully Apr 7 16:38:04 warble1 crmd[13947]: notice: Result of stop operation for warble2-dagg-MDT0 on warble1-host.oob: 0 (ok) Apr 7 16:38:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:04 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:04 warble1 kernel: LustreError: 137-5: dagg-MDT0000_UUID: not available for connect from 192.168.44.170@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:38:04 warble1 kernel: Lustre: images-MDT0000: Not available for connect from 192.168.44.189@o2ib44 (stopping) Apr 7 16:38:04 warble1 kernel: Lustre: Skipped 24 previous similar messages Apr 7 16:38:04 warble1 kernel: LustreError: 14248:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff885d6eed3900 x1594142133171664/t0(0) o13->images-OST0000-osc-MDT0000@192.168.44.51@o2ib44:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 Apr 7 16:38:04 warble1 kernel: LustreError: 14248:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 6 previous similar messages Apr 7 16:38:04 warble2 crmd[14247]: notice: Result of start operation for warble1-ipmi on warble2-host.oob: 0 (ok) Apr 7 16:38:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:04 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:04 warble1 kernel: LustreError: 137-5: dagg-MDT0000_UUID: not available for connect from 192.168.44.133@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:38:04 warble1 kernel: LustreError: Skipped 9 previous similar messages Apr 7 16:38:05 warble1 kernel: Lustre: images-MDT0000: Not available for connect from 192.168.44.179@o2ib44 (stopping) Apr 7 16:38:05 warble1 kernel: Lustre: Skipped 65 previous similar messages Apr 7 16:38:05 warble1 kernel: LustreError: 14261:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88bdb0b60600 x1594142133171808/t0(0) o13->home-OST0001-osc-MDT0000@192.168.44.52@o2ib44:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 Apr 7 16:38:05 warble1 kernel: LustreError: 14261:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 3 previous similar messages Apr 7 16:38:05 warble2 crmd[14247]: notice: Result of start operation for warble2-ipmi on warble2-host.oob: 0 (ok) Apr 7 16:38:05 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:05 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:05 warble1 kernel: Lustre: server umount apps-MDT0000 complete Apr 7 16:38:05 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:38:05 warble1 Lustre(warble2-apps-MDT0)[49229] INFO: warble2-apps-MDT0-pool/MDT0 unmounted successfully Apr 7 16:38:05 warble1 crmd[13947]: notice: Result of stop operation for warble2-apps-MDT0 on warble1-host.oob: 0 (ok) Apr 7 16:38:05 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:05 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:05 warble1 Lustre(warble2-home-MDT0)[49234] INFO: warble2-home-MDT0-pool/MDT0 unmounted successfully Apr 7 16:38:05 warble1 crmd[13947]: notice: Result of stop operation for warble2-home-MDT0 on warble1-host.oob: 0 (ok) Apr 7 16:38:05 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:05 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:06 warble1 Lustre(warble1-images-MDT0)[4922 INFO: warble1-images-MDT0-pool/MDT0 unmounted successfully Apr 7 16:38:06 warble1 crmd[13947]: notice: Result of stop operation for warble1-images-MDT0 on warble1-host.oob: 0 (ok) Apr 7 16:38:06 warble1 stonith-ng[13943]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:06 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:06 warble1 kernel: LustreError: 137-5: home-MDT0000_UUID: not available for connect from 192.168.44.107@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:38:06 warble1 kernel: LustreError: Skipped 6 previous similar messages Apr 7 16:38:08 warble1 kernel: LustreError: 14254:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff885aab905700 x1594142133172080/t0(0) o13->dagg-OST0004-osc-MDT0001@192.168.44.33@o2ib44:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 Apr 7 16:38:08 warble1 kernel: LustreError: 14254:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 8 previous similar messages Apr 7 16:38:08 warble1 kernel: LustreError: 137-5: apps-MDT0000_UUID: not available for connect from 192.168.44.51@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:38:08 warble1 kernel: LustreError: Skipped 7 previous similar messages Apr 7 16:38:09 warble1 kernel: Lustre: dagg-MDT0001: Not available for connect from 192.168.44.36@o2ib44 (stopping) Apr 7 16:38:09 warble1 kernel: Lustre: Skipped 9 previous similar messages Apr 7 16:38:10 warble1 kernel: LustreError: 49321:0:(osp_dev.c:1276:osp_device_free()) header@ffff885e724737b0[0x0, 1, [0x200000007:0x1:0x0] hash exist]{ Apr 7 16:38:10 warble1 kernel: LustreError: 49321:0:(osp_dev.c:1276:osp_device_free()) ....mdt@ffff885e72473800mdt-object@ffff885e724737b0( , writecount=0) Apr 7 16:38:10 warble1 kernel: LustreError: 49321:0:(osp_dev.c:1276:osp_device_free()) ....mdd@ffff88bd62be0e60mdd-object@ffff88bd62be0e60(open_count=0, valid=0, cltime=0, flags=0) Apr 7 16:38:10 warble1 kernel: LustreError: 22468:0:(ldlm_lockd.c:2365:ldlm_cancel_handler()) ldlm_cancel from 192.168.44.136@o2ib44 arrived at 1523083090 with bad export cookie 16766780683466865680 Apr 7 16:38:10 warble1 kernel: LustreError: 49321:0:(osp_dev.c:1276:osp_device_free()) ....lod@ffff88bbefc281a0lod-object@ffff88bbefc281a0 Apr 7 16:38:10 warble1 kernel: LustreError: 49321:0:(osp_dev.c:1276:osp_device_free()) ....osp@ffff88bdae0a6850osp-object@ffff88bdae0a6800 Apr 7 16:38:10 warble1 kernel: LustreError: 49321:0:(osp_dev.c:1276:osp_device_free()) } header@ffff885e724737b0 Apr 7 16:38:10 warble1 kernel: LustreError: 49321:0:(lu_object.c:1177:lu_device_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 1 Apr 7 16:38:10 warble1 kernel: LustreError: 49321:0:(lu_object.c:1177:lu_device_fini()) LBUG Apr 7 16:38:10 warble1 kernel: Pid: 49321, comm: umount Apr 7 16:38:10 warble1 kernel: #012Call Trace: Apr 7 16:38:10 warble1 kernel: [] libcfs_call_trace+0x4e/0x60 [libcfs] Apr 7 16:38:10 warble1 kernel: [] lbug_with_loc+0x4c/0xb0 [libcfs] Apr 7 16:38:10 warble1 kernel: [] lu_device_fini+0xb8/0xc0 [obdclass] Apr 7 16:38:10 warble1 kernel: [] dt_device_fini+0xe/0x10 [obdclass] Apr 7 16:38:10 warble1 kernel: [] osp_device_free+0x42/0x1f0 [osp] Apr 7 16:38:10 warble1 kernel: [] class_free_dev+0x54e/0x7f0 [obdclass] Apr 7 16:38:10 warble1 kernel: [] class_export_put+0x220/0x2f0 [obdclass] Apr 7 16:38:10 warble1 kernel: [] class_unlink_export+0x135/0x170 [obdclass] Apr 7 16:38:10 warble1 kernel: [] class_decref+0x80/0x160 [obdclass] Apr 7 16:38:10 warble1 kernel: [] class_detach+0x1b3/0x2e0 [obdclass] Apr 7 16:38:10 warble1 kernel: [] class_process_config+0x1a28/0x23f0 [obdclass] Apr 7 16:38:10 warble1 kernel: [] ? ttwu_do_activate.constprop.91+0x5d/0x70 Apr 7 16:38:10 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 16:38:10 warble1 kernel: [] class_manual_cleanup+0x1e0/0x710 [obdclass] Apr 7 16:38:10 warble1 kernel: [] osp_obd_disconnect+0x178/0x210 [osp] Apr 7 16:38:10 warble1 kernel: [] lod_putref+0x258/0x960 [lod] Apr 7 16:38:10 warble1 kernel: [] lod_fini_tgt+0xdd/0x3a0 [lod] Apr 7 16:38:10 warble1 kernel: [] lod_device_fini+0x7c/0x1f0 [lod] Apr 7 16:38:10 warble1 kernel: [] class_cleanup+0x971/0xcd0 [obdclass] Apr 7 16:38:10 warble1 kernel: [] class_process_config+0x1992/0x23f0 [obdclass] Apr 7 16:38:10 warble1 kernel: [] ? ttwu_do_activate.constprop.91+0x5d/0x70 Apr 7 16:38:10 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 16:38:10 warble1 kernel: [] class_manual_cleanup+0x1c6/0x710 [obdclass] Apr 7 16:38:10 warble1 kernel: [] lod_obd_disconnect+0x93/0x1c0 [lod] Apr 7 16:38:10 warble1 kernel: [] mdd_process_config+0x289/0x600 [mdd] Apr 7 16:38:10 warble1 kernel: [] mdt_stack_fini+0x2bc/0xd40 [mdt] Apr 7 16:38:10 warble1 kernel: [] mdt_device_fini+0x4d3/0x920 [mdt] Apr 7 16:38:10 warble1 kernel: [] class_cleanup+0x971/0xcd0 [obdclass] Apr 7 16:38:10 warble1 kernel: [] class_process_config+0x1992/0x23f0 [obdclass] Apr 7 16:38:10 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 16:38:10 warble1 kernel: [] class_manual_cleanup+0x1c6/0x710 [obdclass] Apr 7 16:38:10 warble1 kernel: [] server_put_super+0x8de/0xcd0 [obdclass] Apr 7 16:38:10 warble1 kernel: [] generic_shutdown_super+0x72/0x100 Apr 7 16:38:10 warble1 kernel: [] kill_anon_super+0x12/0x20 Apr 7 16:38:10 warble1 kernel: [] lustre_kill_super+0x32/0x50 [obdclass] Apr 7 16:38:10 warble1 kernel: [] deactivate_locked_super+0x49/0x60 Apr 7 16:38:10 warble1 kernel: [] deactivate_super+0x46/0x60 Apr 7 16:38:10 warble1 kernel: [] cleanup_mnt+0x3f/0x80 Apr 7 16:38:10 warble1 kernel: [] __cleanup_mnt+0x12/0x20 Apr 7 16:38:10 warble1 kernel: [] task_work_run+0xc5/0xf0 Apr 7 16:38:10 warble1 kernel: [] do_notify_resume+0x92/0xb0 Apr 7 16:38:10 warble1 kernel: [] int_signal+0x12/0x17 Apr 7 16:38:10 warble1 kernel: Apr 7 16:38:10 warble1 kernel: Kernel panic - not syncing: LBUG Apr 7 16:38:19 transom1 fm0_sm[240274]: WARN [PmAsyncRcv]: PM: PmPrintFailPort: Unable to Get(PortStatus) warble1 hfi1_0 Guid 0x001175010171de62 LID 0x63 Port 1 Apr 7 16:38:28 warble2 corosync[14228]: [TOTEM ] A processor failed, forming new configuration. Apr 7 16:38:30 transom1 fm0_sm[240274]: WARN [PmAsyncRcv]: PM: PmPrintFailPort: Unable to Get(PortStatus) warble1 hfi1_0 Guid 0x001175010171de62 LID 0x63 Port 1 Apr 7 16:38:41 transom1 fm0_sm[240274]: WARN [PmAsyncRcv]: PM: PmPrintFailPort: Unable to Get(PortStatus) warble1 hfi1_0 Guid 0x001175010171de62 LID 0x63 Port 1 Apr 7 16:38:51 transom1 fm0_sm[240274]: WARN [PmAsyncRcv]: PM: PmPrintFailPort: Unable to Get(PortStatus) warble1 hfi1_0 Guid 0x001175010171de62 LID 0x63 Port 1 Apr 7 16:38:52 warble2 corosync[14228]: [TOTEM ] A new membership (10.7.2.232:172) was formed. Members left: 1 Apr 7 16:38:52 warble2 corosync[14228]: [TOTEM ] Failed to receive the leave message. failed: 1 Apr 7 16:38:52 warble2 corosync[14228]: [QUORUM] Members[1]: 2 Apr 7 16:38:52 warble2 corosync[14228]: [MAIN ] Completed service synchronization, ready to provide service. Apr 7 16:38:52 warble2 attrd[14245]: notice: Node warble1-host.oob state is now lost Apr 7 16:38:52 warble2 attrd[14245]: notice: Removing all warble1-host.oob attributes for peer loss Apr 7 16:38:52 warble2 attrd[14245]: notice: Lost attribute writer warble1-host.oob Apr 7 16:38:52 warble2 attrd[14245]: notice: Purged 1 peers with id=1 and/or uname=warble1-host.oob from the membership cache Apr 7 16:38:52 warble2 stonith-ng[14243]: notice: Node warble1-host.oob state is now lost Apr 7 16:38:52 warble2 cib[14242]: notice: Node warble1-host.oob state is now lost Apr 7 16:38:52 warble2 cib[14242]: notice: Purged 1 peers with id=1 and/or uname=warble1-host.oob from the membership cache Apr 7 16:38:52 warble2 stonith-ng[14243]: notice: Purged 1 peers with id=1 and/or uname=warble1-host.oob from the membership cache Apr 7 16:38:52 warble2 pacemakerd[14241]: notice: Node warble1-host.oob state is now lost Apr 7 16:38:52 warble2 crmd[14247]: notice: Our peer on the DC (warble1-host.oob) is dead Apr 7 16:38:52 warble2 crmd[14247]: notice: State transition S_NOT_DC -> S_ELECTION Apr 7 16:38:52 warble2 crmd[14247]: notice: Node warble1-host.oob state is now lost Apr 7 16:38:52 warble2 crmd[14247]: notice: State transition S_ELECTION -> S_INTEGRATION Apr 7 16:38:52 warble2 crmd[14247]: warning: Input I_ELECTION_DC received in state S_INTEGRATION from do_election_check Apr 7 16:38:56 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:56 warble2 pengine[14246]: warning: Cluster node warble1-host.oob will be fenced: peer is no longer part of the cluster Apr 7 16:38:56 warble2 pengine[14246]: warning: Node warble1-host.oob is unclean Apr 7 16:38:56 warble2 pengine[14246]: warning: Action warble1-zfs-MGT-pool_stop_0 on warble1-host.oob is unrunnable (offline) Apr 7 16:38:56 warble2 pengine[14246]: warning: Action warble2-zfs-dagg-MDT0-pool_stop_0 on warble1-host.oob is unrunnable (offline) Apr 7 16:38:56 warble2 pengine[14246]: warning: Action warble1-zfs-dagg-MDT2-pool_stop_0 on warble1-host.oob is unrunnable (offline) Apr 7 16:38:56 warble2 pengine[14246]: warning: Action warble1-dagg-MDT2_stop_0 on warble1-host.oob is unrunnable (offline) Apr 7 16:38:56 warble2 pengine[14246]: warning: Action warble1-zfs-dagg-MDT1-pool_stop_0 on warble1-host.oob is unrunnable (offline) Apr 7 16:38:56 warble2 pengine[14246]: warning: Action warble1-dagg-MDT1_stop_0 on warble1-host.oob is unrunnable (offline) Apr 7 16:38:56 warble2 pengine[14246]: warning: Action warble1-zfs-images-MDT0-pool_stop_0 on warble1-host.oob is unrunnable (offline) Apr 7 16:38:56 warble2 pengine[14246]: warning: Action warble2-zfs-apps-MDT0-pool_stop_0 on warble1-host.oob is unrunnable (offline) Apr 7 16:38:56 warble2 pengine[14246]: warning: Action warble2-zfs-home-MDT0-pool_stop_0 on warble1-host.oob is unrunnable (offline) Apr 7 16:38:56 warble2 pengine[14246]: warning: Scheduling Node warble1-host.oob for STONITH Apr 7 16:38:56 warble2 pengine[14246]: notice: * Fence (reboot) warble1-host.oob 'peer is no longer part of the cluster' Apr 7 16:38:56 warble2 pengine[14246]: notice: * Move warble1-zfs-MGT-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Start warble1-MGT ( warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Move warble2-zfs-dagg-MDT0-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Start warble2-dagg-MDT0 ( warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Move warble1-zfs-dagg-MDT2-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Move warble1-dagg-MDT2 ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Move warble1-zfs-dagg-MDT1-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Move warble1-dagg-MDT1 ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Move warble1-zfs-images-MDT0-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Start warble1-images-MDT0 ( warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Move warble2-zfs-apps-MDT0-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Start warble2-apps-MDT0 ( warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Move warble2-zfs-home-MDT0-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: notice: * Start warble2-home-MDT0 ( warble2-host.oob ) Apr 7 16:38:56 warble2 pengine[14246]: warning: Calculated transition 0 (with warnings), saving inputs in /var/lib/pacemaker/pengine/pe-warn-0.bz2 Apr 7 16:38:56 warble2 crmd[14247]: notice: Initiating monitor operation warble1-ipmi_monitor_60000 locally on warble2-host.oob Apr 7 16:38:56 warble2 crmd[14247]: notice: Initiating monitor operation warble2-ipmi_monitor_60000 locally on warble2-host.oob Apr 7 16:38:56 warble2 crmd[14247]: notice: Requesting fencing (reboot) of node warble1-host.oob Apr 7 16:38:56 warble2 stonith-ng[14243]: notice: Client crmd.14247.7c55338d wants to fence (reboot) 'warble1-host.oob' with device '(any)' Apr 7 16:38:56 warble2 stonith-ng[14243]: notice: Requesting peer fencing (reboot) of warble1-host.oob Apr 7 16:38:56 warble2 stonith-ng[14243]: notice: warble1-ipmi can fence (reboot) warble1-host.oob: static-list Apr 7 16:38:56 warble2 stonith-ng[14243]: notice: warble2-ipmi can not fence (reboot) warble1-host.oob: static-list Apr 7 16:38:56 warble2 stonith-ng[14243]: notice: warble1-ipmi can fence (reboot) warble1-host.oob: static-list Apr 7 16:38:56 warble2 stonith-ng[14243]: notice: warble2-ipmi can not fence (reboot) warble1-host.oob: static-list Apr 7 16:38:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:38:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:39:02 transom1 fm0_sm[240274]: WARN [PmAsyncRcv]: PM: PmPrintFailPort: Unable to Get(PortStatus) warble1 hfi1_0 Guid 0x001175010171de62 LID 0x63 Port 1 Apr 7 16:39:04 transom1 fm0_sm[240274]: transom1; MSG:NOTICE|SM:transom1:port 1|COND:#4 Disappearance from fabric|NODE:warble1 hfi1_0:port 1:0x001175010171de62|LINKEDTO:opa-l-5:port 3:0x00117501020c4c04|DETAIL:Node type: hfi Apr 7 16:39:13 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble1 not in post Apr 7 16:39:24 warble2 fence_ipmilan: Timed out waiting to power ON Apr 7 16:39:24 warble2 stonith-ng[14243]: warning: fence_ipmilan[423934] stderr: [ Timed out waiting to power ON ] Apr 7 16:39:24 warble2 stonith-ng[14243]: warning: fence_ipmilan[423934] stderr: [ ] Apr 7 16:39:24 warble2 stonith-ng[14243]: notice: Operation 'reboot' [423934] (call 2 from crmd.14247) for host 'warble1-host.oob' with device 'warble1-ipmi' returned: 0 (OK) Apr 7 16:39:24 warble2 stonith-ng[14243]: notice: Operation reboot of warble1-host.oob by warble2-host.oob for crmd.14247@warble2-host.oob.44ec5260: OK Apr 7 16:39:24 warble2 crmd[14247]: notice: Stonith operation 2/1:0:0:90e0c6cf-674b-4d88-afa5-28f30039c092: OK (0) Apr 7 16:39:24 warble2 crmd[14247]: notice: Peer warble1-host.oob was terminated (reboot) by warble2-host.oob for warble2-host.oob: OK (ref=44ec5260-748e-456b-9065-bca34b0016aa) by client crmd.14247 Apr 7 16:39:24 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-MGT-pool_start_0 locally on warble2-host.oob Apr 7 16:39:24 warble2 crmd[14247]: notice: Initiating start operation warble2-zfs-dagg-MDT0-pool_start_0 locally on warble2-host.oob Apr 7 16:39:24 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-images-MDT0-pool_start_0 locally on warble2-host.oob Apr 7 16:39:24 warble2 crmd[14247]: notice: Initiating start operation warble2-zfs-apps-MDT0-pool_start_0 locally on warble2-host.oob Apr 7 16:39:24 warble2 crmd[14247]: notice: Initiating start operation warble2-zfs-home-MDT0-pool_start_0 locally on warble2-host.oob Apr 7 16:39:24 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-dagg-MDT2-pool_start_0 locally on warble2-host.oob Apr 7 16:39:24 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-dagg-MDT1-pool_start_0 locally on warble2-host.oob Apr 7 16:39:31 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble1 not in post Apr 7 16:39:49 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble1 not in post Apr 7 16:40:07 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble1 not in post Apr 7 16:40:50 warble2 zed: eid=28 class=history_event pool_guid=0xC0BDFB4695D313E6 Apr 7 16:40:50 warble2 zed: eid=29 class=config_cache_write pool_guid=0xC0BDFB4695D313E6 Apr 7 16:40:50 warble2 zed: eid=30 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 16:40:50 warble2 zed: eid=31 class=pool_import pool_guid=0xC0BDFB4695D313E6 Apr 7 16:40:50 warble2 zed: eid=32 class=history_event pool_guid=0x5ED256D9C36340D3 Apr 7 16:40:50 warble2 zed: eid=33 class=config_cache_write pool_guid=0x5ED256D9C36340D3 Apr 7 16:40:50 warble2 zed: eid=34 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 16:40:50 warble2 zed: eid=35 class=pool_import pool_guid=0x5ED256D9C36340D3 Apr 7 16:40:50 warble2 zed: eid=36 class=history_event pool_guid=0xCF79F68EBE891CC3 Apr 7 16:40:50 warble2 zed: eid=37 class=config_cache_write pool_guid=0xCF79F68EBE891CC3 Apr 7 16:40:50 warble2 zed: eid=38 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 16:40:50 warble2 zed: eid=39 class=pool_import pool_guid=0xCF79F68EBE891CC3 Apr 7 16:40:50 warble2 zed: eid=40 class=history_event pool_guid=0xFC863664CC04C875 Apr 7 16:40:50 warble2 zed: eid=41 class=config_cache_write pool_guid=0xFC863664CC04C875 Apr 7 16:40:50 warble2 zed: eid=42 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 16:40:50 warble2 zed: eid=43 class=pool_import pool_guid=0xFC863664CC04C875 Apr 7 16:40:50 warble2 zed: eid=44 class=history_event pool_guid=0x979BA0B2D95A8C68 Apr 7 16:40:50 warble2 zed: eid=45 class=config_cache_write pool_guid=0x979BA0B2D95A8C68 Apr 7 16:40:50 warble2 zed: eid=46 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 16:40:50 warble2 zed: eid=47 class=pool_import pool_guid=0x979BA0B2D95A8C68 Apr 7 16:40:51 warble2 zed: eid=48 class=history_event pool_guid=0x13C167322AB5F5E9 Apr 7 16:40:51 warble2 zed: eid=49 class=config_cache_write pool_guid=0x13C167322AB5F5E9 Apr 7 16:40:51 warble2 zed: eid=50 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 16:40:51 warble2 zed: eid=51 class=pool_import pool_guid=0x13C167322AB5F5E9 Apr 7 16:40:51 warble2 zed: eid=52 class=history_event pool_guid=0xE146DD6489A1819A Apr 7 16:40:51 warble2 zed: eid=53 class=config_cache_write pool_guid=0xE146DD6489A1819A Apr 7 16:40:51 warble2 zed: eid=54 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 16:40:51 warble2 zed: eid=55 class=pool_import pool_guid=0xE146DD6489A1819A Apr 7 16:40:51 warble2 zed: eid=56 class=history_event pool_guid=0xC0BDFB4695D313E6 Apr 7 16:40:51 warble2 zed: eid=57 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 16:40:51 warble2 zed: eid=58 class=history_event pool_guid=0x5ED256D9C36340D3 Apr 7 16:40:51 warble2 zed: eid=59 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 16:40:51 warble2 zed: eid=60 class=history_event pool_guid=0xCF79F68EBE891CC3 Apr 7 16:40:51 warble2 zed: eid=61 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 16:40:51 warble2 zed: eid=62 class=history_event pool_guid=0xFC863664CC04C875 Apr 7 16:40:51 warble2 zed: eid=63 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 16:40:51 warble2 zed: eid=64 class=history_event pool_guid=0x979BA0B2D95A8C68 Apr 7 16:40:51 warble2 zed: eid=65 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 16:40:51 warble2 lrmd[14244]: notice: warble1-zfs-MGT-pool_start_0:424085:stderr [ cannot open 'warble1-MGT-pool': no such pool ] Apr 7 16:40:51 warble2 lrmd[14244]: notice: warble1-zfs-dagg-MDT1-pool_start_0:424094:stderr [ cannot open 'warble1-dagg-MDT1-pool': no such pool ] Apr 7 16:40:51 warble2 lrmd[14244]: notice: warble1-zfs-images-MDT0-pool_start_0:424087:stderr [ cannot open 'warble1-images-MDT0-pool': no such pool ] Apr 7 16:40:51 warble2 lrmd[14244]: notice: warble2-zfs-apps-MDT0-pool_start_0:424088:stderr [ cannot open 'warble2-apps-MDT0-pool': no such pool ] Apr 7 16:40:51 warble2 lrmd[14244]: notice: warble2-zfs-dagg-MDT0-pool_start_0:424086:stderr [ cannot open 'warble2-dagg-MDT0-pool': no such pool ] Apr 7 16:40:51 warble2 lrmd[14244]: notice: warble2-zfs-home-MDT0-pool_start_0:424089:stderr [ cannot open 'warble2-home-MDT0-pool': no such pool ] Apr 7 16:40:51 warble2 lrmd[14244]: notice: warble1-zfs-dagg-MDT2-pool_start_0:424090:stderr [ cannot open 'warble1-dagg-MDT2-pool': no such pool ] Apr 7 16:40:51 warble2 crmd[14247]: notice: Result of start operation for warble1-zfs-MGT-pool on warble2-host.oob: 0 (ok) Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 zed: eid=66 class=history_event pool_guid=0x13C167322AB5F5E9 Apr 7 16:40:51 warble2 crmd[14247]: notice: Result of start operation for warble1-zfs-dagg-MDT1-pool on warble2-host.oob: 0 (ok) Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 zed: eid=67 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 16:40:51 warble2 crmd[14247]: notice: Result of start operation for warble1-zfs-images-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 crmd[14247]: notice: Result of start operation for warble2-zfs-apps-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 zed: eid=68 class=history_event pool_guid=0xE146DD6489A1819A Apr 7 16:40:51 warble2 crmd[14247]: notice: Result of start operation for warble2-zfs-dagg-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 zed: eid=69 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 16:40:51 warble2 crmd[14247]: notice: Result of start operation for warble2-zfs-home-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 crmd[14247]: notice: Result of start operation for warble1-zfs-dagg-MDT2-pool on warble2-host.oob: 0 (ok) Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-MGT-pool_monitor_5000 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating start operation warble1-MGT_start_0 locally on warble2-host.oob Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-dagg-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating start operation warble2-dagg-MDT0_start_0 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT1-pool_monitor_5000 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating start operation warble1-dagg-MDT1_start_0 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-images-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating start operation warble1-images-MDT0_start_0 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-apps-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating start operation warble2-apps-MDT0_start_0 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-home-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating start operation warble2-home-MDT0_start_0 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT2-pool_monitor_5000 locally on warble2-host.oob Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating start operation warble1-dagg-MDT2_start_0 locally on warble2-host.oob Apr 7 16:40:51 warble2 Lustre(warble1-MGT)[429403]: INFO: Starting to mount warble1-MGT-pool/MGT Apr 7 16:40:51 warble2 Lustre(warble2-dagg-MDT0)[429405 INFO: Starting to mount warble2-dagg-MDT0-pool/MDT0 Apr 7 16:40:51 warble2 Lustre(warble1-dagg-MDT1)[429409 INFO: Starting to mount warble1-dagg-MDT1-pool/MDT1 Apr 7 16:40:51 warble2 Lustre(warble1-images-MDT0)[4294 INFO: Starting to mount warble1-images-MDT0-pool/MDT0 Apr 7 16:40:51 warble2 Lustre(warble2-apps-MDT0)[429420 INFO: Starting to mount warble2-apps-MDT0-pool/MDT0 Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 Lustre(warble2-home-MDT0)[429426 INFO: Starting to mount warble2-home-MDT0-pool/MDT0 Apr 7 16:40:51 warble2 Lustre(warble1-dagg-MDT2)[429432 INFO: Starting to mount warble1-dagg-MDT2-pool/MDT2 Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 Lustre(warble1-MGT)[429403]: INFO: warble1-MGT-pool/MGT mounted successfully Apr 7 16:40:51 warble2 kernel: Lustre: MGS: Connection restored to 192.168.44.22@o2ib44 (at 0@lo) Apr 7 16:40:51 warble2 crmd[14247]: notice: Result of start operation for warble1-MGT on warble2-host.oob: 0 (ok) Apr 7 16:40:51 warble2 crmd[14247]: notice: Initiating monitor operation warble1-MGT_monitor_20000 locally on warble2-host.oob Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:40:51 warble2 kernel: LustreError: 137-5: apps-MDT0000_UUID: not available for connect from 192.168.44.110@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:40:51 warble2 kernel: LustreError: Skipped 3 previous similar messages Apr 7 16:40:51 warble2 kernel: Lustre: MGS: Connection restored to 192.168.44.32@o2ib44 (at 192.168.44.32@o2ib44) Apr 7 16:40:53 warble2 kernel: Lustre: MGS: Connection restored to 192.168.44.34@o2ib44 (at 192.168.44.34@o2ib44) Apr 7 16:40:53 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:40:56 warble2 zed: eid=70 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 16:40:56 warble2 kernel: Lustre: MGS: Connection restored to 6726d708-248c-6db7-b1c3-d1dc8a1d076f (at 192.168.44.209@o2ib44) Apr 7 16:40:56 warble2 kernel: Lustre: Skipped 6 previous similar messages Apr 7 16:40:56 warble2 zed: eid=71 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 16:40:56 warble2 zed: eid=72 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 16:40:56 warble2 zed: eid=73 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 16:40:56 warble2 zed: eid=74 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 16:40:56 warble2 zed: eid=75 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 16:40:56 warble2 zed: eid=76 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 16:40:56 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1523083251/real 0] req@ffff885caefabf00 x1594152428477360/t0(0) o250->MGC192.168.44.21@o2ib44@192.168.44.21@o2ib44:26/25 lens 520/544 e 0 to 1 dl 1523083256 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 16:40:56 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Apr 7 16:41:00 warble2 kernel: Lustre: MGS: Connection restored to 52527511-38de-0e73-d9d3-4312271bcd41 (at 192.168.44.188@o2ib44) Apr 7 16:41:00 warble2 kernel: Lustre: Skipped 5 previous similar messages Apr 7 16:41:07 warble2 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.179@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:41:07 warble2 kernel: LustreError: Skipped 222 previous similar messages Apr 7 16:41:08 warble2 kernel: LustreError: 429514:0:(mgc_request.c:251:do_config_log_add()) MGC192.168.44.21@o2ib44: failed processing log, type 1: rc = -5 Apr 7 16:41:08 warble2 kernel: Lustre: MGS: Connection restored to 04767512-61db-055d-fc68-95a01e3940f1 (at 192.168.44.218@o2ib44) Apr 7 16:41:08 warble2 kernel: Lustre: Skipped 22 previous similar messages Apr 7 16:41:24 warble2 kernel: Lustre: MGS: Connection restored to fc0687ad-2fe7-69e1-528c-0b5ed0b145bc (at 192.168.44.173@o2ib44) Apr 7 16:41:24 warble2 kernel: Lustre: Skipped 59 previous similar messages Apr 7 16:41:39 warble2 kernel: LustreError: 429514:0:(mgc_request.c:251:do_config_log_add()) MGC192.168.44.21@o2ib44: failed processing log, type 4: rc = -110 Apr 7 16:41:40 warble2 kernel: LustreError: 137-5: dagg-MDT0000_UUID: not available for connect from 192.168.44.145@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:41:40 warble2 kernel: LustreError: Skipped 529 previous similar messages Apr 7 16:41:51 warble2 kernel: Lustre: dagg-MDT0000: Imperative Recovery not enabled, recovery window 300-900 Apr 7 16:41:51 warble2 Lustre(warble2-dagg-MDT0)[429405 INFO: warble2-dagg-MDT0-pool/MDT0 mounted successfully Apr 7 16:41:51 warble2 crmd[14247]: notice: Result of start operation for warble2-dagg-MDT0 on warble2-host.oob: 0 (ok) Apr 7 16:41:51 warble2 crmd[14247]: notice: Initiating monitor operation warble2-dagg-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 16:41:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:51 warble2 kernel: LustreError: 11-0: dagg-MDT0000-osp-MDT0001: operation mds_connect to node 0@lo failed: rc = -114 Apr 7 16:41:51 warble2 Lustre(warble1-dagg-MDT1)[429409 INFO: warble1-dagg-MDT1-pool/MDT1 mounted successfully Apr 7 16:41:51 warble2 crmd[14247]: notice: Result of start operation for warble1-dagg-MDT1 on warble2-host.oob: 0 (ok) Apr 7 16:41:51 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT1_monitor_20000 locally on warble2-host.oob Apr 7 16:41:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:51 warble2 Lustre(warble2-apps-MDT0)[429420 INFO: warble2-apps-MDT0-pool/MDT0 mounted successfully Apr 7 16:41:51 warble2 crmd[14247]: notice: Result of start operation for warble2-apps-MDT0 on warble2-host.oob: 0 (ok) Apr 7 16:41:51 warble2 crmd[14247]: notice: Initiating monitor operation warble2-apps-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 16:41:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:51 warble2 Lustre(warble1-images-MDT0)[4294 INFO: warble1-images-MDT0-pool/MDT0 mounted successfully Apr 7 16:41:51 warble2 crmd[14247]: notice: Result of start operation for warble1-images-MDT0 on warble2-host.oob: 0 (ok) Apr 7 16:41:51 warble2 crmd[14247]: notice: Initiating monitor operation warble1-images-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 16:41:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:51 warble2 Lustre(warble2-home-MDT0)[429426 INFO: warble2-home-MDT0-pool/MDT0 mounted successfully Apr 7 16:41:51 warble2 crmd[14247]: notice: Result of start operation for warble2-home-MDT0 on warble2-host.oob: 0 (ok) Apr 7 16:41:51 warble2 crmd[14247]: notice: Initiating monitor operation warble2-home-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 16:41:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:51 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:52 warble2 kernel: Lustre: apps-MDT0000: Will be in recovery for at least 5:00, or until 122 clients reconnect Apr 7 16:41:52 warble2 kernel: Lustre: images-MDT0000: Will be in recovery for at least 5:00, or until 123 clients reconnect Apr 7 16:41:52 warble2 kernel: Lustre: Skipped 2 previous similar messages Apr 7 16:41:52 warble2 kernel: Lustre: dagg-MDT0002: Not available for connect from 192.168.44.121@o2ib44 (not set up) Apr 7 16:41:52 warble2 kernel: Lustre: Skipped 5 previous similar messages Apr 7 16:41:52 warble2 kernel: Lustre: Skipped 3 previous similar messages Apr 7 16:41:52 warble2 kernel: Lustre: dagg-MDT0002: Imperative Recovery not enabled, recovery window 300-900 Apr 7 16:41:52 warble2 kernel: Lustre: Skipped 4 previous similar messages Apr 7 16:41:52 warble2 Lustre(warble1-dagg-MDT2)[429432 INFO: warble1-dagg-MDT2-pool/MDT2 mounted successfully Apr 7 16:41:52 warble2 crmd[14247]: notice: Result of start operation for warble1-dagg-MDT2 on warble2-host.oob: 0 (ok) Apr 7 16:41:52 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT2_monitor_20000 locally on warble2-host.oob Apr 7 16:41:52 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:52 warble2 crmd[14247]: notice: Transition 0 (Complete=70, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-warn-0.bz2): Complete Apr 7 16:41:52 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:41:52 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:41:52 warble2 kernel: Lustre: dagg-MDT0002: Will be in recovery for at least 5:00, or until 124 clients reconnect Apr 7 16:41:56 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1523083311/real 0] req@ffff885caefad400 x1594152428486400/t0(0) o38->home-MDT0000-lwp-MDT0000@192.168.44.21@o2ib44:12/10 lens 520/544 e 0 to 1 dl 1523083316 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 16:41:56 warble2 kernel: Lustre: dagg-MDT0001: Connection restored to dc71949c-276e-0571-c538-0dd062179d6b (at 192.168.44.200@o2ib44) Apr 7 16:41:56 warble2 kernel: Lustre: Skipped 112 previous similar messages Apr 7 16:42:01 warble2 kernel: Lustre: home-MDT0000: Recovery over after 0:10, of 122 clients 122 recovered and 0 were evicted. Apr 7 16:42:01 warble2 kernel: Lustre: Skipped 2 previous similar messages Apr 7 16:42:23 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1523083337/real 0] req@ffff885d4c942d00 x1594152428490896/t0(0) o38->dagg-MDT0000-osp-MDT0002@192.168.44.21@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523083343 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 16:42:23 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 6 previous similar messages Apr 7 16:42:42 warble2 kernel: Lustre: dagg-MDT0002: Recovery over after 0:50, of 124 clients 124 recovered and 0 were evicted. Apr 7 16:42:42 warble2 kernel: LustreError: 441494:0:(tgt_handler.c:509:tgt_filter_recovery_request()) @@@ not permitted during recovery req@ffff88bd6fea8300 x1594152428496288/t0(0) o601->dagg-MDT0000-lwp-MDT0002_UUID@0@lo:728/0 lens 336/0 e 0 to 0 dl 1523083368 ref 1 fl Interpret:/0/ffffffff rc 0/-1 Apr 7 16:42:42 warble2 kernel: LustreError: 11-0: dagg-MDT0000-lwp-MDT0002: operation quota_acquire to node 0@lo failed: rc = -11 Apr 7 16:42:42 warble2 kernel: LustreError: Skipped 1 previous similar message Apr 7 16:42:43 warble2 kernel: Lustre: dagg-MDT0001: Recovery over after 0:52, of 124 clients 124 recovered and 0 were evicted. Apr 7 16:42:43 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:42:57 warble2 kernel: bnx2x 0000:19:00.3 em4: NIC Link is Down Apr 7 16:43:00 warble2 kernel: bnx2x 0000:19:00.3 em4: NIC Link is Up, 1000 Mbps full duplex, Flow control: ON - receive & transmit Apr 7 16:43:00 warble2.oob Severity: Warning, Category: System Health, MessageID: NIC100, Message: The NIC Integrated 1 Port 4 network link is down. Apr 7 16:47:01 transom1 rsyncd[421451]: connect from warble1 (192.168.44.21) Apr 7 16:47:01 transom1 rsyncd[421451]: rsync on images/centos-7.4-minimal-server-05//etc/rsync.options.farnarkle from boot@warble1 (192.168.44.21) Apr 7 16:47:01 transom1 rsyncd[421455]: connect from warble1 (192.168.44.21) Apr 7 16:47:01 transom1 rsyncd[421455]: rsync on images/centos-7.4-minimal-server-05// from boot@warble1 (192.168.44.21) Apr 7 16:47:09 transom1 rsyncd[421511]: connect from warble1 (192.168.44.21) Apr 7 16:47:09 transom1 rsyncd[421511]: rsync on images/centos-7.4-minimal-server-05//lib/modules/3.10.0-693.17.1.el7.x86_64/ from boot@warble1 (192.168.44.21) Apr 7 16:47:31 transom1 fm0_sm[240274]: transom1; MSG:NOTICE|SM:transom1:port 1|COND:#3 Appearance in fabric|NODE:warble1 hfi1_0:port 1:0x001175010171de62|LINKEDTO:opa-l-5:port 3:0x00117501020c4c04|DETAIL:Node type: hfi Apr 7 16:46:46 warble1 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys cpuset Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys cpu Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys cpuacct Apr 7 16:46:46 warble1 kernel: Linux version 3.10.0-693.17.1.el7.x86_64 (builder@kbuilder.dev.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Thu Jan 25 20:13:58 UTC 2018 Apr 7 16:46:46 warble1 kernel: Command line: initrd=oneSIS/initramfs-3.10.0-693.17.1.el7.x86_64.onesis.server.01.img root=rsync://boot@192.168.44.11/images/centos-7.4-minimal-server-05/ ro crashkernel=auto vconsole.font=latarcyrheb-sun16 vconsole.keymap=us LANG=en_US.UTF-8 console=tty0 console=ttyS0,115200n8 rd.driver.blacklist=nouveau selinux=0 exec-shield=0 audit=0 timeshift=12 cluster=farnarkle ping=192.168.44.11 rd.shell bond=bond0:em1,em2:miimon=100,xmit_hash_policy=1,mode=4,lacp_rate=1:9000 nopti BOOT_IMAGE=oneSIS/vmlinuz-3.10.0-693.17.1.el7.x86_64 Apr 7 16:46:46 warble1 kernel: e820: BIOS-provided physical RAM map: Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009bfff] usable Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x000000000009c000-0x000000000009ffff] reserved Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x0000000000100000-0x000000006c5cefff] usable Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x000000006c5cf000-0x000000006e7cefff] reserved Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x000000006e7cf000-0x000000006f5fefff] ACPI NVS Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x000000006f5ff000-0x000000006f7fefff] ACPI data Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x000000006f7ff000-0x000000006f7fffff] usable Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x000000006f800000-0x000000008fffffff] reserved Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x00000000fd000000-0x00000000fe7fffff] reserved Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x00000000fec80000-0x00000000fed00fff] reserved Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved Apr 7 16:46:46 warble1 kernel: BIOS-e820: [mem 0x0000000100000000-0x000000c03fffffff] usable Apr 7 16:46:46 warble1 kernel: NX (Execute Disable) protection: active Apr 7 16:46:46 warble1 kernel: SMBIOS 3.0 present. Apr 7 16:46:46 warble1 kernel: e820: last_pfn = 0xc040000 max_arch_pfn = 0x400000000 Apr 7 16:46:46 warble1 kernel: x86 PAT enabled: cpu 0, old 0x5010600070406, new 0x7010600070106 Apr 7 16:46:46 warble1 kernel: total RAM covered: 785392M Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 64K #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 128K #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 256K #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 64K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 128K #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 256K #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 128K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 256K #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 256K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 512K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 1M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 2M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 4M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 8M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 16M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 721936M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1040M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1040M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1040M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1040M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1040M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1040M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 721936M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1040M Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15344M Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30704M Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -61424M Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -122864M Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -229360M Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -196592M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 721936M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 721936M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 721936M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 721936M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 721936M Apr 7 16:46:46 warble1 kernel: gran_size: 32M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 721936M Apr 7 16:46:46 warble1 kernel: gran_size: 64M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 656432M Apr 7 16:46:46 warble1 kernel: gran_size: 64M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1072M Apr 7 16:46:46 warble1 kernel: gran_size: 64M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1072M Apr 7 16:46:46 warble1 kernel: gran_size: 64M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1072M Apr 7 16:46:46 warble1 kernel: gran_size: 64M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1072M Apr 7 16:46:46 warble1 kernel: gran_size: 64M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1072M Apr 7 16:46:46 warble1 kernel: gran_size: 64M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 656432M Apr 7 16:46:46 warble1 kernel: gran_size: 64M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1072M Apr 7 16:46:46 warble1 kernel: *BAD*gran_size: 64M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15312M Apr 7 16:46:46 warble1 kernel: mtrr_cleanup: can not find optimal value Apr 7 16:46:46 warble1 kernel: please specify mtrr_gran_size/mtrr_chunk_size Apr 7 16:46:46 warble1 kernel: e820: last_pfn = 0x6f800 max_arch_pfn = 0x400000000 Apr 7 16:46:46 warble1 kernel: Using GB pages for direct mapping Apr 7 16:46:46 warble1 kernel: RAMDISK: [mem 0x6982a000-0x6c5a9fff] Apr 7 16:46:46 warble1 kernel: Early table checksum verification disabled Apr 7 16:46:46 warble1 kernel: ACPI: RSDP 00000000000fe320 00024 (v02 DELL ) Apr 7 16:46:46 warble1 kernel: ACPI: XSDT 000000006f6c0188 000FC (v01 DELL PE_SC3 00000000 01000013) Apr 7 16:46:46 warble1 kernel: ACPI: FACP 000000006f7f8000 00114 (v06 DELL PE_SC3 00000000 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: DSDT 000000006f79e000 32342 (v02 DELL PE_SC3 00000003 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: FACS 000000006f4ef000 00040 Apr 7 16:46:46 warble1 kernel: ACPI: SSDT 000000006f7fc000 003C6 (v02 DELL Tpm2Tabl 00001000 INTL 20150818) Apr 7 16:46:46 warble1 kernel: ACPI: TPM2 000000006f7fb000 00038 (v04 DELL PE_SC3 00000002 01000013) Apr 7 16:46:46 warble1 kernel: ACPI: MCEJ 000000006f7fa000 00130 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: WD__ 000000006f7f9000 00134 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: HPET 000000006f7f7000 00038 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: APIC 000000006f7f5000 016DE (v04 DELL PE_SC3 00000000 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: MCFG 000000006f7f4000 0003C (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: MIGT 000000006f7f3000 00040 (v01 DELL PE_SC3 00000000 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: MSCT 000000006f7f2000 00090 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: NFIT 000000006f7d9000 18028 (v01 00000000 00000000) Apr 7 16:46:46 warble1 kernel: ACPI: PCAT 000000006f7d8000 00048 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: PCCT 000000006f7d7000 0006E (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: RASF 000000006f7d6000 00030 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: SLIT 000000006f7d5000 0006C (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: SRAT 000000006f7d2000 02830 (v03 DELL PE_SC3 00000002 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: SVOS 000000006f7d1000 00032 (v01 DELL PE_SC3 00000000 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: OEM4 000000006f6fb000 A27C4 (v02 INTEL CPU CST 00003000 INTL 20150818) Apr 7 16:46:46 warble1 kernel: ACPI: SSDT 000000006f6c5000 35130 (v02 INTEL SSDT PM 00004000 INTL 20150818) Apr 7 16:46:46 warble1 kernel: ACPI: SSDT 000000006f6c4000 00761 (v02 DELL PE_SC3 00000000 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: SSDT 000000006f6c1000 02541 (v02 INTEL SpsNm 00000002 INTL 20150818) Apr 7 16:46:46 warble1 kernel: ACPI: SPCR 000000006f7fd000 00050 (v01 00000000 00000000) Apr 7 16:46:46 warble1 kernel: ACPI: DMAR 000000006f6bf000 001D0 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: HEST 000000006f6be000 0017C (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: BERT 000000006f6bd000 00030 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: ERST 000000006f6bc000 00230 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 7 16:46:46 warble1 kernel: ACPI: EINJ 000000006f6bb000 00150 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 7 16:46:46 warble1 kernel: SRAT: PXM 0 -> APIC 0x00 -> Node 0 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 1 -> APIC 0x42 -> Node 1 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 0 -> APIC 0x0c -> Node 0 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 1 -> APIC 0x4e -> Node 1 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 0 -> APIC 0x08 -> Node 0 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 1 -> APIC 0x46 -> Node 1 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 0 -> APIC 0x0a -> Node 0 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 1 -> APIC 0x4c -> Node 1 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 0 -> APIC 0x20 -> Node 0 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 1 -> APIC 0x48 -> Node 1 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 0 -> APIC 0x2c -> Node 0 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 1 -> APIC 0x6c -> Node 1 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 0 -> APIC 0x26 -> Node 0 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 1 -> APIC 0x64 -> Node 1 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 0 -> APIC 0x28 -> Node 0 Apr 7 16:46:46 warble1 kernel: SRAT: PXM 1 -> APIC 0x68 -> Node 1 Apr 7 16:46:46 warble1 kernel: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff] Apr 7 16:46:46 warble1 kernel: SRAT: Node 0 PXM 0 [mem 0x100000000-0x603fffffff] Apr 7 16:46:46 warble1 kernel: SRAT: Node 1 PXM 1 [mem 0x6040000000-0xc03fffffff] Apr 7 16:46:46 warble1 kernel: NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x603fffffff] -> [mem 0x00000000-0x603fffffff] Apr 7 16:46:46 warble1 kernel: NODE_DATA(0) allocated [mem 0x603ffd9000-0x603fffffff] Apr 7 16:46:46 warble1 kernel: NODE_DATA(1) allocated [mem 0xc03ffd6000-0xc03fffcfff] Apr 7 16:46:46 warble1 kernel: Reserving 208MB of memory at 688MB for crashkernel (System RAM: 785093MB) Apr 7 16:46:46 warble1 kernel: Zone ranges: Apr 7 16:46:46 warble1 kernel: DMA [mem 0x00001000-0x00ffffff] Apr 7 16:46:46 warble1 kernel: DMA32 [mem 0x01000000-0xffffffff] Apr 7 16:46:46 warble1 kernel: Normal [mem 0x100000000-0xc03fffffff] Apr 7 16:46:46 warble1 kernel: Movable zone start for each node Apr 7 16:46:46 warble1 kernel: Early memory node ranges Apr 7 16:46:46 warble1 kernel: node 0: [mem 0x00001000-0x0009bfff] Apr 7 16:46:46 warble1 kernel: node 0: [mem 0x00100000-0x6c5cefff] Apr 7 16:46:46 warble1 kernel: node 0: [mem 0x6f7ff000-0x6f7fffff] Apr 7 16:46:46 warble1 kernel: node 0: [mem 0x100000000-0x603fffffff] Apr 7 16:46:46 warble1 kernel: node 1: [mem 0x6040000000-0xc03fffffff] Apr 7 16:46:46 warble1 kernel: Initmem setup node 0 [mem 0x00001000-0x603fffffff] Apr 7 16:46:46 warble1 kernel: Initmem setup node 1 [mem 0x6040000000-0xc03fffffff] Apr 7 16:46:46 warble1 kernel: ACPI: PM-Timer IO Port: 0x508 Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x38] lapic_id[0x42] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x0c] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x3c] lapic_id[0x4e] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x08] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x39] lapic_id[0x46] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x0a] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x3b] lapic_id[0x4c] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x20] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x3a] lapic_id[0x48] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id[0x2c] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x3f] lapic_id[0x6c] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id[0x26] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x3d] lapic_id[0x64] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x28] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0x3e] lapic_id[0x68] enabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x00] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x01] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x02] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x03] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x04] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x05] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x06] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x07] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x08] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x09] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0a] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0b] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0c] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0d] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0e] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0f] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x10] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x11] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x12] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x13] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x14] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x15] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x16] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x17] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x18] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x19] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1a] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1b] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1c] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1d] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1e] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1f] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x20] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x21] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x22] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x23] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x24] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x25] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x26] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x27] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x28] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x29] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2a] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2b] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2c] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2d] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2e] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2f] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x30] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x31] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x32] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x33] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x34] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x35] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x36] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x37] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x38] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x39] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3a] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3b] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3c] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3d] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3e] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3f] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x40] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x41] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x42] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x43] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x44] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x45] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x46] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x47] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x48] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x49] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4a] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4b] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4c] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4d] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4e] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4f] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x50] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x51] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x52] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x53] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x54] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x55] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x56] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x57] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x58] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x59] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5a] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5b] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5c] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5d] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5e] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5f] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x60] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x61] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x62] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x63] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x64] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x65] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x66] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x67] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x68] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x69] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6a] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6b] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6c] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6d] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6e] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6f] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x70] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x71] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x72] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x73] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x74] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x75] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x76] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x77] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x78] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x79] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7a] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7b] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7c] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7d] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7e] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7f] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x80] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x81] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x82] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x83] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x84] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x85] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x86] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x87] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x88] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x89] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8a] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8b] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8c] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8d] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8e] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8f] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x90] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x91] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x92] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x93] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x94] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x95] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x96] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x97] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x98] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x99] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9a] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9b] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9c] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9d] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9e] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9f] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa0] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa1] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa2] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa3] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa4] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa5] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa6] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa7] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa8] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa9] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xaa] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xab] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xac] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xad] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xae] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xaf] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb0] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb1] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb2] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb3] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb4] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb5] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb6] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb7] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb8] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb9] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xba] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbb] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbc] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbd] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbe] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbf] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc0] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc1] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc2] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc3] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc4] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc5] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc6] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc7] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc8] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc9] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xca] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcb] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcc] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcd] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xce] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcf] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd0] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd1] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd2] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd3] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd4] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd5] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd6] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd7] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd8] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd9] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xda] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdb] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdc] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdd] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xde] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdf] disabled) Apr 7 16:46:46 warble1 kernel: ACPI: X2APIC_NMI (uid[0xffffffff] high level lint[0x1]) Apr 7 16:46:46 warble1 kernel: ACPI: LAPIC_NMI (acpi_id[0xff] high level lint[0x1]) Apr 7 16:46:46 warble1 kernel: ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0]) Apr 7 16:46:46 warble1 kernel: IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23 Apr 7 16:46:46 warble1 kernel: ACPI: IOAPIC (id[0x09] address[0xfec01000] gsi_base[24]) Apr 7 16:46:46 warble1 kernel: IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-31 Apr 7 16:46:46 warble1 kernel: ACPI: IOAPIC (id[0x0a] address[0xfec08000] gsi_base[32]) Apr 7 16:46:46 warble1 kernel: IOAPIC[2]: apic_id 10, version 32, address 0xfec08000, GSI 32-39 Apr 7 16:46:46 warble1 kernel: ACPI: IOAPIC (id[0x0b] address[0xfec10000] gsi_base[40]) Apr 7 16:46:46 warble1 kernel: IOAPIC[3]: apic_id 11, version 32, address 0xfec10000, GSI 40-47 Apr 7 16:46:46 warble1 kernel: ACPI: IOAPIC (id[0x0c] address[0xfec18000] gsi_base[48]) Apr 7 16:46:46 warble1 kernel: IOAPIC[4]: apic_id 12, version 32, address 0xfec18000, GSI 48-55 Apr 7 16:46:46 warble1 kernel: ACPI: IOAPIC (id[0x0f] address[0xfec20000] gsi_base[72]) Apr 7 16:46:46 warble1 kernel: IOAPIC[5]: apic_id 15, version 32, address 0xfec20000, GSI 72-79 Apr 7 16:46:46 warble1 kernel: ACPI: IOAPIC (id[0x10] address[0xfec28000] gsi_base[80]) Apr 7 16:46:46 warble1 kernel: IOAPIC[6]: apic_id 16, version 32, address 0xfec28000, GSI 80-87 Apr 7 16:46:46 warble1 kernel: ACPI: IOAPIC (id[0x11] address[0xfec30000] gsi_base[88]) Apr 7 16:46:46 warble1 kernel: IOAPIC[7]: apic_id 17, version 32, address 0xfec30000, GSI 88-95 Apr 7 16:46:46 warble1 kernel: ACPI: IOAPIC (id[0x12] address[0xfec38000] gsi_base[96]) Apr 7 16:46:46 warble1 kernel: IOAPIC[8]: apic_id 18, version 32, address 0xfec38000, GSI 96-103 Apr 7 16:46:46 warble1 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Apr 7 16:46:46 warble1 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Apr 7 16:46:46 warble1 kernel: Using ACPI (MADT) for SMP configuration information Apr 7 16:46:46 warble1 kernel: ACPI: HPET id: 0x8086a701 base: 0xfed00000 Apr 7 16:46:46 warble1 kernel: smpboot: Allowing 448 CPUs, 432 hotplug CPUs Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0x0009c000-0x0009ffff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0x6c5cf000-0x6e7cefff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0x6e7cf000-0x6f5fefff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0x6f5ff000-0x6f7fefff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0x6f800000-0x8fffffff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0x90000000-0xfcffffff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0xfd000000-0xfe7fffff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0xfe800000-0xfebfffff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0xfec01000-0xfec7ffff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0xfec80000-0xfed00fff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0xfed01000-0xfeffffff] Apr 7 16:46:46 warble1 kernel: PM: Registered nosave memory: [mem 0xff000000-0xffffffff] Apr 7 16:46:46 warble1 kernel: e820: [mem 0x90000000-0xfcffffff] available for PCI devices Apr 7 16:46:46 warble1 kernel: Booting paravirtualized kernel on bare hardware Apr 7 16:46:46 warble1 kernel: setup_percpu: NR_CPUS:5120 nr_cpumask_bits:448 nr_cpu_ids:448 nr_node_ids:2 Apr 7 16:46:46 warble1 kernel: PERCPU: Embedded 35 pages/cpu @ffff885ebda00000 s104536 r8192 d30632 u262144 Apr 7 16:46:46 warble1 kernel: Built 2 zonelists in Zone order, mobility grouping on. Total pages: 197843518 Apr 7 16:46:46 warble1 kernel: Policy zone: Normal Apr 7 16:46:46 warble1 kernel: Kernel command line: initrd=oneSIS/initramfs-3.10.0-693.17.1.el7.x86_64.onesis.server.01.img root=rsync://boot@192.168.44.11/images/centos-7.4-minimal-server-05/ ro crashkernel=auto vconsole.font=latarcyrheb-sun16 vconsole.keymap=us LANG=en_US.UTF-8 console=tty0 console=ttyS0,115200n8 rd.driver.blacklist=nouveau selinux=0 exec-shield=0 audit=0 timeshift=12 cluster=farnarkle ping=192.168.44.11 rd.shell bond=bond0:em1,em2:miimon=100,xmit_hash_policy=1,mode=4,lacp_rate=1:9000 nopti BOOT_IMAGE=oneSIS/vmlinuz-3.10.0-693.17.1.el7.x86_64 Apr 7 16:46:46 warble1 kernel: audit: disabled (until reboot) Apr 7 16:46:46 warble1 kernel: PID hash table entries: 4096 (order: 3, 32768 bytes) Apr 7 16:46:46 warble1 kernel: x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 Apr 7 16:46:46 warble1 kernel: x86/fpu: xstate_offset[3]: 03c0, xstate_sizes[3]: 0040 Apr 7 16:46:46 warble1 kernel: x86/fpu: xstate_offset[4]: 0400, xstate_sizes[4]: 0040 Apr 7 16:46:46 warble1 kernel: x86/fpu: xstate_offset[5]: 0440, xstate_sizes[5]: 0040 Apr 7 16:46:46 warble1 kernel: x86/fpu: xstate_offset[6]: 0480, xstate_sizes[6]: 0200 Apr 7 16:46:46 warble1 kernel: x86/fpu: xstate_offset[7]: 0680, xstate_sizes[7]: 0400 Apr 7 16:46:46 warble1 kernel: xsave: enabled xstate_bv 0xff, cntxt size 0xa80 using standard form Apr 7 16:46:46 warble1 kernel: Memory: 7724828k/806354944k available (6916k kernel code, 2419284k absent, 12968396k reserved, 4551k data, 1800k init) Apr 7 16:46:46 warble1 kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=448, Nodes=2 Apr 7 16:46:46 warble1 kernel: Hierarchical RCU implementation. Apr 7 16:46:46 warble1 kernel: #011RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=448. Apr 7 16:46:46 warble1 kernel: NR_IRQS:327936 nr_irqs:5368 0 Apr 7 16:46:46 warble1 kernel: Console: colour VGA+ 80x25 Apr 7 16:46:46 warble1 kernel: console [tty0] enabled Apr 7 16:46:46 warble1 kernel: console [ttyS0] enabled Apr 7 16:46:46 warble1 kernel: allocated 3215982592 bytes of page_cgroup Apr 7 16:46:46 warble1 kernel: please try 'cgroup_disable=memory' option if you don't want memory cgroups Apr 7 16:46:46 warble1 kernel: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl Apr 7 16:46:46 warble1 kernel: tsc: Detected 3200.000 MHz processor Apr 7 16:46:46 warble1 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 6400.00 BogoMIPS (lpj=3200000) Apr 7 16:46:46 warble1 kernel: pid_max: default: 458752 minimum: 3584 Apr 7 16:46:46 warble1 kernel: Security Framework initialized Apr 7 16:46:46 warble1 kernel: SELinux: Disabled at boot. Apr 7 16:46:46 warble1 kernel: Yama: becoming mindful. Apr 7 16:46:46 warble1 kernel: Dentry cache hash table entries: 134217728 (order: 18, 1073741824 bytes) Apr 7 16:46:46 warble1 kernel: Inode-cache hash table entries: 67108864 (order: 17, 536870912 bytes) Apr 7 16:46:46 warble1 kernel: random: fast init done Apr 7 16:46:46 warble1 kernel: Mount-cache hash table entries: 2097152 (order: 12, 16777216 bytes) Apr 7 16:46:46 warble1 kernel: Mountpoint-cache hash table entries: 2097152 (order: 12, 16777216 bytes) Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys memory Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys devices Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys freezer Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys net_cls Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys blkio Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys perf_event Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys hugetlb Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys pids Apr 7 16:46:46 warble1 kernel: Initializing cgroup subsys net_prio Apr 7 16:46:46 warble1 kernel: CPU: Physical Processor ID: 0 Apr 7 16:46:46 warble1 kernel: CPU: Processor Core ID: 0 Apr 7 16:46:46 warble1 kernel: ENERGY_PERF_BIAS: Set to 'normal', was 'performance' Apr 7 16:46:46 warble1 kernel: ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8) Apr 7 16:46:46 warble1 kernel: FEATURE SPEC_CTRL Present Apr 7 16:46:46 warble1 kernel: FEATURE IBPB_SUPPORT Present Apr 7 16:46:46 warble1 kernel: mce: CPU supports 20 MCE banks Apr 7 16:46:46 warble1 kernel: CPU0: Thermal monitoring enabled (TM1) Apr 7 16:46:46 warble1 kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 Apr 7 16:46:46 warble1 kernel: Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0 Apr 7 16:46:46 warble1 kernel: tlb_flushall_shift: 6 Apr 7 16:46:46 warble1 kernel: Freeing SMP alternatives: 24k freed Apr 7 16:46:46 warble1 kernel: ACPI: Core revision 20130517 Apr 7 16:46:46 warble1 kernel: ACPI: All ACPI Tables successfully acquired Apr 7 16:46:46 warble1 kernel: ftrace: allocating 26618 entries in 104 pages Apr 7 16:46:46 warble1 kernel: DMAR: Host address width 46 Apr 7 16:46:46 warble1 kernel: DMAR: DRHD base: 0x000000d37fc000 flags: 0x0 Apr 7 16:46:46 warble1 kernel: DMAR: dmar0: reg_base_addr d37fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 7 16:46:46 warble1 kernel: DMAR: DRHD base: 0x000000e0ffc000 flags: 0x0 Apr 7 16:46:46 warble1 kernel: DMAR: dmar1: reg_base_addr e0ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 7 16:46:46 warble1 kernel: DMAR: DRHD base: 0x000000ee7fc000 flags: 0x0 Apr 7 16:46:46 warble1 kernel: DMAR: dmar2: reg_base_addr ee7fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 7 16:46:46 warble1 kernel: DMAR: DRHD base: 0x000000fbffc000 flags: 0x0 Apr 7 16:46:46 warble1 kernel: DMAR: dmar3: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 7 16:46:46 warble1 kernel: DMAR: DRHD base: 0x000000aaffc000 flags: 0x0 Apr 7 16:46:46 warble1 kernel: DMAR: dmar4: reg_base_addr aaffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 7 16:46:46 warble1 kernel: DMAR: DRHD base: 0x000000b87fc000 flags: 0x0 Apr 7 16:46:46 warble1 kernel: DMAR: dmar5: reg_base_addr b87fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 7 16:46:46 warble1 kernel: DMAR: DRHD base: 0x000000c5ffc000 flags: 0x0 Apr 7 16:46:46 warble1 kernel: DMAR: dmar6: reg_base_addr c5ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 7 16:46:46 warble1 kernel: DMAR: DRHD base: 0x0000009d7fc000 flags: 0x1 Apr 7 16:46:46 warble1 kernel: DMAR: dmar7: reg_base_addr 9d7fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 7 16:46:46 warble1 kernel: DMAR: RMRR base: 0x0000006e2cd000 end: 0x0000006e7ccfff Apr 7 16:46:46 warble1 kernel: DMAR: RMRR base: 0x0000006f4e1000 end: 0x0000006f4e3fff Apr 7 16:46:46 warble1 kernel: DMAR: ATSR flags: 0x0 Apr 7 16:46:46 warble1 kernel: DMAR: ATSR flags: 0x0 Apr 7 16:46:46 warble1 kernel: DMAR-IR: IOAPIC id 12 under DRHD base 0xc5ffc000 IOMMU 6 Apr 7 16:46:46 warble1 kernel: DMAR-IR: IOAPIC id 11 under DRHD base 0xb87fc000 IOMMU 5 Apr 7 16:46:46 warble1 kernel: DMAR-IR: IOAPIC id 10 under DRHD base 0xaaffc000 IOMMU 4 Apr 7 16:46:46 warble1 kernel: DMAR-IR: IOAPIC id 18 under DRHD base 0xfbffc000 IOMMU 3 Apr 7 16:46:46 warble1 kernel: DMAR-IR: IOAPIC id 17 under DRHD base 0xee7fc000 IOMMU 2 Apr 7 16:46:46 warble1 kernel: DMAR-IR: IOAPIC id 16 under DRHD base 0xe0ffc000 IOMMU 1 Apr 7 16:46:46 warble1 kernel: DMAR-IR: IOAPIC id 15 under DRHD base 0xd37fc000 IOMMU 0 Apr 7 16:46:46 warble1 kernel: DMAR-IR: IOAPIC id 8 under DRHD base 0x9d7fc000 IOMMU 7 Apr 7 16:46:46 warble1 kernel: DMAR-IR: IOAPIC id 9 under DRHD base 0x9d7fc000 IOMMU 7 Apr 7 16:46:46 warble1 kernel: DMAR-IR: HPET id 0 under DRHD base 0x9d7fc000 Apr 7 16:46:46 warble1 kernel: DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. Apr 7 16:46:46 warble1 kernel: DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. Apr 7 16:46:46 warble1 kernel: DMAR-IR: Enabled IRQ remapping in xapic mode Apr 7 16:46:46 warble1 kernel: IRQ remapping doesn't support X2APIC mode, disable x2apic. Apr 7 16:46:46 warble1 kernel: Switched APIC routing to physical flat. Apr 7 16:46:46 warble1 kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Apr 7 16:46:46 warble1 kernel: smpboot: CPU0: Intel(R) Xeon(R) Gold 6134 CPU @ 3.20GHz (fam: 06, model: 55, stepping: 04) Apr 7 16:46:46 warble1 kernel: Performance Events: PEBS fmt3+, 32-deep LBR, Skylake events, full-width counters, Intel PMU driver. Apr 7 16:46:46 warble1 kernel: ... version: 4 Apr 7 16:46:46 warble1 kernel: ... bit width: 48 Apr 7 16:46:46 warble1 kernel: ... generic registers: 8 Apr 7 16:46:46 warble1 kernel: ... value mask: 0000ffffffffffff Apr 7 16:46:46 warble1 kernel: ... max period: 00007fffffffffff Apr 7 16:46:46 warble1 kernel: ... fixed-purpose events: 3 Apr 7 16:46:46 warble1 kernel: ... event mask: 00000007000000ff Apr 7 16:46:46 warble1 kernel: NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 1, Processors #1 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 0, Processors #2 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 1, Processors #3 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 0, Processors #4 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 1, Processors #5 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 0, Processors #6 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 1, Processors #7 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 0, Processors #8 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 1, Processors #9 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 0, Processors #10 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 1, Processors #11 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 0, Processors #12 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 1, Processors #13 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 0, Processors #14 OK Apr 7 16:46:46 warble1 kernel: smpboot: Booting Node 1, Processors #15 Apr 7 16:46:46 warble1 kernel: Brought up 16 CPUs Apr 7 16:46:46 warble1 kernel: smpboot: Max logical packages: 56 Apr 7 16:46:46 warble1 kernel: smpboot: Total of 16 processors activated (102439.61 BogoMIPS) Apr 7 16:46:46 warble1 kernel: node 1 initialised, 98295926 pages in 1538ms Apr 7 16:46:46 warble1 kernel: node 0 initialised, 97514679 pages in 1543ms Apr 7 16:46:46 warble1 kernel: devtmpfs: initialized Apr 7 16:46:46 warble1 kernel: EVM: security.selinux Apr 7 16:46:46 warble1 kernel: EVM: security.ima Apr 7 16:46:46 warble1 kernel: EVM: security.capability Apr 7 16:46:46 warble1 kernel: PM: Registering ACPI NVS region [mem 0x6e7cf000-0x6f5fefff] (14876672 bytes) Apr 7 16:46:46 warble1 kernel: atomic64 test passed for x86-64 platform with CX8 and with SSE Apr 7 16:46:46 warble1 kernel: pinctrl core: initialized pinctrl subsystem Apr 7 16:46:46 warble1 kernel: RTC time: 6:46:41, date: 04/07/18 Apr 7 16:46:46 warble1 kernel: NET: Registered protocol family 16 Apr 7 16:46:46 warble1 kernel: ACPI FADT declares the system doesn't support PCIe ASPM, so disable it Apr 7 16:46:46 warble1 kernel: ACPI: bus type PCI registered Apr 7 16:46:46 warble1 kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Apr 7 16:46:46 warble1 kernel: PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) Apr 7 16:46:46 warble1 kernel: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 Apr 7 16:46:46 warble1 kernel: pmd_set_huge: Cannot satisfy [mem 0x80000000-0x80200000] with a huge-page mapping due to MTRR override. Apr 7 16:46:46 warble1 kernel: PCI: Using configuration type 1 for base access Apr 7 16:46:46 warble1 kernel: PCI: Dell System detected, enabling pci=bfsort. Apr 7 16:46:46 warble1 kernel: ACPI: Added _OSI(Module Device) Apr 7 16:46:46 warble1 kernel: ACPI: Added _OSI(Processor Device) Apr 7 16:46:46 warble1 kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Apr 7 16:46:46 warble1 kernel: ACPI: Added _OSI(Processor Aggregator Device) Apr 7 16:46:46 warble1 kernel: [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored Apr 7 16:46:46 warble1 kernel: ACPI: Dynamic OEM Table Load: Apr 7 16:46:46 warble1 kernel: ACPI: OEM4 (null) A27C4 (v02 INTEL CPU CST 00003000 INTL 20150818) Apr 7 16:46:46 warble1 kernel: ACPI: Interpreter enabled Apr 7 16:46:46 warble1 kernel: ACPI: (supports S0 S5) Apr 7 16:46:46 warble1 kernel: ACPI: Using IOAPIC for interrupt routing Apr 7 16:46:46 warble1 kernel: HEST: Table parsing has been initialized. Apr 7 16:46:46 warble1 kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Apr 7 16:46:46 warble1 kernel: ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00-16]) Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:00: PCIe AER handled by firmware Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:00: ignoring host bridge window [mem 0x000c4000-0x000cbfff window] (conflicts with Video ROM [mem 0x000c0000-0x000c7fff]) Apr 7 16:46:46 warble1 kernel: PCI host bridge to bus 0000:00 Apr 7 16:46:46 warble1 kernel: pci_bus 0000:00: root bus resource [bus 00-16] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:00: root bus resource [io 0x1000-0x3fff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:00: root bus resource [mem 0xfe010000-0xfe010fff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:00: root bus resource [mem 0x90000000-0x9d7fffff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:00: root bus resource [mem 0x380000000000-0x380fffffffff window] Apr 7 16:46:46 warble1 kernel: pci 0000:00:14.0: System wakeup disabled by ACPI Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.0: System wakeup disabled by ACPI Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.4: System wakeup disabled by ACPI Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.0: PCI bridge to [bus 01] Apr 7 16:46:46 warble1 kernel: pci 0000:02:00.0: System wakeup disabled by ACPI Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.4: PCI bridge to [bus 02-03] Apr 7 16:46:46 warble1 kernel: pci 0000:02:00.0: PCI bridge to [bus 03] Apr 7 16:46:46 warble1 kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 7 16:46:46 warble1 kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 *6 10 11 12 14 15) Apr 7 16:46:46 warble1 kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) Apr 7 16:46:46 warble1 kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 7 16:46:46 warble1 kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 7 16:46:46 warble1 kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 *6 10 11 12 14 15) Apr 7 16:46:46 warble1 kernel: ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 *5 6 10 11 12 14 15) Apr 7 16:46:46 warble1 kernel: ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 7 16:46:46 warble1 kernel: ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 17-39]) Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:01: PCIe AER handled by firmware Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration Apr 7 16:46:46 warble1 kernel: PCI host bridge to bus 0000:17 Apr 7 16:46:46 warble1 kernel: pci_bus 0000:17: root bus resource [bus 17-39] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:17: root bus resource [io 0x4000-0x5fff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:17: root bus resource [mem 0x9d800000-0xaaffffff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:17: root bus resource [mem 0x381000000000-0x381fffffffff window] Apr 7 16:46:46 warble1 kernel: pci 0000:17:00.0: System wakeup disabled by ACPI Apr 7 16:46:46 warble1 kernel: pci 0000:17:02.0: System wakeup disabled by ACPI Apr 7 16:46:46 warble1 kernel: pci 0000:17:00.0: PCI bridge to [bus 18] Apr 7 16:46:46 warble1 kernel: pci 0000:17:02.0: PCI bridge to [bus 19] Apr 7 16:46:46 warble1 kernel: ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 3a-5c]) Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:02: PCIe AER handled by firmware Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration Apr 7 16:46:46 warble1 kernel: PCI host bridge to bus 0000:3a Apr 7 16:46:46 warble1 kernel: pci_bus 0000:3a: root bus resource [bus 3a-5c] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:3a: root bus resource [io 0x6000-0x7fff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:3a: root bus resource [mem 0xab000000-0xb87fffff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:3a: root bus resource [mem 0x382000000000-0x382fffffffff window] Apr 7 16:46:46 warble1 kernel: pci 0000:3a:00.0: System wakeup disabled by ACPI Apr 7 16:46:46 warble1 kernel: pci 0000:3b:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit] (contains BAR0 for 16 VFs) Apr 7 16:46:46 warble1 kernel: pci 0000:3b:00.0: VF(n) BAR2 space: [mem 0x00000000-0x00ffffff 64bit] (contains BAR2 for 16 VFs) Apr 7 16:46:46 warble1 kernel: pci 0000:3a:00.0: PCI bridge to [bus 3b] Apr 7 16:46:46 warble1 kernel: ACPI: PCI Root Bridge [PC03] (domain 0000 [bus 5d-7f]) Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:03: PCIe AER handled by firmware Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration Apr 7 16:46:46 warble1 kernel: PCI host bridge to bus 0000:5d Apr 7 16:46:46 warble1 kernel: pci_bus 0000:5d: root bus resource [bus 5d-7f] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:5d: root bus resource [io 0x8000-0x9fff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:5d: root bus resource [mem 0xb8800000-0xc5ffffff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:5d: root bus resource [mem 0x383000000000-0x383fffffffff window] Apr 7 16:46:46 warble1 kernel: ACPI: PCI Root Bridge [PC06] (domain 0000 [bus 80-84]) Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:06: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:06: PCIe AER handled by firmware Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:06: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:06: FADT indicates ASPM is unsupported, using BIOS configuration Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:06: host bridge window [io 0x0000 window] (ignored, not CPU addressable) Apr 7 16:46:46 warble1 kernel: PCI host bridge to bus 0000:80 Apr 7 16:46:46 warble1 kernel: pci_bus 0000:80: root bus resource [bus 80-84] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:80: root bus resource [mem 0xc6000000-0xd37fffff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:80: root bus resource [mem 0x384000000000-0x384fffffffff window] Apr 7 16:46:46 warble1 kernel: ACPI: PCI Root Bridge [PC07] (domain 0000 [bus 85-ad]) Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:07: PCIe AER handled by firmware Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:07: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:07: FADT indicates ASPM is unsupported, using BIOS configuration Apr 7 16:46:46 warble1 kernel: PCI host bridge to bus 0000:85 Apr 7 16:46:46 warble1 kernel: pci_bus 0000:85: root bus resource [bus 85-ad] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:85: root bus resource [io 0xa000-0xbfff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:85: root bus resource [mem 0xd3800000-0xe0ffffff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:85: root bus resource [mem 0x385000000000-0x385fffffffff window] Apr 7 16:46:46 warble1 kernel: ACPI: PCI Root Bridge [PC08] (domain 0000 [bus ae-d6]) Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:08: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:08: PCIe AER handled by firmware Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:08: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:08: FADT indicates ASPM is unsupported, using BIOS configuration Apr 7 16:46:46 warble1 kernel: PCI host bridge to bus 0000:ae Apr 7 16:46:46 warble1 kernel: pci_bus 0000:ae: root bus resource [bus ae-d6] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:ae: root bus resource [io 0xc000-0xdfff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:ae: root bus resource [mem 0xe1000000-0xee7fffff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:ae: root bus resource [mem 0x386000000000-0x386fffffffff window] Apr 7 16:46:46 warble1 kernel: ACPI: PCI Root Bridge [PC09] (domain 0000 [bus d7-ff]) Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:09: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:09: PCIe AER handled by firmware Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:09: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 7 16:46:46 warble1 kernel: acpi PNP0A08:09: FADT indicates ASPM is unsupported, using BIOS configuration Apr 7 16:46:46 warble1 kernel: PCI host bridge to bus 0000:d7 Apr 7 16:46:46 warble1 kernel: pci_bus 0000:d7: root bus resource [bus d7-ff] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:d7: root bus resource [io 0xe000-0xffff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:d7: root bus resource [mem 0xee800000-0xfbffffff window] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:d7: root bus resource [mem 0x387000000000-0x387fffffffff window] Apr 7 16:46:46 warble1 kernel: pci 0000:d7:00.0: System wakeup disabled by ACPI Apr 7 16:46:46 warble1 kernel: pci 0000:d7:00.0: PCI bridge to [bus d8] Apr 7 16:46:46 warble1 kernel: ACPI: Enabled 3 GPEs in block 00 to 7F Apr 7 16:46:46 warble1 kernel: vgaarb: device added: PCI:0000:03:00.0,decodes=io+mem,owns=io+mem,locks=none Apr 7 16:46:46 warble1 kernel: vgaarb: loaded Apr 7 16:46:46 warble1 kernel: vgaarb: bridge control possible 0000:03:00.0 Apr 7 16:46:46 warble1 kernel: SCSI subsystem initialized Apr 7 16:46:46 warble1 kernel: ACPI: bus type USB registered Apr 7 16:46:46 warble1 kernel: usbcore: registered new interface driver usbfs Apr 7 16:46:46 warble1 kernel: usbcore: registered new interface driver hub Apr 7 16:46:46 warble1 kernel: usbcore: registered new device driver usb Apr 7 16:46:46 warble1 kernel: PCI: Using ACPI for IRQ routing Apr 7 16:46:46 warble1 kernel: Expanded resource reserved due to conflict with PNP0003:00 Apr 7 16:46:46 warble1 kernel: NetLabel: Initializing Apr 7 16:46:46 warble1 kernel: NetLabel: domain hash size = 128 Apr 7 16:46:46 warble1 kernel: NetLabel: protocols = UNLABELED CIPSOv4 Apr 7 16:46:46 warble1 kernel: NetLabel: unlabeled traffic allowed by default Apr 7 16:46:46 warble1 kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 Apr 7 16:46:46 warble1 kernel: hpet0: 8 comparators, 64-bit 24.000000 MHz counter Apr 7 16:46:46 warble1 kernel: amd_nb: Cannot enumerate AMD northbridges Apr 7 16:46:46 warble1 kernel: Switched to clocksource hpet Apr 7 16:46:46 warble1 kernel: pnp: PnP ACPI init Apr 7 16:46:46 warble1 kernel: ACPI: bus type PNP registered Apr 7 16:46:46 warble1 kernel: system 00:01: [io 0x0500-0x053f] could not be reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [io 0x0400-0x047f] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [io 0x0540-0x057f] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [io 0x0600-0x061f] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [io 0x0ca0-0x0ca5] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [io 0x0880-0x0883] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [io 0x0800-0x081f] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [mem 0xff000000-0xffffffff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:04: [mem 0xfd000000-0xfdabffff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:04: [mem 0xfdad0000-0xfdadffff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:04: [mem 0xfdb00000-0xfdffffff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:04: [mem 0xfe000000-0xfe00ffff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:04: [mem 0xfe011000-0xfe01ffff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:04: [mem 0xfe036000-0xfe03bfff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:04: [mem 0xfe03d000-0xfe3fffff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:04: [mem 0xfe410000-0xfe7fffff] has been reserved Apr 7 16:46:46 warble1 kernel: system 00:05: [io 0x1000-0x10fe] has been reserved Apr 7 16:46:46 warble1 kernel: pnp: PnP ACPI: found 6 devices Apr 7 16:46:46 warble1 kernel: ACPI: bus type PNP unregistered Apr 7 16:46:46 warble1 kernel: pci 0000:18:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.0: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.1: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.2: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.3: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 7 16:46:46 warble1 kernel: pci 0000:3b:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window Apr 7 16:46:46 warble1 kernel: pci 0000:d8:00.0: can't claim BAR 6 [mem 0xfffe0000-0xffffffff pref]: no compatible bridge window Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.0: BAR 15: assigned [mem 0x380000000000-0x3800001fffff 64bit pref] Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.0: BAR 13: assigned [io 0x3000-0x3fff] Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.0: PCI bridge to [bus 01] Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.0: bridge window [io 0x3000-0x3fff] Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.0: bridge window [mem 0x92a00000-0x92bfffff] Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.0: bridge window [mem 0x380000000000-0x3800001fffff 64bit pref] Apr 7 16:46:46 warble1 kernel: pci 0000:02:00.0: PCI bridge to [bus 03] Apr 7 16:46:46 warble1 kernel: pci 0000:02:00.0: bridge window [mem 0x92000000-0x928fffff] Apr 7 16:46:46 warble1 kernel: pci 0000:02:00.0: bridge window [mem 0x91000000-0x91ffffff 64bit pref] Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.4: PCI bridge to [bus 02-03] Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.4: bridge window [mem 0x92000000-0x928fffff] Apr 7 16:46:46 warble1 kernel: pci 0000:00:1c.4: bridge window [mem 0x91000000-0x91ffffff 64bit pref] Apr 7 16:46:46 warble1 kernel: pci 0000:17:02.0: BAR 14: assigned [mem 0xa1c00000-0xa1dfffff] Apr 7 16:46:46 warble1 kernel: pci 0000:18:00.0: BAR 6: no space for [mem size 0x00100000 pref] Apr 7 16:46:46 warble1 kernel: pci 0000:18:00.0: BAR 6: failed to assign [mem size 0x00100000 pref] Apr 7 16:46:46 warble1 kernel: pci 0000:17:00.0: PCI bridge to [bus 18] Apr 7 16:46:46 warble1 kernel: pci 0000:17:00.0: bridge window [io 0x4000-0x4fff] Apr 7 16:46:46 warble1 kernel: pci 0000:17:00.0: bridge window [mem 0xa1900000-0xa1afffff] Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.0: BAR 6: assigned [mem 0xa1c00000-0xa1c7ffff pref] Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.1: BAR 6: assigned [mem 0xa1c80000-0xa1cfffff pref] Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.2: BAR 6: assigned [mem 0xa1d00000-0xa1d7ffff pref] Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.3: BAR 6: assigned [mem 0xa1d80000-0xa1dfffff pref] Apr 7 16:46:46 warble1 kernel: pci 0000:17:02.0: PCI bridge to [bus 19] Apr 7 16:46:46 warble1 kernel: pci 0000:17:02.0: bridge window [mem 0xa1c00000-0xa1dfffff] Apr 7 16:46:46 warble1 kernel: pci 0000:17:02.0: bridge window [mem 0x9d800000-0xa18fffff 64bit pref] Apr 7 16:46:46 warble1 kernel: pci 0000:3b:00.0: BAR 6: no space for [mem size 0x00100000 pref] Apr 7 16:46:46 warble1 kernel: pci 0000:3b:00.0: BAR 6: failed to assign [mem size 0x00100000 pref] Apr 7 16:46:46 warble1 kernel: pci 0000:3b:00.0: BAR 9: no space for [mem size 0x01000000 64bit] Apr 7 16:46:46 warble1 kernel: pci 0000:3b:00.0: BAR 9: failed to assign [mem size 0x01000000 64bit] Apr 7 16:46:46 warble1 kernel: pci 0000:3b:00.0: BAR 7: no space for [mem size 0x00100000 64bit] Apr 7 16:46:46 warble1 kernel: pci 0000:3b:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit] Apr 7 16:46:46 warble1 kernel: pci 0000:3a:00.0: PCI bridge to [bus 3b] Apr 7 16:46:46 warble1 kernel: pci 0000:3a:00.0: bridge window [io 0x6000-0x6fff] Apr 7 16:46:46 warble1 kernel: pci 0000:3a:00.0: bridge window [mem 0xab000000-0xab1fffff] Apr 7 16:46:46 warble1 kernel: pci_bus 0000:3a: Some PCI device resources are unassigned, try booting with pci=realloc Apr 7 16:46:46 warble1 kernel: pci 0000:d8:00.0: BAR 6: no space for [mem size 0x00020000 pref] Apr 7 16:46:46 warble1 kernel: pci 0000:d8:00.0: BAR 6: failed to assign [mem size 0x00020000 pref] Apr 7 16:46:46 warble1 kernel: pci 0000:d7:00.0: PCI bridge to [bus d8] Apr 7 16:46:46 warble1 kernel: pci 0000:d7:00.0: bridge window [mem 0xf0000000-0xf3ffffff] Apr 7 16:46:46 warble1 kernel: NET: Registered protocol family 2 Apr 7 16:46:46 warble1 kernel: TCP established hash table entries: 524288 (order: 10, 4194304 bytes) Apr 7 16:46:46 warble1 kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) Apr 7 16:46:46 warble1 kernel: TCP: Hash tables configured (established 524288 bind 65536) Apr 7 16:46:46 warble1 kernel: TCP: reno registered Apr 7 16:46:46 warble1 kernel: UDP hash table entries: 65536 (order: 9, 2097152 bytes) Apr 7 16:46:46 warble1 kernel: UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes) Apr 7 16:46:46 warble1 kernel: NET: Registered protocol family 1 Apr 7 16:46:46 warble1 kernel: Unpacking initramfs... Apr 7 16:46:46 warble1 kernel: Freeing initrd memory: 46592k freed Apr 7 16:46:46 warble1 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Apr 7 16:46:46 warble1 kernel: software IO TLB [mem 0x6582a000-0x6982a000] (64MB) mapped at [ffff88006582a000-ffff880069829fff] Apr 7 16:46:46 warble1 kernel: Intel CQM monitoring enabled Apr 7 16:46:46 warble1 kernel: Intel MBM enabled Apr 7 16:46:46 warble1 kernel: RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer Apr 7 16:46:46 warble1 kernel: RAPL PMU: hw unit of domain pp0-core 2^-14 Joules Apr 7 16:46:46 warble1 kernel: RAPL PMU: hw unit of domain package 2^-14 Joules Apr 7 16:46:46 warble1 kernel: RAPL PMU: hw unit of domain dram 2^-16 Joules Apr 7 16:46:46 warble1 kernel: sha1_ssse3: Using AVX2 optimized SHA-1 implementation Apr 7 16:46:46 warble1 kernel: sha256_ssse3: Using AVX2 optimized SHA-256 implementation Apr 7 16:46:46 warble1 kernel: futex hash table entries: 131072 (order: 11, 8388608 bytes) Apr 7 16:46:46 warble1 kernel: Initialise system trusted keyring Apr 7 16:46:46 warble1 kernel: HugeTLB registered 1 GB page size, pre-allocated 0 pages Apr 7 16:46:46 warble1 kernel: HugeTLB registered 2 MB page size, pre-allocated 0 pages Apr 7 16:46:46 warble1 kernel: zpool: loaded Apr 7 16:46:46 warble1 kernel: zbud: loaded Apr 7 16:46:46 warble1 kernel: VFS: Disk quotas dquot_6.5.2 Apr 7 16:46:46 warble1 kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Apr 7 16:46:46 warble1 kernel: msgmni has been set to 32768 Apr 7 16:46:46 warble1 kernel: Key type big_key registered Apr 7 16:46:46 warble1 kernel: NET: Registered protocol family 38 Apr 7 16:46:46 warble1 kernel: Key type asymmetric registered Apr 7 16:46:46 warble1 kernel: Asymmetric key parser 'x509' registered Apr 7 16:46:46 warble1 kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) Apr 7 16:46:46 warble1 kernel: io scheduler noop registered Apr 7 16:46:46 warble1 kernel: io scheduler deadline registered (default) Apr 7 16:46:46 warble1 kernel: io scheduler cfq registered Apr 7 16:46:46 warble1 kernel: pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pcieport 0000:00:1c.4: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pci 0000:02:00.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pci 0000:03:00.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pcieport 0000:17:00.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pci 0000:18:00.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pcieport 0000:17:02.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.1: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.2: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pci 0000:19:00.3: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pcieport 0000:3a:00.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pci 0000:3b:00.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pcieport 0000:d7:00.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pci 0000:d8:00.0: Signaling PME through PCIe PME interrupt Apr 7 16:46:46 warble1 kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5 Apr 7 16:46:46 warble1 kernel: pciehp 0000:00:1c.0:pcie04: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl+ LLActRep+ Apr 7 16:46:46 warble1 kernel: pciehp: PCI Express Hot Plug Controller Driver version: 0.4 Apr 7 16:46:46 warble1 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 Apr 7 16:46:46 warble1 kernel: ACPI: Power Button [PWRF] Apr 7 16:46:46 warble1 kernel: ERST: Error Record Serialization Table (ERST) support is initialized. Apr 7 16:46:46 warble1 kernel: pstore: Registered erst as persistent store backend Apr 7 16:46:46 warble1 kernel: GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. Apr 7 16:46:46 warble1 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Apr 7 16:46:46 warble1 kernel: 00:02: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Apr 7 16:46:46 warble1 kernel: 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A Apr 7 16:46:46 warble1 kernel: Non-volatile memory driver v1.3 Apr 7 16:46:46 warble1 kernel: Linux agpgart interface v0.103 Apr 7 16:46:46 warble1 kernel: crash memory driver: version 1.1 Apr 7 16:46:46 warble1 kernel: rdac: device handler registered Apr 7 16:46:46 warble1 kernel: hp_sw: device handler registered Apr 7 16:46:46 warble1 kernel: emc: device handler registered Apr 7 16:46:46 warble1 kernel: alua: device handler registered Apr 7 16:46:46 warble1 kernel: libphy: Fixed MDIO Bus: probed Apr 7 16:46:46 warble1 kernel: ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver Apr 7 16:46:46 warble1 kernel: ehci-pci: EHCI PCI platform driver Apr 7 16:46:46 warble1 kernel: ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver Apr 7 16:46:46 warble1 kernel: ohci-pci: OHCI PCI platform driver Apr 7 16:46:46 warble1 kernel: uhci_hcd: USB Universal Host Controller Interface driver Apr 7 16:46:46 warble1 kernel: xhci_hcd 0000:00:14.0: xHCI Host Controller Apr 7 16:46:46 warble1 kernel: xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 1 Apr 7 16:46:46 warble1 kernel: xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810 Apr 7 16:46:46 warble1 kernel: usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 Apr 7 16:46:46 warble1 kernel: usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Apr 7 16:46:46 warble1 kernel: usb usb1: Product: xHCI Host Controller Apr 7 16:46:46 warble1 kernel: usb usb1: Manufacturer: Linux 3.10.0-693.17.1.el7.x86_64 xhci-hcd Apr 7 16:46:46 warble1 kernel: usb usb1: SerialNumber: 0000:00:14.0 Apr 7 16:46:46 warble1 kernel: hub 1-0:1.0: USB hub found Apr 7 16:46:46 warble1 kernel: hub 1-0:1.0: 16 ports detected Apr 7 16:46:46 warble1 kernel: xhci_hcd 0000:00:14.0: xHCI Host Controller Apr 7 16:46:46 warble1 kernel: xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 Apr 7 16:46:46 warble1 kernel: usb usb2: New USB device found, idVendor=1d6b, idProduct=0003 Apr 7 16:46:46 warble1 kernel: usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Apr 7 16:46:46 warble1 kernel: usb usb2: Product: xHCI Host Controller Apr 7 16:46:46 warble1 kernel: usb usb2: Manufacturer: Linux 3.10.0-693.17.1.el7.x86_64 xhci-hcd Apr 7 16:46:46 warble1 kernel: usb usb2: SerialNumber: 0000:00:14.0 Apr 7 16:46:46 warble1 kernel: hub 2-0:1.0: USB hub found Apr 7 16:46:46 warble1 kernel: hub 2-0:1.0: 10 ports detected Apr 7 16:46:46 warble1 kernel: usb: port power management may be unreliable Apr 7 16:46:46 warble1 kernel: usbcore: registered new interface driver usbserial Apr 7 16:46:46 warble1 kernel: usbcore: registered new interface driver usbserial_generic Apr 7 16:46:46 warble1 kernel: usbserial: USB Serial support registered for generic Apr 7 16:46:46 warble1 kernel: i8042: PNP: No PS/2 controller found. Probing ports directly. Apr 7 16:46:46 warble1 kernel: usb 1-14: new high-speed USB device number 2 using xhci_hcd Apr 7 16:46:46 warble1 kernel: usb 1-14: New USB device found, idVendor=1604, idProduct=10c0 Apr 7 16:46:46 warble1 kernel: usb 1-14: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Apr 7 16:46:46 warble1 kernel: hub 1-14:1.0: USB hub found Apr 7 16:46:46 warble1 kernel: hub 1-14:1.0: 4 ports detected Apr 7 16:46:46 warble1 kernel: i8042: No controller found Apr 7 16:46:46 warble1 kernel: tsc: Refined TSC clocksource calibration: 3192.499 MHz Apr 7 16:46:46 warble1 kernel: mousedev: PS/2 mouse device common for all mice Apr 7 16:46:46 warble1 kernel: usb 1-14.1: new high-speed USB device number 3 using xhci_hcd Apr 7 16:46:46 warble1 kernel: Switched to clocksource tsc Apr 7 16:46:46 warble1 kernel: rtc_cmos 00:00: RTC can wake from S4 Apr 7 16:46:46 warble1 kernel: rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0 Apr 7 16:46:46 warble1 kernel: rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs Apr 7 16:46:46 warble1 kernel: cpuidle: using governor menu Apr 7 16:46:46 warble1 kernel: hidraw: raw HID events driver (C) Jiri Kosina Apr 7 16:46:46 warble1 kernel: usbcore: registered new interface driver usbhid Apr 7 16:46:46 warble1 kernel: usbhid: USB HID core driver Apr 7 16:46:46 warble1 kernel: drop_monitor: Initializing network drop monitor service Apr 7 16:46:46 warble1 kernel: TCP: cubic registered Apr 7 16:46:46 warble1 kernel: Initializing XFRM netlink socket Apr 7 16:46:46 warble1 kernel: NET: Registered protocol family 10 Apr 7 16:46:46 warble1 kernel: NET: Registered protocol family 17 Apr 7 16:46:46 warble1 kernel: intel_rdt: Intel RDT L3 allocation detected Apr 7 16:46:46 warble1 kernel: intel_rdt: Intel RDT L3DATA allocation detected Apr 7 16:46:46 warble1 kernel: intel_rdt: Intel RDT L3CODE allocation detected Apr 7 16:46:46 warble1 kernel: microcode: CPU0 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU1 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU2 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU3 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU4 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU5 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU6 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU7 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU8 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU9 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU10 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU11 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU12 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU13 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU14 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: CPU15 sig=0x50654, pf=0x80, revision=0x2000043 Apr 7 16:46:46 warble1 kernel: microcode: Microcode Update Driver: v2.01 , Peter Oruba Apr 7 16:46:46 warble1 kernel: Loading compiled-in X.509 certificates Apr 7 16:46:46 warble1 kernel: Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' Apr 7 16:46:46 warble1 kernel: Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' Apr 7 16:46:46 warble1 kernel: Loaded X.509 cert 'CentOS Linux kernel signing key: 506c6868809d2cbf540bf0d983d5c6709dbc4f22' Apr 7 16:46:46 warble1 kernel: registered taskstats version 1 Apr 7 16:46:46 warble1 kernel: Key type trusted registered Apr 7 16:46:46 warble1 kernel: Key type encrypted registered Apr 7 16:46:46 warble1 kernel: IMA: No TPM chip found, activating TPM-bypass! Apr 7 16:46:46 warble1 kernel: Magic number: 14:382:771 Apr 7 16:46:46 warble1 kernel: hash matches drivers/base/power/main.c:487 Apr 7 16:46:46 warble1 kernel: pci 0000:00:05.2: hash matches Apr 7 16:46:46 warble1 kernel: acpi LNXCPU:5f: hash matches Apr 7 16:46:46 warble1 kernel: memory memory4923: hash matches Apr 7 16:46:46 warble1 kernel: memory memory4477: hash matches Apr 7 16:46:46 warble1 kernel: memory memory3191: hash matches Apr 7 16:46:46 warble1 kernel: memory memory1710: hash matches Apr 7 16:46:46 warble1 kernel: memory memory1264: hash matches Apr 7 16:46:46 warble1 kernel: memory memory923: hash matches Apr 7 16:46:46 warble1 kernel: memory memory477: hash matches Apr 7 16:46:46 warble1 kernel: rtc_cmos 00:00: setting system clock to 2018-04-07 06:46:45 UTC (1523083605) Apr 7 16:46:46 warble1 kernel: usb 1-14.1: New USB device found, idVendor=1604, idProduct=10c0 Apr 7 16:46:46 warble1 kernel: usb 1-14.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Apr 7 16:46:46 warble1 kernel: hub 1-14.1:1.0: USB hub found Apr 7 16:46:46 warble1 kernel: hub 1-14.1:1.0: 4 ports detected Apr 7 16:46:46 warble1 kernel: usb 1-14.4: new high-speed USB device number 4 using xhci_hcd Apr 7 16:46:46 warble1 kernel: usb 1-14.4: New USB device found, idVendor=1604, idProduct=10c0 Apr 7 16:46:46 warble1 kernel: usb 1-14.4: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Apr 7 16:46:46 warble1 kernel: hub 1-14.4:1.0: USB hub found Apr 7 16:46:46 warble1 kernel: hub 1-14.4:1.0: 4 ports detected Apr 7 16:46:46 warble1 kernel: Freeing unused kernel memory: 1800k freed Apr 7 16:46:46 warble1 systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) Apr 7 16:46:46 warble1 systemd[1]: Detected architecture x86-64. Apr 7 16:46:46 warble1 systemd[1]: Running in initial RAM disk. Apr 7 16:46:46 warble1 systemd[1]: No hostname configured. Apr 7 16:46:46 warble1 systemd[1]: Set hostname to . Apr 7 16:46:46 warble1 systemd[1]: Initializing machine ID from random generator. Apr 7 16:46:46 warble1 systemd[1]: Started Dispatch Password Requests to Console Directory Watch. Apr 7 16:46:46 warble1 systemd[1]: Starting Dispatch Password Requests to Console Directory Watch. Apr 7 16:46:46 warble1 systemd[1]: Reached target Swap. Apr 7 16:46:46 warble1 systemd[1]: Starting Swap. Apr 7 16:46:46 warble1 systemd[1]: Reached target Paths. Apr 7 16:46:46 warble1 systemd[1]: Starting Paths. Apr 7 16:46:46 warble1 systemd[1]: Created slice Root Slice. Apr 7 16:46:46 warble1 systemd[1]: Starting Root Slice. Apr 7 16:46:46 warble1 systemd[1]: Created slice System Slice. Apr 7 16:46:46 warble1 systemd[1]: Starting System Slice. Apr 7 16:46:46 warble1 systemd[1]: Listening on udev Kernel Socket. Apr 7 16:46:46 warble1 systemd[1]: Starting udev Kernel Socket. Apr 7 16:46:46 warble1 systemd[1]: Listening on Journal Socket. Apr 7 16:46:46 warble1 systemd[1]: Starting Journal Socket. Apr 7 16:46:46 warble1 systemd[1]: Starting Journal Service... Apr 7 16:46:46 warble1 systemd[1]: Starting Load Kernel Modules... Apr 7 16:46:46 warble1 systemd[1]: Starting dracut cmdline hook... Apr 7 16:46:46 warble1 systemd[1]: Starting Create list of required static device nodes for the current kernel... Apr 7 16:46:46 warble1 journal: Journal started Apr 7 16:46:46 warble1 systemd[1]: Reached target Slices. Apr 7 16:46:46 warble1 systemd[1]: Starting Slices. Apr 7 16:46:46 warble1 systemd[1]: Reached target Local File Systems. Apr 7 16:46:46 warble1 systemd[1]: Starting Local File Systems. Apr 7 16:46:46 warble1 systemd[1]: Reached target Timers. Apr 7 16:46:46 warble1 systemd[1]: Starting Timers. Apr 7 16:46:46 warble1 systemd[1]: Listening on udev Control Socket. Apr 7 16:46:46 warble1 systemd[1]: Starting udev Control Socket. Apr 7 16:46:46 warble1 systemd[1]: Reached target Sockets. Apr 7 16:46:46 warble1 systemd[1]: Starting Sockets. Apr 7 16:46:46 warble1 systemd[1]: Started Journal Service. Apr 7 16:46:46 warble1 systemd: Started Load Kernel Modules. Apr 7 16:46:46 warble1 systemd: Started dracut cmdline hook. Apr 7 16:46:46 warble1 systemd: Started Create list of required static device nodes for the current kernel. Apr 7 16:46:46 warble1 systemd: Starting Create Static Device Nodes in /dev... Apr 7 16:46:46 warble1 systemd: Starting dracut pre-udev hook... Apr 7 16:46:46 warble1 systemd: Starting Apply Kernel Variables... Apr 7 16:46:46 warble1 systemd: Started Create Static Device Nodes in /dev. Apr 7 16:46:46 warble1 systemd: Started Apply Kernel Variables. Apr 7 16:46:46 warble1 systemd: Started dracut pre-udev hook. Apr 7 16:46:46 warble1 systemd: Starting udev Kernel Device Manager... Apr 7 16:46:46 warble1 systemd-udevd: starting version 219 Apr 7 16:46:46 warble1 systemd: Started udev Kernel Device Manager. Apr 7 16:46:46 warble1 systemd: Starting dracut pre-trigger hook... Apr 7 16:46:46 warble1 systemd: Started dracut pre-trigger hook. Apr 7 16:46:46 warble1 systemd: Starting udev Coldplug all Devices... Apr 7 16:46:46 warble1 systemd: Mounting Configuration File System... Apr 7 16:46:46 warble1 systemd: Mounted Configuration File System. Apr 7 16:46:46 warble1 systemd-udevd: could not find module by name='ipmi_si' Apr 7 16:46:46 warble1 systemd-udevd: could not find module by name='ipmi_devintf' Apr 7 16:46:46 warble1 systemd-udevd: could not find module by name='ipmi_msghandler' Apr 7 16:46:46 warble1 kernel: pps_core: LinuxPPS API ver. 1 registered Apr 7 16:46:46 warble1 kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Apr 7 16:46:46 warble1 kernel: megasas: 07.701.17.00-rh1 Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: FW now in Ready state Apr 7 16:46:46 warble1 kernel: PTP clock support registered Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: firmware supports msix#011: (96) Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: current msix/online cpus#011: (16/16) Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: RDPQ mode#011: (disabled) Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: Current firmware maximum commands: 928#011 LDIO threshold: 0 Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: FW supports sync cache#011: No Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: Init cmd success Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: firmware type#011: Extended VD(240 VD)firmware Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: controller type#011: MR(2048MB) Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: Online Controller Reset(OCR)#011: Enabled Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: Secure JBOD support#011: No Apr 7 16:46:46 warble1 systemd: Started udev Coldplug all Devices. Apr 7 16:46:46 warble1 kernel: bnx2x: QLogic 5771x/578xx 10/20-Gigabit Ethernet Driver bnx2x 1.712.30-0 (2014/02/10) Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: INIT adapter done Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: Jbod map is not supported megasas_setup_jbod_map 5121 Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: pci id#011#011: (0x1000)/(0x005d)/(0x1028)/(0x1f42) Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: unevenspan support#011: yes Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: firmware crash dump#011: no Apr 7 16:46:46 warble1 kernel: megaraid_sas 0000:18:00.0: jbod sync map#011#011: no Apr 7 16:46:46 warble1 kernel: scsi host0: Avago SAS based MegaRAID driver Apr 7 16:46:46 warble1 systemd: Reached target System Initialization. Apr 7 16:46:46 warble1 systemd: Starting System Initialization. Apr 7 16:46:46 warble1 kernel: scsi 0:2:0:0: Direct-Access DELL PERC H730P Adp 4.28 PQ: 0 ANSI: 5 Apr 7 16:46:46 warble1 kernel: bnx2x 0000:19:00.0: msix capability found Apr 7 16:46:46 warble1 kernel: bnx2x 0000:19:00.0: part number 0-0-0-0 Apr 7 16:46:46 warble1 kernel: mpt3sas version 15.100.00.00 loaded Apr 7 16:46:46 warble1 kernel: mpt3sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (791015680 kB) Apr 7 16:46:46 warble1 kernel: ahci 0000:00:11.5: AHCI 0001.0301 32 slots 6 ports 6 Gbps 0x3f impl SATA mode Apr 7 16:46:46 warble1 kernel: ahci 0000:00:11.5: flags: 64bit ncq sntf pm led clo only pio slum part ems deso sadm sds apst Apr 7 16:46:46 warble1 systemd: Reached target Basic System. Apr 7 16:46:46 warble1 systemd: Starting Basic System. Apr 7 16:46:46 warble1 systemd: Starting dracut initqueue hook... Apr 7 16:46:46 warble1 kernel: mpt3sas_cm0: MSI-X vectors supported: 96, no of cores: 16, max_msix_vectors: -1 Apr 7 16:46:46 warble1 kernel: scsi host2: ahci Apr 7 16:46:46 warble1 kernel: scsi host3: ahci Apr 7 16:46:46 warble1 kernel: scsi host4: ahci Apr 7 16:46:46 warble1 kernel: scsi host5: ahci Apr 7 16:46:46 warble1 kernel: scsi host6: ahci Apr 7 16:46:46 warble1 kernel: scsi host7: ahci Apr 7 16:46:46 warble1 kernel: ata1: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80100 irq 53 Apr 7 16:46:46 warble1 kernel: ata2: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80180 irq 53 Apr 7 16:46:46 warble1 kernel: ata3: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80200 irq 53 Apr 7 16:46:46 warble1 kernel: ata4: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80280 irq 53 Apr 7 16:46:46 warble1 kernel: ata5: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80300 irq 53 Apr 7 16:46:46 warble1 kernel: ata6: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80380 irq 53 Apr 7 16:46:46 warble1 kernel: ahci 0000:00:17.0: AHCI 0001.0301 32 slots 8 ports 6 Gbps 0xff impl SATA mode Apr 7 16:46:46 warble1 kernel: ahci 0000:00:17.0: flags: 64bit ncq sntf pm led clo only pio slum part ems deso sadm sds apst Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 55 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 56 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 57 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 58 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 59 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 60 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 61 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 62 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 63 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 64 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 65 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 66 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 67 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 68 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 69 Apr 7 16:46:46 warble1 kernel: mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 70 Apr 7 16:46:46 warble1 kernel: mpt3sas_cm0: iomem(0x00000000ab100000), mapped(0xffffc90063a60000), size(65536) Apr 7 16:46:46 warble1 kernel: mpt3sas_cm0: ioport(0x0000000000006000), size(256) Apr 7 16:46:47 warble1 kernel: scsi host8: ahci Apr 7 16:46:47 warble1 kernel: scsi host9: ahci Apr 7 16:46:47 warble1 kernel: scsi host10: ahci Apr 7 16:46:47 warble1 kernel: scsi host11: ahci Apr 7 16:46:47 warble1 kernel: scsi host12: ahci Apr 7 16:46:47 warble1 kernel: scsi host13: ahci Apr 7 16:46:47 warble1 kernel: scsi host14: ahci Apr 7 16:46:47 warble1 kernel: scsi host15: ahci Apr 7 16:46:47 warble1 kernel: ata7: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00100 irq 54 Apr 7 16:46:47 warble1 kernel: ata8: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00180 irq 54 Apr 7 16:46:47 warble1 kernel: ata9: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00200 irq 54 Apr 7 16:46:47 warble1 kernel: ata10: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00280 irq 54 Apr 7 16:46:47 warble1 kernel: ata11: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00300 irq 54 Apr 7 16:46:47 warble1 kernel: ata12: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00380 irq 54 Apr 7 16:46:47 warble1 kernel: ata13: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00400 irq 54 Apr 7 16:46:47 warble1 kernel: ata14: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00480 irq 54 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: Eager buffer size 2097152 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: enabling device (0000 -> 0002) Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: WC Remapped RcvArray: ffffc90063e00000 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Implementation: RTL silicon, revision 0x0 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: GUID 1175010171de62 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Resetting CSRs with FLR Apr 7 16:46:47 warble1 kernel: bnx2x 0000:19:00.1: msix capability found Apr 7 16:46:47 warble1 kernel: bnx2x 0000:19:00.1: part number 0-0-0-0 Apr 7 16:46:47 warble1 kernel: mpt3sas_cm0: Allocated physical memory: size(18353 kB) Apr 7 16:46:47 warble1 kernel: mpt3sas_cm0: Current Controller Queue Depth(9548),Max Controller Queue Depth(9680) Apr 7 16:46:47 warble1 kernel: mpt3sas_cm0: Scatter Gather Elements per IO(128) Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe,8000MHz,x16 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: do_pcie_gen3_transition: PCIe already at gen3, skipping Apr 7 16:46:47 warble1 kernel: mpt3sas_cm0: LSISAS3008: FWVersion(13.15.02.00), ChipRevision(0x02), BiosVersion(15.00.02.00) Apr 7 16:46:47 warble1 kernel: mpt3sas_cm0: Protocol=( Apr 7 16:46:47 warble1 kernel: Initiator Apr 7 16:46:47 warble1 kernel: ,Target Apr 7 16:46:47 warble1 kernel: ), Apr 7 16:46:47 warble1 kernel: Capabilities=( Apr 7 16:46:47 warble1 kernel: TLR Apr 7 16:46:47 warble1 kernel: ,EEDP Apr 7 16:46:47 warble1 kernel: ,Snapshot Buffer Apr 7 16:46:47 warble1 kernel: ,Diag Trace Buffer Apr 7 16:46:47 warble1 kernel: ,Task Set Full Apr 7 16:46:47 warble1 kernel: ,NCQ Apr 7 16:46:47 warble1 kernel: ) Apr 7 16:46:47 warble1 kernel: scsi host1: Fusion MPT SAS Host Apr 7 16:46:47 warble1 kernel: mpt3sas_cm0: sending port enable !! Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Board description not found Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: rcv contexts: chip 160, used 25 (kernel 9, user 16) Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: RcvArray groups 327, ctxts extra 17 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: unused send context blocks: 9 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send contexts: chip 160, used 42 (kernel 16, ack 9, user 16, vl15 1) Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Using send context 16(143) for VL15 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA mod_num_sdma: 0 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_engines: 16 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_mem_size: 401408 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA engines 16 descq_cnt 2048 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA num_sdma: 16 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 26 MSI-X interrupts allocated Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 83, type GENERAL -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 84, type SDMA engine 0 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 85, type SDMA engine 1 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 86, type SDMA engine 2 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 87, type SDMA engine 3 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 88, type SDMA engine 4 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 89, type SDMA engine 5 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 90, type SDMA engine 6 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 91, type SDMA engine 7 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 92, type SDMA engine 8 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 93, type SDMA engine 9 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 94, type SDMA engine 10 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 95, type SDMA engine 11 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 96, type SDMA engine 12 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 97, type SDMA engine 13 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 98, type SDMA engine 14 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 99, type SDMA engine 15 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 100, type RCVCTXT ctxt 0 -> cpu: 1 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 101, type RCVCTXT ctxt 1 -> cpu: 3 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 102, type RCVCTXT ctxt 2 -> cpu: 5 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 103, type RCVCTXT ctxt 3 -> cpu: 7 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 112, type RCVCTXT ctxt 4 -> cpu: 9 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 113, type RCVCTXT ctxt 5 -> cpu: 11 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 114, type RCVCTXT ctxt 6 -> cpu: 13 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 115, type RCVCTXT ctxt 7 -> cpu: 15 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 116, type RCVCTXT ctxt 8 -> cpu: 3 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 7 16:46:47 warble1 kernel: bnx2x 0000:19:00.2: msix capability found Apr 7 16:46:47 warble1 kernel: bnx2x 0000:19:00.2: part number 0-0-0-0 Apr 7 16:46:47 warble1 kernel: ata1: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata2: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata5: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata12: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata13: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata3: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata6: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata4: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051 firmware version 1.24 Apr 7 16:46:47 warble1 kernel: ata10: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata11: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata7: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata8: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata14: SATA link up 1.5 Gbps (SStatus 113 SControl 300) Apr 7 16:46:47 warble1 kernel: ata9: SATA link down (SStatus 0 SControl 300) Apr 7 16:46:47 warble1 kernel: ata14.00: ATAPI: HL-DT-ST DVD-ROM DU90N, D3C0, max UDMA/100 Apr 7 16:46:47 warble1 kernel: ata14.00: configured for UDMA/100 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SBus Master firmware version 0x10130001 Apr 7 16:46:47 warble1 kernel: bnx2x 0000:19:00.3: msix capability found Apr 7 16:46:47 warble1 kernel: bnx2x 0000:19:00.3: part number 0-0-0-0 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe SerDes firmware version 0x4755 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric SerDes firmware version 0x1055 Apr 7 16:46:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Initializing thermal sensor Apr 7 16:46:47 warble1 kernel: scsi: waiting for bus probes to complete ... Apr 7 16:46:47 warble1 kernel: Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011) Apr 7 16:46:47 warble1 kernel: bonding: bond0 is being created... Apr 7 16:46:47 warble1 kernel: bonding: bond0 already exists Apr 7 16:46:47 warble1 kernel: bond0: Setting MII monitoring interval to 100 Apr 7 16:46:47 warble1 kernel: bond0: Setting xmit hash policy to layer3+4 (1) Apr 7 16:46:47 warble1 kernel: bond0: Setting LACP rate to fast (1) Apr 7 16:46:47 warble1 kernel: IPv6: ADDRCONF(NETDEV_UP): bond0: link is not ready Apr 7 16:46:47 warble1 kernel: bond0: Adding slave em1 Apr 7 16:46:48 warble1 kernel: bnx2x 0000:19:00.0 em1: using MSI-X IRQs: sp 72 fp[0] 74 ... fp[7] 81 Apr 7 16:46:48 warble1 kernel: bnx2x 0000:19:00.0 em1: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 7 16:46:48 warble1 kernel: bnx2x 0000:19:00.0 em1: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 7 16:46:48 warble1 kernel: bond0: Enslaving em1 as a backup interface with an up link Apr 7 16:46:48 warble1 kernel: bond0: Adding slave em2 Apr 7 16:46:48 warble1 kernel: mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x51866da0bde21000), phys(8) Apr 7 16:46:48 warble1 kernel: scsi 1:0:0:0: Direct-Access DELL MD34xx 0825 PQ: 1 ANSI: 5 Apr 7 16:46:48 warble1 kernel: scsi 1:0:0:0: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:48 warble1 kernel: scsi 1:0:0:0: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:48 warble1 kernel: scsi 1:0:0:0: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:48 warble1 kernel: scsi 1:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:48 warble1 kernel: bnx2x 0000:19:00.1 em2: using MSI-X IRQs: sp 117 fp[0] 119 ... fp[7] 126 Apr 7 16:46:49 warble1 kernel: bnx2x 0000:19:00.1 em2: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 7 16:46:49 warble1 kernel: bnx2x 0000:19:00.1 em2: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 7 16:46:49 warble1 kernel: bond0: Enslaving em2 as a backup interface with an up link Apr 7 16:46:49 warble1 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready Apr 7 16:46:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: wait_for_qsfp_init: No IntN detected, reset complete Apr 7 16:46:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current OFFLINE, new POLL Apr 7 16:46:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:10: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:10: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:10: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:10: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:10: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:10: Mode parameters changed Apr 7 16:46:50 warble1 kernel: bnx2x 0000:19:00.0 em1: using MSI-X IRQs: sp 72 fp[0] 74 ... fp[7] 81 Apr 7 16:46:50 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Reserving QPNs from 0x800000 to 0x80ffff for non-verbs use Apr 7 16:46:50 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_POLL (0x2), phy 0x20 Apr 7 16:46:50 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_TRAINING (0x4), phy 0x40 Apr 7 16:46:50 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Congestion Control Agent enabled for port 1 Apr 7 16:46:50 warble1 kernel: Couldn't create new SM AH Apr 7 16:46:50 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Registration with rdmavt done. Apr 7 16:46:50 warble1 kernel: bnx2x 0000:19:00.0 em1: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 7 16:46:50 warble1 kernel: bnx2x 0000:19:00.0 em1: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 7 16:46:50 warble1 kernel: sd 0:2:0:0: [sda] 584843264 512-byte logical blocks: (299 GB/278 GiB) Apr 7 16:46:50 warble1 kernel: sd 0:2:0:0: [sda] Write Protect is off Apr 7 16:46:50 warble1 kernel: sd 0:2:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA Apr 7 16:46:50 warble1 kernel: sda: sda1 sda2 Apr 7 16:46:50 warble1 kernel: sd 0:2:0:0: [sda] Attached SCSI disk Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:11: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:11: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:11: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:11: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:11: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:11: Mode parameters changed Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:20: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:20: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:20: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:20: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:20: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:20: Mode parameters changed Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:21: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:21: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:21: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:21: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:21: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:21: Mode parameters changed Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:22: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:22: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:22: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:22: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:22: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:22: Mode parameters changed Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:23: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:23: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:23: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:23: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:23: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:23: Mode parameters changed Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:24: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:24: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:24: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:24: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:24: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:24: Mode parameters changed Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:25: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:25: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:25: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:25: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:25: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:25: Mode parameters changed Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:31: Direct-Access DELL Universal Xport 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:31: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:31: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:31: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:31: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:40: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:40: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:40: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:40: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:40: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:40: Mode parameters changed Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:41: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:41: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:41: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:41: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:41: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:50 warble1 kernel: scsi 1:0:0:41: Mode parameters changed Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:51: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:51: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:51: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:51: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:51: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:51: Mode parameters changed Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:52: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:52: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:52: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:52: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:52: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:52: Mode parameters changed Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:60: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:60: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:60: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:60: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:60: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:60: Mode parameters changed Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:61: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:61: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:61: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:61: SSP: enclosure level(0x0000), connector name( 0 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:61: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:0:61: Mode parameters changed Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:0: Direct-Access DELL MD34xx 0825 PQ: 1 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:0: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:0: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:0: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: bnx2x 0000:19:00.1 em2: using MSI-X IRQs: sp 117 fp[0] 119 ... fp[7] 126 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:10: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:10: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:10: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:10: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:10: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:11: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:11: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:11: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:11: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:11: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:20: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:20: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:20: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:20: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: bnx2x 0000:19:00.1 em2: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 7 16:46:51 warble1 kernel: bnx2x 0000:19:00.1 em2: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:20: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:21: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:21: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:21: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:21: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:21: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:22: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:22: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:22: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:22: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:22: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 dracut-initqueue: dhcp: PREINIT bond0 up Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:23: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:23: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:23: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:23: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:23: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 dhclient[576]: DHCPDISCOVER on bond0 to 255.255.255.255 port 67 interval 6 (xid=0x139e7233) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:24: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:24: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:24: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:24: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:24: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:25: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:25: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:25: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:25: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:25: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:31: Direct-Access DELL Universal Xport 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:31: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:31: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:31: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:31: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:40: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:40: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:40: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:40: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:40: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:41: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:41: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:41: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:41: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:51 warble1 kernel: scsi 1:0:1:41: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:51: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:51: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:51: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:51: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:51: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:52: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:52: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:52: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:52: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:52: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:60: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:60: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:60: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:60: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:60: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:61: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:61: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:61: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:61: SSP: enclosure level(0x0000), connector name( 1 ) Apr 7 16:46:52 warble1 kernel: scsi 1:0:1:61: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 7 16:46:53 warble1 kernel: mpt3sas_cm0: port enable: SUCCESS Apr 7 16:46:53 warble1 kernel: scsi 1:0:0:0: rdac: LUN 0 (IOSHIP) (unowned) Apr 7 16:46:53 warble1 kernel: scsi 1:0:0:10: rdac: LUN 10 (IOSHIP) (unowned) Apr 7 16:46:53 warble1 kernel: sd 1:0:0:10: [sdb] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 7 16:46:53 warble1 kernel: scsi 1:0:0:11: rdac: LUN 11 (IOSHIP) (owned) Apr 7 16:46:53 warble1 kernel: sd 1:0:0:10: [sdb] Write Protect is off Apr 7 16:46:53 warble1 kernel: sd 1:0:0:11: [sdc] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:20: rdac: LUN 20 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:11: [sdc] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:0:20: [sdd] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:11: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:21: rdac: LUN 21 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:21: [sde] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:20: [sdd] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:22: rdac: LUN 22 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:20: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:0:22: [sdf] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:21: [sde] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:0:21: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:23: rdac: LUN 23 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:23: [sdg] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:22: [sdf] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:0:22: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:24: rdac: LUN 24 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:24: [sdh] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:23: [sdg] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:25: rdac: LUN 25 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:23: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:0:25: [sdi] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:24: [sdh] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:0:24: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:40: rdac: LUN 40 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:11: [sdc] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:0:40: [sdj] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:25: [sdi] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:41: rdac: LUN 41 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:25: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:0:41: [sdk] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:40: [sdj] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:51: rdac: LUN 51 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:40: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:0:21: [sde] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:0:20: [sdd] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:0:51: [sdl] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:41: [sdk] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:52: rdac: LUN 52 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:41: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:0:52: [sdm] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:51: [sdl] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:0:22: [sdf] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:60: rdac: LUN 60 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:51: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:0:23: [sdg] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:0:60: [sdn] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:52: [sdm] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:0:61: rdac: LUN 61 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:52: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:0: rdac: LUN 0 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:10: rdac: LUN 10 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:61: [sdo] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:10: [sdp] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:60: [sdn] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:0:24: [sdh] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:11: rdac: LUN 11 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:11: [sdq] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:10: [sdp] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:0:60: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:20: rdac: LUN 20 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:10: [sdp] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:0:25: [sdi] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:11: [sdq] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:1:20: [sdr] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:11: [sdq] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:21: rdac: LUN 21 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:61: [sdo] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:1:21: [sds] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:20: [sdr] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:0:61: [sdo] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:22: rdac: LUN 22 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:20: [sdr] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:22: [sdt] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:21: [sds] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:23: rdac: LUN 23 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:21: [sds] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:0:40: [sdj] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:0:41: [sdk] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:23: [sdu] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:22: [sdt] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:24: rdac: LUN 24 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:22: [sdt] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:24: [sdv] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:23: [sdu] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:25: rdac: LUN 25 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:23: [sdu] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:10: [sdp] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:0:52: [sdm] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:25: [sdw] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:51: [sdl] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:24: [sdv] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:40: rdac: LUN 40 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:24: [sdv] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:40: [sdx] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:0:61: [sdo] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:25: [sdw] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:0:60: [sdn] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:41: rdac: LUN 41 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:25: [sdw] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:20: [sdr] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:41: [sdy] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:40: [sdx] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:1:11: [sdq] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:51: rdac: LUN 51 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:40: [sdx] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:51: [sdz] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:41: [sdy] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:52: rdac: LUN 52 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:21: [sds] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:41: [sdy] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:52: [sdaa] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:22: [sdt] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:51: [sdz] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:60: rdac: LUN 60 (IOSHIP) (owned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:51: [sdz] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:60: [sdab] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:52: [sdaa] Write Protect is off Apr 7 16:46:54 warble1 kernel: scsi 1:0:1:61: rdac: LUN 61 (IOSHIP) (unowned) Apr 7 16:46:54 warble1 kernel: sd 1:0:1:52: [sdaa] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:24: [sdv] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:61: [sdac] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 7 16:46:54 warble1 kernel: scsi 15:0:0:0: CD-ROM HL-DT-ST DVD-ROM DU90N D3C0 PQ: 0 ANSI: 5 Apr 7 16:46:54 warble1 kernel: sd 1:0:1:60: [sdab] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:1:23: [sdu] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:60: [sdab] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:61: [sdac] Write Protect is off Apr 7 16:46:54 warble1 kernel: sd 1:0:1:61: [sdac] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:1:25: [sdw] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:40: [sdx] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:41: [sdy] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:51: [sdz] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:60: [sdab] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:52: [sdaa] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sd 1:0:1:61: [sdac] Attached SCSI disk Apr 7 16:46:54 warble1 kernel: sr 15:0:0:0: [sr0] scsi3-mmc drive: 24x/24x cd/rw xa/form2 cdda tray Apr 7 16:46:54 warble1 kernel: cdrom: Uniform CD-ROM driver Revision: 3.20 Apr 7 16:46:54 warble1 kernel: sd 1:0:0:10: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 7 16:46:54 warble1 kernel: sd 1:0:0:10: [sdb] Attached SCSI disk Apr 7 16:46:56 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current POLL, new VERIFY_CAP Apr 7 16:46:56 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 7 16:46:56 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer PHY: power management 0x0, continuous updates 0x0 Apr 7 16:46:56 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Fabric: vAU 3, Z 1, vCU 0, vl15 credits 0x44, CRC sizes 0x3 Apr 7 16:46:56 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Link Width: tx rate 0x2, widths 0x8 Apr 7 16:46:56 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Device ID: 0xabc0, Revision 0x10 Apr 7 16:46:56 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Final LCB CRC mode: 1 Apr 7 16:46:56 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Neighbor Guid: 117501020c4c04 Neighbor type 1 MgmtAllowed 1 FM security bypass 0 Apr 7 16:46:56 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 7 16:46:56 warble1 kernel: Couldn't create new SM AH Apr 7 16:46:56 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current VERIFY_CAP, new GOING_UP Apr 7 16:46:57 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051: Link up Apr 7 16:46:57 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current GOING_UP, new INIT (LINKUP) Apr 7 16:46:57 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_INIT (0x2) Apr 7 16:46:57 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 7 16:46:57 warble1 dhclient[576]: DHCPDISCOVER on bond0 to 255.255.255.255 port 67 interval 7 (xid=0x139e7233) Apr 7 16:46:57 warble1 dhclient[576]: DHCPREQUEST on bond0 to 255.255.255.255 port 67 (xid=0x139e7233) Apr 7 16:46:57 warble1 dhclient[576]: DHCPOFFER from 10.8.44.11 Apr 7 16:46:57 warble1 dhclient[576]: DHCPACK from 10.8.44.11 (xid=0x139e7233) Apr 7 16:46:57 warble1 dracut-initqueue: dhcp: BOND setting bond0 Apr 7 16:46:58 warble1 kernel: random: crng init done Apr 7 16:46:58 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_LINKUP (0x5), phy 0x50 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 7 16:46:59 warble1 kernel: Couldn't create new SM AH Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: port 1: got a lid: 0x63 Apr 7 16:46:59 warble1 kernel: SubnSet(OPA_PortInfo) smlid 0x8 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 1 from 10240 to 0 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 2 from 10240 to 0 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 3 from 10240 to 0 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 4 from 10240 to 0 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 5 from 10240 to 0 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 6 from 10240 to 0 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 7 from 10240 to 0 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current INIT, new ARMED Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ARMED (0x3) Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x103 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x103 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x1 Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current ARMED, new ACTIVE Apr 7 16:46:59 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ACTIVE (0x4) Apr 7 16:47:00 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x203 Apr 7 16:47:00 warble1 dhclient[576]: bound to 10.8.44.21 -- renewal in 21252 seconds. Apr 7 16:47:00 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x203 Apr 7 16:47:00 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x2 Apr 7 16:47:00 warble1 kernel: IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready Apr 7 16:47:00 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Switching to NO_DMA_RTAIL Apr 7 16:47:00 warble1 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready Apr 7 16:47:01 warble1 dracut-initqueue: . Apr 7 16:47:01 warble1 dracut-initqueue: Number of files: 1 Apr 7 16:47:01 warble1 dracut-initqueue: Number of files transferred: 1 Apr 7 16:47:01 warble1 dracut-initqueue: Total file size: 1172 bytes Apr 7 16:47:01 warble1 dracut-initqueue: Total transferred file size: 1172 bytes Apr 7 16:47:01 warble1 dracut-initqueue: Literal data: 1172 bytes Apr 7 16:47:01 warble1 dracut-initqueue: Matched data: 0 bytes Apr 7 16:47:01 warble1 dracut-initqueue: File list size: 39 Apr 7 16:47:01 warble1 dracut-initqueue: File list generation time: 0.001 seconds Apr 7 16:47:01 warble1 dracut-initqueue: File list transfer time: 0.000 seconds Apr 7 16:47:01 warble1 dracut-initqueue: Total bytes sent: 75 Apr 7 16:47:01 warble1 dracut-initqueue: Total bytes received: 1329 Apr 7 16:47:01 warble1 dracut-initqueue: sent 75 bytes received 1329 bytes 2808.00 bytes/sec Apr 7 16:47:01 warble1 dracut-initqueue: total size is 1172 speedup is 0.83 Apr 7 16:47:10 warble1 dracut-initqueue: Number of files: 45008 Apr 7 16:47:10 warble1 dracut-initqueue: Number of files transferred: 35605 Apr 7 16:47:10 warble1 dracut-initqueue: Total file size: 1075962237 bytes Apr 7 16:47:10 warble1 dracut-initqueue: Total transferred file size: 1045524501 bytes Apr 7 16:47:10 warble1 dracut-initqueue: Literal data: 1045523329 bytes Apr 7 16:47:10 warble1 dracut-initqueue: Matched data: 1172 bytes Apr 7 16:47:10 warble1 dracut-initqueue: File list size: 924418 Apr 7 16:47:10 warble1 dracut-initqueue: File list generation time: 0.001 seconds Apr 7 16:47:10 warble1 dracut-initqueue: File list transfer time: 0.000 seconds Apr 7 16:47:10 warble1 dracut-initqueue: Total bytes sent: 836684 Apr 7 16:47:10 warble1 dracut-initqueue: Total bytes received: 1048256649 Apr 7 16:47:10 warble1 dracut-initqueue: sent 836684 bytes received 1048256649 bytes 110430877.16 bytes/sec Apr 7 16:47:10 warble1 dracut-initqueue: total size is 1075962237 speedup is 1.03 Apr 7 16:47:10 warble1 dracut-initqueue: Number of files: 3022 Apr 7 16:47:10 warble1 dracut-initqueue: Number of files transferred: 2461 Apr 7 16:47:10 warble1 dracut-initqueue: Total file size: 60768950 bytes Apr 7 16:47:10 warble1 dracut-initqueue: Total transferred file size: 60768902 bytes Apr 7 16:47:10 warble1 dracut-initqueue: Literal data: 60768902 bytes Apr 7 16:47:10 warble1 dracut-initqueue: Matched data: 0 bytes Apr 7 16:47:10 warble1 dracut-initqueue: File list size: 62854 Apr 7 16:47:10 warble1 dracut-initqueue: File list generation time: 0.001 seconds Apr 7 16:47:10 warble1 dracut-initqueue: File list transfer time: 0.000 seconds Apr 7 16:47:10 warble1 dracut-initqueue: Total bytes sent: 49056 Apr 7 16:47:10 warble1 dracut-initqueue: Total bytes received: 60946523 Apr 7 16:47:10 warble1 dracut-initqueue: sent 49056 bytes received 60946523 bytes 121991158.00 bytes/sec Apr 7 16:47:10 warble1 dracut-initqueue: total size is 60768950 speedup is 1.00 Apr 7 16:47:10 warble1 systemd: Started dracut initqueue hook. Apr 7 16:47:10 warble1 systemd: Reached target Initrd Root File System. Apr 7 16:47:10 warble1 systemd: Starting Initrd Root File System. Apr 7 16:47:10 warble1 systemd: Starting Reload Configuration from the Real Root... Apr 7 16:47:10 warble1 systemd: Reached target Remote File Systems (Pre). Apr 7 16:47:10 warble1 systemd: Starting Remote File Systems (Pre). Apr 7 16:47:10 warble1 systemd: Reached target Remote File Systems. Apr 7 16:47:10 warble1 systemd: Starting Remote File Systems. Apr 7 16:47:10 warble1 systemd: Reloading. Apr 7 16:47:10 warble1 systemd: Started Reload Configuration from the Real Root. Apr 7 16:47:10 warble1 systemd: Reached target Initrd File Systems. Apr 7 16:47:10 warble1 systemd: Starting Initrd File Systems. Apr 7 16:47:10 warble1 systemd: Reached target Initrd Default Target. Apr 7 16:47:10 warble1 systemd: Starting Initrd Default Target. Apr 7 16:47:10 warble1 systemd: Starting dracut pre-pivot and cleanup hook... Apr 7 16:47:11 warble1 systemd: Started dracut pre-pivot and cleanup hook. Apr 7 16:47:11 warble1 systemd: Starting Cleaning Up and Shutting Down Daemons... Apr 7 16:47:11 warble1 systemd: Stopped target Timers. Apr 7 16:47:11 warble1 systemd: Stopping Timers. Apr 7 16:47:11 warble1 systemd: Stopped Cleaning Up and Shutting Down Daemons. Apr 7 16:47:11 warble1 systemd: Stopped dracut pre-pivot and cleanup hook. Apr 7 16:47:11 warble1 systemd: Stopping dracut pre-pivot and cleanup hook... Apr 7 16:47:11 warble1 systemd: Stopped target Remote File Systems. Apr 7 16:47:11 warble1 systemd: Stopping Remote File Systems. Apr 7 16:47:11 warble1 systemd: Stopped target Remote File Systems (Pre). Apr 7 16:47:11 warble1 systemd: Stopping Remote File Systems (Pre). Apr 7 16:47:11 warble1 systemd: Stopped dracut initqueue hook. Apr 7 16:47:11 warble1 systemd: Stopping dracut initqueue hook... Apr 7 16:47:11 warble1 systemd: Stopped target Initrd Default Target. Apr 7 16:47:11 warble1 systemd: Stopping Initrd Default Target. Apr 7 16:47:11 warble1 systemd: Stopped target Basic System. Apr 7 16:47:11 warble1 systemd: Stopping Basic System. Apr 7 16:47:11 warble1 systemd: Stopped target Sockets. Apr 7 16:47:11 warble1 systemd: Stopping Sockets. Apr 7 16:47:11 warble1 systemd: Stopped target Paths. Apr 7 16:47:11 warble1 systemd: Stopping Paths. Apr 7 16:47:11 warble1 systemd: Stopped Dispatch Password Requests to Console Directory Watch. Apr 7 16:47:11 warble1 systemd: Stopping Dispatch Password Requests to Console Directory Watch. Apr 7 16:47:11 warble1 systemd: Stopped target Slices. Apr 7 16:47:11 warble1 systemd: Stopping Slices. Apr 7 16:47:11 warble1 systemd: Stopped target System Initialization. Apr 7 16:47:11 warble1 systemd: Stopping System Initialization. Apr 7 16:47:11 warble1 systemd: Stopped udev Coldplug all Devices. Apr 7 16:47:11 warble1 systemd: Stopping udev Coldplug all Devices... Apr 7 16:47:11 warble1 systemd: Stopped dracut pre-trigger hook. Apr 7 16:47:11 warble1 systemd: Stopping dracut pre-trigger hook... Apr 7 16:47:11 warble1 systemd: Stopping udev Kernel Device Manager... Apr 7 16:47:11 warble1 systemd: Stopped target Local File Systems. Apr 7 16:47:11 warble1 systemd: Stopping Local File Systems. Apr 7 16:47:11 warble1 systemd: Stopped target Swap. Apr 7 16:47:11 warble1 systemd: Stopping Swap. Apr 7 16:47:11 warble1 systemd: Stopped Apply Kernel Variables. Apr 7 16:47:11 warble1 systemd: Stopping Apply Kernel Variables... Apr 7 16:47:11 warble1 systemd: Stopped Load Kernel Modules. Apr 7 16:47:11 warble1 systemd: Stopping Load Kernel Modules... Apr 7 16:47:11 warble1 systemd: Stopped udev Kernel Device Manager. Apr 7 16:47:11 warble1 systemd: Stopped Create Static Device Nodes in /dev. Apr 7 16:47:11 warble1 systemd: Stopping Create Static Device Nodes in /dev... Apr 7 16:47:11 warble1 systemd: Stopped Create list of required static device nodes for the current kernel. Apr 7 16:47:11 warble1 systemd: Stopping Create list of required static device nodes for the current kernel... Apr 7 16:47:11 warble1 systemd: Stopped dracut pre-udev hook. Apr 7 16:47:11 warble1 systemd: Stopping dracut pre-udev hook... Apr 7 16:47:11 warble1 systemd: Stopped dracut cmdline hook. Apr 7 16:47:11 warble1 systemd: Stopping dracut cmdline hook... Apr 7 16:47:11 warble1 systemd: Closed udev Control Socket. Apr 7 16:47:11 warble1 systemd: Stopping udev Control Socket. Apr 7 16:47:11 warble1 systemd: Closed udev Kernel Socket. Apr 7 16:47:11 warble1 systemd: Stopping udev Kernel Socket. Apr 7 16:47:11 warble1 systemd: Starting Cleanup udevd DB... Apr 7 16:47:11 warble1 systemd: Started Cleanup udevd DB. Apr 7 16:47:11 warble1 systemd: Reached target Switch Root. Apr 7 16:47:11 warble1 systemd: Starting Switch Root. Apr 7 16:47:11 warble1 systemd: Starting Switch Root... Apr 7 16:47:11 warble1 systemd: Switching root. Apr 7 16:47:11 warble1 journal: Journal stopped Apr 7 16:47:11 warble1 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 7 16:47:11 warble1 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 7 16:47:11 warble1 systemd-journald[167]: Received SIGTERM from PID 1 (systemd). Apr 7 16:47:11 warble1 kernel: ip_tables: (C) 2000-2006 Netfilter Core Team Apr 7 16:47:11 warble1 systemd[1]: Inserted module 'ip_tables' Apr 7 16:47:11 warble1 journal: Journal started Apr 7 16:47:11 warble1 systemd: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) Apr 7 16:47:11 warble1 systemd: Detected architecture x86-64. Apr 7 16:47:11 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 7 16:47:11 warble1 systemd: Cannot add dependency job for unit cpupower.service, ignoring: Unit is masked. Apr 7 16:47:11 warble1 systemd: Cannot add dependency job for unit gssproxy.service, ignoring: Unit is masked. Apr 7 16:47:11 warble1 systemd: Started Create list of required static device nodes for the current kernel. Apr 7 16:47:11 warble1 systemd: Started Setup Virtual Console. Apr 7 16:47:11 warble1 systemd: Started Load Kernel Modules. Apr 7 16:47:11 warble1 systemd: Started Availability of block devices. Apr 7 16:47:11 warble1 systemd: Started Remount Root and Kernel File Systems. Apr 7 16:47:11 warble1 systemd: Got automount request for /proc/sys/fs/binfmt_misc, triggered by 900 (systemd-binfmt) Apr 7 16:47:11 warble1 systemd: Mounting Arbitrary Executable File Formats File System... Apr 7 16:47:11 warble1 systemd: Starting Configure read-only root support... Apr 7 16:47:11 warble1 systemd: Starting Rebuild Hardware Database... Apr 7 16:47:11 warble1 systemd: Starting Load/Save Random Seed... Apr 7 16:47:11 warble1 systemd: Starting Apply Kernel Variables... Apr 7 16:47:11 warble1 systemd: Starting Create Static Device Nodes in /dev... Apr 7 16:47:11 warble1 systemd: Starting Flush Journal to Persistent Storage... Apr 7 16:47:11 warble1 systemd: Mounted Arbitrary Executable File Formats File System. Apr 7 16:47:11 warble1 systemd: Started Configure read-only root support. Apr 7 16:47:11 warble1 systemd: Started Set Up Additional Binary Formats. Apr 7 16:47:11 warble1 systemd: Started Load/Save Random Seed. Apr 7 16:47:11 warble1 systemd: Started Apply Kernel Variables. Apr 7 16:47:11 warble1 systemd: Started Create Static Device Nodes in /dev. Apr 7 16:47:11 warble1 systemd: Reached target Local File Systems (Pre). Apr 7 16:47:11 warble1 systemd: Starting Local File Systems (Pre). Apr 7 16:47:11 warble1 systemd: Starting udev Kernel Device Manager... Apr 7 16:47:11 warble1 systemd-udevd: starting version 219 Apr 7 16:47:11 warble1 systemd: Started udev Kernel Device Manager. Apr 7 16:47:11 warble1 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 7 16:47:11 warble1 systemd: Started Flush Journal to Persistent Storage. Apr 7 16:47:11 warble1 systemd: Started Rebuild Hardware Database. Apr 7 16:47:11 warble1 systemd: Starting udev Coldplug all Devices... Apr 7 16:47:11 warble1 systemd: Starting Initialize the iWARP/InfiniBand/RDMA stack in the kernel... Apr 7 16:47:11 warble1 kernel: ACPI Error: No handler for Region [SYSI] (ffff88606ef81d38) [IPMI] (20130517/evregion-162) Apr 7 16:47:11 warble1 kernel: ACPI Error: Region IPMI (ID=7) has no handler (20130517/exfldio-305) Apr 7 16:47:11 warble1 kernel: ACPI Error: Method parse/execution failed [\_SB_.PMI0._GHL] (Node ffff88606ef4e550), AE_NOT_EXIST (20130517/psparse-536) Apr 7 16:47:12 warble1 kernel: ACPI Error: Method parse/execution failed [\_SB_.PMI0._PMC] (Node ffff88606ef4e4b0), AE_NOT_EXIST (20130517/psparse-536) Apr 7 16:47:12 warble1 kernel: ACPI Exception: AE_NOT_EXIST, Evaluating _PMC (20130517/power_meter-753) Apr 7 16:47:12 warble1 kernel: ipmi message handler version 39.2 Apr 7 16:47:12 warble1 kernel: ipmi device interface Apr 7 16:47:12 warble1 kernel: ipmi_si IPI0001:00: ipmi_si: probing via ACPI Apr 7 16:47:12 warble1 kernel: ipmi_si IPI0001:00: [io 0x0ca8] regsize 1 spacing 4 irq 10 Apr 7 16:47:12 warble1 kernel: ipmi_si: Adding ACPI-specified kcs state machine Apr 7 16:47:12 warble1 kernel: IPMI System Interface driver. Apr 7 16:47:12 warble1 kernel: ipmi_si: probing via SMBIOS Apr 7 16:47:12 warble1 kernel: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10 Apr 7 16:47:12 warble1 kernel: ipmi_si: Adding SMBIOS-specified kcs state machine duplicate interface Apr 7 16:47:12 warble1 kernel: ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca8, slave address 0x0, irq 10 Apr 7 16:47:12 warble1 kernel: i801_smbus 0000:00:1f.4: SMBus using PCI interrupt Apr 7 16:47:12 warble1 kernel: lpc_ich 0000:00:1f.0: I/O space for ACPI uninitialized Apr 7 16:47:12 warble1 kernel: lpc_ich 0000:00:1f.0: No MFD cells added Apr 7 16:47:12 warble1 systemd: Found device /dev/ttyS0. Apr 7 16:47:12 warble1 kernel: input: PC Speaker as /devices/platform/pcspkr/input/input1 Apr 7 16:47:12 warble1 kernel: ipmi_si IPI0001:00: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed. Apr 7 16:47:12 warble1 kernel: ipmi_si IPI0001:00: Using irq 10 Apr 7 16:47:12 warble1 kernel: ipmi_si IPI0001:00: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20) Apr 7 16:47:12 warble1 kernel: ipmi_si IPI0001:00: IPMI kcs interface initialized Apr 7 16:47:12 warble1 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Apr 7 16:47:12 warble1 kernel: sd 0:2:0:0: Attached scsi generic sg0 type 0 Apr 7 16:47:12 warble1 kernel: scsi 1:0:0:0: Attached scsi generic sg1 type 0 Apr 7 16:47:12 warble1 systemd: Started udev Coldplug all Devices. Apr 7 16:47:12 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: No such file or directory Apr 7 16:47:12 warble1 kernel: sd 1:0:0:10: Attached scsi generic sg2 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:11: Attached scsi generic sg3 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:20: Attached scsi generic sg4 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:21: Attached scsi generic sg5 type 0 Apr 7 16:47:12 warble1 systemd: Starting Device-Mapper Multipath Device Controller... Apr 7 16:47:12 warble1 kernel: device-mapper: uevent: version 1.0.3 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:22: Attached scsi generic sg6 type 0 Apr 7 16:47:12 warble1 kernel: device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com Apr 7 16:47:12 warble1 kernel: sd 1:0:0:23: Attached scsi generic sg7 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:24: Attached scsi generic sg8 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:25: Attached scsi generic sg9 type 0 Apr 7 16:47:12 warble1 kernel: scsi 1:0:0:31: Attached scsi generic sg10 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:40: Attached scsi generic sg11 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:41: Attached scsi generic sg12 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:51: Attached scsi generic sg13 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:52: Attached scsi generic sg14 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:60: Attached scsi generic sg15 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:0:61: Attached scsi generic sg16 type 0 Apr 7 16:47:12 warble1 kernel: scsi 1:0:1:0: Attached scsi generic sg17 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:10: Attached scsi generic sg18 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:11: Attached scsi generic sg19 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:20: Attached scsi generic sg20 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:21: Attached scsi generic sg21 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:22: Attached scsi generic sg22 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:23: Attached scsi generic sg23 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:24: Attached scsi generic sg24 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:25: Attached scsi generic sg25 type 0 Apr 7 16:47:12 warble1 kernel: scsi 1:0:1:31: Attached scsi generic sg26 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:40: Attached scsi generic sg27 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:41: Attached scsi generic sg28 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:51: Attached scsi generic sg29 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:52: Attached scsi generic sg30 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:60: Attached scsi generic sg31 type 0 Apr 7 16:47:12 warble1 kernel: sd 1:0:1:61: Attached scsi generic sg32 type 0 Apr 7 16:47:12 warble1 kernel: sr 15:0:0:0: Attached scsi generic sg33 type 5 Apr 7 16:47:12 warble1 kernel: [drm] Initialized Apr 7 16:47:12 warble1 kernel: spl: loading out-of-tree module taints kernel. Apr 7 16:47:12 warble1 kernel: spl: module verification failed: signature and/or required key missing - tainting kernel Apr 7 16:47:12 warble1 kernel: SPL: Loaded module v0.7.6-1 Apr 7 16:47:12 warble1 kernel: znvpair: module license 'CDDL' taints kernel. Apr 7 16:47:12 warble1 kernel: znvpair: module license 'CDDL' taints kernel. Apr 7 16:47:12 warble1 kernel: Disabling lock debugging due to kernel taint Apr 7 16:47:12 warble1 kernel: AES CTR mode by8 optimization enabled Apr 7 16:47:12 warble1 kernel: alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) Apr 7 16:47:12 warble1 systemd: Created slice system-lvm2\x2dpvscan.slice. Apr 7 16:47:12 warble1 systemd: Starting system-lvm2\x2dpvscan.slice. Apr 7 16:47:12 warble1 systemd: Starting LVM2 PV scan on device 8:2... Apr 7 16:47:12 warble1 kernel: alg: No test for crc32 (crc32-pclmul) Apr 7 16:47:12 warble1 systemd: Started Initialize the iWARP/InfiniBand/RDMA stack in the kernel. Apr 7 16:47:12 warble1 systemd: Started LVM2 metadata daemon. Apr 7 16:47:12 warble1 systemd: Starting LVM2 metadata daemon... Apr 7 16:47:12 warble1 kernel: [TTM] Zone kernel: Available graphics memory: 395507840 kiB Apr 7 16:47:12 warble1 kernel: [TTM] Zone dma32: Available graphics memory: 2097152 kiB Apr 7 16:47:12 warble1 kernel: [TTM] Initializing pool allocator Apr 7 16:47:12 warble1 kernel: [TTM] Initializing DMA pool allocator Apr 7 16:47:12 warble1 kernel: intel_rapl: Found RAPL domain package Apr 7 16:47:12 warble1 kernel: intel_rapl: Found RAPL domain dram Apr 7 16:47:12 warble1 kernel: intel_rapl: DRAM domain energy unit 15300pj Apr 7 16:47:12 warble1 kernel: fbcon: mgadrmfb (fb0) is primary device Apr 7 16:47:12 warble1 kernel: intel_rapl: Found RAPL domain package Apr 7 16:47:12 warble1 kernel: intel_rapl: Found RAPL domain dram Apr 7 16:47:12 warble1 kernel: intel_rapl: DRAM domain energy unit 15300pj Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 7 16:47:12 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 7 16:47:12 warble1 kernel: iTCO_vendor_support: vendor-support=0 Apr 7 16:47:12 warble1 kernel: iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 Apr 7 16:47:12 warble1 kernel: iTCO_wdt: Found a Intel PCH TCO device (Version=4, TCOBASE=0x0400) Apr 7 16:47:12 warble1 kernel: iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) Apr 7 16:47:12 warble1 kernel: dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2) Apr 7 16:47:12 warble1 kernel: Console: switching to colour frame buffer device 128x48 Apr 7 16:47:12 warble1 kernel: mgag200 0000:03:00.0: fb0: mgadrmfb frame buffer device Apr 7 16:47:13 warble1 kernel: device-mapper: multipath round-robin: version 1.2.0 loaded Apr 7 16:47:13 warble1 systemd: Started Device-Mapper Multipath Device Controller. Apr 7 16:47:13 warble1 multipathd: vol-mgt-a: load table [0 819200 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:240 1 round-robin 0 1 1 8:16 1] Apr 7 16:47:13 warble1 multipathd: vol-mgt-b: load table [0 819200 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:32 1 round-robin 0 1 1 65:0 1] Apr 7 16:47:13 warble1 multipathd: vol-mdt0-a: load table [0 1319780352 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:16 1 round-robin 0 1 1 8:48 1] Apr 7 16:47:13 warble1 multipathd: vol-mdt0-b: load table [0 1319780352 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:64 1 round-robin 0 1 1 65:32 1] Apr 7 16:47:13 warble1 multipathd: vol-mdt1-a: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:48 1 round-robin 0 1 1 8:80 1] Apr 7 16:47:13 warble1 multipathd: vol-mdt1-b: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:96 1 round-robin 0 1 1 65:64 1] Apr 7 16:47:13 warble1 multipathd: vol-mdt2-a: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:80 1 round-robin 0 1 1 8:112 1] Apr 7 16:47:13 warble1 multipathd: vol-mdt2-b: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:128 1 round-robin 0 1 1 65:96 1] Apr 7 16:47:13 warble1 multipathd: vol-home-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:112 1 round-robin 0 1 1 8:144 1] Apr 7 16:47:13 warble1 multipathd: vol-home-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:160 1 round-robin 0 1 1 65:128 1] Apr 7 16:47:13 warble1 multipathd: vol-images-system-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:144 1 round-robin 0 1 1 8:176 1] Apr 7 16:47:13 warble1 multipathd: vol-images-system-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:192 1 round-robin 0 1 1 65:160 1] Apr 7 16:47:13 warble1 multipathd: vol-apps-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:176 1 round-robin 0 1 1 8:208 1] Apr 7 16:47:13 warble1 multipathd: vol-apps-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:224 1 round-robin 0 1 1 65:192 1] Apr 7 16:47:13 warble1 multipathd: vol-mgt-a: event checker started Apr 7 16:47:13 warble1 multipathd: vol-mgt-b: event checker started Apr 7 16:47:13 warble1 multipathd: vol-mdt0-a: event checker started Apr 7 16:47:13 warble1 multipathd: vol-mdt0-b: event checker started Apr 7 16:47:13 warble1 multipathd: vol-mdt1-a: event checker started Apr 7 16:47:13 warble1 multipathd: vol-mdt1-b: event checker started Apr 7 16:47:13 warble1 multipathd: vol-mdt2-a: event checker started Apr 7 16:47:13 warble1 multipathd: vol-mdt2-b: event checker started Apr 7 16:47:13 warble1 multipathd: vol-home-a: event checker started Apr 7 16:47:13 warble1 multipathd: vol-home-b: event checker started Apr 7 16:47:13 warble1 multipathd: vol-images-system-a: event checker started Apr 7 16:47:13 warble1 multipathd: vol-images-system-b: event checker started Apr 7 16:47:13 warble1 multipathd: vol-apps-a: event checker started Apr 7 16:47:13 warble1 multipathd: vol-apps-b: event checker started Apr 7 16:47:13 warble1 multipathd: path checkers start up Apr 7 16:47:13 warble1 kernel: [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0 Apr 7 16:47:15 warble1 kernel: ZFS: Loaded module v0.7.6-1, ZFS pool version 5000, ZFS filesystem version 5 Apr 7 16:47:15 warble1 multipathd: sdb: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdb: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdo: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdo: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdy: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdy: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdq: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdq: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdx: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdx: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdf: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdf: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdg: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdg: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sds: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sds: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdc: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdc: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdp: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdp: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdh: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdh: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdn: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdn: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdaa: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdaa: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdt: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdt: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdz: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdz: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdd: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdd: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdl: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdl: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdk: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdk: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdm: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdm: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdu: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdu: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdw: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdw: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdr: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdr: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdab: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdab: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdi: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdi: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdj: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdj: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdac: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdac: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sde: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sde: spurious uevent, path already in pathvec Apr 7 16:47:15 warble1 multipathd: sdv: add path (uevent) Apr 7 16:47:15 warble1 multipathd: sdv: spurious uevent, path already in pathvec Apr 7 16:47:16 warble1 systemd: Found device /dev/centos/swap. Apr 7 16:47:16 warble1 systemd: Activating swap /dev/centos/swap... Apr 7 16:47:16 warble1 kernel: Adding 4194300k swap on /dev/mapper/centos-swap. Priority:-1 extents:1 across:4194300k FS Apr 7 16:47:16 warble1 systemd: Activated swap /dev/centos/swap. Apr 7 16:47:16 warble1 systemd: Found device /dev/centos/root. Apr 7 16:47:16 warble1 systemd: Mounting /mnt/root... Apr 7 16:47:16 warble1 systemd: Reached target Swap. Apr 7 16:47:16 warble1 systemd: Starting Swap. Apr 7 16:47:16 warble1 lvm: 3 logical volume(s) in volume group "centos" now active Apr 7 16:47:16 warble1 systemd: Started LVM2 PV scan on device 8:2. Apr 7 16:47:16 warble1 kernel: SGI XFS with ACLs, security attributes, no debug enabled Apr 7 16:47:16 warble1 kernel: XFS (dm-16): Mounting V5 Filesystem Apr 7 16:47:16 warble1 kernel: XFS (dm-16): Starting recovery (logdev: internal) Apr 7 16:47:16 warble1 kernel: XFS (dm-16): Ending recovery (logdev: internal) Apr 7 16:47:16 warble1 systemd: Mounted /mnt/root. Apr 7 16:47:16 warble1 systemd: Reached target Local File Systems. Apr 7 16:47:16 warble1 systemd: Starting Local File Systems. Apr 7 16:47:16 warble1 systemd: Starting Import network configuration from initramfs... Apr 7 16:47:16 warble1 systemd: Starting Rebuild Journal Catalog... Apr 7 16:47:16 warble1 systemd: Starting Mark the need to relabel after reboot... Apr 7 16:47:16 warble1 systemd: Starting Preprocess NFS configuration... Apr 7 16:47:16 warble1 systemd: Started Import network configuration from initramfs. Apr 7 16:47:16 warble1 systemd: Started Rebuild Journal Catalog. Apr 7 16:47:16 warble1 systemd: Started Mark the need to relabel after reboot. Apr 7 16:47:16 warble1 systemd: Started Preprocess NFS configuration. Apr 7 16:47:16 warble1 systemd: Starting Notify NFS peers of a restart... Apr 7 16:47:16 warble1 sm-notify[13346]: Version 1.3.0 starting Apr 7 16:47:16 warble1 systemd: Starting Update is Completed... Apr 7 16:47:16 warble1 systemd: Starting Create Volatile Files and Directories... Apr 7 16:47:16 warble1 systemd: Started Notify NFS peers of a restart. Apr 7 16:47:16 warble1 systemd: Started Update is Completed. Apr 7 16:47:16 warble1 systemd: Started Create Volatile Files and Directories. Apr 7 16:47:16 warble1 systemd: Mounting RPC Pipe File System... Apr 7 16:47:16 warble1 systemd: Starting Update UTMP about System Boot/Shutdown... Apr 7 16:47:16 warble1 systemd: Started Update UTMP about System Boot/Shutdown. Apr 7 16:47:16 warble1 kernel: RPC: Registered named UNIX socket transport module. Apr 7 16:47:16 warble1 kernel: RPC: Registered udp transport module. Apr 7 16:47:16 warble1 kernel: RPC: Registered tcp transport module. Apr 7 16:47:16 warble1 kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. Apr 7 16:47:16 warble1 systemd: Reached target System Initialization. Apr 7 16:47:16 warble1 systemd: Starting System Initialization. Apr 7 16:47:16 warble1 systemd: Started Flexible branding. Apr 7 16:47:16 warble1 systemd: Starting Flexible branding. Apr 7 16:47:16 warble1 systemd: Reached target Paths. Apr 7 16:47:16 warble1 systemd: Starting Paths. Apr 7 16:47:16 warble1 systemd: Started Daily Cleanup of Temporary Directories. Apr 7 16:47:16 warble1 systemd: Starting Daily Cleanup of Temporary Directories. Apr 7 16:47:16 warble1 systemd: Reached target Timers. Apr 7 16:47:16 warble1 systemd: Starting Timers. Apr 7 16:47:16 warble1 systemd: Listening on RPCbind Server Activation Socket. Apr 7 16:47:16 warble1 systemd: Starting RPCbind Server Activation Socket. Apr 7 16:47:16 warble1 systemd: Listening on D-Bus System Message Bus Socket. Apr 7 16:47:16 warble1 systemd: Starting D-Bus System Message Bus Socket. Apr 7 16:47:16 warble1 systemd: Reached target Sockets. Apr 7 16:47:16 warble1 systemd: Starting Sockets. Apr 7 16:47:16 warble1 systemd: Reached target Basic System. Apr 7 16:47:16 warble1 systemd: Starting Basic System. Apr 7 16:47:16 warble1 systemd: Starting Set time via NTP... Apr 7 16:47:16 warble1 systemd: Starting Dump dmesg to /var/log/dmesg... Apr 7 16:47:16 warble1 systemd: Starting Initialize the OPA layer... Apr 7 16:47:16 warble1 systemd: Started Runs late. Kinda like rc.local. Apr 7 16:47:16 warble1 systemd: Starting Runs late. Kinda like rc.local... Apr 7 16:47:16 warble1 systemd: Starting Postfix Mail Transport Agent... Apr 7 16:47:16 warble1 systemd: Starting OpenSSH server daemon... Apr 7 16:47:16 warble1 systemd: Starting SYSV: pslogger process logger... Apr 7 16:47:16 warble1 pslogger: Starting pslogger: Apr 7 16:47:16 warble1 systemd: Starting Builds and install new kernel modules through DKMS... Apr 7 16:47:16 warble1 kinda_rc_local: rmmod: ERROR: Module lnet_selftest is not currently loaded Apr 7 16:47:16 warble1 kinda_rc_local: rmmod: ERROR: Module lnet_selftest is not currently loaded Apr 7 16:47:16 warble1 zed: ZFS Event Daemon 0.7.6-1 (PID 13407) Apr 7 16:47:16 warble1 opa-init-kernel: Renicing ib_mad processes...done. Apr 7 16:47:16 warble1 zed: Processing events since eid=0 Apr 7 16:47:16 warble1 systemd: Started ZFS Event Daemon (zed). Apr 7 16:47:16 warble1 systemd: Starting ZFS Event Daemon (zed)... Apr 7 16:47:16 warble1 systemd: Started RDMA Node Description Daemon. Apr 7 16:47:16 warble1 systemd: Starting RDMA Node Description Daemon... Apr 7 16:47:16 warble1 systemd: Starting System Security Services Daemon... Apr 7 16:47:16 warble1 systemd: Starting System Logging Service... Apr 7 16:47:16 warble1 kinda_rc_local: Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8). Apr 7 16:47:16 warble1 kinda_rc_local: Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8). Apr 7 16:47:16 warble1 sssd: Starting up Apr 7 16:47:16 warble1 rsyslogd: [origin software="rsyslogd" swVersion="8.24.0" x-pid="13444" x-info="http://www.rsyslog.com"] start Apr 7 16:47:16 warble1 systemd: Starting Machine Check Exception Logging Daemon... Apr 7 16:47:16 warble1 sssd[be[default]]: Starting up Apr 7 16:47:16 warble1 systemd: Started irqbalance daemon. Apr 7 16:47:16 warble1 systemd: Starting irqbalance daemon... Apr 7 16:47:16 warble1 systemd: Starting Temporary: Start ifalias interface for oobview even after parent is brought up in the initramfs... Apr 7 16:47:16 warble1 sssd[nss]: Starting up Apr 7 16:47:16 warble1 sssd[pam]: Starting up Apr 7 16:47:16 warble1 systemd: Starting Resets System Activity Logs... Apr 7 16:47:16 warble1 systemd: Started D-Bus System Message Bus. Apr 7 16:47:16 warble1 systemd: Starting D-Bus System Message Bus... Apr 7 16:47:16 warble1 systemd: Mounted RPC Pipe File System. Apr 7 16:47:16 warble1 systemd: Started OpenSSH server daemon. Apr 7 16:47:16 warble1 systemd: Started System Logging Service. Apr 7 16:47:16 warble1 systemd: Started System Security Services Daemon. Apr 7 16:47:16 warble1 systemd: Started Dump dmesg to /var/log/dmesg. Apr 7 16:47:16 warble1 systemd: Started Initialize the OPA layer. Apr 7 16:47:16 warble1 systemd: Started SYSV: pslogger process logger. Apr 7 16:47:16 warble1 systemd: Started Resets System Activity Logs. Apr 7 16:47:16 warble1 systemd: Started Builds and install new kernel modules through DKMS. Apr 7 16:47:16 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current ACTIVE, new OFFLINE Apr 7 16:47:16 warble1 systemd: Started Machine Check Exception Logging Daemon. Apr 7 16:47:16 warble1 systemd: Reached target User and Group Name Lookups. Apr 7 16:47:16 warble1 systemd: Starting User and Group Name Lookups. Apr 7 16:47:16 warble1 systemd: Starting Login Service... Apr 7 16:47:16 warble1 systemd: Reached target NFS client services. Apr 7 16:47:16 warble1 systemd: Starting NFS client services. Apr 7 16:47:16 warble1 systemd: Reached target Remote File Systems (Pre). Apr 7 16:47:16 warble1 systemd: Starting Remote File Systems (Pre). Apr 7 16:47:16 warble1 systemd: Reached target Remote File Systems. Apr 7 16:47:16 warble1 systemd: Starting Remote File Systems. Apr 7 16:47:16 warble1 systemd: Starting Permit User Sessions... Apr 7 16:47:16 warble1 systemd: Started Permit User Sessions. Apr 7 16:47:16 warble1 systemd-logind: New seat seat0. Apr 7 16:47:16 warble1 systemd-logind: Watching system buttons on /dev/input/event0 (Power Button) Apr 7 16:47:16 warble1 systemd: Started Getty on tty1. Apr 7 16:47:16 warble1 systemd: Starting Getty on tty1... Apr 7 16:47:16 warble1 systemd: Started Serial Getty on ttyS0. Apr 7 16:47:16 warble1 systemd: Starting Serial Getty on ttyS0... Apr 7 16:47:16 warble1 systemd: Reached target Login Prompts. Apr 7 16:47:16 warble1 systemd: Starting Login Prompts. Apr 7 16:47:16 warble1 systemd: Started Login Service. Apr 7 16:47:16 warble1 kernel: bnx2x 0000:19:00.2 em3: using MSI-X IRQs: sp 127 fp[0] 129 ... fp[7] 136 Apr 7 16:47:16 warble1 kernel: bnx2x 0000:19:00.2 em3: NIC Link is Up, 1000 Mbps full duplex, Flow control: none Apr 7 16:47:17 warble1 systemd: Started Postfix Mail Transport Agent. Apr 7 16:47:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_DOWN (0x1) Apr 7 16:47:18 warble1 ntpdate[13369]: sendto(transom1): Network is unreachable Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: Eager buffer size 2097152 Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: WC Remapped RcvArray: ffffc90064c00000 Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Implementation: RTL silicon, revision 0x0 Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: GUID 1175010171de62 Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Resetting CSRs with FLR Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe,8000MHz,x16 Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: do_pcie_gen3_transition: PCIe already at gen3, skipping Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Board description not found Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: rcv contexts: chip 160, used 21 (kernel 5, user 16) Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: RcvArray groups 390, ctxts extra 2 Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: unused send context blocks: 9 Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send contexts: chip 160, used 38 (kernel 16, ack 5, user 16, vl15 1) Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Using send context 16(143) for VL15 Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA mod_num_sdma: 0 Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_engines: 16 Apr 7 16:47:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_mem_size: 401408 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA engines 16 descq_cnt 2048 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA num_sdma: 16 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 22 MSI-X interrupts allocated Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 83, type GENERAL -> cpu: 1 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 84, type SDMA engine 0 -> cpu: 11 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 85, type SDMA engine 1 -> cpu: 13 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 86, type SDMA engine 2 -> cpu: 15 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 87, type SDMA engine 3 -> cpu: 11 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 88, type SDMA engine 4 -> cpu: 13 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 89, type SDMA engine 5 -> cpu: 15 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 90, type SDMA engine 6 -> cpu: 11 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 91, type SDMA engine 7 -> cpu: 13 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 92, type SDMA engine 8 -> cpu: 15 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 93, type SDMA engine 9 -> cpu: 11 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 94, type SDMA engine 10 -> cpu: 13 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 95, type SDMA engine 11 -> cpu: 15 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 96, type SDMA engine 12 -> cpu: 11 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 97, type SDMA engine 13 -> cpu: 13 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 98, type SDMA engine 14 -> cpu: 15 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 99, type SDMA engine 15 -> cpu: 11 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 100, type RCVCTXT ctxt 0 -> cpu: 1 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 101, type RCVCTXT ctxt 1 -> cpu: 3 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 102, type RCVCTXT ctxt 2 -> cpu: 5 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 103, type RCVCTXT ctxt 3 -> cpu: 7 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 112, type RCVCTXT ctxt 4 -> cpu: 9 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051 firmware version 1.24 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SBus Master firmware version 0x10130001 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe SerDes firmware version 0x4755 Apr 7 16:47:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric SerDes firmware version 0x1055 Apr 7 16:47:20 warble1 ntpdate[13369]: no server suitable for synchronization found Apr 7 16:47:22 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: wait_for_qsfp_init: No IntN detected, reset complete Apr 7 16:47:22 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current OFFLINE, new POLL Apr 7 16:47:22 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 7 16:47:22 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Reserving QPNs from 0x800000 to 0x80ffff for non-verbs use Apr 7 16:47:22 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_POLL (0x2), phy 0x20 Apr 7 16:47:22 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_TRAINING (0x4), phy 0x40 Apr 7 16:47:22 warble1 kernel: bnx2x 0000:19:00.3 em4: using MSI-X IRQs: sp 138 fp[0] 140 ... fp[7] 147 Apr 7 16:47:22 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Congestion Control Agent enabled for port 1 Apr 7 16:47:22 warble1 kernel: Couldn't create new SM AH Apr 7 16:47:22 warble1 kernel: bnx2x 0000:19:00.3 em4: NIC Link is Up, 1000 Mbps full duplex, Flow control: ON - receive & transmit Apr 7 16:47:22 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Registration with rdmavt done. Apr 7 16:47:23 warble1 kernel: ib0: P_Key 0x8000 is Invalid Apr 7 16:47:23 warble1 kernel: IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready Apr 7 16:47:23 warble1 kinda_rc_local: RTNETLINK answers: No such process Apr 7 16:47:23 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 7 16:47:23 warble1 systemd: Stopping irqbalance daemon... Apr 7 16:47:23 warble1 systemd: Started irqbalance daemon. Apr 7 16:47:23 warble1 systemd: Starting irqbalance daemon... Apr 7 16:47:23 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 7 16:47:23 warble1 systemd: Stopping System Security Services Daemon... Apr 7 16:47:23 warble1 sssd[nss]: Shutting down Apr 7 16:47:23 warble1 sssd[be[default]]: Shutting down Apr 7 16:47:23 warble1 sssd[pam]: Shutting down Apr 7 16:47:23 warble1 systemd: Starting System Security Services Daemon... Apr 7 16:47:23 warble1 sssd: Starting up Apr 7 16:47:23 warble1 sssd[be[default]]: Starting up Apr 7 16:47:23 warble1 sssd[pam]: Starting up Apr 7 16:47:23 warble1 sssd[nss]: Starting up Apr 7 16:47:23 warble1 systemd: Started System Security Services Daemon. Apr 7 16:47:26 warble1 systemd: Started Temporary: Start ifalias interface for oobview even after parent is brought up in the initramfs. Apr 7 16:47:26 warble1 systemd: Starting PCS GUI and remote configuration interface... Apr 7 16:47:27 warble1 systemd: Started PCS GUI and remote configuration interface. Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current POLL, new VERIFY_CAP Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer PHY: power management 0x0, continuous updates 0x0 Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Fabric: vAU 3, Z 1, vCU 0, vl15 credits 0x44, CRC sizes 0x3 Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Link Width: tx rate 0x2, widths 0x8 Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Device ID: 0xabc0, Revision 0x10 Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Final LCB CRC mode: 1 Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Neighbor Guid: 117501020c4c04 Neighbor type 1 MgmtAllowed 1 FM security bypass 0 Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 7 16:47:29 warble1 kernel: Couldn't create new SM AH Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current VERIFY_CAP, new GOING_UP Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051: Link up Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current GOING_UP, new INIT (LINKUP) Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_INIT (0x2) Apr 7 16:47:29 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 7 16:47:30 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_LINKUP (0x5), phy 0x50 Apr 7 16:47:31 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 7 16:47:31 warble1 kernel: Couldn't create new SM AH Apr 7 16:47:31 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: port 1: got a lid: 0x63 Apr 7 16:47:31 warble1 kernel: SubnSet(OPA_PortInfo) smlid 0x8 Apr 7 16:47:31 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 1 from 10240 to 0 Apr 7 16:47:31 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 2 from 10240 to 0 Apr 7 16:47:31 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 3 from 10240 to 0 Apr 7 16:47:31 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 4 from 10240 to 0 Apr 7 16:47:31 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 5 from 10240 to 0 Apr 7 16:47:31 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 6 from 10240 to 0 Apr 7 16:47:31 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 7 from 10240 to 0 Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current INIT, new ARMED Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ARMED (0x3) Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x103 Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x103 Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x1 Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current ARMED, new ACTIVE Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ACTIVE (0x4) Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x203 Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x203 Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x2 Apr 7 16:47:32 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Switching to NO_DMA_RTAIL Apr 7 16:47:34 warble1 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready Apr 7 16:47:34 warble1 ntpdate[13778]: no server suitable for synchronization found Apr 7 16:47:34 warble1 rsyslogd: action 'action 0' resumed (module 'builtin:omfwd') [v8.24.0 try http://www.rsyslog.com/e/2359 ] Apr 7 16:47:34 warble1 rsyslogd: action 'action 0' resumed (module 'builtin:omfwd') [v8.24.0 try http://www.rsyslog.com/e/2359 ] Apr 7 16:47:45 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 7 16:47:45 warble1 systemd: Starting RPC bind service... Apr 7 16:47:45 warble1 systemd: Started RPC bind service. Apr 7 16:47:45 warble1 kernel: DCCP: Activated CCID 2 (TCP-like) Apr 7 16:47:45 warble1 kernel: DCCP: Activated CCID 3 (TCP-Friendly Rate Control) Apr 7 16:47:45 warble1 kernel: sctp: Hash tables configured (bind 16384/16384) Apr 7 16:47:56 warble1 systemd: Time has been changed Apr 7 16:47:56 warble1 ntpdate[14513]: step time server 192.168.44.11 offset -0.352964 sec Apr 7 16:47:56 warble1 systemd: Started Set time via NTP. Apr 7 16:47:56 warble1 systemd: Starting Network Time Service... Apr 7 16:47:56 warble1 systemd: Reached target System Time Synchronized. Apr 7 16:47:56 warble1 systemd: Starting System Time Synchronized. Apr 7 16:47:56 warble1 ntpd[14520]: ntpd 4.2.6p5@1.2349-o Wed Apr 12 21:24:06 UTC 2017 (1) Apr 7 16:47:56 warble1 systemd: Started Network Time Service. Apr 7 16:47:56 warble1 systemd: Reached target Multi-User System. Apr 7 16:47:56 warble1 systemd: Starting Multi-User System. Apr 7 16:47:56 warble1 systemd: Starting Ganglia Monitoring Daemon... Apr 7 16:47:56 warble1 systemd: Starting Update UTMP about System Runlevel Changes... Apr 7 16:47:56 warble1 ntpd[14521]: proto: precision = 0.036 usec Apr 7 16:47:56 warble1 ntpd[14521]: 0.0.0.0 c01d 0d kern kernel time sync enabled Apr 7 16:47:56 warble1 ntpd[14521]: Listen and drop on 0 v4wildcard 0.0.0.0 UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen and drop on 1 v6wildcard :: UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen normally on 2 lo 127.0.0.1 UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen normally on 3 em3 10.7.2.231 UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen normally on 4 em4 10.1.1.21 UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen normally on 5 bond0 10.8.44.21 UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen normally on 6 ib0 192.168.44.21 UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen normally on 7 lo ::1 UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen normally on 8 em4 fe80::1a66:daff:febc:88e3 UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen normally on 9 em3 fe80::1a66:daff:febc:88e1 UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen normally on 10 bond0 fe80::1a66:daff:febc:88dd UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listen normally on 11 ib0 fe80::211:7501:171:de62 UDP 123 Apr 7 16:47:56 warble1 ntpd[14521]: Listening on routing socket on fd #28 for interface updates Apr 7 16:47:56 warble1 ntpd[14521]: 0.0.0.0 c016 06 restart Apr 7 16:47:56 warble1 ntpd[14521]: 0.0.0.0 c012 02 freq_set kernel 0.000 PPM Apr 7 16:47:56 warble1 ntpd[14521]: 0.0.0.0 c011 01 freq_not_set Apr 7 16:47:56 warble1 systemd: Started Update UTMP about System Runlevel Changes. Apr 7 16:47:56 warble1 systemd: Started Ganglia Monitoring Daemon. Apr 7 16:47:56 warble1 systemd: Startup finished in 6.501s (kernel) + 25.535s (initrd) + 45.295s (userspace) = 1min 17.332s. Apr 7 16:47:56 warble1 kernel: 8021q: 802.1Q VLAN Support v1.8 Apr 7 16:47:56 warble1 kernel: 8021q: adding VLAN 0 to HW filter on device em1 Apr 7 16:47:56 warble1 kernel: 8021q: adding VLAN 0 to HW filter on device em2 Apr 7 16:47:56 warble1 kernel: 8021q: adding VLAN 0 to HW filter on device em3 Apr 7 16:47:56 warble1 kernel: 8021q: adding VLAN 0 to HW filter on device em4 Apr 7 16:47:56 warble1 kernel: 8021q: adding VLAN 0 to HW filter on device bond0 Apr 7 16:48:01 warble1 ntpd[14521]: 0.0.0.0 c514 04 freq_mode Apr 7 16:48:11 warble1 dbus-daemon: dbus[13477]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' Apr 7 16:48:11 warble1 dbus[13477]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' Apr 7 16:48:11 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 7 16:48:11 warble1 systemd: Starting Authorization Manager... Apr 7 16:48:11 warble1 polkitd[14565]: Started polkitd version 0.112 Apr 7 16:48:11 warble1 dbus-daemon: dbus[13477]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Apr 7 16:48:11 warble1 dbus[13477]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Apr 7 16:48:11 warble1 systemd: Started Authorization Manager. Apr 7 16:48:11 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 7 16:48:11 warble1 systemd: Starting Corosync Cluster Engine... Apr 7 16:48:11 warble1 corosync[14583]: [MAIN ] Corosync Cluster Engine ('2.4.0'): started and ready to provide service. Apr 7 16:48:11 warble1 corosync[14583]: [MAIN ] Corosync built-in features: dbus systemd xmlconf qdevices qnetd snmp libcgroup pie relro bindnow Apr 7 16:48:11 warble1 corosync[14584]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 7 16:48:11 warble1 corosync[14584]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none Apr 7 16:48:11 warble1 corosync[14584]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 7 16:48:11 warble1 corosync[14584]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none Apr 7 16:48:11 warble1 corosync[14584]: [TOTEM ] The network interface [10.7.2.231] is now up. Apr 7 16:48:11 warble1 corosync[14584]: [SERV ] Service engine loaded: corosync configuration map access [0] Apr 7 16:48:11 warble1 corosync[14584]: [QB ] server name: cmap Apr 7 16:48:11 warble1 corosync[14584]: [SERV ] Service engine loaded: corosync configuration service [1] Apr 7 16:48:11 warble1 corosync[14584]: [QB ] server name: cfg Apr 7 16:48:11 warble1 corosync[14584]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 [2] Apr 7 16:48:11 warble1 corosync[14584]: [QB ] server name: cpg Apr 7 16:48:11 warble1 corosync[14584]: [SERV ] Service engine loaded: corosync profile loading service [4] Apr 7 16:48:11 warble1 corosync[14584]: [QUORUM] Using quorum provider corosync_votequorum Apr 7 16:48:11 warble1 corosync[14584]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 7 16:48:11 warble1 corosync[14584]: [SERV ] Service engine loaded: corosync vote quorum service v1.0 [5] Apr 7 16:48:11 warble1 corosync[14584]: [QB ] server name: votequorum Apr 7 16:48:11 warble1 corosync[14584]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1 [3] Apr 7 16:48:11 warble1 corosync[14584]: [QB ] server name: quorum Apr 7 16:48:11 warble1 corosync[14584]: [TOTEM ] The network interface [10.1.1.21] is now up. Apr 7 16:48:11 warble1 corosync[14584]: [TOTEM ] A new membership (10.7.2.231:4) was formed. Members joined: 1 Apr 7 16:48:11 warble1 corosync[14584]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 7 16:48:11 warble1 corosync[14584]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 7 16:48:11 warble1 corosync[14584]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 7 16:48:11 warble1 corosync[14584]: [QUORUM] Members[1]: 1 Apr 7 16:48:11 warble1 corosync[14584]: [MAIN ] Completed service synchronization, ready to provide service. Apr 7 16:48:11 warble2 corosync[14228]: [TOTEM ] A new membership (10.7.2.231:176) was formed. Members joined: 1 Apr 7 16:48:11 warble1 corosync[14584]: [TOTEM ] A new membership (10.7.2.231:176) was formed. Members joined: 2 Apr 7 16:48:11 warble2 corosync[14228]: [QUORUM] Members[2]: 1 2 Apr 7 16:48:11 warble2 corosync[14228]: [MAIN ] Completed service synchronization, ready to provide service. Apr 7 16:48:11 warble2 pacemakerd[14241]: notice: Node warble1-host.oob state is now member Apr 7 16:48:11 warble2 crmd[14247]: notice: Node warble1-host.oob state is now member Apr 7 16:48:11 warble1 corosync[14584]: [QUORUM] This node is within the primary component and will provide service. Apr 7 16:48:11 warble1 corosync[14584]: [QUORUM] Members[1]: 1 Apr 7 16:48:11 warble1 corosync[14584]: [QUORUM] Members[2]: 1 2 Apr 7 16:48:11 warble1 corosync[14584]: [MAIN ] Completed service synchronization, ready to provide service. Apr 7 16:48:12 warble1 corosync: Starting Corosync Cluster Engine (corosync): [ OK ] Apr 7 16:48:12 warble1 systemd: Started Corosync Cluster Engine. Apr 7 16:48:12 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 7 16:48:12 warble1 systemd: Reached target resource-agents dependencies. Apr 7 16:48:12 warble1 systemd: Starting resource-agents dependencies. Apr 7 16:48:12 warble1 systemd: Started Pacemaker High Availability Cluster Manager. Apr 7 16:48:12 warble1 systemd: Starting Pacemaker High Availability Cluster Manager... Apr 7 16:48:12 warble1 pacemakerd[14597]: notice: Additional logging available in /var/log/pacemaker.log Apr 7 16:48:12 warble1 pacemakerd[14597]: notice: Switching to /var/log/cluster/corosync.log Apr 7 16:48:12 warble1 pacemakerd[14597]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 7 16:48:12 warble1 pacemakerd[14597]: notice: Starting Pacemaker 1.1.16-12.el7_4.7 Apr 7 16:48:12 warble1 pacemakerd[14597]: notice: Quorum acquired Apr 7 16:48:12 warble1 pacemakerd[14597]: notice: Node warble1-host.oob state is now member Apr 7 16:48:12 warble1 pacemakerd[14597]: notice: Node warble2-host.oob state is now member Apr 7 16:48:12 warble1 cib[14598]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 7 16:48:12 warble1 cib[14598]: notice: Using new config location: /var/lib/pacemaker/cib Apr 7 16:48:12 warble1 cib[14598]: warning: Could not verify cluster configuration file /var/lib/pacemaker/cib/cib.xml: No such file or directory (2) Apr 7 16:48:12 warble1 cib[14598]: warning: Primary configuration corrupt or unusable, trying backups in /var/lib/pacemaker/cib Apr 7 16:48:12 warble1 cib[14598]: warning: Continuing with an empty configuration. Apr 7 16:48:12 warble1 attrd[14601]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 7 16:48:12 warble1 lrmd[14600]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 7 16:48:12 warble1 pengine[14602]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 7 16:48:12 warble2 attrd[14245]: notice: Node warble1-host.oob state is now member Apr 7 16:48:12 warble2 stonith-ng[14243]: notice: Node warble1-host.oob state is now member Apr 7 16:48:12 warble2 cib[14242]: notice: Node warble1-host.oob state is now member Apr 7 16:48:12 warble1 attrd[14601]: notice: Connecting to cluster infrastructure: corosync Apr 7 16:48:12 warble1 stonith-ng[14599]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 7 16:48:12 warble1 stonith-ng[14599]: notice: Connecting to cluster infrastructure: corosync Apr 7 16:48:12 warble1 crmd[14603]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 7 16:48:12 warble1 cib[14598]: notice: Connecting to cluster infrastructure: corosync Apr 7 16:48:12 warble1 attrd[14601]: notice: Node warble1-host.oob state is now member Apr 7 16:48:12 warble1 cib[14598]: notice: Node warble1-host.oob state is now member Apr 7 16:48:12 warble1 stonith-ng[14599]: notice: Node warble1-host.oob state is now member Apr 7 16:48:12 warble1 cib[14598]: notice: Node warble2-host.oob state is now member Apr 7 16:48:12 warble1 cib[14604]: warning: Could not verify cluster configuration file /var/lib/pacemaker/cib/cib.xml: No such file or directory (2) Apr 7 16:48:12 warble1 stonith-ng[14599]: notice: Node warble2-host.oob state is now member Apr 7 16:48:13 warble1 crmd[14603]: notice: Connecting to cluster infrastructure: corosync Apr 7 16:48:13 warble2 crmd[14247]: notice: State transition S_IDLE -> S_INTEGRATION Apr 7 16:48:13 warble1 crmd[14603]: notice: Quorum acquired Apr 7 16:48:13 warble1 crmd[14603]: notice: Node warble1-host.oob state is now member Apr 7 16:48:13 warble1 crmd[14603]: notice: Node warble2-host.oob state is now member Apr 7 16:48:13 warble1 crmd[14603]: notice: The local CRM is operational Apr 7 16:48:13 warble1 crmd[14603]: notice: State transition S_STARTING -> S_PENDING Apr 7 16:48:13 warble1 attrd[14601]: notice: Node warble2-host.oob state is now member Apr 7 16:48:13 warble1 attrd[14601]: notice: Recorded attribute writer: warble2-host.oob Apr 7 16:48:15 warble1 crmd[14603]: notice: State transition S_PENDING -> S_NOT_DC Apr 7 16:48:15 warble1 attrd[14601]: notice: Updating all attributes after cib_refresh_notify event Apr 7 16:48:15 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:15 warble1 attrd[14601]: notice: Updating all attributes after cib_refresh_notify event Apr 7 16:48:16 warble1 stonith-ng[14599]: notice: Added 'warble1-ipmi' to the device list (1 active devices) Apr 7 16:48:16 warble1 stonith-ng[14599]: notice: Added 'warble2-ipmi' to the device list (2 active devices) Apr 7 16:48:16 warble1 stonith-ng[14599]: notice: Versions did not change in patch 0.335.57 Apr 7 16:48:20 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:20 warble2 pengine[14246]: notice: Calculated transition 1, saving inputs in /var/lib/pacemaker/pengine/pe-input-0.bz2 Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble1-ipmi_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble2-ipmi_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-MGT-pool_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble1-MGT_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-dagg-MDT0-pool_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble2-dagg-MDT0_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation healthLUSTRE_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation healthLNET_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT2-pool_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT2_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT1-pool_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT1_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-images-MDT0-pool_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble1-images-MDT0_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-apps-MDT0-pool_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble2-apps-MDT0_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-home-MDT0-pool_monitor_0 on warble1-host.oob Apr 7 16:48:20 warble2 crmd[14247]: notice: Initiating monitor operation warble2-home-MDT0_monitor_0 on warble1-host.oob Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble1-ipmi on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble2-ipmi on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 lrmd[14600]: notice: warble1-zfs-MGT-pool_monitor_0:14624:stderr [ cannot open 'warble1-MGT-pool': no such pool ] Apr 7 16:48:21 warble1 lrmd[14600]: notice: warble2-zfs-dagg-MDT0-pool_monitor_0:14626:stderr [ cannot open 'warble2-dagg-MDT0-pool': no such pool ] Apr 7 16:48:21 warble1 lrmd[14600]: notice: warble1-zfs-dagg-MDT2-pool_monitor_0:14636:stderr [ cannot open 'warble1-dagg-MDT2-pool': no such pool ] Apr 7 16:48:21 warble1 Lustre(warble2-dagg-MDT0)[14627] ERROR: warble2-dagg-MDT0-pool/MDT0 is not mounted Apr 7 16:48:21 warble1 Lustre(warble1-MGT)[14625]: ERROR: warble1-MGT-pool/MGT is not mounted Apr 7 16:48:21 warble1 lrmd[14600]: notice: warble1-zfs-dagg-MDT1-pool_monitor_0:14642:stderr [ cannot open 'warble1-dagg-MDT1-pool': no such pool ] Apr 7 16:48:21 warble1 lrmd[14600]: notice: warble1-zfs-images-MDT0-pool_monitor_0:14648:stderr [ cannot open 'warble1-images-MDT0-pool': no such pool ] Apr 7 16:48:21 warble1 Lustre(warble1-dagg-MDT2)[14639] ERROR: warble1-dagg-MDT2-pool/MDT2 is not mounted Apr 7 16:48:21 warble1 lrmd[14600]: notice: warble2-zfs-apps-MDT0-pool_monitor_0:14657:stderr [ cannot open 'warble2-apps-MDT0-pool': no such pool ] Apr 7 16:48:21 warble1 Lustre(warble1-dagg-MDT1)[14645] ERROR: warble1-dagg-MDT1-pool/MDT1 is not mounted Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for healthLUSTRE on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 lrmd[14600]: notice: warble2-zfs-home-MDT0-pool_monitor_0:14673:stderr [ cannot open 'warble2-home-MDT0-pool': no such pool ] Apr 7 16:48:21 warble1 Lustre(warble1-images-MDT0)[1465 ERROR: warble1-images-MDT0-pool/MDT0 is not mounted Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 Lustre(warble2-apps-MDT0)[14663] ERROR: warble2-apps-MDT0-pool/MDT0 is not mounted Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble1-zfs-MGT-pool on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: warble1-host.oob-warble1-zfs-MGT-pool_monitor_0:13 [ cannot open 'warble1-MGT-pool': no such pool\n ] Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble2-zfs-dagg-MDT0-pool on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: warble1-host.oob-warble2-zfs-dagg-MDT0-pool_monitor_0:21 [ cannot open 'warble2-dagg-MDT0-pool': no such pool\n ] Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble1-zfs-dagg-MDT2-pool on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: warble1-host.oob-warble1-zfs-dagg-MDT2-pool_monitor_0:39 [ cannot open 'warble1-dagg-MDT2-pool': no such pool\n ] Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble1-zfs-dagg-MDT1-pool on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: warble1-host.oob-warble1-zfs-dagg-MDT1-pool_monitor_0:47 [ cannot open 'warble1-dagg-MDT1-pool': no such pool\n ] Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble1-zfs-images-MDT0-pool on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: warble1-host.oob-warble1-zfs-images-MDT0-pool_monitor_0:55 [ cannot open 'warble1-images-MDT0-pool': no such pool\n ] Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble2-zfs-apps-MDT0-pool on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 crmd[14603]: notice: warble1-host.oob-warble2-zfs-apps-MDT0-pool_monitor_0:63 [ cannot open 'warble2-apps-MDT0-pool': no such pool\n ] Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble2-dagg-MDT0 on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for healthLNET on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble1-MGT on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble2-zfs-home-MDT0-pool on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: warble1-host.oob-warble2-zfs-home-MDT0-pool_monitor_0:71 [ cannot open 'warble2-home-MDT0-pool': no such pool\n ] Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble1-dagg-MDT2 on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble1-dagg-MDT1 on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble1-images-MDT0 on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble2-apps-MDT0 on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble1 Lustre(warble2-home-MDT0)[14757] ERROR: warble2-home-MDT0-pool/MDT0 is not mounted Apr 7 16:48:21 warble1 crmd[14603]: notice: Result of probe operation for warble2-home-MDT0 on warble1-host.oob: 7 (not running) Apr 7 16:48:21 warble2 crmd[14247]: notice: Transition 1 (Complete=18, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-0.bz2): Complete Apr 7 16:48:21 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:21 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:48:21 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:36 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 16:48:36 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:36 warble2 pengine[14246]: notice: * Start healthLUSTRE:1 ( warble1-host.oob ) Apr 7 16:48:36 warble2 pengine[14246]: notice: * Start healthLNET:1 ( warble1-host.oob ) Apr 7 16:48:36 warble2 pengine[14246]: notice: Calculated transition 2, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 7 16:48:36 warble2 crmd[14247]: notice: Initiating start operation healthLUSTRE_start_0 on warble1-host.oob Apr 7 16:48:36 warble2 crmd[14247]: notice: Initiating start operation healthLNET_start_0 on warble1-host.oob Apr 7 16:48:36 warble1 kernel: LNet: HW NUMA nodes: 2, HW CPU cores: 16, npartitions: 2 Apr 7 16:48:36 warble1 kernel: alg: No test for adler32 (adler32-zlib) Apr 7 16:48:36 warble1 kernel: alg: No test for crc32 (crc32-table) Apr 7 16:48:37 warble1 kernel: Lustre: Lustre: Build Version: 2.10.3 Apr 7 16:48:37 warble1 kernel: LNet: Using FMR for registration Apr 7 16:48:37 warble1 kernel: LNet: Added LNI 192.168.44.21@o2ib44 [128/2048/0/180] Apr 7 16:48:37 warble2 crmd[14247]: notice: Transition aborted by status-1-lustred doing create lustred=1: Transient attribute change Apr 7 16:48:37 warble1 crmd[14603]: notice: Result of start operation for healthLUSTRE on warble1-host.oob: 0 (ok) Apr 7 16:48:37 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:37 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:37 warble1 crmd[14603]: notice: Result of start operation for healthLNET on warble1-host.oob: 0 (ok) Apr 7 16:48:37 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:37 warble2 crmd[14247]: notice: Transition 2 (Complete=6, Pending=0, Fired=0, Skipped=2, Incomplete=2, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Stopped Apr 7 16:48:37 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:37 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:37 warble2 pengine[14246]: notice: Calculated transition 3, saving inputs in /var/lib/pacemaker/pengine/pe-input-2.bz2 Apr 7 16:48:37 warble2 crmd[14247]: notice: Initiating monitor operation healthLUSTRE_monitor_10000 on warble1-host.oob Apr 7 16:48:37 warble2 crmd[14247]: notice: Initiating monitor operation healthLNET_monitor_20000 on warble1-host.oob Apr 7 16:48:37 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:37 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:37 warble2 crmd[14247]: notice: Transition 3 (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-2.bz2): Complete Apr 7 16:48:37 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:48:37 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:37 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:42 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 16:48:42 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:42 warble2 pengine[14246]: notice: Calculated transition 4, saving inputs in /var/lib/pacemaker/pengine/pe-input-3.bz2 Apr 7 16:48:42 warble2 crmd[14247]: notice: Transition 4 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-3.bz2): Complete Apr 7 16:48:42 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:48:56 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 16:48:57 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:57 warble2 pengine[14246]: notice: * Move warble2-ipmi ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:48:57 warble2 pengine[14246]: notice: * Move warble1-zfs-MGT-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:48:57 warble2 pengine[14246]: notice: * Move warble1-MGT ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:48:57 warble2 pengine[14246]: notice: * Move warble1-zfs-dagg-MDT2-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:48:57 warble2 pengine[14246]: notice: * Move warble1-dagg-MDT2 ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:48:57 warble2 pengine[14246]: notice: * Move warble1-zfs-dagg-MDT1-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:48:57 warble2 pengine[14246]: notice: * Move warble1-dagg-MDT1 ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:48:57 warble2 pengine[14246]: notice: * Move warble1-zfs-images-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:48:57 warble2 pengine[14246]: notice: * Move warble1-images-MDT0 ( warble2-host.oob -> warble1-host.oob ) Apr 7 16:48:57 warble2 pengine[14246]: notice: Calculated transition 5, saving inputs in /var/lib/pacemaker/pengine/pe-input-4.bz2 Apr 7 16:48:57 warble2 crmd[14247]: notice: Initiating stop operation warble2-ipmi_stop_0 locally on warble2-host.oob Apr 7 16:48:57 warble2 crmd[14247]: notice: Initiating stop operation warble1-MGT_stop_0 locally on warble2-host.oob Apr 7 16:48:57 warble2 crmd[14247]: notice: Initiating stop operation warble1-dagg-MDT2_stop_0 locally on warble2-host.oob Apr 7 16:48:57 warble2 crmd[14247]: notice: Initiating stop operation warble1-dagg-MDT1_stop_0 locally on warble2-host.oob Apr 7 16:48:57 warble2 crmd[14247]: notice: Initiating stop operation warble1-images-MDT0_stop_0 locally on warble2-host.oob Apr 7 16:48:57 warble2 crmd[14247]: notice: Result of stop operation for warble2-ipmi on warble2-host.oob: 0 (ok) Apr 7 16:48:57 warble2 crmd[14247]: notice: Initiating start operation warble2-ipmi_start_0 on warble1-host.oob Apr 7 16:48:57 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:57 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:57 warble2 Lustre(warble1-MGT)[376447]: INFO: Starting to unmount warble1-MGT-pool/MGT Apr 7 16:48:57 warble2 Lustre(warble1-dagg-MDT1)[376449 INFO: Starting to unmount warble1-dagg-MDT1-pool/MDT1 Apr 7 16:48:57 warble2 Lustre(warble1-dagg-MDT2)[376448 INFO: Starting to unmount warble1-dagg-MDT2-pool/MDT2 Apr 7 16:48:57 warble2 Lustre(warble1-images-MDT0)[3764 INFO: Starting to unmount warble1-images-MDT0-pool/MDT0 Apr 7 16:48:57 warble2 kernel: Lustre: Failing over dagg-MDT0002 Apr 7 16:48:57 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:48:57 warble2 kernel: LustreError: 11-0: dagg-MDT0001-osp-MDT0000: operation out_update to node 0@lo failed: rc = -19 Apr 7 16:48:57 warble2 kernel: Lustre: dagg-MDT0001-osp-MDT0000: Connection to dagg-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Apr 7 16:48:57 warble2 kernel: Lustre: images-MDT0000: Not available for connect from 192.168.44.199@o2ib44 (stopping) Apr 7 16:48:57 warble2 kernel: LustreError: 376499:0:(osp_dev.c:487:osp_disconnect()) dagg-MDT0002-osp-MDT0001: can't disconnect: rc = -19 Apr 7 16:48:57 warble2 kernel: LustreError: 14873:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff885e632e8f00 x1594152434865456/t0(0) o13->images-OST0000-osc-MDT0000@192.168.44.51@o2ib44:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 Apr 7 16:48:57 warble2 kernel: LustreError: 376499:0:(lod_dev.c:264:lod_sub_process_config()) dagg-MDT0001-mdtlov: error cleaning up LOD index 2: cmd 0xcf031: rc = -19 Apr 7 16:48:57 warble2 kernel: LustreError: 14873:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 2 previous similar messages Apr 7 16:48:57 warble2 kernel: LustreError: 376499:0:(osp_object.c:582:osp_attr_get()) dagg-MDT0002-osp-MDT0001:osp_attr_get update error [0x20000000a:0x2:0x0]: rc = -5 Apr 7 16:48:57 warble2 kernel: LustreError: 376499:0:(llog_cat.c:318:llog_cat_close()) dagg-MDT0002-osp-MDT0001: failure destroying log during cleanup: rc = -5 Apr 7 16:48:57 warble2 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.102@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:48:57 warble2 kernel: LustreError: Skipped 114 previous similar messages Apr 7 16:48:57 warble2 kernel: LustreError: 14882:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88bd766b0300 x1594152434866096/t0(0) o13->dagg-OST000f-osc-MDT0002@192.168.44.38@o2ib44:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 Apr 7 16:48:57 warble2 kernel: LustreError: 14882:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 3 previous similar messages Apr 7 16:48:58 warble1 crmd[14603]: notice: Result of start operation for warble2-ipmi on warble1-host.oob: 0 (ok) Apr 7 16:48:58 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:58 warble2 crmd[14247]: notice: Initiating monitor operation warble2-ipmi_monitor_60000 on warble1-host.oob Apr 7 16:48:58 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:58 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:58 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:48:59 warble2 kernel: LustreError: 14881:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88bda35f8c00 x1594152434866592/t0(0) o13->dagg-OST000d-osc-MDT0001@192.168.44.37@o2ib44:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 Apr 7 16:48:59 warble2 kernel: LustreError: 14881:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 14 previous similar messages Apr 7 16:49:00 warble2 kernel: LustreError: 11-0: dagg-MDT0002-osp-MDT0000: operation out_update to node 0@lo failed: rc = -107 Apr 7 16:49:00 warble2 kernel: LustreError: Skipped 2 previous similar messages Apr 7 16:49:00 warble2 kernel: Lustre: dagg-MDT0002-osp-MDT0000: Connection to dagg-MDT0002 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Apr 7 16:49:03 warble2 kernel: Lustre: 376495:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523083737/real 1523083737] req@ffff885e75c7f500 x1594152434865264/t0(0) o251->MGC192.168.44.22@o2ib44@0@lo:26/25 lens 224/224 e 0 to 1 dl 1523083743 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 16:49:03 warble2 kernel: Lustre: 376495:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 7 16:49:03 warble2 Lustre(warble1-images-MDT0)[3764 INFO: warble1-images-MDT0-pool/MDT0 unmounted successfully Apr 7 16:49:03 warble2 Lustre(warble1-dagg-MDT2)[376448 INFO: warble1-dagg-MDT2-pool/MDT2 unmounted successfully Apr 7 16:49:03 warble2 Lustre(warble1-dagg-MDT1)[376449 INFO: warble1-dagg-MDT1-pool/MDT1 unmounted successfully Apr 7 16:49:03 warble2 crmd[14247]: notice: Result of stop operation for warble1-dagg-MDT1 on warble2-host.oob: 0 (ok) Apr 7 16:49:03 warble2 crmd[14247]: notice: Result of stop operation for warble1-images-MDT0 on warble2-host.oob: 0 (ok) Apr 7 16:49:03 warble2 crmd[14247]: notice: Result of stop operation for warble1-dagg-MDT2 on warble2-host.oob: 0 (ok) Apr 7 16:49:03 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-dagg-MDT1-pool_stop_0 locally on warble2-host.oob Apr 7 16:49:03 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-images-MDT0-pool_stop_0 locally on warble2-host.oob Apr 7 16:49:03 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-dagg-MDT2-pool_stop_0 locally on warble2-host.oob Apr 7 16:49:03 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble2 kernel: Lustre: server umount MGS complete Apr 7 16:49:03 warble2 kernel: Lustre: Skipped 4 previous similar messages Apr 7 16:49:03 warble2 Lustre(warble1-MGT)[376447]: INFO: warble1-MGT-pool/MGT unmounted successfully Apr 7 16:49:03 warble2 crmd[14247]: notice: Result of stop operation for warble1-MGT on warble2-host.oob: 0 (ok) Apr 7 16:49:03 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-MGT-pool_stop_0 locally on warble2-host.oob Apr 7 16:49:03 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble2 zed: eid=77 class=pool_export pool_guid=0xE146DD6489A1819A Apr 7 16:49:03 warble2 crmd[14247]: notice: Result of stop operation for warble1-zfs-dagg-MDT1-pool on warble2-host.oob: 0 (ok) Apr 7 16:49:03 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-dagg-MDT1-pool_start_0 on warble1-host.oob Apr 7 16:49:03 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble2 zed: eid=78 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 16:49:03 warble2 zed: eid=79 class=pool_export pool_guid=0x5ED256D9C36340D3 Apr 7 16:49:03 warble2 crmd[14247]: notice: Result of stop operation for warble1-zfs-images-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 16:49:03 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-images-MDT0-pool_start_0 on warble1-host.oob Apr 7 16:49:03 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:03 warble2 zed: eid=80 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 16:49:03 warble2 zed: eid=81 class=pool_export pool_guid=0x13C167322AB5F5E9 Apr 7 16:49:03 warble1 zed: eid=1 class=history_event pool_guid=0xE146DD6489A1819A Apr 7 16:49:03 warble1 zed: eid=2 class=config_cache_write pool_guid=0xE146DD6489A1819A Apr 7 16:49:03 warble1 zed: eid=3 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 16:49:03 warble1 zed: eid=4 class=pool_import pool_guid=0xE146DD6489A1819A Apr 7 16:49:04 warble1 zed: eid=5 class=history_event pool_guid=0xE146DD6489A1819A Apr 7 16:49:04 warble1 zed: eid=6 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 16:49:04 warble1 zed: eid=7 class=history_event pool_guid=0x5ED256D9C36340D3 Apr 7 16:49:04 warble1 zed: eid=8 class=config_cache_write pool_guid=0x5ED256D9C36340D3 Apr 7 16:49:04 warble1 zed: eid=9 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 16:49:04 warble1 zed: eid=10 class=pool_import pool_guid=0x5ED256D9C36340D3 Apr 7 16:49:04 warble1 lrmd[14600]: notice: warble1-zfs-dagg-MDT1-pool_start_0:15066:stderr [ cannot open 'warble1-dagg-MDT1-pool': no such pool ] Apr 7 16:49:04 warble1 lrmd[14600]: notice: warble1-zfs-images-MDT0-pool_start_0:15082:stderr [ cannot open 'warble1-images-MDT0-pool': no such pool ] Apr 7 16:49:04 warble1 crmd[14603]: notice: Result of start operation for warble1-zfs-dagg-MDT1-pool on warble1-host.oob: 0 (ok) Apr 7 16:49:04 warble1 zed: eid=11 class=history_event pool_guid=0x5ED256D9C36340D3 Apr 7 16:49:04 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT1-pool_monitor_5000 on warble1-host.oob Apr 7 16:49:04 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble2 crmd[14247]: notice: Initiating start operation warble1-dagg-MDT1_start_0 on warble1-host.oob Apr 7 16:49:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 crmd[14603]: notice: Result of start operation for warble1-zfs-images-MDT0-pool on warble1-host.oob: 0 (ok) Apr 7 16:49:04 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-images-MDT0-pool_monitor_5000 on warble1-host.oob Apr 7 16:49:04 warble2 crmd[14247]: notice: Initiating start operation warble1-images-MDT0_start_0 on warble1-host.oob Apr 7 16:49:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 zed: eid=12 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 16:49:04 warble1 Lustre(warble1-dagg-MDT1)[16114] INFO: Starting to mount warble1-dagg-MDT1-pool/MDT1 Apr 7 16:49:04 warble1 Lustre(warble1-images-MDT0)[1611 INFO: Starting to mount warble1-images-MDT0-pool/MDT0 Apr 7 16:49:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble2 crmd[14247]: notice: Result of stop operation for warble1-zfs-dagg-MDT2-pool on warble2-host.oob: 0 (ok) Apr 7 16:49:04 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-dagg-MDT2-pool_start_0 on warble1-host.oob Apr 7 16:49:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble2 zed: eid=82 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 16:49:04 warble2 zed: eid=83 class=pool_export pool_guid=0xC0BDFB4695D313E6 Apr 7 16:49:04 warble2 crmd[14247]: notice: Result of stop operation for warble1-zfs-MGT-pool on warble2-host.oob: 0 (ok) Apr 7 16:49:04 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-MGT-pool_start_0 on warble1-host.oob Apr 7 16:49:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble2 zed: eid=84 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 16:49:04 warble1 zed: eid=13 class=history_event pool_guid=0x13C167322AB5F5E9 Apr 7 16:49:04 warble1 zed: eid=14 class=config_cache_write pool_guid=0x13C167322AB5F5E9 Apr 7 16:49:04 warble1 zed: eid=15 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 16:49:04 warble1 zed: eid=16 class=pool_import pool_guid=0x13C167322AB5F5E9 Apr 7 16:49:04 warble1 zed: eid=17 class=history_event pool_guid=0x13C167322AB5F5E9 Apr 7 16:49:04 warble1 zed: eid=18 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 16:49:04 warble1 zed: eid=19 class=history_event pool_guid=0xC0BDFB4695D313E6 Apr 7 16:49:04 warble1 zed: eid=20 class=config_cache_write pool_guid=0xC0BDFB4695D313E6 Apr 7 16:49:04 warble1 lrmd[14600]: notice: warble1-zfs-dagg-MDT2-pool_start_0:16250:stderr [ cannot open 'warble1-dagg-MDT2-pool': no such pool ] Apr 7 16:49:04 warble1 lrmd[14600]: notice: warble1-zfs-MGT-pool_start_0:16300:stderr [ cannot open 'warble1-MGT-pool': no such pool ] Apr 7 16:49:04 warble1 zed: eid=21 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 16:49:04 warble1 crmd[14603]: notice: Result of start operation for warble1-zfs-dagg-MDT2-pool on warble1-host.oob: 0 (ok) Apr 7 16:49:04 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT2-pool_monitor_5000 on warble1-host.oob Apr 7 16:49:04 warble2 crmd[14247]: notice: Initiating start operation warble1-dagg-MDT2_start_0 on warble1-host.oob Apr 7 16:49:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 crmd[14603]: notice: Result of start operation for warble1-zfs-MGT-pool on warble1-host.oob: 0 (ok) Apr 7 16:49:04 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-MGT-pool_monitor_5000 on warble1-host.oob Apr 7 16:49:04 warble2 crmd[14247]: notice: Initiating start operation warble1-MGT_start_0 on warble1-host.oob Apr 7 16:49:04 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 zed: eid=22 class=pool_import pool_guid=0xC0BDFB4695D313E6 Apr 7 16:49:04 warble1 Lustre(warble1-dagg-MDT2)[17232] INFO: Starting to mount warble1-dagg-MDT2-pool/MDT2 Apr 7 16:49:04 warble1 Lustre(warble1-MGT)[17234]: INFO: Starting to mount warble1-MGT-pool/MGT Apr 7 16:49:04 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:04 warble1 zed: eid=23 class=history_event pool_guid=0xC0BDFB4695D313E6 Apr 7 16:49:04 warble1 zed: eid=24 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 16:49:09 warble1 zed: eid=25 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 16:49:09 warble1 zed: eid=26 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 16:49:09 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523083744/real 1523083744] req@ffff885ea1b20000 x1597069031637008/t0(0) o250->MGC192.168.44.21@o2ib44@0@lo:26/25 lens 520/544 e 0 to 1 dl 1523083749 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 16:49:09 warble1 zed: eid=27 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 16:49:09 warble1 zed: eid=28 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 16:49:14 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523083749/real 1523083749] req@ffff885e90eb8000 x1597069031637040/t0(0) o250->MGC192.168.44.21@o2ib44@192.168.44.22@o2ib44:26/25 lens 520/544 e 0 to 1 dl 1523083754 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 16:49:14 warble1 Lustre(warble1-MGT)[17234]: INFO: warble1-MGT-pool/MGT mounted successfully Apr 7 16:49:14 warble1 crmd[14603]: notice: Result of start operation for warble1-MGT on warble1-host.oob: 0 (ok) Apr 7 16:49:14 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:14 warble2 crmd[14247]: notice: Initiating monitor operation warble1-MGT_monitor_20000 on warble1-host.oob Apr 7 16:49:14 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:14 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:14 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:21 warble1 kernel: LustreError: 16150:0:(mgc_request.c:251:do_config_log_add()) MGC192.168.44.21@o2ib44: failed processing log, type 1: rc = -5 Apr 7 16:49:27 warble1 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.220@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:49:29 warble2 kernel: LustreError: 166-1: MGC192.168.44.21@o2ib44: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail Apr 7 16:49:29 warble1 kernel: LustreError: 137-5: dagg-MDT0002_UUID: not available for connect from 192.168.44.22@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:49:29 warble1 kernel: Lustre: MGS: Connection restored to (at 192.168.44.131@o2ib44) Apr 7 16:49:29 warble1 kernel: Lustre: MGS: Connection restored to 5b0913d8-3869-c249-8c5b-8b25fae9a1ac (at 192.168.44.150@o2ib44) Apr 7 16:49:29 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:49:32 warble1 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.201@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 16:49:32 warble1 kernel: Lustre: MGS: Connection restored to (at 192.168.44.201@o2ib44) Apr 7 16:49:32 warble1 kernel: LustreError: Skipped 12 previous similar messages Apr 7 16:49:34 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 192.168.44.21@o2ib44 (at 192.168.44.21@o2ib44) Apr 7 16:49:34 warble2 kernel: Lustre: Skipped 718 previous similar messages Apr 7 16:49:34 warble1 kernel: Lustre: dagg-MDT0001: Imperative Recovery not enabled, recovery window 300-900 Apr 7 16:49:34 warble1 Lustre(warble1-dagg-MDT1)[16114] INFO: warble1-dagg-MDT1-pool/MDT1 mounted successfully Apr 7 16:49:34 warble1 crmd[14603]: notice: Result of start operation for warble1-dagg-MDT1 on warble1-host.oob: 0 (ok) Apr 7 16:49:34 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT1_monitor_20000 on warble1-host.oob Apr 7 16:49:34 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble1 Lustre(warble1-images-MDT0)[1611 INFO: warble1-images-MDT0-pool/MDT0 mounted successfully Apr 7 16:49:34 warble1 crmd[14603]: notice: Result of start operation for warble1-images-MDT0 on warble1-host.oob: 0 (ok) Apr 7 16:49:34 warble2 crmd[14247]: notice: Initiating monitor operation warble1-images-MDT0_monitor_20000 on warble1-host.oob Apr 7 16:49:34 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble1 kernel: Lustre: dagg-MDT0002: Not available for connect from 192.168.44.122@o2ib44 (not set up) Apr 7 16:49:34 warble1 kernel: Lustre: dagg-MDT0001: Will be in recovery for at least 5:00, or until 124 clients reconnect Apr 7 16:49:34 warble1 kernel: Lustre: images-MDT0000: Will be in recovery for at least 5:00, or until 123 clients reconnect Apr 7 16:49:34 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 16:49:34 warble1 kernel: LustreError: 11-0: dagg-MDT0001-osp-MDT0002: operation mds_connect to node 0@lo failed: rc = -114 Apr 7 16:49:34 warble1 Lustre(warble1-dagg-MDT2)[17232] INFO: warble1-dagg-MDT2-pool/MDT2 mounted successfully Apr 7 16:49:34 warble1 crmd[14603]: notice: Result of start operation for warble1-dagg-MDT2 on warble1-host.oob: 0 (ok) Apr 7 16:49:34 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT2_monitor_20000 on warble1-host.oob Apr 7 16:49:34 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble2 crmd[14247]: notice: Transition 5 (Complete=44, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-4.bz2): Complete Apr 7 16:49:34 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:49:34 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:34 warble1 kernel: Lustre: images-MDT0000: Connection restored to f2c82ff7-72c6-f080-76b6-cfb26f0b19e7 (at 192.168.44.179@o2ib44) Apr 7 16:49:34 warble1 kernel: Lustre: Skipped 23 previous similar messages Apr 7 16:49:35 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 16:49:35 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:35 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:35 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 16:49:35 warble2 pengine[14246]: notice: Calculated transition 6, saving inputs in /var/lib/pacemaker/pengine/pe-input-5.bz2 Apr 7 16:49:35 warble2 crmd[14247]: notice: Transition 6 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-5.bz2): Complete Apr 7 16:49:35 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 16:49:35 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523083769/real 1523083769] req@ffff88bce016ec00 x1594152434868848/t0(0) o250->MGC192.168.44.21@o2ib44@0@lo:26/25 lens 520/544 e 0 to 1 dl 1523083775 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 16:49:35 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 7 16:49:38 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to (at 192.168.44.201@o2ib44) Apr 7 16:49:38 warble1 kernel: Lustre: Skipped 40 previous similar messages Apr 7 16:49:46 warble1 kernel: Lustre: MGS: Connection restored to 85e2afde-f097-5a19-44dd-4fdc43395790 (at 192.168.44.183@o2ib44) Apr 7 16:49:46 warble1 kernel: Lustre: Skipped 236 previous similar messages Apr 7 16:49:54 warble2 kernel: Lustre: Evicted from MGS (at 192.168.44.21@o2ib44) after server handle changed from 0xaea67cc1322e55a6 to 0x17c6bac8a346580a Apr 7 16:50:00 warble1 kernel: Lustre: images-MDT0000: Recovery over after 0:26, of 123 clients 123 recovered and 0 were evicted. Apr 7 16:50:19 warble1 kernel: Lustre: dagg-MDT0001: Connection restored to 192.168.44.22@o2ib44 (at 192.168.44.22@o2ib44) Apr 7 16:50:19 warble1 kernel: Lustre: Skipped 226 previous similar messages Apr 7 16:51:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 16:52:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 16:52:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 1 previous similar message Apr 7 16:53:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 16:53:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 16:54:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 16:54:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 16:55:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 16:55:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 16:56:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 16:56:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 16:57:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 16:57:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 16:58:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 16:58:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 16:58:52 warble2 kernel: Lustre: 431682:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply#012 req@ffff88bd30c4c850 x1597017505650016/t0(0) o101->dc32fca6-f266-16ac-e214-b77ef785a309@192.168.44.199@o2ib44:187/0 lens 736/3384 e 24 to 0 dl 1523084337 ref 2 fl Interpret:/0/0 rc 0/0 Apr 7 16:58:58 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 16:58:58 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 16:58:58 warble2 kernel: Lustre: Skipped 4 previous similar messages Apr 7 17:00:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 17:00:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 11 previous similar messages Apr 7 17:01:39 warble1 systemd: Starting Cleanup of Temporary Directories... Apr 7 17:01:39 warble1 systemd: Started Cleanup of Temporary Directories. Apr 7 17:03:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 17:03:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 17 previous similar messages Apr 7 17:04:35 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 17:04:35 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 17:04:35 warble2 pengine[14246]: notice: Calculated transition 7, saving inputs in /var/lib/pacemaker/pengine/pe-input-5.bz2 Apr 7 17:04:35 warble2 crmd[14247]: notice: Transition 7 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-5.bz2): Complete Apr 7 17:04:35 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 17:06:09 warble1 ntpd[14521]: 0.0.0.0 0612 02 freq_set kernel 62.952 PPM Apr 7 17:06:09 warble1 ntpd[14521]: 0.0.0.0 0615 05 clock_sync Apr 7 17:08:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 17:08:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 34 previous similar messages Apr 7 17:08:59 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 17:08:59 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 17:17:34 warble1 kernel: Lustre: 21122:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 17:17:34 warble1 kernel: Lustre: 21122:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 50 previous similar messages Apr 7 17:19:00 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 17:19:00 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 17:19:35 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 17:19:35 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 17:19:35 warble2 pengine[14246]: notice: Calculated transition 8, saving inputs in /var/lib/pacemaker/pengine/pe-input-5.bz2 Apr 7 17:19:35 warble2 crmd[14247]: notice: Transition 8 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-5.bz2): Complete Apr 7 17:19:35 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 17:25:34 warble2 kernel: Lustre: 444939:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply#012 req@ffff88bcfdab0600 x1594465555204144/t210453477948(0) o35->bd95096f-2790-2a0e-d286-cdfd62034abc@192.168.44.13@o2ib44:278/0 lens 512/696 e 24 to 0 dl 1523085938 ref 2 fl Interpret:/0/0 rc 0/0 Apr 7 17:25:39 warble2 kernel: Lustre: dagg-MDT0000: Client bd95096f-2790-2a0e-d286-cdfd62034abc (at 192.168.44.13@o2ib44) reconnecting Apr 7 17:27:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 17:27:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 17:29:01 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 17:29:01 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 17:29:01 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 17:34:35 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 17:34:35 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 17:34:35 warble2 pengine[14246]: notice: Calculated transition 9, saving inputs in /var/lib/pacemaker/pengine/pe-input-5.bz2 Apr 7 17:34:35 warble2 crmd[14247]: notice: Transition 9 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-5.bz2): Complete Apr 7 17:34:35 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 17:37:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 17:37:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 17:39:02 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 17:39:02 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 17:40:21 warble2 kernel: Lustre: 444940:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply#012 req@ffff88bce0142700 x1594465555263760/t210453477962(0) o35->bd95096f-2790-2a0e-d286-cdfd62034abc@192.168.44.13@o2ib44:411/0 lens 512/696 e 1 to 0 dl 1523086826 ref 2 fl Interpret:/0/0 rc 0/0 Apr 7 17:40:27 warble2 kernel: Lustre: dagg-MDT0000: Client bd95096f-2790-2a0e-d286-cdfd62034abc (at 192.168.44.13@o2ib44) reconnecting Apr 7 17:47:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 17:47:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 17:49:03 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 17:49:03 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 17:49:03 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 17:49:35 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 17:49:35 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 17:49:35 warble2 pengine[14246]: notice: Calculated transition 10, saving inputs in /var/lib/pacemaker/pengine/pe-input-5.bz2 Apr 7 17:49:35 warble2 crmd[14247]: notice: Transition 10 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-5.bz2): Complete Apr 7 17:49:35 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 17:57:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 17:57:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 17:59:04 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 17:59:04 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 18:04:35 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 18:04:35 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 18:04:35 warble2 pengine[14246]: notice: Calculated transition 11, saving inputs in /var/lib/pacemaker/pengine/pe-input-5.bz2 Apr 7 18:04:35 warble2 crmd[14247]: notice: Transition 11 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-5.bz2): Complete Apr 7 18:04:35 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 18:07:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:07:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 18:09:06 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 18:09:06 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 18:17:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:17:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 18:19:07 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 18:19:07 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 18:19:35 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 18:19:35 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 18:19:35 warble2 pengine[14246]: notice: Calculated transition 12, saving inputs in /var/lib/pacemaker/pengine/pe-input-5.bz2 Apr 7 18:19:35 warble2 crmd[14247]: notice: Transition 12 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-5.bz2): Complete Apr 7 18:19:35 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 18:27:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:27:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 18:29:08 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 18:29:08 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 18:34:35 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 18:34:35 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 18:34:35 warble2 pengine[14246]: notice: Calculated transition 13, saving inputs in /var/lib/pacemaker/pengine/pe-input-5.bz2 Apr 7 18:34:35 warble2 crmd[14247]: notice: Transition 13 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-5.bz2): Complete Apr 7 18:34:35 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 18:37:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:37:34 warble1 kernel: Lustre: 19417:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 18:39:09 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 18:39:09 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 18:39:45 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 18:39:45 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:45 warble2 pengine[14246]: notice: * Move warble2-ipmi ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:45 warble2 pengine[14246]: notice: * Move warble1-zfs-MGT-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:45 warble2 pengine[14246]: notice: * Move warble1-MGT ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:45 warble2 pengine[14246]: notice: * Stop healthLUSTRE:1 ( warble1-host.oob ) due to node availability Apr 7 18:39:45 warble2 pengine[14246]: notice: * Stop healthLNET:1 ( warble1-host.oob ) due to node availability Apr 7 18:39:45 warble2 pengine[14246]: notice: * Move warble1-zfs-dagg-MDT2-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:45 warble2 pengine[14246]: notice: * Move warble1-dagg-MDT2 ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:45 warble2 pengine[14246]: notice: * Move warble1-zfs-dagg-MDT1-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:45 warble2 pengine[14246]: notice: * Move warble1-dagg-MDT1 ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:45 warble2 pengine[14246]: notice: * Move warble1-zfs-images-MDT0-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:45 warble2 pengine[14246]: notice: * Move warble1-images-MDT0 ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:45 warble2 pengine[14246]: notice: Calculated transition 14, saving inputs in /var/lib/pacemaker/pengine/pe-input-6.bz2 Apr 7 18:39:45 warble2 crmd[14247]: notice: Initiating stop operation warble2-ipmi_stop_0 on warble1-host.oob Apr 7 18:39:45 warble2 crmd[14247]: notice: Initiating stop operation warble1-MGT_stop_0 on warble1-host.oob Apr 7 18:39:45 warble2 crmd[14247]: notice: Initiating stop operation warble1-dagg-MDT2_stop_0 on warble1-host.oob Apr 7 18:39:45 warble2 crmd[14247]: notice: Initiating stop operation warble1-dagg-MDT1_stop_0 on warble1-host.oob Apr 7 18:39:45 warble2 crmd[14247]: notice: Initiating stop operation warble1-images-MDT0_stop_0 on warble1-host.oob Apr 7 18:39:45 warble2 crmd[14247]: notice: Initiating stop operation healthLUSTRE_stop_0 on warble1-host.oob Apr 7 18:39:45 warble2 crmd[14247]: notice: Initiating stop operation healthLNET_stop_0 on warble1-host.oob Apr 7 18:39:45 warble1 crmd[14603]: notice: Result of stop operation for warble2-ipmi on warble1-host.oob: 0 (ok) Apr 7 18:39:45 warble2 crmd[14247]: notice: Initiating start operation warble2-ipmi_start_0 locally on warble2-host.oob Apr 7 18:39:45 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:45 warble1 Lustre(warble1-MGT)[80950]: INFO: Starting to unmount warble1-MGT-pool/MGT Apr 7 18:39:45 warble1 Lustre(warble1-dagg-MDT1)[80952] INFO: Starting to unmount warble1-dagg-MDT1-pool/MDT1 Apr 7 18:39:45 warble1 Lustre(warble1-dagg-MDT2)[80951] INFO: Starting to unmount warble1-dagg-MDT2-pool/MDT2 Apr 7 18:39:45 warble1 Lustre(warble1-images-MDT0)[8095 INFO: Starting to unmount warble1-images-MDT0-pool/MDT0 Apr 7 18:39:45 warble1 crmd[14603]: notice: Result of stop operation for healthLUSTRE on warble1-host.oob: 0 (ok) Apr 7 18:39:45 warble2 crmd[14247]: notice: Transition aborted by deletion of nvpair[@id='status-1-lustred']: Transient attribute change Apr 7 18:39:45 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:45 warble1 crmd[14603]: notice: Result of stop operation for healthLNET on warble1-host.oob: 0 (ok) Apr 7 18:39:45 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:45 warble1 kernel: LustreError: 81014:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-lwp-MDT0001: namespace resource [0x200000006:0x1010000:0x0].0x0 (ffff885e894a4000) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 18:39:45 warble1 kernel: Lustre: Failing over images-MDT0000 Apr 7 18:39:45 warble1 kernel: LustreError: 81014:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff885e894a4000) refcount = 2 Apr 7 18:39:45 warble1 kernel: LustreError: 81014:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 18:39:45 warble1 kernel: LustreError: 81014:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-lwp-MDT0001 lock: ffff885e89af0000/0x17c6bac8a34603e0 lrc: 2/1,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 3 type: PLN flags: 0x1106400000000 nid: local remote: 0xaea67cc1344bcc08 expref: -99 pid: 19130 timeout: 0 lvb_type: 2 Apr 7 18:39:45 warble1 Lustre(warble1-MGT)[80950]: INFO: warble1-MGT-pool/MGT unmounted successfully Apr 7 18:39:45 warble1 crmd[14603]: notice: Result of stop operation for warble1-MGT on warble1-host.oob: 0 (ok) Apr 7 18:39:45 warble1 kernel: LustreError: 81016:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff885e8f945140) refcount = 2 Apr 7 18:39:45 warble1 kernel: Lustre: server umount MGS complete Apr 7 18:39:45 warble1 kernel: LustreError: 81016:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 18:39:45 warble1 kernel: LustreError: 19140:0:(llog_osd.c:882:llog_osd_next_block()) dagg-MDT0000-osp-MDT0001: can't read llog block from log [0x2000013ca:0x1:0x0] offset 163840: rc = -5 Apr 7 18:39:45 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:45 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:45 warble2 kernel: LNet: 14863:0:(o2iblnd_cb.c:396:kiblnd_handle_rx()) PUT_NACK from 192.168.44.21@o2ib44 Apr 7 18:39:45 warble1 kernel: LustreError: 20910:0:(llog.c:607:llog_process_thread()) dagg-MDT0000-osp-MDT0002 retry remote llog process Apr 7 18:39:45 warble1 kernel: LustreError: 20910:0:(lod_dev.c:419:lod_sub_recovery_thread()) dagg-MDT0000-osp-MDT0002 getting update log failed: rc = -11 Apr 7 18:39:45 warble1 kernel: LustreError: 14887:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 18:39:45 warble1 kernel: Lustre: images-MDT0000: Not available for connect from 192.168.44.169@o2ib44 (stopping) Apr 7 18:39:45 warble1 kernel: LustreError: 81016:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) dagg-MDT0002: Aborting recovery Apr 7 18:39:45 warble1 kernel: Lustre: 21122:0:(ldlm_lib.c:2048:target_recovery_overseer()) recovery is aborted, evict exports in recovery Apr 7 18:39:45 warble1 kernel: Lustre: 21122:0:(ldlm_lib.c:2038:target_recovery_overseer()) dagg-MDT0002 recovery is aborted by hard timeout Apr 7 18:39:45 warble1 kernel: Lustre: dagg-MDT0002: Recovery over after 110:11, of 124 clients 0 recovered and 124 were evicted. Apr 7 18:39:45 warble1 kernel: LustreError: 20210:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88bd72610f00 x1597070087497472/t0(0) o5->dagg-OST0001-osc-MDT0002@192.168.44.31@o2ib44:28/4 lens 432/432 e 0 to 0 dl 0 ref 2 fl Rpc:N/0/ffffffff rc 0/-1 Apr 7 18:39:45 warble1 kernel: LustreError: 20210:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 2 previous similar messages Apr 7 18:39:45 warble1 kernel: LustreError: 20217:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) dagg-OST0002-osc-MDT0002: cannot cleanup orphans: rc = -5 Apr 7 18:39:45 warble1 kernel: LustreError: 20217:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages Apr 7 18:39:45 warble1 kernel: LustreError: 19140:0:(llog_osd.c:882:llog_osd_next_block()) Skipped 1 previous similar message Apr 7 18:39:46 warble1 kernel: Lustre: images-MDT0000: Not available for connect from 192.168.44.180@o2ib44 (stopping) Apr 7 18:39:46 warble1 kernel: Lustre: Skipped 6 previous similar messages Apr 7 18:39:46 warble2 crmd[14247]: notice: Result of start operation for warble2-ipmi on warble2-host.oob: 0 (ok) Apr 7 18:39:46 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:46 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:46 warble1 kernel: Lustre: server umount dagg-MDT0002 complete Apr 7 18:39:46 warble1 Lustre(warble1-dagg-MDT2)[80951] INFO: warble1-dagg-MDT2-pool/MDT2 unmounted successfully Apr 7 18:39:46 warble1 crmd[14603]: notice: Result of stop operation for warble1-dagg-MDT2 on warble1-host.oob: 0 (ok) Apr 7 18:39:46 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:46 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:46 warble1 Lustre(warble1-dagg-MDT1)[80952] INFO: warble1-dagg-MDT1-pool/MDT1 unmounted successfully Apr 7 18:39:46 warble1 crmd[14603]: notice: Result of stop operation for warble1-dagg-MDT1 on warble1-host.oob: 0 (ok) Apr 7 18:39:46 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:46 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:47 warble1 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.123@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 18:39:47 warble1 kernel: LustreError: Skipped 40 previous similar messages Apr 7 18:39:48 warble1 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.213@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 18:39:48 warble1 kernel: LustreError: Skipped 1 previous similar message Apr 7 18:39:49 warble1 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.160@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 18:39:49 warble1 kernel: LustreError: Skipped 11 previous similar messages Apr 7 18:39:51 warble2 kernel: LustreError: 35206:0:(ldlm_lib.c:3226:target_bulk_io()) @@@ timeout on bulk WRITE after 6+0s req@ffff88bdca0d3c50 x1597070087496928/t0(0) o1000->dagg-MDT0002-mdtlov_UUID@192.168.44.21@o2ib44:201/0 lens 336/37088 e 0 to 0 dl 1523090391 ref 1 fl Interpret:/0/0 rc 0/0 Apr 7 18:39:51 warble2 kernel: LNet: 14865:0:(o2iblnd_cb.c:396:kiblnd_handle_rx()) PUT_NACK from 192.168.44.21@o2ib44 Apr 7 18:39:51 warble1 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.122@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 18:39:51 warble1 kernel: LustreError: Skipped 10 previous similar messages Apr 7 18:39:53 warble1 kernel: Lustre: 81017:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523090387/real 1523090387] req@ffff88bd7323dd00 x1597070087498144/t0(0) o251->MGC192.168.44.21@o2ib44@0@lo:26/25 lens 224/224 e 0 to 1 dl 1523090393 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 18:39:53 warble1 Lustre(warble1-images-MDT0)[8095 INFO: warble1-images-MDT0-pool/MDT0 unmounted successfully Apr 7 18:39:53 warble1 crmd[14603]: notice: Result of stop operation for warble1-images-MDT0 on warble1-host.oob: 0 (ok) Apr 7 18:39:53 warble2 crmd[14247]: notice: Transition 14 (Complete=16, Pending=0, Fired=0, Skipped=5, Incomplete=34, Source=/var/lib/pacemaker/pengine/pe-input-6.bz2): Stopped Apr 7 18:39:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble1 kernel: Lustre: server umount images-MDT0000 complete Apr 7 18:39:53 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 18:39:53 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble2 pengine[14246]: notice: * Move warble1-zfs-MGT-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:53 warble2 pengine[14246]: notice: * Start warble1-MGT ( warble2-host.oob ) Apr 7 18:39:53 warble2 pengine[14246]: notice: * Move warble1-zfs-dagg-MDT2-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:53 warble2 pengine[14246]: notice: * Start warble1-dagg-MDT2 ( warble2-host.oob ) Apr 7 18:39:53 warble2 pengine[14246]: notice: * Move warble1-zfs-dagg-MDT1-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:53 warble2 pengine[14246]: notice: * Start warble1-dagg-MDT1 ( warble2-host.oob ) Apr 7 18:39:53 warble2 pengine[14246]: notice: * Move warble1-zfs-images-MDT0-pool ( warble1-host.oob -> warble2-host.oob ) Apr 7 18:39:53 warble2 pengine[14246]: notice: * Start warble1-images-MDT0 ( warble2-host.oob ) Apr 7 18:39:53 warble2 pengine[14246]: notice: Calculated transition 15, saving inputs in /var/lib/pacemaker/pengine/pe-input-7.bz2 Apr 7 18:39:53 warble2 crmd[14247]: notice: Initiating monitor operation warble2-ipmi_monitor_60000 locally on warble2-host.oob Apr 7 18:39:53 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-MGT-pool_stop_0 on warble1-host.oob Apr 7 18:39:53 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-dagg-MDT2-pool_stop_0 on warble1-host.oob Apr 7 18:39:53 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-dagg-MDT1-pool_stop_0 on warble1-host.oob Apr 7 18:39:53 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-images-MDT0-pool_stop_0 on warble1-host.oob Apr 7 18:39:53 warble1 zed: eid=29 class=pool_export pool_guid=0x13C167322AB5F5E9 Apr 7 18:39:53 warble1 crmd[14603]: notice: Result of stop operation for warble1-zfs-dagg-MDT2-pool on warble1-host.oob: 0 (ok) Apr 7 18:39:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-dagg-MDT2-pool_start_0 locally on warble2-host.oob Apr 7 18:39:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble1 zed: eid=30 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 18:39:53 warble1 zed: eid=31 class=pool_export pool_guid=0xC0BDFB4695D313E6 Apr 7 18:39:53 warble1 crmd[14603]: notice: Result of stop operation for warble1-zfs-MGT-pool on warble1-host.oob: 0 (ok) Apr 7 18:39:53 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-MGT-pool_start_0 locally on warble2-host.oob Apr 7 18:39:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble1 zed: eid=32 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 18:39:53 warble1 zed: eid=33 class=pool_export pool_guid=0xE146DD6489A1819A Apr 7 18:39:53 warble1 crmd[14603]: notice: Result of stop operation for warble1-zfs-dagg-MDT1-pool on warble1-host.oob: 0 (ok) Apr 7 18:39:53 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-dagg-MDT1-pool_start_0 locally on warble2-host.oob Apr 7 18:39:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble1 zed: eid=34 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 18:39:53 warble1 zed: eid=35 class=pool_export pool_guid=0x5ED256D9C36340D3 Apr 7 18:39:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble1 crmd[14603]: notice: Result of stop operation for warble1-zfs-images-MDT0-pool on warble1-host.oob: 0 (ok) Apr 7 18:39:53 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-images-MDT0-pool_start_0 locally on warble2-host.oob Apr 7 18:39:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:53 warble1 zed: eid=36 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 18:39:54 warble2 zed: eid=85 class=history_event pool_guid=0x13C167322AB5F5E9 Apr 7 18:39:54 warble2 zed: eid=86 class=config_cache_write pool_guid=0x13C167322AB5F5E9 Apr 7 18:39:54 warble2 zed: eid=87 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 18:39:54 warble2 zed: eid=88 class=pool_import pool_guid=0x13C167322AB5F5E9 Apr 7 18:39:54 warble2 zed: eid=89 class=history_event pool_guid=0xE146DD6489A1819A Apr 7 18:39:54 warble2 zed: eid=90 class=config_cache_write pool_guid=0xE146DD6489A1819A Apr 7 18:39:54 warble2 zed: eid=91 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 18:39:54 warble2 zed: eid=92 class=pool_import pool_guid=0xE146DD6489A1819A Apr 7 18:39:54 warble2 zed: eid=93 class=history_event pool_guid=0x5ED256D9C36340D3 Apr 7 18:39:54 warble2 zed: eid=94 class=config_cache_write pool_guid=0x5ED256D9C36340D3 Apr 7 18:39:54 warble2 zed: eid=95 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 18:39:54 warble2 zed: eid=96 class=pool_import pool_guid=0x5ED256D9C36340D3 Apr 7 18:39:54 warble2 zed: eid=97 class=history_event pool_guid=0xC0BDFB4695D313E6 Apr 7 18:39:54 warble2 zed: eid=98 class=config_cache_write pool_guid=0xC0BDFB4695D313E6 Apr 7 18:39:54 warble2 zed: eid=99 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 18:39:54 warble2 zed: eid=100 class=pool_import pool_guid=0xC0BDFB4695D313E6 Apr 7 18:39:54 warble2 lrmd[14244]: notice: warble1-zfs-dagg-MDT2-pool_start_0:438371:stderr [ cannot open 'warble1-dagg-MDT2-pool': no such pool ] Apr 7 18:39:54 warble2 lrmd[14244]: notice: warble1-zfs-dagg-MDT1-pool_start_0:438381:stderr [ cannot open 'warble1-dagg-MDT1-pool': no such pool ] Apr 7 18:39:54 warble2 lrmd[14244]: notice: warble1-zfs-images-MDT0-pool_start_0:438419:stderr [ cannot open 'warble1-images-MDT0-pool': no such pool ] Apr 7 18:39:54 warble2 lrmd[14244]: notice: warble1-zfs-MGT-pool_start_0:438376:stderr [ cannot open 'warble1-MGT-pool': no such pool ] Apr 7 18:39:54 warble2 crmd[14247]: notice: Result of start operation for warble1-zfs-dagg-MDT2-pool on warble2-host.oob: 0 (ok) Apr 7 18:39:54 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 crmd[14247]: notice: Result of start operation for warble1-zfs-dagg-MDT1-pool on warble2-host.oob: 0 (ok) Apr 7 18:39:54 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 zed: eid=101 class=history_event pool_guid=0x13C167322AB5F5E9 Apr 7 18:39:54 warble2 crmd[14247]: notice: Result of start operation for warble1-zfs-images-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 18:39:54 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 zed: eid=102 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 18:39:54 warble2 crmd[14247]: notice: Result of start operation for warble1-zfs-MGT-pool on warble2-host.oob: 0 (ok) Apr 7 18:39:54 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT2-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:39:54 warble2 crmd[14247]: notice: Initiating start operation warble1-dagg-MDT2_start_0 locally on warble2-host.oob Apr 7 18:39:54 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT1-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:39:54 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 crmd[14247]: notice: Initiating start operation warble1-dagg-MDT1_start_0 locally on warble2-host.oob Apr 7 18:39:54 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-images-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:39:54 warble2 crmd[14247]: notice: Initiating start operation warble1-images-MDT0_start_0 locally on warble2-host.oob Apr 7 18:39:54 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-MGT-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:39:54 warble2 crmd[14247]: notice: Initiating start operation warble1-MGT_start_0 locally on warble2-host.oob Apr 7 18:39:54 warble2 zed: eid=103 class=history_event pool_guid=0xE146DD6489A1819A Apr 7 18:39:54 warble2 Lustre(warble1-dagg-MDT2)[440301 INFO: Starting to mount warble1-dagg-MDT2-pool/MDT2 Apr 7 18:39:54 warble2 Lustre(warble1-dagg-MDT1)[440303 INFO: Starting to mount warble1-dagg-MDT1-pool/MDT1 Apr 7 18:39:54 warble2 Lustre(warble1-images-MDT0)[4403 INFO: Starting to mount warble1-images-MDT0-pool/MDT0 Apr 7 18:39:54 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 Lustre(warble1-MGT)[440312]: INFO: Starting to mount warble1-MGT-pool/MGT Apr 7 18:39:54 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 zed: eid=104 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 18:39:54 warble2 Lustre(warble1-MGT)[440312]: INFO: warble1-MGT-pool/MGT mounted successfully Apr 7 18:39:54 warble2 zed: eid=105 class=history_event pool_guid=0x5ED256D9C36340D3 Apr 7 18:39:54 warble2 kernel: LNet: 14863:0:(o2iblnd_cb.c:396:kiblnd_handle_rx()) PUT_NACK from 192.168.44.21@o2ib44 Apr 7 18:39:54 warble2 crmd[14247]: notice: Result of start operation for warble1-MGT on warble2-host.oob: 0 (ok) Apr 7 18:39:54 warble2 crmd[14247]: notice: Initiating monitor operation warble1-MGT_monitor_20000 locally on warble2-host.oob Apr 7 18:39:54 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 zed: eid=106 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 18:39:54 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:39:54 warble2 zed: eid=107 class=history_event pool_guid=0xC0BDFB4695D313E6 Apr 7 18:39:54 warble2 zed: eid=108 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 18:39:59 warble2 zed: eid=109 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 18:39:59 warble2 zed: eid=110 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 18:39:59 warble2 zed: eid=111 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 18:39:59 warble2 zed: eid=112 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 18:40:01 warble2 kernel: Lustre: 440371:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523090394/real 1523090394] req@ffff88bcb6670600 x1594152435313024/t0(0) o253->MGC192.168.44.21@o2ib44@192.168.44.21@o2ib44:26/25 lens 4768/4768 e 0 to 1 dl 1523090401 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 Apr 7 18:40:01 warble2 kernel: LustreError: 166-1: MGC192.168.44.21@o2ib44: Connection to MGS (at 192.168.44.21@o2ib44) was lost; in progress operations using this service will fail Apr 7 18:40:09 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523090403/real 1523090403] req@ffff88bda35fb900 x1594152435313472/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.21@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523090409 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 18:40:09 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages Apr 7 18:40:17 warble2 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.169@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 18:40:17 warble2 kernel: LustreError: Skipped 395 previous similar messages Apr 7 18:40:26 warble2 kernel: Lustre: Evicted from MGS (at MGC192.168.44.21@o2ib44_1) after server handle changed from 0x17c6bac8a346580a to 0xaea67cc134512d02 Apr 7 18:40:26 warble2 kernel: Lustre: dagg-MDT0001: Imperative Recovery not enabled, recovery window 300-900 Apr 7 18:40:26 warble2 Lustre(warble1-dagg-MDT1)[440303 INFO: warble1-dagg-MDT1-pool/MDT1 mounted successfully Apr 7 18:40:26 warble2 crmd[14247]: notice: Result of start operation for warble1-dagg-MDT1 on warble2-host.oob: 0 (ok) Apr 7 18:40:26 warble2 kernel: Lustre: dagg-MDT0001: Will be in recovery for at least 5:00, or until 124 clients reconnect Apr 7 18:40:26 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT1_monitor_20000 locally on warble2-host.oob Apr 7 18:40:26 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble2 kernel: Lustre: dagg-MDT0002: Not available for connect from 192.168.44.107@o2ib44 (not set up) Apr 7 18:40:26 warble2 kernel: Lustre: Skipped 7 previous similar messages Apr 7 18:40:26 warble2 Lustre(warble1-dagg-MDT2)[440301 INFO: warble1-dagg-MDT2-pool/MDT2 mounted successfully Apr 7 18:40:26 warble2 crmd[14247]: notice: Result of start operation for warble1-dagg-MDT2 on warble2-host.oob: 0 (ok) Apr 7 18:40:26 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT2_monitor_20000 locally on warble2-host.oob Apr 7 18:40:26 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble2 Lustre(warble1-images-MDT0)[4403 INFO: warble1-images-MDT0-pool/MDT0 mounted successfully Apr 7 18:40:26 warble2 crmd[14247]: notice: Result of start operation for warble1-images-MDT0 on warble2-host.oob: 0 (ok) Apr 7 18:40:26 warble2 crmd[14247]: notice: Initiating monitor operation warble1-images-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 18:40:26 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble2 crmd[14247]: notice: Transition 15 (Complete=38, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-7.bz2): Complete Apr 7 18:40:26 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 18:40:26 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:26 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:40:27 warble2 kernel: Lustre: dagg-MDT0002: Will be in recovery for at least 5:00, or until 124 clients reconnect Apr 7 18:40:27 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 18:40:31 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523090426/real 1523090426] req@ffff885c78619800 x1594152435403872/t0(0) o38->images-MDT0000-lwp-MDT0000@192.168.44.21@o2ib44:12/10 lens 520/544 e 0 to 1 dl 1523090431 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 18:40:31 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 7 18:41:09 warble2 kernel: Lustre: images-MDT0000: Recovery over after 0:42, of 123 clients 123 recovered and 0 were evicted. Apr 7 18:42:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:43:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:43:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 1 previous similar message Apr 7 18:44:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:44:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 18:45:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:45:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 18:46:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:46:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 18:46:56 warble2 kernel: Lustre: 429759:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply#012 req@ffff88bc58bbad00 x1597017511006736/t0(0) o35->dc32fca6-f266-16ac-e214-b77ef785a309@192.168.44.199@o2ib44:631/0 lens 512/696 e 23 to 0 dl 1523090821 ref 2 fl Interpret:/0/0 rc 0/0 Apr 7 18:47:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:47:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 18:48:26 warble2 kernel: Lustre: 444106:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:48:26 warble2 kernel: Lustre: 444106:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 18:49:05 warble2 kernel: Lustre: 429759:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply#012 req@ffff88bd7aaf7b00 x1597017511427696/t0(0) o35->dc32fca6-f266-16ac-e214-b77ef785a309@192.168.44.199@o2ib44:5/0 lens 512/696 e 3 to 0 dl 1523090950 ref 2 fl Interpret:/0/0 rc 0/0 Apr 7 18:49:05 warble2 kernel: Lustre: 429759:0:(service.c:1346:ptlrpc_at_send_early_reply()) Skipped 1 previous similar message Apr 7 18:49:10 warble2 kernel: Lustre: dagg-MDT0000: Client dc32fca6-f266-16ac-e214-b77ef785a309 (at 192.168.44.199@o2ib44) reconnecting Apr 7 18:49:10 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 4ceb2312-ea73-5592-c1b4-1db4c5b9fe10 (at 192.168.44.199@o2ib44) Apr 7 18:49:10 warble2 kernel: Lustre: Skipped 541 previous similar messages Apr 7 18:49:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:49:26 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages Apr 7 18:49:52 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 18:49:53 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 7 18:49:53 warble2 pengine[14246]: notice: Calculated transition 16, saving inputs in /var/lib/pacemaker/pengine/pe-input-8.bz2 Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble1-ipmi_monitor_60000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble2-ipmi_monitor_60000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble1-zfs-MGT-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble1-MGT_monitor_20000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble2-zfs-dagg-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble2-dagg-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation healthLUSTRE_monitor_10000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation healthLNET_monitor_20000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble1-zfs-dagg-MDT2-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble1-dagg-MDT2_monitor_20000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble1-zfs-dagg-MDT1-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble1-dagg-MDT1_monitor_20000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble1-zfs-images-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble1-images-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble2-zfs-apps-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble2-apps-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble2-zfs-home-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 18:49:53 warble2 crmd[14247]: notice: Initiating cancel operation warble2-home-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 crmd[14247]: notice: Transition 16 (Complete=18, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-8.bz2): Complete Apr 7 18:49:53 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 18:49:53 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 18:50:04 warble2 kernel: Lustre: Failing over dagg-MDT0000 Apr 7 18:50:04 warble2 kernel: LustreError: 11-0: dagg-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -19 Apr 7 18:50:04 warble2 kernel: Lustre: dagg-MDT0000-osp-MDT0001: Connection to dagg-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Apr 7 18:50:04 warble2 kernel: LustreError: 441273:0:(osp_object.c:582:osp_attr_get()) dagg-MDT0001-osp-MDT0000:osp_attr_get update error [0x28001c154:0x2b75:0x0]: rc = -5 Apr 7 18:50:04 warble2 kernel: Lustre: 441273:0:(service.c:2112:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (600:54s); client may timeout. req@ffff88bd7aaf7b00 x1597017511427696/t210453478004(0) o35->dc32fca6-f266-16ac-e214-b77ef785a309@192.168.44.199@o2ib44:5/0 lens 512/424 e 3 to 0 dl 1523090950 ref 1 fl Complete:/0/0 rc -19/-19 Apr 7 18:50:04 warble2 kernel: LNet: Service thread pid 429755 completed after 7267.21s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). Apr 7 18:50:04 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 18:50:04 warble2 kernel: Lustre: dagg-MDT0000: Not available for connect from 192.168.44.199@o2ib44 (stopping) Apr 7 18:50:04 warble2 kernel: Lustre: Skipped 2 previous similar messages Apr 7 18:50:04 warble2 kernel: Lustre: 441273:0:(service.c:2112:ptlrpc_server_handle_request()) Skipped 5 previous similar messages Apr 7 18:50:04 warble2 kernel: LustreError: 14884:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88bc784ec500 x1594152762362336/t0(0) o13->dagg-OST000c-osc-MDT0000@192.168.44.37@o2ib44:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 Apr 7 18:50:04 warble2 kernel: LustreError: 14884:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 15 previous similar messages Apr 7 18:50:06 warble2 kernel: Lustre: dagg-MDT0000: Not available for connect from 192.168.44.189@o2ib44 (stopping) Apr 7 18:50:06 warble2 kernel: Lustre: Skipped 12 previous similar messages Apr 7 18:50:09 warble2 kernel: Lustre: server umount dagg-MDT0000 complete Apr 7 18:50:10 warble2 kernel: LustreError: 137-5: dagg-MDT0000_UUID: not available for connect from 192.168.44.205@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 18:50:10 warble2 kernel: LustreError: Skipped 70 previous similar messages Apr 7 18:50:16 warble2 kernel: LustreError: 429602:0:(ldlm_lockd.c:2365:ldlm_cancel_handler()) ldlm_cancel from 192.168.44.185@o2ib44 arrived at 1523091016 with bad export cookie 12584883377945857779 Apr 7 18:50:26 warble2 kernel: LustreError: 11-0: dagg-MDT0000-lwp-MDT0001: operation obd_ping to node 0@lo failed: rc = -107 Apr 7 18:50:26 warble2 kernel: Lustre: dagg-MDT0000-lwp-MDT0002: Connection to dagg-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Apr 7 18:50:26 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 18:50:26 warble2 kernel: LustreError: Skipped 2 previous similar messages Apr 7 18:50:48 warble2 kernel: Lustre: dagg-MDT0000: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 Apr 7 18:50:53 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523091048/real 1523091048] req@ffff885e45250c00 x1594152762364624/t0(0) o38->dagg-MDT0002-osp-MDT0000@192.168.44.21@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523091053 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 18:50:53 warble2 kernel: Lustre: dagg-MDT0000: Will be in recovery for at least 2:30, or until 124 clients reconnect Apr 7 18:50:53 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Apr 7 18:51:13 warble2 kernel: Lustre: dagg-MDT0001: Received new LWP connection from 0@lo, removing former export from same NID Apr 7 18:51:13 warble2 kernel: Lustre: dagg-MDT0002: Client dagg-MDT0000-mdtlov_UUID (at 0@lo) refused connection, still busy with 6 references Apr 7 18:51:13 warble2 kernel: LustreError: 11-0: dagg-MDT0002-osp-MDT0000: operation mds_connect to node 0@lo failed: rc = -16 Apr 7 18:51:13 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 18:51:26 warble2 kernel: LustreError: 1322:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-lwp-MDT0000: namespace resource [0x200000006:0x1010000:0x0].0x0 (ffff885e77bd1e00) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 18:51:26 warble2 kernel: LustreError: 1322:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff885e77bd1e00) refcount = 2 Apr 7 18:51:26 warble2 kernel: Lustre: 444106:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:51:26 warble2 kernel: Lustre: 444106:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 8 previous similar messages Apr 7 18:51:26 warble2 kernel: LustreError: 1322:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 18:51:26 warble2 kernel: LustreError: 1322:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-lwp-MDT0000 lock: ffff885e464a5c00/0xaea67cc13469b49c lrc: 2/1,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 3 type: PLN flags: 0x1106400000000 nid: local remote: 0xaea67cc13469d485 expref: -99 pid: 458435 timeout: 0 lvb_type: 2 Apr 7 18:51:26 warble2 kernel: Lustre: Failing over dagg-MDT0000 Apr 7 18:51:26 warble2 kernel: LustreError: 11-0: dagg-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -19 Apr 7 18:51:26 warble2 kernel: LustreError: Skipped 1 previous similar message Apr 7 18:51:26 warble2 kernel: LustreError: 458439:0:(osp_object.c:582:osp_attr_get()) dagg-MDT0001-osp-MDT0000:osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 Apr 7 18:51:26 warble2 kernel: LustreError: 458440:0:(lod_sub_object.c:932:lod_sub_prep_llog()) dagg-MDT0000-mdtlov: can't get id from catalogs: rc = -5 Apr 7 18:51:26 warble2 kernel: LustreError: 458440:0:(lod_dev.c:419:lod_sub_recovery_thread()) dagg-MDT0002-osp-MDT0000 getting update log failed: rc = -5 Apr 7 18:51:26 warble2 kernel: LustreError: 458439:0:(osp_object.c:582:osp_attr_get()) Skipped 4 previous similar messages Apr 7 18:51:26 warble2 kernel: LustreError: 1322:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) dagg-MDT0000: Aborting recovery Apr 7 18:51:26 warble2 kernel: Lustre: 458465:0:(ldlm_lib.c:2048:target_recovery_overseer()) recovery is aborted, evict exports in recovery Apr 7 18:51:26 warble2 kernel: LustreError: 458465:0:(ldlm_lib.c:1640:abort_lock_replay_queue()) @@@ aborted: req@ffff885e3368e900 x1594462427850848/t0(0) o101->02c65d3d-616e-a18f-3474-eecff1778104@192.168.44.14@o2ib44:164/0 lens 328/0 e 2 to 0 dl 1523091109 ref 1 fl Complete:/40/ffffffff rc 0/-1 Apr 7 18:51:26 warble2 kernel: Lustre: dagg-MDT0000: Recovery over after 0:33, of 124 clients 0 recovered and 124 were evicted. Apr 7 18:51:27 warble2 kernel: Lustre: dagg-MDT0000: Not available for connect from 192.168.44.14@o2ib44 (stopping) Apr 7 18:51:27 warble2 kernel: Lustre: Skipped 11 previous similar messages Apr 7 18:51:27 warble2 kernel: LustreError: 458298:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff885e9a24dd00 x1594152768995872/t0(0) o5->dagg-OST0000-osc-MDT0000@192.168.44.31@o2ib44:28/4 lens 432/432 e 0 to 0 dl 0 ref 2 fl Rpc:N/0/ffffffff rc 0/-1 Apr 7 18:51:27 warble2 kernel: LustreError: 458300:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) dagg-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -5 Apr 7 18:51:27 warble2 kernel: LustreError: 458302:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) dagg-OST0002-osc-MDT0000: cannot cleanup orphans: rc = -5 Apr 7 18:51:27 warble2 kernel: LustreError: 458300:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages Apr 7 18:51:27 warble2 kernel: LustreError: 458302:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) Skipped 4 previous similar messages Apr 7 18:51:27 warble2 kernel: LustreError: 458298:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 15 previous similar messages Apr 7 18:51:28 warble2 kernel: Lustre: server umount dagg-MDT0000 complete Apr 7 18:51:28 warble2 kernel: LustreError: 137-5: dagg-MDT0000_UUID: not available for connect from 192.168.44.33@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 18:51:28 warble2 kernel: LustreError: Skipped 115 previous similar messages Apr 7 18:51:29 warble2 kernel: LustreError: 1515:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-lwp-MDT0001: namespace resource [0x200000006:0x1010000:0x0].0x0 (ffff88bca296d200) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 18:51:29 warble2 kernel: LustreError: 1515:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff88bca296d200) refcount = 2 Apr 7 18:51:29 warble2 kernel: LustreError: 1515:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 18:51:29 warble2 kernel: LustreError: 1515:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-lwp-MDT0001 lock: ffff885e2b8b0000/0xaea67cc13451367f lrc: 2/1,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 3 type: PLN flags: 0x1106400000000 nid: local remote: 0xaea67cc134513686 expref: -99 pid: 442435 timeout: 0 lvb_type: 2 Apr 7 18:51:29 warble2 kernel: Lustre: Failing over dagg-MDT0001 Apr 7 18:51:29 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 18:51:29 warble2 kernel: LustreError: 442509:0:(llog_osd.c:882:llog_osd_next_block()) dagg-MDT0000-osp-MDT0001: can't read llog block from log [0x2000013ca:0x1:0x0] offset 163840: rc = -5 Apr 7 18:51:29 warble2 kernel: LustreError: 442509:0:(llog.c:607:llog_process_thread()) dagg-MDT0000-osp-MDT0001 retry remote llog process Apr 7 18:51:29 warble2 kernel: LustreError: 442509:0:(lod_dev.c:419:lod_sub_recovery_thread()) dagg-MDT0000-osp-MDT0001 getting update log failed: rc = -11 Apr 7 18:51:29 warble2 kernel: LustreError: 442509:0:(lod_dev.c:419:lod_sub_recovery_thread()) Skipped 1 previous similar message Apr 7 18:51:29 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) Skipped 1 previous similar message Apr 7 18:51:29 warble2 kernel: LustreError: 1515:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) dagg-MDT0001: Aborting recovery Apr 7 18:51:29 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:2048:target_recovery_overseer()) recovery is aborted, evict exports in recovery Apr 7 18:51:29 warble2 kernel: Lustre: 442719:0:(ldlm_lib.c:2048:target_recovery_overseer()) Skipped 2 previous similar messages Apr 7 18:51:29 warble2 kernel: Lustre: dagg-MDT0001: Recovery over after 11:03, of 124 clients 0 recovered and 124 were evicted. Apr 7 18:51:29 warble2 kernel: LustreError: 441807:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff885e1db2c500 x1594152772588208/t0(0) o5->dagg-OST0000-osc-MDT0001@192.168.44.31@o2ib44:28/4 lens 432/432 e 0 to 0 dl 0 ref 2 fl Rpc:N/0/ffffffff rc 0/-1 Apr 7 18:51:29 warble2 kernel: LustreError: 441862:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) dagg-OST000a-osc-MDT0001: cannot cleanup orphans: rc = -5 Apr 7 18:51:29 warble2 kernel: LustreError: 441862:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) Skipped 14 previous similar messages Apr 7 18:51:29 warble2 kernel: LustreError: 441807:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 15 previous similar messages Apr 7 18:51:30 warble2 kernel: LustreError: 11-0: dagg-MDT0000-osp-MDT0002: operation out_update to node 0@lo failed: rc = -107 Apr 7 18:51:30 warble2 kernel: LustreError: Skipped 293557 previous similar messages Apr 7 18:51:30 warble2 kernel: Lustre: server umount dagg-MDT0001 complete Apr 7 18:51:38 warble2 kernel: LustreError: 11-0: dagg-MDT0000-osp-MDT0002: operation out_update to node 0@lo failed: rc = -107 Apr 7 18:51:38 warble2 kernel: LustreError: Skipped 411718 previous similar messages Apr 7 18:51:39 warble2 kernel: LustreError: 1868:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-lwp-MDT0002: namespace resource [0x200000006:0x1010000:0x0].0x0 (ffff885e73dec300) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 18:51:39 warble2 kernel: LustreError: 1868:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff885e73dec300) refcount = 2 Apr 7 18:51:39 warble2 kernel: LustreError: 1868:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 18:51:39 warble2 kernel: LustreError: 1868:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-lwp-MDT0002 lock: ffff885e2b8b4600/0xaea67cc1345140f8 lrc: 2/1,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 3 type: PLN flags: 0x1106400000000 nid: local remote: 0xaea67cc1345140ff expref: -99 pid: 443862 timeout: 0 lvb_type: 2 Apr 7 18:51:39 warble2 kernel: Lustre: Failing over dagg-MDT0002 Apr 7 18:51:39 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 18:51:39 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) Skipped 1 previous similar message Apr 7 18:51:39 warble2 kernel: LustreError: 443868:0:(llog_osd.c:882:llog_osd_next_block()) dagg-MDT0000-osp-MDT0002: can't read llog block from log [0x2000013cb:0x1:0x0] offset 131072: rc = -5 Apr 7 18:51:39 warble2 kernel: LustreError: 443868:0:(llog.c:607:llog_process_thread()) dagg-MDT0000-osp-MDT0002 retry remote llog process Apr 7 18:51:39 warble2 kernel: LustreError: 443868:0:(lod_dev.c:419:lod_sub_recovery_thread()) dagg-MDT0000-osp-MDT0002 getting update log failed: rc = -11 Apr 7 18:51:39 warble2 kernel: LustreError: 1868:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) dagg-MDT0002: Aborting recovery Apr 7 18:51:39 warble2 kernel: Lustre: 444106:0:(ldlm_lib.c:2048:target_recovery_overseer()) recovery is aborted, evict exports in recovery Apr 7 18:51:39 warble2 kernel: Lustre: 444106:0:(ldlm_lib.c:2048:target_recovery_overseer()) Skipped 2 previous similar messages Apr 7 18:51:39 warble2 kernel: Lustre: dagg-MDT0002: Recovery over after 11:12, of 124 clients 0 recovered and 124 were evicted. Apr 7 18:51:39 warble2 kernel: LustreError: 443018:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff885e18d23600 x1594152780297904/t0(0) o5->dagg-OST0000-osc-MDT0002@192.168.44.31@o2ib44:28/4 lens 432/432 e 0 to 0 dl 0 ref 2 fl Rpc:N/0/ffffffff rc 0/-1 Apr 7 18:51:39 warble2 kernel: LustreError: 443018:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) dagg-OST0000-osc-MDT0002: cannot cleanup orphans: rc = -5 Apr 7 18:51:39 warble2 kernel: LustreError: 443018:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) Skipped 12 previous similar messages Apr 7 18:51:40 warble2 kernel: Lustre: server umount dagg-MDT0002 complete Apr 7 18:51:54 warble2 kernel: Lustre: dagg-MDT0000: Not available for connect from 192.168.44.118@o2ib44 (not set up) Apr 7 18:51:54 warble2 kernel: Lustre: Skipped 2 previous similar messages Apr 7 18:51:54 warble2 kernel: Lustre: dagg-MDT0000: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 Apr 7 18:51:54 warble2 kernel: Lustre: dagg-MDT0000: Will be in recovery for at least 2:30, or until 124 clients reconnect Apr 7 18:51:59 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523091114/real 1523091114] req@ffff88bcd7f58900 x1594152780299056/t0(0) o38->dagg-MDT0002-osp-MDT0000@192.168.44.21@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523091119 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 18:51:59 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 5 previous similar messages Apr 7 18:52:18 warble2 kernel: LustreError: 11-0: dagg-MDT0000-osp-MDT0001: operation mds_connect to node 0@lo failed: rc = -114 Apr 7 18:52:18 warble2 kernel: LustreError: Skipped 15479 previous similar messages Apr 7 18:52:18 warble2 kernel: Lustre: dagg-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 Apr 7 18:52:23 warble2 kernel: Lustre: dagg-MDT0001: Will be in recovery for at least 2:30, or until 124 clients reconnect Apr 7 18:52:24 warble2 kernel: Lustre: dagg-MDT0002: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 Apr 7 18:53:15 warble2 kernel: Lustre: dagg-MDT0000: Recovery over after 1:21, of 124 clients 124 recovered and 0 were evicted. Apr 7 18:55:18 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 18:55:18 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 7 18:58:03 warble2 kernel: Lustre: MGS: haven't heard from client 6ffa68a6-4989-db6b-2ef6-ea4d70d1a657 (at 192.168.44.199@o2ib44) in 227 seconds. I think it's dead, and I am evicting it. exp ffff88bdb0849400, cur 1523091483 expire 1523091333 last 1523091256 Apr 7 18:58:12 warble2 kernel: Lustre: apps-MDT0000: haven't heard from client 2bfc9870-9691-7c14-e86d-92c4c83fa3e6 (at 192.168.44.199@o2ib44) in 228 seconds. I think it's dead, and I am evicting it. exp ffff885e17a58000, cur 1523091492 expire 1523091342 last 1523091264 Apr 7 18:58:12 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 18:58:18 warble2 kernel: Lustre: images-MDT0000: haven't heard from client 2ac43cfa-883f-90e2-4a09-0341b6f98865 (at 192.168.44.199@o2ib44) in 227 seconds. I think it's dead, and I am evicting it. exp ffff88bc2d8b0000, cur 1523091498 expire 1523091348 last 1523091271 Apr 7 19:00:18 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 19:00:18 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 28 previous similar messages Apr 7 19:04:53 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 19:04:53 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 19:04:53 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 7 19:04:53 warble2 pengine[14246]: notice: Calculated transition 17, saving inputs in /var/lib/pacemaker/pengine/pe-input-9.bz2 Apr 7 19:04:53 warble2 crmd[14247]: notice: Transition 17 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-9.bz2): Complete Apr 7 19:04:53 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 19:05:45 warble2 kernel: Lustre: 82321:0:(service.c:1346:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-150), not sending early reply#012 req@ffff88bc0b687800 x1597017511745600/t0(0) o35->dc32fca6-f266-16ac-e214-b77ef785a309@192.168.44.199@o2ib44:250/0 lens 512/696 e 0 to 0 dl 1523091950 ref 2 fl Interpret:/0/0 rc 0/0 Apr 7 19:09:18 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 19:09:18 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 55 previous similar messages Apr 7 19:19:18 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 19:19:18 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 19:19:53 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 19:19:53 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 19:19:53 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 7 19:19:53 warble2 pengine[14246]: notice: Calculated transition 18, saving inputs in /var/lib/pacemaker/pengine/pe-input-9.bz2 Apr 7 19:19:53 warble2 crmd[14247]: notice: Transition 18 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-9.bz2): Complete Apr 7 19:19:53 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 19:21:56 warble2 kernel: LustreError: 10575:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-lwp-MDT0002: namespace resource [0x200000006:0x1010000:0x0].0x0 (ffff88bccdf28b40) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 19:21:56 warble2 kernel: LustreError: 10575:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff88bccdf28b40) refcount = 2 Apr 7 19:21:56 warble2 kernel: LustreError: 10575:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 19:21:56 warble2 kernel: LustreError: 10575:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-lwp-MDT0002 lock: ffff885e464a4400/0xaea67cc1346c4fcc lrc: 2/1,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 3 type: PLN flags: 0x1106400000000 nid: local remote: 0xaea67cc1346c4fd3 expref: -99 pid: 4584 timeout: 0 lvb_type: 2 Apr 7 19:21:56 warble2 kernel: Lustre: Failing over dagg-MDT0002 Apr 7 19:21:56 warble2 kernel: LustreError: 4596:0:(llog_osd.c:882:llog_osd_next_block()) dagg-MDT0000-osp-MDT0002: can't read llog block from log [0x2000013cb:0x1:0x0] offset 131072: rc = -5 Apr 7 19:21:56 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 19:21:56 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) Skipped 1 previous similar message Apr 7 19:21:56 warble2 kernel: LustreError: 4596:0:(llog.c:607:llog_process_thread()) dagg-MDT0000-osp-MDT0002 retry remote llog process Apr 7 19:21:56 warble2 kernel: LustreError: 4596:0:(lod_dev.c:419:lod_sub_recovery_thread()) dagg-MDT0000-osp-MDT0002 getting update log failed: rc = -11 Apr 7 19:21:56 warble2 kernel: LustreError: 10575:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) dagg-MDT0002: Aborting recovery Apr 7 19:21:56 warble2 kernel: Lustre: 4616:0:(ldlm_lib.c:2048:target_recovery_overseer()) recovery is aborted, evict exports in recovery Apr 7 19:21:56 warble2 kernel: Lustre: 4616:0:(ldlm_lib.c:2048:target_recovery_overseer()) Skipped 2 previous similar messages Apr 7 19:21:56 warble2 kernel: Lustre: 4616:0:(ldlm_lib.c:2038:target_recovery_overseer()) dagg-MDT0002 recovery is aborted by hard timeout Apr 7 19:21:56 warble2 kernel: Lustre: dagg-MDT0002: Recovery over after 29:32, of 124 clients 0 recovered and 124 were evicted. Apr 7 19:21:56 warble2 kernel: LustreError: 4157:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88595e466f00 x1594153759385392/t0(0) o5->dagg-OST0001-osc-MDT0002@192.168.44.31@o2ib44:28/4 lens 432/432 e 0 to 0 dl 0 ref 2 fl Rpc:N/0/ffffffff rc 0/-1 Apr 7 19:21:56 warble2 kernel: LustreError: 4159:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) dagg-OST0002-osc-MDT0002: cannot cleanup orphans: rc = -5 Apr 7 19:21:56 warble2 kernel: LustreError: 4159:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) Skipped 15 previous similar messages Apr 7 19:21:56 warble2 kernel: LustreError: 4157:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 29 previous similar messages Apr 7 19:21:57 warble2 kernel: Lustre: dagg-MDT0002: Not available for connect from 192.168.44.34@o2ib44 (stopping) Apr 7 19:21:57 warble2 kernel: Lustre: Skipped 2 previous similar messages Apr 7 19:21:57 warble2 kernel: Lustre: server umount dagg-MDT0002 complete Apr 7 19:21:58 warble2 kernel: LustreError: 137-5: dagg-MDT0002_UUID: not available for connect from 192.168.44.31@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:21:58 warble2 kernel: LustreError: Skipped 377 previous similar messages Apr 7 19:21:59 warble2 kernel: LustreError: 10768:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-lwp-MDT0001: namespace resource [0x200000006:0x1010000:0x0].0x0 (ffff88bae7d34c00) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 19:21:59 warble2 kernel: LustreError: 10768:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff88bae7d34c00) refcount = 2 Apr 7 19:21:59 warble2 kernel: LustreError: 10768:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 19:21:59 warble2 kernel: LustreError: 10768:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-lwp-MDT0001 lock: ffff88bd8a8f3800/0xaea67cc1346c3c23 lrc: 2/1,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 3 type: PLN flags: 0x1106400000000 nid: local remote: 0xaea67cc1346c3c2a expref: -99 pid: 3820 timeout: 0 lvb_type: 2 Apr 7 19:21:59 warble2 kernel: Lustre: Failing over dagg-MDT0001 Apr 7 19:21:59 warble2 kernel: LustreError: 3826:0:(llog_osd.c:882:llog_osd_next_block()) dagg-MDT0000-osp-MDT0001: can't read llog block from log [0x2000013ca:0x1:0x0] offset 163840: rc = -108 Apr 7 19:21:59 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 19:21:59 warble2 kernel: LustreError: 3826:0:(lod_dev.c:419:lod_sub_recovery_thread()) dagg-MDT0000-osp-MDT0001 getting update log failed: rc = -108 Apr 7 19:21:59 warble2 kernel: LustreError: 10768:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) dagg-MDT0001: Aborting recovery Apr 7 19:21:59 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:2048:target_recovery_overseer()) recovery is aborted, evict exports in recovery Apr 7 19:21:59 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:2048:target_recovery_overseer()) Skipped 2 previous similar messages Apr 7 19:21:59 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:2038:target_recovery_overseer()) dagg-MDT0001 recovery is aborted by hard timeout Apr 7 19:21:59 warble2 kernel: Lustre: 3896:0:(ldlm_lib.c:2038:target_recovery_overseer()) Skipped 1 previous similar message Apr 7 19:21:59 warble2 kernel: Lustre: dagg-MDT0001: Recovery over after 29:36, of 124 clients 0 recovered and 124 were evicted. Apr 7 19:21:59 warble2 kernel: LustreError: 3117:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88b81eff0900 x1594153760433968/t0(0) o5->dagg-OST0001-osc-MDT0001@192.168.44.31@o2ib44:28/4 lens 432/432 e 0 to 0 dl 0 ref 2 fl Rpc:N/0/ffffffff rc 0/-1 Apr 7 19:21:59 warble2 kernel: LustreError: 3119:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) dagg-OST0002-osc-MDT0001: cannot cleanup orphans: rc = -5 Apr 7 19:21:59 warble2 kernel: LustreError: 3119:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) Skipped 14 previous similar messages Apr 7 19:21:59 warble2 kernel: LustreError: 3117:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 15 previous similar messages Apr 7 19:22:00 warble2 kernel: Lustre: server umount dagg-MDT0001 complete Apr 7 19:22:01 warble2 kernel: Lustre: Failing over dagg-MDT0000 Apr 7 19:22:02 warble2 kernel: LustreError: 429760:0:(osp_object.c:582:osp_attr_get()) dagg-MDT0001-osp-MDT0000:osp_attr_get update error [0x28001c93a:0x1e970:0x0]: rc = -5 Apr 7 19:22:02 warble2 kernel: Lustre: 429759:0:(service.c:2112:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (755:971s); client may timeout. req@ffff88bc8e67dc50 x1597017511745552/t214748364801(0) o35->dc32fca6-f266-16ac-e214-b77ef785a309@192.168.44.199@o2ib44:250/0 lens 512/424 e 0 to 0 dl 1523091950 ref 1 fl Complete:/0/0 rc -19/-19 Apr 7 19:22:02 warble2 kernel: LNet: Service thread pid 429759 completed after 1726.79s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). Apr 7 19:22:02 warble2 kernel: LNet: Skipped 5 previous similar messages Apr 7 19:22:02 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 19:22:02 warble2 kernel: LustreError: 14870:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88bb41fb2100 x1594153760434400/t0(0) o38->dagg-MDT0002-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:N/0/ffffffff rc 0/-1 Apr 7 19:22:02 warble2 kernel: LustreError: 429760:0:(osp_object.c:582:osp_attr_get()) Skipped 1 previous similar message Apr 7 19:22:02 warble2 kernel: Lustre: dagg-MDT0000: Not available for connect from 192.168.44.166@o2ib44 (stopping) Apr 7 19:22:02 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 19:22:02 warble2 kernel: LustreError: 7029:0:(ldlm_lib.c:3226:target_bulk_io()) @@@ timeout on bulk WRITE after 6+0s req@ffff88bde0cd9450 x1594153759321616/t0(0) o1000->dagg-MDT0002-mdtlov_UUID@0@lo:467/0 lens 336/37088 e 0 to 0 dl 1523092922 ref 1 fl Interpret:/0/0 rc 0/0 Apr 7 19:22:06 warble2 kernel: Lustre: dagg-MDT0000: Not available for connect from 192.168.44.121@o2ib44 (stopping) Apr 7 19:22:06 warble2 kernel: Lustre: Skipped 37 previous similar messages Apr 7 19:22:08 warble2 kernel: Lustre: server umount dagg-MDT0000 complete Apr 7 19:22:08 warble2 kernel: LustreError: 137-5: dagg-MDT0000_UUID: not available for connect from 192.168.44.115@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:22:08 warble2 kernel: LustreError: Skipped 3 previous similar messages Apr 7 19:22:24 warble2 kernel: LustreError: 137-5: dagg-MDT0002_UUID: not available for connect from 192.168.44.102@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:22:24 warble2 kernel: LustreError: Skipped 324 previous similar messages Apr 7 19:22:27 warble2 kernel: Lustre: 11422:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523092940/real 1523092940] req@ffff88bb41fb6900 x1594153760435248/t0(0) o251->MGC192.168.44.22@o2ib44@0@lo:26/25 lens 224/224 e 0 to 1 dl 1523092946 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 19:22:27 warble2 kernel: Lustre: 11422:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 5 previous similar messages Apr 7 19:22:27 warble2 kernel: Lustre: server umount MGS complete Apr 7 19:22:31 warble2 kernel: LustreError: 166-1: MGC192.168.44.21@o2ib44: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail Apr 7 19:22:51 warble2 kernel: Lustre: MGS: Connection restored to 192.168.44.22@o2ib44 (at 0@lo) Apr 7 19:22:51 warble2 kernel: Lustre: Skipped 560 previous similar messages Apr 7 19:22:58 warble2 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.38@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:22:58 warble2 kernel: LustreError: Skipped 34 previous similar messages Apr 7 19:23:22 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523092996/real 1523092996] req@ffff88012cd90000 x1594153760436464/t0(0) o250->MGC192.168.44.21@o2ib44@192.168.44.21@o2ib44:26/25 lens 520/544 e 0 to 1 dl 1523093002 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 19:23:22 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Apr 7 19:23:41 warble2 kernel: Lustre: Evicted from MGS (at MGC192.168.44.21@o2ib44_1) after server handle changed from 0xaea67cc134512d02 to 0xaea67cc1349bda9c Apr 7 19:24:02 warble2 kernel: LustreError: 137-5: dagg-MDT0000_UUID: not available for connect from 192.168.44.36@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:24:02 warble2 kernel: LustreError: Skipped 519 previous similar messages Apr 7 19:25:07 warble2 kernel: Lustre: dagg-MDT0002: Imperative Recovery not enabled, recovery window 300-900 Apr 7 19:25:07 warble2 kernel: Lustre: Skipped 2 previous similar messages Apr 7 19:25:07 warble2 kernel: Lustre: dagg-MDT0002: Will be in recovery for at least 5:00, or until 124 clients reconnect Apr 7 19:25:07 warble2 kernel: Lustre: dagg-MDT0002: Connection restored to fa702abf-6761-dcc1-c47b-1c8ca4b06a6f (at 192.168.44.167@o2ib44) Apr 7 19:25:07 warble2 kernel: Lustre: Skipped 133 previous similar messages Apr 7 19:25:07 warble2 kernel: Lustre: Skipped 1 previous similar message Apr 7 19:25:12 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523093107/real 1523093107] req@ffff885e78f37b00 x1594153760440256/t0(0) o38->dagg-MDT0001-osp-MDT0002@192.168.44.21@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523093112 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 19:25:36 warble2 kernel: Lustre: dagg-MDT0001: Imperative Recovery not enabled, recovery window 300-900 Apr 7 19:25:37 warble2 kernel: Lustre: dagg-MDT0001: Will be in recovery for at least 5:00, or until 124 clients reconnect Apr 7 19:26:05 warble2 kernel: Lustre: dagg-MDT0000: Imperative Recovery not enabled, recovery window 300-900 Apr 7 19:26:08 warble2 kernel: Lustre: dagg-MDT0000: Will be in recovery for at least 5:00, or until 121 clients reconnect Apr 7 19:26:38 warble2 kernel: Lustre: dagg-MDT0000: Recovery over after 0:30, of 122 clients 122 recovered and 0 were evicted. Apr 7 19:26:41 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523093190/real 1523093190] req@ffff88bc83a74500 x1594154256733712/t0(0) o38->dagg-MDT0000-lwp-MDT0002@192.168.44.21@o2ib44:12/10 lens 520/544 e 0 to 1 dl 1523093201 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 19:26:41 warble2 kernel: Lustre: 14870:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 8 previous similar messages Apr 7 19:31:07 warble2 kernel: Lustre: 12283:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 19:31:07 warble2 kernel: Lustre: 12283:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 17 previous similar messages Apr 7 19:34:53 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 19:34:53 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:53 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 7 19:34:53 warble2 pengine[14246]: notice: Calculated transition 19, saving inputs in /var/lib/pacemaker/pengine/pe-input-9.bz2 Apr 7 19:34:53 warble2 crmd[14247]: notice: Transition 19 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-9.bz2): Complete Apr 7 19:34:53 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 19:34:55 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 19:34:56 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 pengine[14246]: notice: Calculated transition 20, saving inputs in /var/lib/pacemaker/pengine/pe-input-10.bz2 Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble1-ipmi_monitor_60000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble2-ipmi_monitor_60000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-MGT-pool_monitor_5000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble1-MGT_monitor_20000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-dagg-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble2-dagg-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation healthLUSTRE_monitor_10000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation healthLNET_monitor_20000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT2-pool_monitor_5000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT2_monitor_20000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT1-pool_monitor_5000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT1_monitor_20000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-images-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble1-images-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-apps-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble2-apps-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-home-MDT0-pool_monitor_5000 locally on warble2-host.oob Apr 7 19:34:56 warble2 crmd[14247]: notice: Initiating monitor operation warble2-home-MDT0_monitor_20000 locally on warble2-host.oob Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble2 crmd[14247]: notice: Transition 20 (Complete=18, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-10.bz2): Complete Apr 7 19:34:56 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 19:34:56 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:34:56 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:11 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 19:35:11 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:11 warble2 pengine[14246]: notice: * Start healthLUSTRE:1 ( warble1-host.oob ) Apr 7 19:35:11 warble2 pengine[14246]: notice: * Start healthLNET:1 ( warble1-host.oob ) Apr 7 19:35:11 warble2 pengine[14246]: notice: Calculated transition 21, saving inputs in /var/lib/pacemaker/pengine/pe-input-11.bz2 Apr 7 19:35:11 warble2 crmd[14247]: notice: Initiating start operation healthLUSTRE_start_0 on warble1-host.oob Apr 7 19:35:11 warble2 crmd[14247]: notice: Initiating start operation healthLNET_start_0 on warble1-host.oob Apr 7 19:35:11 warble2 crmd[14247]: notice: Transition aborted by status-1-lustred doing create lustred=1: Transient attribute change Apr 7 19:35:11 warble1 crmd[14603]: notice: Result of start operation for healthLUSTRE on warble1-host.oob: 0 (ok) Apr 7 19:35:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:11 warble1 crmd[14603]: notice: Result of start operation for healthLNET on warble1-host.oob: 0 (ok) Apr 7 19:35:11 warble2 crmd[14247]: notice: Transition 21 (Complete=6, Pending=0, Fired=0, Skipped=2, Incomplete=2, Source=/var/lib/pacemaker/pengine/pe-input-11.bz2): Stopped Apr 7 19:35:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:11 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:11 warble2 pengine[14246]: notice: Calculated transition 22, saving inputs in /var/lib/pacemaker/pengine/pe-input-12.bz2 Apr 7 19:35:11 warble2 crmd[14247]: notice: Initiating monitor operation healthLUSTRE_monitor_10000 on warble1-host.oob Apr 7 19:35:11 warble2 crmd[14247]: notice: Initiating monitor operation healthLNET_monitor_20000 on warble1-host.oob Apr 7 19:35:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:11 warble2 crmd[14247]: notice: Transition 22 (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-12.bz2): Complete Apr 7 19:35:11 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 19:35:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:16 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 19:35:16 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 19:35:16 warble2 pengine[14246]: notice: Calculated transition 23, saving inputs in /var/lib/pacemaker/pengine/pe-input-13.bz2 Apr 7 19:35:16 warble2 crmd[14247]: notice: Transition 23 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-13.bz2): Complete Apr 7 19:35:16 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 19:37:05 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 19:37:05 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:05 warble2 pengine[14246]: notice: * Move warble2-ipmi ( warble2-host.oob -> warble1-host.oob ) Apr 7 19:37:05 warble2 pengine[14246]: notice: * Move warble1-zfs-MGT-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 19:37:05 warble2 pengine[14246]: notice: * Move warble1-MGT ( warble2-host.oob -> warble1-host.oob ) Apr 7 19:37:05 warble2 pengine[14246]: notice: * Move warble1-zfs-dagg-MDT2-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 19:37:05 warble2 pengine[14246]: notice: * Move warble1-dagg-MDT2 ( warble2-host.oob -> warble1-host.oob ) Apr 7 19:37:05 warble2 pengine[14246]: notice: * Move warble1-zfs-dagg-MDT1-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 19:37:05 warble2 pengine[14246]: notice: * Move warble1-dagg-MDT1 ( warble2-host.oob -> warble1-host.oob ) Apr 7 19:37:05 warble2 pengine[14246]: notice: * Move warble1-zfs-images-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 19:37:05 warble2 pengine[14246]: notice: * Move warble1-images-MDT0 ( warble2-host.oob -> warble1-host.oob ) Apr 7 19:37:05 warble2 pengine[14246]: notice: Calculated transition 24, saving inputs in /var/lib/pacemaker/pengine/pe-input-14.bz2 Apr 7 19:37:05 warble2 crmd[14247]: notice: Initiating stop operation warble2-ipmi_stop_0 locally on warble2-host.oob Apr 7 19:37:05 warble2 crmd[14247]: notice: Initiating stop operation warble1-MGT_stop_0 locally on warble2-host.oob Apr 7 19:37:05 warble2 crmd[14247]: notice: Initiating stop operation warble1-dagg-MDT2_stop_0 locally on warble2-host.oob Apr 7 19:37:05 warble2 crmd[14247]: notice: Initiating stop operation warble1-dagg-MDT1_stop_0 locally on warble2-host.oob Apr 7 19:37:05 warble2 crmd[14247]: notice: Initiating stop operation warble1-images-MDT0_stop_0 locally on warble2-host.oob Apr 7 19:37:05 warble2 crmd[14247]: notice: Result of stop operation for warble2-ipmi on warble2-host.oob: 0 (ok) Apr 7 19:37:05 warble2 crmd[14247]: notice: Initiating start operation warble2-ipmi_start_0 on warble1-host.oob Apr 7 19:37:05 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:05 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:05 warble2 Lustre(warble1-MGT)[18366]: INFO: Starting to unmount warble1-MGT-pool/MGT Apr 7 19:37:05 warble2 Lustre(warble1-dagg-MDT2)[18367] INFO: Starting to unmount warble1-dagg-MDT2-pool/MDT2 Apr 7 19:37:05 warble2 Lustre(warble1-dagg-MDT1)[18368] INFO: Starting to unmount warble1-dagg-MDT1-pool/MDT1 Apr 7 19:37:05 warble2 Lustre(warble1-images-MDT0)[1836 INFO: Starting to unmount warble1-images-MDT0-pool/MDT0 Apr 7 19:37:05 warble2 kernel: Lustre: Failing over images-MDT0000 Apr 7 19:37:05 warble2 kernel: LustreError: 18416:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-lwp-MDT0001: namespace resource [0x200000006:0x1010000:0x0].0x0 (ffff88bebb493e00) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 19:37:05 warble2 kernel: LustreError: 18416:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff88bebb493e00) refcount = 2 Apr 7 19:37:05 warble2 kernel: LustreError: 18416:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 19:37:05 warble2 kernel: LustreError: 18416:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-lwp-MDT0001 lock: ffff88bb4083b600/0xaea67cc1349efdce lrc: 2/1,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 3 type: PLN flags: 0x1106400000000 nid: local remote: 0xaea67cc134a03c8d expref: -99 pid: 13565 timeout: 0 lvb_type: 2 Apr 7 19:37:05 warble2 kernel: LustreError: 18415:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff885b58d40a80) refcount = 2 Apr 7 19:37:05 warble2 kernel: LustreError: 18415:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 19:37:05 warble2 kernel: LustreError: 13574:0:(llog_osd.c:882:llog_osd_next_block()) dagg-MDT0000-osp-MDT0001: can't read llog block from log [0x2000013ca:0x1:0x0] offset 163840: rc = -5 Apr 7 19:37:05 warble2 kernel: LustreError: 13574:0:(llog.c:607:llog_process_thread()) dagg-MDT0000-osp-MDT0001 retry remote llog process Apr 7 19:37:05 warble2 kernel: LustreError: 13574:0:(lod_dev.c:419:lod_sub_recovery_thread()) dagg-MDT0000-osp-MDT0001 getting update log failed: rc = -11 Apr 7 19:37:05 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 19:37:05 warble2 kernel: LustreError: 18415:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) dagg-MDT0002: Aborting recovery Apr 7 19:37:05 warble2 kernel: Lustre: 12283:0:(ldlm_lib.c:2048:target_recovery_overseer()) recovery is aborted, evict exports in recovery Apr 7 19:37:05 warble2 kernel: Lustre: 12283:0:(ldlm_lib.c:2048:target_recovery_overseer()) Skipped 2 previous similar messages Apr 7 19:37:05 warble2 kernel: Lustre: dagg-MDT0002: Recovery over after 11:58, of 124 clients 0 recovered and 124 were evicted. Apr 7 19:37:05 warble2 kernel: LustreError: 12856:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff885e7d1bd700 x1594154966833216/t0(0) o5->dagg-OST0000-osc-MDT0001@192.168.44.31@o2ib44:28/4 lens 432/432 e 0 to 0 dl 0 ref 2 fl Rpc:N/0/ffffffff rc 0/-1 Apr 7 19:37:05 warble2 kernel: LustreError: 12856:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 17 previous similar messages Apr 7 19:37:05 warble2 kernel: LustreError: 12858:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) dagg-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -5 Apr 7 19:37:05 warble2 kernel: LustreError: 12858:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) Skipped 15 previous similar messages Apr 7 19:37:05 warble2 kernel: Lustre: Skipped 2 previous similar messages Apr 7 19:37:06 warble2 kernel: Lustre: images-MDT0000: Not available for connect from 192.168.44.215@o2ib44 (stopping) Apr 7 19:37:06 warble2 kernel: Lustre: Skipped 11 previous similar messages Apr 7 19:37:06 warble2 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.110@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:37:06 warble2 kernel: LustreError: Skipped 787 previous similar messages Apr 7 19:37:06 warble1 crmd[14603]: notice: Result of start operation for warble2-ipmi on warble1-host.oob: 0 (ok) Apr 7 19:37:06 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:06 warble2 crmd[14247]: notice: Initiating monitor operation warble2-ipmi_monitor_60000 on warble1-host.oob Apr 7 19:37:06 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:06 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:06 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble2 kernel: Lustre: 18411:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523093825/real 1523093825] req@ffff88bd88bffb00 x1594154966832432/t0(0) o251->MGC192.168.44.22@o2ib44@0@lo:26/25 lens 224/224 e 0 to 1 dl 1523093831 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 19:37:11 warble2 kernel: Lustre: 18411:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 7 19:37:11 warble2 Lustre(warble1-images-MDT0)[1836 INFO: warble1-images-MDT0-pool/MDT0 unmounted successfully Apr 7 19:37:11 warble2 Lustre(warble1-dagg-MDT2)[18367] INFO: warble1-dagg-MDT2-pool/MDT2 unmounted successfully Apr 7 19:37:11 warble2 Lustre(warble1-dagg-MDT1)[18368] INFO: warble1-dagg-MDT1-pool/MDT1 unmounted successfully Apr 7 19:37:11 warble2 crmd[14247]: notice: Result of stop operation for warble1-images-MDT0 on warble2-host.oob: 0 (ok) Apr 7 19:37:11 warble2 crmd[14247]: notice: Result of stop operation for warble1-dagg-MDT1 on warble2-host.oob: 0 (ok) Apr 7 19:37:11 warble2 crmd[14247]: notice: Result of stop operation for warble1-dagg-MDT2 on warble2-host.oob: 0 (ok) Apr 7 19:37:11 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-images-MDT0-pool_stop_0 locally on warble2-host.oob Apr 7 19:37:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-dagg-MDT1-pool_stop_0 locally on warble2-host.oob Apr 7 19:37:11 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-dagg-MDT2-pool_stop_0 locally on warble2-host.oob Apr 7 19:37:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble2 kernel: Lustre: server umount MGS complete Apr 7 19:37:11 warble2 kernel: Lustre: Skipped 3 previous similar messages Apr 7 19:37:11 warble2 Lustre(warble1-MGT)[18366]: INFO: warble1-MGT-pool/MGT unmounted successfully Apr 7 19:37:11 warble2 crmd[14247]: notice: Result of stop operation for warble1-MGT on warble2-host.oob: 0 (ok) Apr 7 19:37:11 warble2 crmd[14247]: notice: Initiating stop operation warble1-zfs-MGT-pool_stop_0 locally on warble2-host.oob Apr 7 19:37:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble2 zed: eid=113 class=pool_export pool_guid=0x5ED256D9C36340D3 Apr 7 19:37:11 warble2 crmd[14247]: notice: Result of stop operation for warble1-zfs-images-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 19:37:11 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-images-MDT0-pool_start_0 on warble1-host.oob Apr 7 19:37:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble2 zed: eid=114 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 19:37:11 warble2 zed: eid=115 class=pool_export pool_guid=0xE146DD6489A1819A Apr 7 19:37:11 warble2 crmd[14247]: notice: Result of stop operation for warble1-zfs-dagg-MDT1-pool on warble2-host.oob: 0 (ok) Apr 7 19:37:11 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-dagg-MDT1-pool_start_0 on warble1-host.oob Apr 7 19:37:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble2 zed: eid=116 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 19:37:11 warble2 zed: eid=117 class=pool_export pool_guid=0x13C167322AB5F5E9 Apr 7 19:37:11 warble2 crmd[14247]: notice: Result of stop operation for warble1-zfs-dagg-MDT2-pool on warble2-host.oob: 0 (ok) Apr 7 19:37:11 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-dagg-MDT2-pool_start_0 on warble1-host.oob Apr 7 19:37:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:11 warble2 zed: eid=118 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 19:37:11 warble2 zed: eid=119 class=pool_export pool_guid=0xC0BDFB4695D313E6 Apr 7 19:37:12 warble1 zed: eid=37 class=history_event pool_guid=0x5ED256D9C36340D3 Apr 7 19:37:12 warble1 zed: eid=38 class=config_cache_write pool_guid=0x5ED256D9C36340D3 Apr 7 19:37:12 warble1 zed: eid=39 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 19:37:12 warble1 lrmd[14600]: notice: warble1-zfs-images-MDT0-pool_start_0:86867:stderr [ cannot open 'warble1-images-MDT0-pool': no such pool ] Apr 7 19:37:12 warble1 crmd[14603]: notice: Result of start operation for warble1-zfs-images-MDT0-pool on warble1-host.oob: 0 (ok) Apr 7 19:37:12 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-images-MDT0-pool_monitor_5000 on warble1-host.oob Apr 7 19:37:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble2 crmd[14247]: notice: Initiating start operation warble1-images-MDT0_start_0 on warble1-host.oob Apr 7 19:37:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble1 zed: eid=40 class=pool_import pool_guid=0x5ED256D9C36340D3 Apr 7 19:37:12 warble2 crmd[14247]: notice: Result of stop operation for warble1-zfs-MGT-pool on warble2-host.oob: 0 (ok) Apr 7 19:37:12 warble2 crmd[14247]: notice: Initiating start operation warble1-zfs-MGT-pool_start_0 on warble1-host.oob Apr 7 19:37:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble1 Lustre(warble1-images-MDT0)[8747 INFO: Starting to mount warble1-images-MDT0-pool/MDT0 Apr 7 19:37:12 warble2 zed: eid=120 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 19:37:12 warble1 zed: eid=41 class=history_event pool_guid=0x5ED256D9C36340D3 Apr 7 19:37:12 warble1 zed: eid=42 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 19:37:12 warble1 zed: eid=43 class=history_event pool_guid=0xE146DD6489A1819A Apr 7 19:37:12 warble1 zed: eid=44 class=config_cache_write pool_guid=0xE146DD6489A1819A Apr 7 19:37:12 warble1 zed: eid=45 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 19:37:12 warble1 zed: eid=46 class=pool_import pool_guid=0xE146DD6489A1819A Apr 7 19:37:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble1 lrmd[14600]: notice: warble1-zfs-dagg-MDT1-pool_start_0:86929:stderr [ cannot open 'warble1-dagg-MDT1-pool': no such pool ] Apr 7 19:37:12 warble1 crmd[14603]: notice: Result of start operation for warble1-zfs-dagg-MDT1-pool on warble1-host.oob: 0 (ok) Apr 7 19:37:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT1-pool_monitor_5000 on warble1-host.oob Apr 7 19:37:12 warble2 crmd[14247]: notice: Initiating start operation warble1-dagg-MDT1_start_0 on warble1-host.oob Apr 7 19:37:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble1 Lustre(warble1-dagg-MDT1)[87938] INFO: Starting to mount warble1-dagg-MDT1-pool/MDT1 Apr 7 19:37:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble1 zed: eid=47 class=history_event pool_guid=0xE146DD6489A1819A Apr 7 19:37:12 warble1 zed: eid=48 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 19:37:12 warble1 zed: eid=49 class=history_event pool_guid=0x13C167322AB5F5E9 Apr 7 19:37:12 warble1 zed: eid=50 class=config_cache_write pool_guid=0x13C167322AB5F5E9 Apr 7 19:37:12 warble1 zed: eid=51 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 19:37:12 warble1 lrmd[14600]: notice: warble1-zfs-dagg-MDT2-pool_start_0:87018:stderr [ cannot open 'warble1-dagg-MDT2-pool': no such pool ] Apr 7 19:37:12 warble1 crmd[14603]: notice: Result of start operation for warble1-zfs-dagg-MDT2-pool on warble1-host.oob: 0 (ok) Apr 7 19:37:12 warble1 zed: eid=52 class=pool_import pool_guid=0x13C167322AB5F5E9 Apr 7 19:37:12 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-dagg-MDT2-pool_monitor_5000 on warble1-host.oob Apr 7 19:37:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble2 crmd[14247]: notice: Initiating start operation warble1-dagg-MDT2_start_0 on warble1-host.oob Apr 7 19:37:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble1 Lustre(warble1-dagg-MDT2)[88478] INFO: Starting to mount warble1-dagg-MDT2-pool/MDT2 Apr 7 19:37:12 warble1 zed: eid=53 class=history_event pool_guid=0x13C167322AB5F5E9 Apr 7 19:37:12 warble1 zed: eid=54 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 19:37:12 warble1 zed: eid=55 class=history_event pool_guid=0xC0BDFB4695D313E6 Apr 7 19:37:12 warble1 zed: eid=56 class=config_cache_write pool_guid=0xC0BDFB4695D313E6 Apr 7 19:37:12 warble1 zed: eid=57 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 19:37:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble1 lrmd[14600]: notice: warble1-zfs-MGT-pool_start_0:87501:stderr [ cannot open 'warble1-MGT-pool': no such pool ] Apr 7 19:37:12 warble1 crmd[14603]: notice: Result of start operation for warble1-zfs-MGT-pool on warble1-host.oob: 0 (ok) Apr 7 19:37:12 warble1 zed: eid=58 class=pool_import pool_guid=0xC0BDFB4695D313E6 Apr 7 19:37:12 warble2 crmd[14247]: notice: Initiating monitor operation warble1-zfs-MGT-pool_monitor_5000 on warble1-host.oob Apr 7 19:37:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble2 crmd[14247]: notice: Initiating start operation warble1-MGT_start_0 on warble1-host.oob Apr 7 19:37:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble1 Lustre(warble1-MGT)[88945]: INFO: Starting to mount warble1-MGT-pool/MGT Apr 7 19:37:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:12 warble1 zed: eid=59 class=history_event pool_guid=0xC0BDFB4695D313E6 Apr 7 19:37:12 warble1 zed: eid=60 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 19:37:17 warble1 zed: eid=61 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 7 19:37:17 warble1 zed: eid=62 class=config_sync pool_guid=0xE146DD6489A1819A Apr 7 19:37:17 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523093832/real 1523093832] req@ffff88bd87769b00 x1597070087498160/t0(0) o250->MGC192.168.44.21@o2ib44@0@lo:26/25 lens 520/544 e 0 to 1 dl 1523093837 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 19:37:17 warble1 Lustre(warble1-MGT)[88945]: INFO: warble1-MGT-pool/MGT mounted successfully Apr 7 19:37:17 warble1 crmd[14603]: notice: Result of start operation for warble1-MGT on warble1-host.oob: 0 (ok) Apr 7 19:37:17 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:17 warble2 crmd[14247]: notice: Initiating monitor operation warble1-MGT_monitor_20000 on warble1-host.oob Apr 7 19:37:17 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:17 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:17 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:17 warble1 zed: eid=63 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 7 19:37:17 warble1 zed: eid=64 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 7 19:37:22 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523093837/real 1523093837] req@ffff885e77d10300 x1597070087498192/t0(0) o250->MGC192.168.44.21@o2ib44@192.168.44.22@o2ib44:26/25 lens 520/544 e 0 to 1 dl 1523093842 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 19:37:22 warble2 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.36@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:37:22 warble2 kernel: LustreError: Skipped 174 previous similar messages Apr 7 19:37:27 warble2 kernel: LustreError: 166-1: MGC192.168.44.21@o2ib44: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail Apr 7 19:37:28 warble1 kernel: LustreError: 87514:0:(mgc_request.c:251:do_config_log_add()) MGC192.168.44.21@o2ib44: failed processing log, type 1: rc = -5 Apr 7 19:37:31 warble1 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.153@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:37:31 warble1 kernel: LustreError: Skipped 18 previous similar messages Apr 7 19:37:34 warble1 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.147@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:37:37 warble1 kernel: LustreError: 137-5: dagg-MDT0002_UUID: not available for connect from 192.168.44.13@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:37:37 warble1 kernel: LustreError: Skipped 1 previous similar message Apr 7 19:37:38 warble1 kernel: Lustre: MGS: Connection restored to 8a9c7a47-4b79-f076-3ca9-c9eb4a640e95 (at 192.168.44.215@o2ib44) Apr 7 19:37:38 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 19:37:39 warble1 kernel: LustreError: 137-5: dagg-MDT0002_UUID: not available for connect from 192.168.44.180@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:37:39 warble1 kernel: LustreError: Skipped 9 previous similar messages Apr 7 19:37:42 warble1 kernel: Lustre: MGS: Connection restored to 192.168.44.21@o2ib44 (at 0@lo) Apr 7 19:37:42 warble1 kernel: Lustre: Skipped 41 previous similar messages Apr 7 19:37:42 warble1 kernel: Lustre: images-MDT0000: Imperative Recovery not enabled, recovery window 300-900 Apr 7 19:37:42 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 19:37:42 warble1 Lustre(warble1-images-MDT0)[8747 INFO: warble1-images-MDT0-pool/MDT0 mounted successfully Apr 7 19:37:42 warble1 crmd[14603]: notice: Result of start operation for warble1-images-MDT0 on warble1-host.oob: 0 (ok) Apr 7 19:37:42 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble2 crmd[14247]: notice: Initiating monitor operation warble1-images-MDT0_monitor_20000 on warble1-host.oob Apr 7 19:37:42 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble2 kernel: Lustre: dagg-MDT0000: Connection restored to 192.168.44.21@o2ib44 (at 192.168.44.21@o2ib44) Apr 7 19:37:42 warble2 kernel: Lustre: Skipped 420 previous similar messages Apr 7 19:37:42 warble1 Lustre(warble1-dagg-MDT1)[87938] INFO: warble1-dagg-MDT1-pool/MDT1 mounted successfully Apr 7 19:37:42 warble1 crmd[14603]: notice: Result of start operation for warble1-dagg-MDT1 on warble1-host.oob: 0 (ok) Apr 7 19:37:42 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT1_monitor_20000 on warble1-host.oob Apr 7 19:37:42 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble1 kernel: LustreError: 11-0: dagg-MDT0001-osp-MDT0002: operation mds_connect to node 0@lo failed: rc = -114 Apr 7 19:37:42 warble1 Lustre(warble1-dagg-MDT2)[88478] INFO: warble1-dagg-MDT2-pool/MDT2 mounted successfully Apr 7 19:37:42 warble1 crmd[14603]: notice: Result of start operation for warble1-dagg-MDT2 on warble1-host.oob: 0 (ok) Apr 7 19:37:42 warble2 crmd[14247]: notice: Initiating monitor operation warble1-dagg-MDT2_monitor_20000 on warble1-host.oob Apr 7 19:37:42 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble2 crmd[14247]: notice: Transition 24 (Complete=44, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-14.bz2): Complete Apr 7 19:37:42 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 19:37:42 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:42 warble1 kernel: Lustre: images-MDT0000: Will be in recovery for at least 5:00, or until 121 clients reconnect Apr 7 19:37:42 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 19:37:43 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:43 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 19:37:43 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:43 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 19:37:43 warble2 pengine[14246]: notice: Calculated transition 25, saving inputs in /var/lib/pacemaker/pengine/pe-input-15.bz2 Apr 7 19:37:43 warble2 crmd[14247]: notice: Transition 25 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-15.bz2): Complete Apr 7 19:37:43 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 19:37:44 warble1 kernel: Lustre: dagg-MDT0001: Will be in recovery for at least 5:00, or until 124 clients reconnect Apr 7 19:37:44 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 19:37:50 warble1 kernel: Lustre: MGS: Connection restored to 07243512-4d53-e3cb-a3a5-b5b1bf6eb45c (at 192.168.44.195@o2ib44) Apr 7 19:37:50 warble1 kernel: Lustre: Skipped 175 previous similar messages Apr 7 19:37:52 warble2 kernel: Lustre: Evicted from MGS (at 192.168.44.21@o2ib44) after server handle changed from 0xaea67cc1349bda9c to 0x17c6bac8a4593602 Apr 7 19:37:56 warble2 kernel: LustreError: 137-5: images-MDT0000_UUID: not available for connect from 192.168.44.153@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 19:37:56 warble2 kernel: LustreError: Skipped 221 previous similar messages Apr 7 19:38:06 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to b1414fbd-0eff-2de8-072c-81f3eb82a6bc (at 192.168.44.182@o2ib44) Apr 7 19:38:06 warble1 kernel: Lustre: Skipped 297 previous similar messages Apr 7 19:38:07 warble1 kernel: Lustre: images-MDT0000: Recovery over after 0:25, of 121 clients 121 recovered and 0 were evicted. Apr 7 19:38:07 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 19:43:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 19:43:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 14 previous similar messages Apr 7 19:45:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 19:45:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 11 previous similar messages Apr 7 19:48:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 19:48:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 17 previous similar messages Apr 7 19:52:43 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 19:52:43 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 19:52:43 warble2 pengine[14246]: notice: Calculated transition 26, saving inputs in /var/lib/pacemaker/pengine/pe-input-15.bz2 Apr 7 19:52:43 warble2 crmd[14247]: notice: Transition 26 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-15.bz2): Complete Apr 7 19:52:43 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 19:53:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 19:53:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 31 previous similar messages Apr 7 20:03:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 20:03:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 20:07:43 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 20:07:43 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 20:07:43 warble2 pengine[14246]: notice: Calculated transition 27, saving inputs in /var/lib/pacemaker/pengine/pe-input-15.bz2 Apr 7 20:07:43 warble2 crmd[14247]: notice: Transition 27 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-15.bz2): Complete Apr 7 20:07:43 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 20:13:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 20:13:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 56 previous similar messages Apr 7 20:22:43 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 20:22:43 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 20:22:43 warble2 pengine[14246]: notice: Calculated transition 28, saving inputs in /var/lib/pacemaker/pengine/pe-input-15.bz2 Apr 7 20:22:43 warble2 crmd[14247]: notice: Transition 28 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-15.bz2): Complete Apr 7 20:22:43 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 20:23:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 20:23:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 20:33:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 20:33:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 20:37:43 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 20:37:43 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 20:37:43 warble2 pengine[14246]: notice: Calculated transition 29, saving inputs in /var/lib/pacemaker/pengine/pe-input-15.bz2 Apr 7 20:37:43 warble2 crmd[14247]: notice: Transition 29 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-15.bz2): Complete Apr 7 20:37:43 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 20:43:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 20:43:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 20:52:43 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 20:52:43 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 20:52:43 warble2 pengine[14246]: notice: Calculated transition 30, saving inputs in /var/lib/pacemaker/pengine/pe-input-15.bz2 Apr 7 20:52:43 warble2 crmd[14247]: notice: Transition 30 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-15.bz2): Complete Apr 7 20:52:43 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 20:53:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 20:53:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 21:03:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 21:03:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 21:07:43 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 21:07:44 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 21:07:44 warble2 pengine[14246]: notice: Calculated transition 31, saving inputs in /var/lib/pacemaker/pengine/pe-input-15.bz2 Apr 7 21:07:44 warble2 crmd[14247]: notice: Transition 31 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-15.bz2): Complete Apr 7 21:07:44 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 21:13:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 21:13:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 21:22:44 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 21:22:44 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 21:22:44 warble2 pengine[14246]: notice: Calculated transition 32, saving inputs in /var/lib/pacemaker/pengine/pe-input-15.bz2 Apr 7 21:22:44 warble2 crmd[14247]: notice: Transition 32 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-15.bz2): Complete Apr 7 21:22:44 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 21:23:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 21:23:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 21:32:09 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 21:32:09 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:09 warble2 pengine[14246]: notice: * Move warble1-ipmi ( warble2-host.oob -> warble1-host.oob ) Apr 7 21:32:09 warble2 pengine[14246]: notice: * Move warble2-zfs-dagg-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 21:32:09 warble2 pengine[14246]: notice: * Move warble2-dagg-MDT0 ( warble2-host.oob -> warble1-host.oob ) Apr 7 21:32:09 warble2 pengine[14246]: notice: * Stop healthLUSTRE:0 ( warble2-host.oob ) due to node availability Apr 7 21:32:09 warble2 pengine[14246]: notice: * Stop healthLNET:0 ( warble2-host.oob ) due to node availability Apr 7 21:32:09 warble2 pengine[14246]: notice: * Move warble2-zfs-apps-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 21:32:09 warble2 pengine[14246]: notice: * Move warble2-apps-MDT0 ( warble2-host.oob -> warble1-host.oob ) Apr 7 21:32:09 warble2 pengine[14246]: notice: * Move warble2-zfs-home-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 21:32:09 warble2 pengine[14246]: notice: * Move warble2-home-MDT0 ( warble2-host.oob -> warble1-host.oob ) Apr 7 21:32:09 warble2 pengine[14246]: notice: Calculated transition 33, saving inputs in /var/lib/pacemaker/pengine/pe-input-16.bz2 Apr 7 21:32:09 warble2 crmd[14247]: notice: Initiating stop operation warble1-ipmi_stop_0 locally on warble2-host.oob Apr 7 21:32:09 warble2 crmd[14247]: notice: Initiating stop operation warble2-dagg-MDT0_stop_0 locally on warble2-host.oob Apr 7 21:32:09 warble2 crmd[14247]: notice: Initiating stop operation warble2-apps-MDT0_stop_0 locally on warble2-host.oob Apr 7 21:32:09 warble2 crmd[14247]: notice: Initiating stop operation warble2-home-MDT0_stop_0 locally on warble2-host.oob Apr 7 21:32:09 warble2 crmd[14247]: notice: Result of stop operation for warble1-ipmi on warble2-host.oob: 0 (ok) Apr 7 21:32:09 warble2 crmd[14247]: notice: Initiating stop operation healthLUSTRE_stop_0 locally on warble2-host.oob Apr 7 21:32:09 warble2 crmd[14247]: notice: Initiating stop operation healthLNET_stop_0 locally on warble2-host.oob Apr 7 21:32:09 warble2 crmd[14247]: notice: Initiating start operation warble1-ipmi_start_0 on warble1-host.oob Apr 7 21:32:09 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:09 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:09 warble2 Lustre(warble2-dagg-MDT0)[72278] INFO: Starting to unmount warble2-dagg-MDT0-pool/MDT0 Apr 7 21:32:09 warble2 Lustre(warble2-apps-MDT0)[72279] INFO: Starting to unmount warble2-apps-MDT0-pool/MDT0 Apr 7 21:32:09 warble2 Lustre(warble2-home-MDT0)[72280] INFO: Starting to unmount warble2-home-MDT0-pool/MDT0 Apr 7 21:32:09 warble2 crmd[14247]: notice: Result of stop operation for healthLUSTRE on warble2-host.oob: 0 (ok) Apr 7 21:32:09 warble2 crmd[14247]: notice: Transition aborted by deletion of nvpair[@id='status-2-lustred']: Transient attribute change Apr 7 21:32:09 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:09 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:09 warble2 crmd[14247]: notice: Result of stop operation for healthLNET on warble2-host.oob: 0 (ok) Apr 7 21:32:09 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:09 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:09 warble2 kernel: Lustre: Failing over home-MDT0000 Apr 7 21:32:09 warble1 kernel: LustreError: 11-0: dagg-MDT0000-osp-MDT0001: operation out_update to node 192.168.44.22@o2ib44 failed: rc = -19 Apr 7 21:32:09 warble1 kernel: Lustre: dagg-MDT0000-osp-MDT0002: Connection to dagg-MDT0000 (at 192.168.44.22@o2ib44) was lost; in progress operations using this service will wait for recovery to complete Apr 7 21:32:09 warble1 kernel: LustreError: Skipped 1 previous similar message Apr 7 21:32:09 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 21:32:09 warble2 kernel: Lustre: dagg-MDT0000: Not available for connect from 192.168.44.21@o2ib44 (stopping) Apr 7 21:32:09 warble2 kernel: LustreError: 14870:0:(import.c:662:ptlrpc_connect_import()) Skipped 1 previous similar message Apr 7 21:32:09 warble2 kernel: Lustre: server umount home-MDT0000 complete Apr 7 21:32:09 warble2 Lustre(warble2-home-MDT0)[72280] INFO: warble2-home-MDT0-pool/MDT0 unmounted successfully Apr 7 21:32:09 warble2 crmd[14247]: notice: Result of stop operation for warble2-home-MDT0 on warble2-host.oob: 0 (ok) Apr 7 21:32:09 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:09 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:09 warble2 Lustre(warble2-apps-MDT0)[72279] INFO: warble2-apps-MDT0-pool/MDT0 unmounted successfully Apr 7 21:32:09 warble2 crmd[14247]: notice: Result of stop operation for warble2-apps-MDT0 on warble2-host.oob: 0 (ok) Apr 7 21:32:10 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:09 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:10 warble2 kernel: LustreError: 137-5: apps-MDT0000_UUID: not available for connect from 192.168.44.140@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 21:32:10 warble2 kernel: LustreError: Skipped 9 previous similar messages Apr 7 21:32:10 warble2 kernel: LustreError: 429601:0:(ldlm_lockd.c:2365:ldlm_cancel_handler()) ldlm_cancel from 192.168.44.163@o2ib44 arrived at 1523100730 with bad export cookie 12584883377945863295 Apr 7 21:32:10 warble2 Lustre(warble2-dagg-MDT0)[72278] INFO: warble2-dagg-MDT0-pool/MDT0 unmounted successfully Apr 7 21:32:10 warble2 crmd[14247]: notice: Result of stop operation for warble2-dagg-MDT0 on warble2-host.oob: 0 (ok) Apr 7 21:32:10 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:10 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:10 warble1 crmd[14603]: notice: Result of start operation for warble1-ipmi on warble1-host.oob: 0 (ok) Apr 7 21:32:10 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:10 warble2 crmd[14247]: notice: Transition 33 (Complete=14, Pending=0, Fired=0, Skipped=4, Incomplete=26, Source=/var/lib/pacemaker/pengine/pe-input-16.bz2): Stopped Apr 7 21:32:10 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:10 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:10 warble2 pengine[14246]: notice: * Move warble2-zfs-dagg-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 21:32:10 warble2 pengine[14246]: notice: * Start warble2-dagg-MDT0 ( warble1-host.oob ) Apr 7 21:32:10 warble2 pengine[14246]: notice: * Move warble2-zfs-apps-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 21:32:10 warble2 pengine[14246]: notice: * Start warble2-apps-MDT0 ( warble1-host.oob ) Apr 7 21:32:10 warble2 pengine[14246]: notice: * Move warble2-zfs-home-MDT0-pool ( warble2-host.oob -> warble1-host.oob ) Apr 7 21:32:10 warble2 pengine[14246]: notice: * Start warble2-home-MDT0 ( warble1-host.oob ) Apr 7 21:32:10 warble2 pengine[14246]: notice: Calculated transition 34, saving inputs in /var/lib/pacemaker/pengine/pe-input-17.bz2 Apr 7 21:32:10 warble2 crmd[14247]: notice: Initiating monitor operation warble1-ipmi_monitor_60000 on warble1-host.oob Apr 7 21:32:10 warble2 crmd[14247]: notice: Initiating stop operation warble2-zfs-dagg-MDT0-pool_stop_0 locally on warble2-host.oob Apr 7 21:32:10 warble2 crmd[14247]: notice: Initiating stop operation warble2-zfs-apps-MDT0-pool_stop_0 locally on warble2-host.oob Apr 7 21:32:10 warble2 crmd[14247]: notice: Initiating stop operation warble2-zfs-home-MDT0-pool_stop_0 locally on warble2-host.oob Apr 7 21:32:10 warble2 zed: eid=121 class=pool_export pool_guid=0xFC863664CC04C875 Apr 7 21:32:10 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:10 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble2 crmd[14247]: notice: Result of stop operation for warble2-zfs-dagg-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 21:32:11 warble2 crmd[14247]: notice: Initiating start operation warble2-zfs-dagg-MDT0-pool_start_0 on warble1-host.oob Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble2 zed: eid=122 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 21:32:11 warble2 zed: eid=123 class=pool_export pool_guid=0xCF79F68EBE891CC3 Apr 7 21:32:11 warble2 crmd[14247]: notice: Result of stop operation for warble2-zfs-apps-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 21:32:11 warble2 crmd[14247]: notice: Initiating start operation warble2-zfs-apps-MDT0-pool_start_0 on warble1-host.oob Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble2 zed: eid=124 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 21:32:11 warble2 zed: eid=125 class=pool_export pool_guid=0x979BA0B2D95A8C68 Apr 7 21:32:11 warble2 crmd[14247]: notice: Result of stop operation for warble2-zfs-home-MDT0-pool on warble2-host.oob: 0 (ok) Apr 7 21:32:11 warble2 crmd[14247]: notice: Initiating start operation warble2-zfs-home-MDT0-pool_start_0 on warble1-host.oob Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble2 zed: eid=126 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 21:32:11 warble1 zed: eid=65 class=history_event pool_guid=0xFC863664CC04C875 Apr 7 21:32:11 warble1 zed: eid=66 class=config_cache_write pool_guid=0xFC863664CC04C875 Apr 7 21:32:11 warble1 zed: eid=67 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 21:32:11 warble1 zed: eid=68 class=pool_import pool_guid=0xFC863664CC04C875 Apr 7 21:32:11 warble1 zed: eid=69 class=history_event pool_guid=0xFC863664CC04C875 Apr 7 21:32:11 warble1 zed: eid=70 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 21:32:11 warble1 zed: eid=71 class=history_event pool_guid=0xCF79F68EBE891CC3 Apr 7 21:32:11 warble1 zed: eid=72 class=config_cache_write pool_guid=0xCF79F68EBE891CC3 Apr 7 21:32:11 warble1 zed: eid=73 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 21:32:11 warble1 zed: eid=74 class=pool_import pool_guid=0xCF79F68EBE891CC3 Apr 7 21:32:11 warble1 zed: eid=75 class=history_event pool_guid=0x979BA0B2D95A8C68 Apr 7 21:32:11 warble1 zed: eid=76 class=config_cache_write pool_guid=0x979BA0B2D95A8C68 Apr 7 21:32:11 warble1 zed: eid=77 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 21:32:11 warble1 lrmd[14600]: notice: warble2-zfs-dagg-MDT0-pool_start_0:153521:stderr [ cannot open 'warble2-dagg-MDT0-pool': no such pool ] Apr 7 21:32:11 warble1 lrmd[14600]: notice: warble2-zfs-apps-MDT0-pool_start_0:153526:stderr [ cannot open 'warble2-apps-MDT0-pool': no such pool ] Apr 7 21:32:11 warble1 lrmd[14600]: notice: warble2-zfs-home-MDT0-pool_start_0:153563:stderr [ cannot open 'warble2-home-MDT0-pool': no such pool ] Apr 7 21:32:11 warble1 zed: eid=78 class=pool_import pool_guid=0x979BA0B2D95A8C68 Apr 7 21:32:11 warble1 crmd[14603]: notice: Result of start operation for warble2-zfs-dagg-MDT0-pool on warble1-host.oob: 0 (ok) Apr 7 21:32:11 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-dagg-MDT0-pool_monitor_5000 on warble1-host.oob Apr 7 21:32:11 warble2 crmd[14247]: notice: Initiating start operation warble2-dagg-MDT0_start_0 on warble1-host.oob Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 crmd[14603]: notice: Result of start operation for warble2-zfs-apps-MDT0-pool on warble1-host.oob: 0 (ok) Apr 7 21:32:11 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-apps-MDT0-pool_monitor_5000 on warble1-host.oob Apr 7 21:32:11 warble2 crmd[14247]: notice: Initiating start operation warble2-apps-MDT0_start_0 on warble1-host.oob Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 crmd[14603]: notice: Result of start operation for warble2-zfs-home-MDT0-pool on warble1-host.oob: 0 (ok) Apr 7 21:32:11 warble2 crmd[14247]: notice: Initiating monitor operation warble2-zfs-home-MDT0-pool_monitor_5000 on warble1-host.oob Apr 7 21:32:11 warble2 crmd[14247]: notice: Initiating start operation warble2-home-MDT0_start_0 on warble1-host.oob Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 zed: eid=79 class=history_event pool_guid=0xCF79F68EBE891CC3 Apr 7 21:32:11 warble1 Lustre(warble2-dagg-MDT0)[155010 INFO: Starting to mount warble2-dagg-MDT0-pool/MDT0 Apr 7 21:32:11 warble1 Lustre(warble2-apps-MDT0)[155012 INFO: Starting to mount warble2-apps-MDT0-pool/MDT0 Apr 7 21:32:11 warble1 Lustre(warble2-home-MDT0)[155017 INFO: Starting to mount warble2-home-MDT0-pool/MDT0 Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 zed: eid=80 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 21:32:11 warble1 zed: eid=81 class=history_event pool_guid=0x979BA0B2D95A8C68 Apr 7 21:32:11 warble1 zed: eid=82 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 21:32:11 warble1 kernel: Lustre: dagg-MDT0001: Received LWP connection from 0@lo, removing former export from 192.168.44.22@o2ib44 Apr 7 21:32:11 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 192.168.44.21@o2ib44 (at 0@lo) Apr 7 21:32:11 warble1 kernel: Lustre: Skipped 15 previous similar messages Apr 7 21:32:11 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 21:32:11 warble1 kernel: Lustre: dagg-MDT0000: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 Apr 7 21:32:11 warble1 Lustre(warble2-dagg-MDT0)[155010 INFO: warble2-dagg-MDT0-pool/MDT0 mounted successfully Apr 7 21:32:11 warble1 crmd[14603]: notice: Result of start operation for warble2-dagg-MDT0 on warble1-host.oob: 0 (ok) Apr 7 21:32:11 warble2 crmd[14247]: notice: Initiating monitor operation warble2-dagg-MDT0_monitor_20000 on warble1-host.oob Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:11 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:12 warble1 Lustre(warble2-apps-MDT0)[155012 INFO: warble2-apps-MDT0-pool/MDT0 mounted successfully Apr 7 21:32:12 warble1 crmd[14603]: notice: Result of start operation for warble2-apps-MDT0 on warble1-host.oob: 0 (ok) Apr 7 21:32:12 warble2 crmd[14247]: notice: Initiating monitor operation warble2-apps-MDT0_monitor_20000 on warble1-host.oob Apr 7 21:32:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:12 warble1 Lustre(warble2-home-MDT0)[155017 INFO: warble2-home-MDT0-pool/MDT0 mounted successfully Apr 7 21:32:12 warble1 crmd[14603]: notice: Result of start operation for warble2-home-MDT0 on warble1-host.oob: 0 (ok) Apr 7 21:32:12 warble2 crmd[14247]: notice: Initiating monitor operation warble2-home-MDT0_monitor_20000 on warble1-host.oob Apr 7 21:32:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:12 warble2 crmd[14247]: notice: Transition 34 (Complete=29, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-17.bz2): Complete Apr 7 21:32:12 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 21:32:12 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:12 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:14 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 21:32:14 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 21:32:14 warble2 pengine[14246]: notice: Calculated transition 35, saving inputs in /var/lib/pacemaker/pengine/pe-input-18.bz2 Apr 7 21:32:14 warble2 crmd[14247]: notice: Transition 35 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-18.bz2): Complete Apr 7 21:32:14 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 21:32:16 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523100731/real 1523100731] req@ffff88bd6e17a700 x1597071190083616/t0(0) o38->dagg-MDT0000-lwp-MDT0000@192.168.44.22@o2ib44:12/10 lens 520/544 e 0 to 1 dl 1523100736 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 21:32:16 warble1 zed: eid=83 class=config_sync pool_guid=0xFC863664CC04C875 Apr 7 21:32:16 warble1 zed: eid=84 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 7 21:32:16 warble1 zed: eid=85 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 7 21:32:17 warble1 kernel: Lustre: dagg-MDT0000: Will be in recovery for at least 2:30, or until 123 clients reconnect Apr 7 21:32:17 warble1 kernel: Lustre: home-MDT0000: Connection restored to 25eb5322-6bd6-abbd-fa2a-e0448c6634bf (at 192.168.44.134@o2ib44) Apr 7 21:32:17 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 7 21:32:17 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 21:32:25 warble1 kernel: Lustre: apps-MDT0000: Connection restored to de49d247-dc9b-a24e-4510-7d56af5537fc (at 192.168.44.216@o2ib44) Apr 7 21:32:25 warble1 kernel: Lustre: Skipped 350 previous similar messages Apr 7 21:32:25 warble1 kernel: Lustre: apps-MDT0000: Recovery over after 0:09, of 121 clients 121 recovered and 0 were evicted. Apr 7 21:32:26 warble1 kernel: Lustre: home-MDT0000: Recovery over after 0:10, of 121 clients 121 recovered and 0 were evicted. Apr 7 21:32:37 warble1 kernel: Lustre: dagg-MDT0000: Recovery over after 0:21, of 123 clients 123 recovered and 0 were evicted. Apr 7 21:32:42 warble1 kernel: Lustre: home-MDT0000: Connection restored to 192.168.44.52@o2ib44 (at 192.168.44.52@o2ib44) Apr 7 21:32:42 warble1 kernel: Lustre: Skipped 18 previous similar messages Apr 7 21:32:44 warble1 kernel: Lustre: 14892:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523100757/real 1523100757] req@ffff88bd6e2b3f00 x1597071190092272/t0(0) o400->dagg-MDT0000-lwp-MDT0001@192.168.44.22@o2ib44:12/10 lens 224/224 e 0 to 1 dl 1523100764 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 21:32:44 warble1 kernel: Lustre: dagg-MDT0000-lwp-MDT0001: Connection to dagg-MDT0000 (at 192.168.44.22@o2ib44) was lost; in progress operations using this service will wait for recovery to complete Apr 7 21:32:44 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 21:32:50 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523100764/real 1523100764] req@ffff885e85db6f00 x1597071194106656/t0(0) o38->dagg-MDT0000-lwp-MDT0001@192.168.44.22@o2ib44:12/10 lens 520/544 e 0 to 1 dl 1523100770 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 21:32:50 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 7 21:33:09 warble1 kernel: LustreError: 167-0: dagg-MDT0000-lwp-MDT0001: This client was evicted by dagg-MDT0000; in progress operations using this service will fail. Apr 7 21:33:09 warble1 kernel: LustreError: 160531:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-lwp-MDT0001: namespace resource [0x200000006:0x1010000:0x0].0x0 (ffff88bdbebdb500) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 21:33:09 warble1 kernel: LustreError: 160532:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff885e7573b440) refcount = 2 Apr 7 21:33:09 warble1 kernel: LustreError: 160532:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 21:33:09 warble1 kernel: LustreError: 160532:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-lwp-MDT0002 lock: ffff88bd729adc00/0x17c6bac8a45906f3 lrc: 2/1,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 3 type: PLN flags: 0x1106400000000 nid: local remote: 0xaea67cc134afcc9e expref: -99 pid: 92258 timeout: 0 lvb_type: 2 Apr 7 21:33:09 warble1 kernel: LustreError: 160532:0:(ldlm_resource.c:1688:ldlm_resource_dump()) Skipped 1 previous similar message Apr 7 21:33:09 warble1 kernel: LustreError: 160531:0:(ldlm_resource.c:1100:ldlm_resource_complain()) Skipped 2 previous similar messages Apr 7 21:33:09 warble1 kernel: LustreError: 160531:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff88bdbebdb500) refcount = 2 Apr 7 21:33:09 warble1 kernel: LustreError: 160531:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 21:33:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 21:33:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 61 previous similar messages Apr 7 21:43:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 21:43:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 56 previous similar messages Apr 7 21:47:14 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 21:47:14 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 21:47:14 warble2 pengine[14246]: notice: Calculated transition 36, saving inputs in /var/lib/pacemaker/pengine/pe-input-18.bz2 Apr 7 21:47:14 warble2 crmd[14247]: notice: Transition 36 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-18.bz2): Complete Apr 7 21:47:14 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 21:53:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 21:53:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 56 previous similar messages Apr 7 22:02:14 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 22:02:14 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 22:02:14 warble2 pengine[14246]: notice: Calculated transition 37, saving inputs in /var/lib/pacemaker/pengine/pe-input-18.bz2 Apr 7 22:02:14 warble2 crmd[14247]: notice: Transition 37 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-18.bz2): Complete Apr 7 22:02:14 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 22:03:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 22:03:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 22:13:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 22:13:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 56 previous similar messages Apr 7 22:17:14 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 22:17:14 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 22:17:14 warble2 pengine[14246]: notice: Calculated transition 38, saving inputs in /var/lib/pacemaker/pengine/pe-input-18.bz2 Apr 7 22:17:14 warble2 crmd[14247]: notice: Transition 38 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-18.bz2): Complete Apr 7 22:17:14 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 22:23:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 22:23:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 22:32:14 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 22:32:14 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 22:32:14 warble2 pengine[14246]: notice: Calculated transition 39, saving inputs in /var/lib/pacemaker/pengine/pe-input-18.bz2 Apr 7 22:32:14 warble2 crmd[14247]: notice: Transition 39 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-18.bz2): Complete Apr 7 22:32:14 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 22:33:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 22:33:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 56 previous similar messages Apr 7 22:43:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 22:43:42 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 7 22:47:14 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 22:47:14 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 22:47:14 warble2 pengine[14246]: notice: Calculated transition 40, saving inputs in /var/lib/pacemaker/pengine/pe-input-18.bz2 Apr 7 22:47:14 warble2 crmd[14247]: notice: Transition 40 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-18.bz2): Complete Apr 7 22:47:14 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 22:53:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 7 22:53:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 56 previous similar messages Apr 7 22:57:35 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 22:57:36 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 7 22:57:36 warble2 pengine[14246]: notice: Calculated transition 41, saving inputs in /var/lib/pacemaker/pengine/pe-input-19.bz2 Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble1-ipmi_monitor_60000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble2-ipmi_monitor_60000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble1-zfs-MGT-pool_monitor_5000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble1-MGT_monitor_20000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble2-zfs-dagg-MDT0-pool_monitor_5000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble2-dagg-MDT0_monitor_20000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation healthLUSTRE_monitor_10000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation healthLNET_monitor_20000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble1-zfs-dagg-MDT2-pool_monitor_5000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble1-dagg-MDT2_monitor_20000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble1-zfs-dagg-MDT1-pool_monitor_5000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble1-dagg-MDT1_monitor_20000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble1-zfs-images-MDT0-pool_monitor_5000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble1-images-MDT0_monitor_20000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble2-zfs-apps-MDT0-pool_monitor_5000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble2-apps-MDT0_monitor_20000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble2-zfs-home-MDT0-pool_monitor_5000 on warble1-host.oob Apr 7 22:57:36 warble2 crmd[14247]: notice: Initiating cancel operation warble2-home-MDT0_monitor_20000 on warble1-host.oob Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 crmd[14247]: notice: Transition 41 (Complete=18, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-19.bz2): Complete Apr 7 22:57:36 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble1 stonith-ng[14599]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:36 warble2 stonith-ng[14243]: notice: On loss of CCM Quorum: Ignore Apr 7 22:57:41 warble1 kernel: LustreError: 226285:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-lwp-MDT0002: namespace resource [0x200000006:0x1010000:0x0].0x0 (ffff885e7573b440) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 22:57:41 warble1 kernel: LustreError: 226285:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff885e7573b440) refcount = 2 Apr 7 22:57:41 warble1 kernel: LustreError: 226285:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 22:57:42 warble1 kernel: LustreError: 226285:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-lwp-MDT0002 lock: ffff88bd729adc00/0x17c6bac8a45906f3 lrc: 2/1,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 3 type: PLN flags: 0x1106400000000 nid: local remote: 0xaea67cc134afcc9e expref: -99 pid: 92258 timeout: 0 lvb_type: 2 Apr 7 22:57:42 warble1 kernel: LustreError: 226285:0:(ldlm_resource.c:1688:ldlm_resource_dump()) Skipped 1 previous similar message Apr 7 22:57:42 warble1 kernel: Lustre: Failing over dagg-MDT0002 Apr 7 22:57:42 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 22:57:42 warble1 kernel: LustreError: 92263:0:(llog_osd.c:882:llog_osd_next_block()) dagg-MDT0000-osp-MDT0002: can't read llog block from log [0x2000013cb:0x1:0x0] offset 131072: rc = -5 Apr 7 22:57:42 warble1 kernel: LustreError: 14887:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 22:57:42 warble1 kernel: LustreError: 14887:0:(import.c:662:ptlrpc_connect_import()) Skipped 1 previous similar message Apr 7 22:57:42 warble1 kernel: LustreError: 92263:0:(llog.c:607:llog_process_thread()) dagg-MDT0000-osp-MDT0002 retry remote llog process Apr 7 22:57:42 warble1 kernel: LustreError: 92263:0:(llog.c:607:llog_process_thread()) Skipped 1 previous similar message Apr 7 22:57:42 warble1 kernel: LustreError: 92263:0:(lod_dev.c:419:lod_sub_recovery_thread()) dagg-MDT0000-osp-MDT0002 getting update log failed: rc = -11 Apr 7 22:57:42 warble1 kernel: LustreError: 92263:0:(lod_dev.c:419:lod_sub_recovery_thread()) Skipped 1 previous similar message Apr 7 22:57:42 warble1 kernel: LustreError: 226285:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) dagg-MDT0002: Aborting recovery Apr 7 22:57:42 warble1 kernel: LustreError: 226285:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) Skipped 1 previous similar message Apr 7 22:57:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:2048:target_recovery_overseer()) recovery is aborted, evict exports in recovery Apr 7 22:57:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:2048:target_recovery_overseer()) Skipped 5 previous similar messages Apr 7 22:57:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:2038:target_recovery_overseer()) dagg-MDT0002 recovery is aborted by hard timeout Apr 7 22:57:42 warble1 kernel: Lustre: 92447:0:(ldlm_lib.c:2038:target_recovery_overseer()) Skipped 3 previous similar messages Apr 7 22:57:42 warble1 kernel: Lustre: dagg-MDT0002: Recovery over after 199:58, of 125 clients 0 recovered and 125 were evicted. Apr 7 22:57:42 warble1 kernel: LustreError: 91458:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88bd63efc200 x1597074078969216/t0(0) o5->dagg-OST0000-osc-MDT0002@192.168.44.31@o2ib44:28/4 lens 432/432 e 0 to 0 dl 0 ref 2 fl Rpc:N/0/ffffffff rc 0/-1 Apr 7 22:57:42 warble1 kernel: LustreError: 91481:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) dagg-OST0002-osc-MDT0002: cannot cleanup orphans: rc = -5 Apr 7 22:57:42 warble1 kernel: LustreError: 91481:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) Skipped 30 previous similar messages Apr 7 22:57:42 warble1 kernel: LustreError: 91458:0:(client.c:1166:ptlrpc_import_delay_req()) Skipped 42 previous similar messages Apr 7 22:57:42 warble1 kernel: Lustre: dagg-MDT0002: Not available for connect from 192.168.44.32@o2ib44 (stopping) Apr 7 22:57:42 warble1 kernel: Lustre: Skipped 8 previous similar messages Apr 7 22:57:43 warble1 kernel: Lustre: server umount dagg-MDT0002 complete Apr 7 22:57:43 warble1 kernel: LustreError: 137-5: dagg-MDT0002_UUID: not available for connect from 192.168.44.34@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 22:57:43 warble1 kernel: LustreError: Skipped 36 previous similar messages Apr 7 22:57:44 warble1 kernel: LustreError: 137-5: dagg-MDT0002_UUID: not available for connect from 192.168.44.31@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 22:57:44 warble1 kernel: LustreError: Skipped 1 previous similar message Apr 7 22:57:44 warble1 kernel: LustreError: 226596:0:(ldlm_resource.c:1100:ldlm_resource_complain()) dagg-MDT0000-lwp-MDT0001: namespace resource [0x200000006:0x1010000:0x0].0x0 (ffff88bdbebdb500) refcount nonzero (1) after lock cleanup; forcing cleanup. Apr 7 22:57:44 warble1 kernel: LustreError: 226596:0:(ldlm_resource.c:1682:ldlm_resource_dump()) --- Resource: [0x200000006:0x1010000:0x0].0x0 (ffff88bdbebdb500) refcount = 2 Apr 7 22:57:44 warble1 kernel: LustreError: 226596:0:(ldlm_resource.c:1685:ldlm_resource_dump()) Granted locks (in reverse order): Apr 7 22:57:44 warble1 kernel: LustreError: 226596:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: dagg-MDT0000-lwp-MDT0001 lock: ffff88bd72eaa000/0x17c6bac8a458fd99 lrc: 2/1,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 3 type: PLN flags: 0x1106400000000 nid: local remote: 0xaea67cc134afcc7b expref: -99 pid: 90750 timeout: 0 lvb_type: 2 Apr 7 22:57:44 warble1 kernel: Lustre: Failing over dagg-MDT0001 Apr 7 22:57:44 warble1 kernel: LustreError: 90790:0:(llog_osd.c:882:llog_osd_next_block()) dagg-MDT0000-osp-MDT0001: can't read llog block from log [0x2000013ca:0x1:0x0] offset 163840: rc = -5 Apr 7 22:57:44 warble1 kernel: LustreError: 90790:0:(llog.c:607:llog_process_thread()) dagg-MDT0000-osp-MDT0001 retry remote llog process Apr 7 22:57:44 warble1 kernel: LustreError: 90790:0:(lod_dev.c:419:lod_sub_recovery_thread()) dagg-MDT0000-osp-MDT0001 getting update log failed: rc = -11 Apr 7 22:57:44 warble1 kernel: LustreError: 14887:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import Apr 7 22:57:44 warble1 kernel: LustreError: 226596:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) dagg-MDT0001: Aborting recovery Apr 7 22:57:44 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:2048:target_recovery_overseer()) recovery is aborted, evict exports in recovery Apr 7 22:57:44 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:2048:target_recovery_overseer()) Skipped 2 previous similar messages Apr 7 22:57:44 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:2038:target_recovery_overseer()) dagg-MDT0001 recovery is aborted by hard timeout Apr 7 22:57:44 warble1 kernel: Lustre: 91203:0:(ldlm_lib.c:2038:target_recovery_overseer()) Skipped 1 previous similar message Apr 7 22:57:44 warble1 kernel: Lustre: dagg-MDT0001: Recovery over after 200:00, of 125 clients 0 recovered and 125 were evicted. Apr 7 22:57:44 warble1 kernel: LustreError: 90348:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff885e85d7dd00 x1597074080043360/t0(0) o5->dagg-OST0002-osc-MDT0001@192.168.44.32@o2ib44:28/4 lens 432/432 e 0 to 0 dl 0 ref 2 fl Rpc:N/0/ffffffff rc 0/-1 Apr 7 22:57:44 warble1 kernel: LustreError: 90348:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) dagg-OST0002-osc-MDT0001: cannot cleanup orphans: rc = -5 Apr 7 22:57:44 warble1 kernel: LustreError: 90348:0:(osp_precreate.c:903:osp_precreate_cleanup_orphans()) Skipped 11 previous similar messages Apr 7 22:57:45 warble1 kernel: Lustre: server umount dagg-MDT0001 complete Apr 7 22:57:47 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.38@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 22:57:47 warble1 kernel: LustreError: Skipped 2 previous similar messages Apr 7 22:57:48 warble1 kernel: LustreError: 160112:0:(ldlm_lib.c:3226:target_bulk_io()) @@@ timeout on bulk WRITE after 6+0s req@ffff885e8f171450 x1597074078887744/t0(0) o1000->dagg-MDT0002-mdtlov_UUID@0@lo:578/0 lens 336/37088 e 0 to 0 dl 1523105868 ref 1 fl Interpret:/0/0 rc 0/0 Apr 7 22:57:49 warble1 kernel: LustreError: 137-5: dagg-MDT0002_UUID: not available for connect from 192.168.44.219@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 22:57:49 warble1 kernel: LustreError: Skipped 10 previous similar messages Apr 7 22:57:53 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.118@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 22:57:53 warble1 kernel: LustreError: Skipped 45 previous similar messages Apr 7 22:58:02 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.216@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 22:58:02 warble1 kernel: LustreError: Skipped 27 previous similar messages Apr 7 22:58:09 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523100731/real 1523100731] req@ffff885eb3c4d100 x1597071190085936/t0(0) o400->dagg-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 206 to 1 dl 1523105889 ref 1 fl Rpc:X/c0/ffffffff rc 0/-1 Apr 7 22:58:09 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 7 22:58:32 warble1 kernel: LustreError: 137-5: dagg-MDT0002_UUID: not available for connect from 192.168.44.32@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 22:58:32 warble1 kernel: LustreError: Skipped 183 previous similar messages Apr 7 22:58:41 warble1 kernel: Lustre: dagg-MDT0002: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 Apr 7 22:58:41 warble1 kernel: Lustre: Skipped 2 previous similar messages Apr 7 22:58:41 warble1 kernel: LustreError: 226981:0:(mdt_handler.c:6167:mdt_iocontrol()) dagg-MDT0002: Aborting recovery for device Apr 7 22:58:41 warble1 kernel: LustreError: 226981:0:(ldlm_lib.c:2595:target_stop_recovery_thread()) dagg-MDT0002: Aborting recovery Apr 7 22:58:41 warble1 kernel: Lustre: 227582:0:(ldlm_lib.c:2048:target_recovery_overseer()) recovery is aborted, evict exports in recovery Apr 7 22:58:42 warble1 kernel: Lustre: 227582:0:(ldlm_lib.c:2048:target_recovery_overseer()) Skipped 2 previous similar messages Apr 7 22:58:42 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 07243512-4d53-e3cb-a3a5-b5b1bf6eb45c (at 192.168.44.195@o2ib44) Apr 7 22:58:42 warble1 kernel: Lustre: Skipped 22 previous similar messages Apr 7 22:58:46 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 65792d98-a2c3-6d10-9792-03adbc33091b (at 192.168.44.168@o2ib44) Apr 7 22:58:46 warble1 kernel: Lustre: Skipped 4 previous similar messages Apr 7 22:58:46 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523105921/real 1523105921] req@ffff885e764c2d00 x1597074080048800/t0(0) o38->dagg-MDT0000-lwp-MDT0002@192.168.44.22@o2ib44:12/10 lens 520/544 e 0 to 1 dl 1523105926 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 22:58:46 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 7 22:58:48 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523105921/real 1523105921] req@ffff885e764c3600 x1597074080048160/t0(0) o38->dagg-MDT0002-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523105927 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 22:58:48 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 7 22:58:54 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 192.168.44.33@o2ib44 (at 192.168.44.33@o2ib44) Apr 7 22:58:54 warble1 kernel: Lustre: Skipped 120 previous similar messages Apr 7 22:59:04 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.181@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 22:59:04 warble1 kernel: LustreError: Skipped 80 previous similar messages Apr 7 22:59:12 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523105946/real 1523105946] req@ffff885e9f2acb00 x1597074080053200/t0(0) o38->dagg-MDT0001-osp-MDT0002@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523105952 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 22:59:12 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 7 22:59:20 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 192.168.44.37@o2ib44 (at 192.168.44.37@o2ib44) Apr 7 22:59:20 warble1 kernel: Lustre: Skipped 8 previous similar messages Apr 7 22:59:42 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523105971/real 1523105971] req@ffff885e9f2ab000 x1597074086085824/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523105982 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:00:07 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523105996/real 1523105996] req@ffff885e76ed0000 x1597074092120720/t0(0) o38->dagg-MDT0001-osp-MDT0002@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523106007 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:00:08 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.119@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 23:00:08 warble1 kernel: LustreError: Skipped 191 previous similar messages Apr 7 23:00:37 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523106021/real 1523106021] req@ffff885eb4498000 x1597074098162064/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523106037 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:01:32 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523106071/real 1523106071] req@ffff885e7b2e6900 x1597074110237184/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523106092 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:01:32 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 7 23:02:22 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.38@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 23:02:22 warble1 kernel: LustreError: Skipped 289 previous similar messages Apr 7 23:02:41 warble1 kernel: INFO: task mount.lustre:226981 blocked for more than 120 seconds. Apr 7 23:02:41 warble1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 7 23:02:41 warble1 kernel: mount.lustre D ffff88bd63c62f70 0 226981 226980 0x00000000 Apr 7 23:02:41 warble1 kernel: Call Trace: Apr 7 23:02:41 warble1 kernel: [] schedule+0x29/0x70 Apr 7 23:02:41 warble1 kernel: [] schedule_timeout+0x239/0x2c0 Apr 7 23:02:41 warble1 kernel: [] ? default_wake_function+0x12/0x20 Apr 7 23:02:41 warble1 kernel: [] ? autoremove_wake_function+0x2b/0x40 Apr 7 23:02:41 warble1 kernel: [] wait_for_completion+0xfd/0x140 Apr 7 23:02:41 warble1 kernel: [] ? wake_up_state+0x20/0x20 Apr 7 23:02:41 warble1 kernel: [] target_stop_recovery_thread.part.16+0x3d/0xd0 [ptlrpc] Apr 7 23:02:41 warble1 kernel: [] target_stop_recovery_thread+0x18/0x20 [ptlrpc] Apr 7 23:02:41 warble1 kernel: [] mdt_iocontrol+0x550/0xaf0 [mdt] Apr 7 23:02:41 warble1 kernel: [] server_start_targets+0x1be3/0x2a70 [obdclass] Apr 7 23:02:41 warble1 kernel: [] ? class_config_dump_handler+0x7e0/0x7e0 [obdclass] Apr 7 23:02:41 warble1 kernel: [] server_fill_super+0x108d/0x184c [obdclass] Apr 7 23:02:41 warble1 kernel: [] lustre_fill_super+0x328/0x950 [obdclass] Apr 7 23:02:41 warble1 kernel: [] ? lustre_common_put_super+0x270/0x270 [obdclass] Apr 7 23:02:41 warble1 kernel: [] mount_nodev+0x4d/0xb0 Apr 7 23:02:41 warble1 kernel: [] lustre_mount+0x38/0x60 [obdclass] Apr 7 23:02:41 warble1 kernel: [] mount_fs+0x39/0x1b0 Apr 7 23:02:41 warble1 kernel: [] vfs_kern_mount+0x67/0x110 Apr 7 23:02:41 warble1 kernel: [] do_mount+0x233/0xaf0 Apr 7 23:02:41 warble1 kernel: [] ? __get_free_pages+0xe/0x40 Apr 7 23:02:41 warble1 kernel: [] SyS_mount+0x96/0xf0 Apr 7 23:02:41 warble1 kernel: [] system_call_fastpath+0x16/0x1b Apr 7 23:02:52 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523106146/real 1523106146] req@ffff885e7c17d100 x1597074128374512/t0(0) o38->dagg-MDT0001-osp-MDT0002@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523106172 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:02:52 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Apr 7 23:04:41 warble1 kernel: INFO: task mount.lustre:226981 blocked for more than 120 seconds. Apr 7 23:04:41 warble1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 7 23:04:41 warble1 kernel: mount.lustre D ffff88bd63c62f70 0 226981 226980 0x00000000 Apr 7 23:04:41 warble1 kernel: Call Trace: Apr 7 23:04:41 warble1 kernel: [] schedule+0x29/0x70 Apr 7 23:04:41 warble1 kernel: [] schedule_timeout+0x239/0x2c0 Apr 7 23:04:41 warble1 kernel: [] ? default_wake_function+0x12/0x20 Apr 7 23:04:41 warble1 kernel: [] ? autoremove_wake_function+0x2b/0x40 Apr 7 23:04:41 warble1 kernel: [] wait_for_completion+0xfd/0x140 Apr 7 23:04:41 warble1 kernel: [] ? wake_up_state+0x20/0x20 Apr 7 23:04:41 warble1 kernel: [] target_stop_recovery_thread.part.16+0x3d/0xd0 [ptlrpc] Apr 7 23:04:41 warble1 kernel: [] target_stop_recovery_thread+0x18/0x20 [ptlrpc] Apr 7 23:04:41 warble1 kernel: [] mdt_iocontrol+0x550/0xaf0 [mdt] Apr 7 23:04:41 warble1 kernel: [] server_start_targets+0x1be3/0x2a70 [obdclass] Apr 7 23:04:41 warble1 kernel: [] ? class_config_dump_handler+0x7e0/0x7e0 [obdclass] Apr 7 23:04:41 warble1 kernel: [] server_fill_super+0x108d/0x184c [obdclass] Apr 7 23:04:41 warble1 kernel: [] lustre_fill_super+0x328/0x950 [obdclass] Apr 7 23:04:41 warble1 kernel: [] ? lustre_common_put_super+0x270/0x270 [obdclass] Apr 7 23:04:41 warble1 kernel: [] mount_nodev+0x4d/0xb0 Apr 7 23:04:41 warble1 kernel: [] lustre_mount+0x38/0x60 [obdclass] Apr 7 23:04:41 warble1 kernel: [] mount_fs+0x39/0x1b0 Apr 7 23:04:41 warble1 kernel: [] vfs_kern_mount+0x67/0x110 Apr 7 23:04:41 warble1 kernel: [] do_mount+0x233/0xaf0 Apr 7 23:04:41 warble1 kernel: [] ? __get_free_pages+0xe/0x40 Apr 7 23:04:41 warble1 kernel: [] SyS_mount+0x96/0xf0 Apr 7 23:04:41 warble1 kernel: [] system_call_fastpath+0x16/0x1b Apr 7 23:04:41 warble1 kernel: INFO: task mount.lustre:228584 blocked for more than 120 seconds. Apr 7 23:04:41 warble1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 7 23:04:41 warble1 kernel: mount.lustre D ffff885e89758fd0 0 228584 228583 0x00000000 Apr 7 23:04:41 warble1 kernel: Call Trace: Apr 7 23:04:41 warble1 kernel: [] schedule_preempt_disabled+0x29/0x70 Apr 7 23:04:41 warble1 kernel: [] __mutex_lock_slowpath+0xc7/0x1d0 Apr 7 23:04:41 warble1 kernel: [] mutex_lock+0x1f/0x2f Apr 7 23:04:41 warble1 kernel: [] mgc_set_info_async+0xa98/0x15f0 [mgc] Apr 7 23:04:41 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:04:41 warble1 kernel: [] server_start_targets+0x34e/0x2a70 [obdclass] Apr 7 23:04:41 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:04:41 warble1 kernel: [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] Apr 7 23:04:41 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:04:41 warble1 kernel: [] server_fill_super+0x108d/0x184c [obdclass] Apr 7 23:04:41 warble1 kernel: [] lustre_fill_super+0x328/0x950 [obdclass] Apr 7 23:04:41 warble1 kernel: [] ? lustre_common_put_super+0x270/0x270 [obdclass] Apr 7 23:04:41 warble1 kernel: [] mount_nodev+0x4d/0xb0 Apr 7 23:04:41 warble1 kernel: [] lustre_mount+0x38/0x60 [obdclass] Apr 7 23:04:41 warble1 kernel: [] mount_fs+0x39/0x1b0 Apr 7 23:04:41 warble1 kernel: [] vfs_kern_mount+0x67/0x110 Apr 7 23:04:41 warble1 kernel: [] do_mount+0x233/0xaf0 Apr 7 23:04:41 warble1 kernel: [] ? __get_free_pages+0xe/0x40 Apr 7 23:04:41 warble1 kernel: [] SyS_mount+0x96/0xf0 Apr 7 23:04:41 warble1 kernel: [] system_call_fastpath+0x16/0x1b Apr 7 23:05:07 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523106271/real 1523106271] req@ffff885e9f2ac800 x1597074158549104/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523106307 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:05:07 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Apr 7 23:06:39 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.176@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 23:06:39 warble1 kernel: LustreError: Skipped 511 previous similar messages Apr 7 23:06:41 warble1 kernel: INFO: task mount.lustre:226981 blocked for more than 120 seconds. Apr 7 23:06:41 warble1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 7 23:06:41 warble1 kernel: mount.lustre D ffff88bd63c62f70 0 226981 226980 0x00000000 Apr 7 23:06:41 warble1 kernel: Call Trace: Apr 7 23:06:41 warble1 kernel: [] schedule+0x29/0x70 Apr 7 23:06:41 warble1 kernel: [] schedule_timeout+0x239/0x2c0 Apr 7 23:06:41 warble1 kernel: [] ? default_wake_function+0x12/0x20 Apr 7 23:06:41 warble1 kernel: [] ? autoremove_wake_function+0x2b/0x40 Apr 7 23:06:41 warble1 kernel: [] wait_for_completion+0xfd/0x140 Apr 7 23:06:41 warble1 kernel: [] ? wake_up_state+0x20/0x20 Apr 7 23:06:41 warble1 kernel: [] target_stop_recovery_thread.part.16+0x3d/0xd0 [ptlrpc] Apr 7 23:06:41 warble1 kernel: [] target_stop_recovery_thread+0x18/0x20 [ptlrpc] Apr 7 23:06:41 warble1 kernel: [] mdt_iocontrol+0x550/0xaf0 [mdt] Apr 7 23:06:41 warble1 kernel: [] server_start_targets+0x1be3/0x2a70 [obdclass] Apr 7 23:06:41 warble1 kernel: [] ? class_config_dump_handler+0x7e0/0x7e0 [obdclass] Apr 7 23:06:41 warble1 kernel: [] server_fill_super+0x108d/0x184c [obdclass] Apr 7 23:06:41 warble1 kernel: [] lustre_fill_super+0x328/0x950 [obdclass] Apr 7 23:06:41 warble1 kernel: [] ? lustre_common_put_super+0x270/0x270 [obdclass] Apr 7 23:06:42 warble1 kernel: [] mount_nodev+0x4d/0xb0 Apr 7 23:06:42 warble1 kernel: [] lustre_mount+0x38/0x60 [obdclass] Apr 7 23:06:42 warble1 kernel: [] mount_fs+0x39/0x1b0 Apr 7 23:06:42 warble1 kernel: [] vfs_kern_mount+0x67/0x110 Apr 7 23:06:42 warble1 kernel: [] do_mount+0x233/0xaf0 Apr 7 23:06:42 warble1 kernel: [] ? __get_free_pages+0xe/0x40 Apr 7 23:06:42 warble1 kernel: [] SyS_mount+0x96/0xf0 Apr 7 23:06:42 warble1 kernel: [] system_call_fastpath+0x16/0x1b Apr 7 23:06:42 warble1 kernel: INFO: task mount.lustre:228584 blocked for more than 120 seconds. Apr 7 23:06:42 warble1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 7 23:06:42 warble1 kernel: mount.lustre D ffff885e89758fd0 0 228584 228583 0x00000000 Apr 7 23:06:42 warble1 kernel: Call Trace: Apr 7 23:06:42 warble1 kernel: [] schedule_preempt_disabled+0x29/0x70 Apr 7 23:06:42 warble1 kernel: [] __mutex_lock_slowpath+0xc7/0x1d0 Apr 7 23:06:42 warble1 kernel: [] mutex_lock+0x1f/0x2f Apr 7 23:06:42 warble1 kernel: [] mgc_set_info_async+0xa98/0x15f0 [mgc] Apr 7 23:06:42 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:06:42 warble1 kernel: [] server_start_targets+0x34e/0x2a70 [obdclass] Apr 7 23:06:42 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:06:42 warble1 kernel: [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] Apr 7 23:06:42 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:06:42 warble1 kernel: [] server_fill_super+0x108d/0x184c [obdclass] Apr 7 23:06:42 warble1 kernel: [] lustre_fill_super+0x328/0x950 [obdclass] Apr 7 23:06:42 warble1 kernel: [] ? lustre_common_put_super+0x270/0x270 [obdclass] Apr 7 23:06:42 warble1 kernel: [] mount_nodev+0x4d/0xb0 Apr 7 23:06:42 warble1 kernel: [] lustre_mount+0x38/0x60 [obdclass] Apr 7 23:06:42 warble1 kernel: [] mount_fs+0x39/0x1b0 Apr 7 23:06:42 warble1 kernel: [] vfs_kern_mount+0x67/0x110 Apr 7 23:06:42 warble1 kernel: [] do_mount+0x233/0xaf0 Apr 7 23:06:42 warble1 kernel: [] ? __get_free_pages+0xe/0x40 Apr 7 23:06:42 warble1 kernel: [] SyS_mount+0x96/0xf0 Apr 7 23:06:42 warble1 kernel: [] system_call_fastpath+0x16/0x1b Apr 7 23:08:42 warble1 kernel: INFO: task mount.lustre:226981 blocked for more than 120 seconds. Apr 7 23:08:42 warble1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 7 23:08:42 warble1 kernel: mount.lustre D ffff88bd63c62f70 0 226981 226980 0x00000000 Apr 7 23:08:42 warble1 kernel: Call Trace: Apr 7 23:08:42 warble1 kernel: [] schedule+0x29/0x70 Apr 7 23:08:42 warble1 kernel: [] schedule_timeout+0x239/0x2c0 Apr 7 23:08:42 warble1 kernel: [] ? default_wake_function+0x12/0x20 Apr 7 23:08:42 warble1 kernel: [] ? autoremove_wake_function+0x2b/0x40 Apr 7 23:08:42 warble1 kernel: [] wait_for_completion+0xfd/0x140 Apr 7 23:08:42 warble1 kernel: [] ? wake_up_state+0x20/0x20 Apr 7 23:08:42 warble1 kernel: [] target_stop_recovery_thread.part.16+0x3d/0xd0 [ptlrpc] Apr 7 23:08:42 warble1 kernel: [] target_stop_recovery_thread+0x18/0x20 [ptlrpc] Apr 7 23:08:42 warble1 kernel: [] mdt_iocontrol+0x550/0xaf0 [mdt] Apr 7 23:08:42 warble1 kernel: [] server_start_targets+0x1be3/0x2a70 [obdclass] Apr 7 23:08:42 warble1 kernel: [] ? class_config_dump_handler+0x7e0/0x7e0 [obdclass] Apr 7 23:08:42 warble1 kernel: [] server_fill_super+0x108d/0x184c [obdclass] Apr 7 23:08:42 warble1 kernel: [] lustre_fill_super+0x328/0x950 [obdclass] Apr 7 23:08:42 warble1 kernel: [] ? lustre_common_put_super+0x270/0x270 [obdclass] Apr 7 23:08:42 warble1 kernel: [] mount_nodev+0x4d/0xb0 Apr 7 23:08:42 warble1 kernel: [] lustre_mount+0x38/0x60 [obdclass] Apr 7 23:08:42 warble1 kernel: [] mount_fs+0x39/0x1b0 Apr 7 23:08:42 warble1 kernel: [] vfs_kern_mount+0x67/0x110 Apr 7 23:08:42 warble1 kernel: [] do_mount+0x233/0xaf0 Apr 7 23:08:42 warble1 kernel: [] ? __get_free_pages+0xe/0x40 Apr 7 23:08:42 warble1 kernel: [] SyS_mount+0x96/0xf0 Apr 7 23:08:42 warble1 kernel: [] system_call_fastpath+0x16/0x1b Apr 7 23:08:42 warble1 kernel: INFO: task mount.lustre:228584 blocked for more than 120 seconds. Apr 7 23:08:42 warble1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 7 23:08:42 warble1 kernel: mount.lustre D ffff885e89758fd0 0 228584 228583 0x00000000 Apr 7 23:08:42 warble1 kernel: Call Trace: Apr 7 23:08:42 warble1 kernel: [] schedule_preempt_disabled+0x29/0x70 Apr 7 23:08:42 warble1 kernel: [] __mutex_lock_slowpath+0xc7/0x1d0 Apr 7 23:08:42 warble1 kernel: [] mutex_lock+0x1f/0x2f Apr 7 23:08:42 warble1 kernel: [] mgc_set_info_async+0xa98/0x15f0 [mgc] Apr 7 23:08:42 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:08:42 warble1 kernel: [] server_start_targets+0x34e/0x2a70 [obdclass] Apr 7 23:08:42 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:08:42 warble1 kernel: [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] Apr 7 23:08:42 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:08:42 warble1 kernel: [] server_fill_super+0x108d/0x184c [obdclass] Apr 7 23:08:42 warble1 kernel: [] lustre_fill_super+0x328/0x950 [obdclass] Apr 7 23:08:42 warble1 kernel: [] ? lustre_common_put_super+0x270/0x270 [obdclass] Apr 7 23:08:42 warble1 kernel: [] mount_nodev+0x4d/0xb0 Apr 7 23:08:42 warble1 kernel: [] lustre_mount+0x38/0x60 [obdclass] Apr 7 23:08:42 warble1 kernel: [] mount_fs+0x39/0x1b0 Apr 7 23:08:42 warble1 kernel: [] vfs_kern_mount+0x67/0x110 Apr 7 23:08:42 warble1 kernel: [] do_mount+0x233/0xaf0 Apr 7 23:08:42 warble1 kernel: [] ? __get_free_pages+0xe/0x40 Apr 7 23:08:42 warble1 kernel: [] SyS_mount+0x96/0xf0 Apr 7 23:08:42 warble1 kernel: [] system_call_fastpath+0x16/0x1b Apr 7 23:09:32 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523106521/real 1523106521] req@ffff885e9ea6d700 x1597074218888544/t0(0) o38->dagg-MDT0001-osp-MDT0002@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523106572 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:09:32 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 6 previous similar messages Apr 7 23:10:42 warble1 kernel: INFO: task mount.lustre:226981 blocked for more than 120 seconds. Apr 7 23:10:42 warble1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 7 23:10:42 warble1 kernel: mount.lustre D ffff88bd63c62f70 0 226981 226980 0x00000000 Apr 7 23:10:42 warble1 kernel: Call Trace: Apr 7 23:10:42 warble1 kernel: [] schedule+0x29/0x70 Apr 7 23:10:42 warble1 kernel: [] schedule_timeout+0x239/0x2c0 Apr 7 23:10:42 warble1 kernel: [] ? default_wake_function+0x12/0x20 Apr 7 23:10:42 warble1 kernel: [] ? autoremove_wake_function+0x2b/0x40 Apr 7 23:10:42 warble1 kernel: [] wait_for_completion+0xfd/0x140 Apr 7 23:10:42 warble1 kernel: [] ? wake_up_state+0x20/0x20 Apr 7 23:10:42 warble1 kernel: [] target_stop_recovery_thread.part.16+0x3d/0xd0 [ptlrpc] Apr 7 23:10:42 warble1 kernel: [] target_stop_recovery_thread+0x18/0x20 [ptlrpc] Apr 7 23:10:42 warble1 kernel: [] mdt_iocontrol+0x550/0xaf0 [mdt] Apr 7 23:10:42 warble1 kernel: [] server_start_targets+0x1be3/0x2a70 [obdclass] Apr 7 23:10:42 warble1 kernel: [] ? class_config_dump_handler+0x7e0/0x7e0 [obdclass] Apr 7 23:10:42 warble1 kernel: [] server_fill_super+0x108d/0x184c [obdclass] Apr 7 23:10:42 warble1 kernel: [] lustre_fill_super+0x328/0x950 [obdclass] Apr 7 23:10:42 warble1 kernel: [] ? lustre_common_put_super+0x270/0x270 [obdclass] Apr 7 23:10:42 warble1 kernel: [] mount_nodev+0x4d/0xb0 Apr 7 23:10:42 warble1 kernel: [] lustre_mount+0x38/0x60 [obdclass] Apr 7 23:10:42 warble1 kernel: [] mount_fs+0x39/0x1b0 Apr 7 23:10:42 warble1 kernel: [] vfs_kern_mount+0x67/0x110 Apr 7 23:10:42 warble1 kernel: [] do_mount+0x233/0xaf0 Apr 7 23:10:42 warble1 kernel: [] ? __get_free_pages+0xe/0x40 Apr 7 23:10:42 warble1 kernel: [] SyS_mount+0x96/0xf0 Apr 7 23:10:42 warble1 kernel: [] system_call_fastpath+0x16/0x1b Apr 7 23:10:42 warble1 kernel: INFO: task mount.lustre:228584 blocked for more than 120 seconds. Apr 7 23:10:42 warble1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 7 23:10:42 warble1 kernel: mount.lustre D ffff885e89758fd0 0 228584 228583 0x00000000 Apr 7 23:10:42 warble1 kernel: Call Trace: Apr 7 23:10:42 warble1 kernel: [] schedule_preempt_disabled+0x29/0x70 Apr 7 23:10:42 warble1 kernel: [] __mutex_lock_slowpath+0xc7/0x1d0 Apr 7 23:10:42 warble1 kernel: [] mutex_lock+0x1f/0x2f Apr 7 23:10:42 warble1 kernel: [] mgc_set_info_async+0xa98/0x15f0 [mgc] Apr 7 23:10:42 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:10:42 warble1 kernel: [] server_start_targets+0x34e/0x2a70 [obdclass] Apr 7 23:10:42 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:10:42 warble1 kernel: [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] Apr 7 23:10:42 warble1 kernel: [] ? libcfs_debug_msg+0x57/0x80 [libcfs] Apr 7 23:10:42 warble1 kernel: [] server_fill_super+0x108d/0x184c [obdclass] Apr 7 23:10:42 warble1 kernel: [] lustre_fill_super+0x328/0x950 [obdclass] Apr 7 23:10:42 warble1 kernel: [] ? lustre_common_put_super+0x270/0x270 [obdclass] Apr 7 23:10:42 warble1 kernel: [] mount_nodev+0x4d/0xb0 Apr 7 23:10:42 warble1 kernel: [] lustre_mount+0x38/0x60 [obdclass] Apr 7 23:10:42 warble1 kernel: [] mount_fs+0x39/0x1b0 Apr 7 23:10:42 warble1 kernel: [] vfs_kern_mount+0x67/0x110 Apr 7 23:10:42 warble1 kernel: [] do_mount+0x233/0xaf0 Apr 7 23:10:42 warble1 kernel: [] ? __get_free_pages+0xe/0x40 Apr 7 23:10:42 warble1 kernel: [] SyS_mount+0x96/0xf0 Apr 7 23:10:42 warble1 kernel: [] system_call_fastpath+0x16/0x1b Apr 7 23:12:36 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 23:12:36 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 23:12:36 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 7 23:12:36 warble2 pengine[14246]: notice: Calculated transition 42, saving inputs in /var/lib/pacemaker/pengine/pe-input-20.bz2 Apr 7 23:12:36 warble2 crmd[14247]: notice: Transition 42 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-20.bz2): Complete Apr 7 23:12:36 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 23:12:42 warble1 kernel: INFO: task mount.lustre:226981 blocked for more than 120 seconds. Apr 7 23:12:42 warble1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Apr 7 23:12:42 warble1 kernel: mount.lustre D ffff88bd63c62f70 0 226981 226980 0x00000000 Apr 7 23:12:42 warble1 kernel: Call Trace: Apr 7 23:12:42 warble1 kernel: [] schedule+0x29/0x70 Apr 7 23:12:42 warble1 kernel: [] schedule_timeout+0x239/0x2c0 Apr 7 23:12:42 warble1 kernel: [] ? default_wake_function+0x12/0x20 Apr 7 23:12:42 warble1 kernel: [] ? autoremove_wake_function+0x2b/0x40 Apr 7 23:12:42 warble1 kernel: [] wait_for_completion+0xfd/0x140 Apr 7 23:12:42 warble1 kernel: [] ? wake_up_state+0x20/0x20 Apr 7 23:12:42 warble1 kernel: [] target_stop_recovery_thread.part.16+0x3d/0xd0 [ptlrpc] Apr 7 23:12:42 warble1 kernel: [] target_stop_recovery_thread+0x18/0x20 [ptlrpc] Apr 7 23:12:42 warble1 kernel: [] mdt_iocontrol+0x550/0xaf0 [mdt] Apr 7 23:12:42 warble1 kernel: [] server_start_targets+0x1be3/0x2a70 [obdclass] Apr 7 23:12:42 warble1 kernel: [] ? class_config_dump_handler+0x7e0/0x7e0 [obdclass] Apr 7 23:12:42 warble1 kernel: [] server_fill_super+0x108d/0x184c [obdclass] Apr 7 23:12:42 warble1 kernel: [] lustre_fill_super+0x328/0x950 [obdclass] Apr 7 23:12:42 warble1 kernel: [] ? lustre_common_put_super+0x270/0x270 [obdclass] Apr 7 23:12:43 warble1 kernel: [] mount_nodev+0x4d/0xb0 Apr 7 23:12:43 warble1 kernel: [] lustre_mount+0x38/0x60 [obdclass] Apr 7 23:12:43 warble1 kernel: [] mount_fs+0x39/0x1b0 Apr 7 23:12:43 warble1 kernel: [] vfs_kern_mount+0x67/0x110 Apr 7 23:12:43 warble1 kernel: [] do_mount+0x233/0xaf0 Apr 7 23:12:43 warble1 kernel: [] ? __get_free_pages+0xe/0x40 Apr 7 23:12:43 warble1 kernel: [] SyS_mount+0x96/0xf0 Apr 7 23:12:43 warble1 kernel: [] system_call_fastpath+0x16/0x1b Apr 7 23:15:42 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.38@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 23:15:42 warble1 kernel: LustreError: Skipped 738 previous similar messages Apr 7 23:18:22 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523107096/real 1523107096] req@ffff88bdcdf9e000 x1597074357730336/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523107102 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:18:22 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 10 previous similar messages Apr 7 23:25:45 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.219@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 23:25:45 warble1 kernel: LustreError: Skipped 1248 previous similar messages Apr 7 23:27:36 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 23:27:36 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 23:27:36 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 7 23:27:36 warble2 pengine[14246]: notice: Calculated transition 43, saving inputs in /var/lib/pacemaker/pengine/pe-input-20.bz2 Apr 7 23:27:36 warble2 crmd[14247]: notice: Transition 43 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-20.bz2): Complete Apr 7 23:27:36 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 23:28:42 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523107671/real 1523107671] req@ffff885e77dfe300 x1597074496539808/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523107722 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:28:42 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 17 previous similar messages Apr 7 23:35:45 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.190@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 23:35:45 warble1 kernel: LustreError: Skipped 913 previous similar messages Apr 7 23:38:52 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523108321/real 1523108321] req@ffff885e9e9a0300 x1597074653446688/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523108332 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:38:52 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 12 previous similar messages Apr 7 23:42:36 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 23:42:36 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 23:42:36 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 7 23:42:36 warble2 pengine[14246]: notice: Calculated transition 44, saving inputs in /var/lib/pacemaker/pengine/pe-input-20.bz2 Apr 7 23:42:36 warble2 crmd[14247]: notice: Transition 44 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-20.bz2): Complete Apr 7 23:42:36 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 7 23:45:46 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 23:45:46 warble1 kernel: LustreError: Skipped 1172 previous similar messages Apr 7 23:49:22 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523108921/real 1523108921] req@ffff885e6fb16c00 x1597074798363872/t0(0) o38->dagg-MDT0001-osp-MDT0002@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523108962 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 7 23:49:22 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 17 previous similar messages Apr 7 23:55:59 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.205@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 7 23:55:59 warble1 kernel: LustreError: Skipped 969 previous similar messages Apr 7 23:57:36 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 7 23:57:36 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 7 23:57:36 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 7 23:57:36 warble2 pengine[14246]: notice: Calculated transition 45, saving inputs in /var/lib/pacemaker/pengine/pe-input-20.bz2 Apr 7 23:57:36 warble2 crmd[14247]: notice: Transition 45 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-20.bz2): Complete Apr 7 23:57:36 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 00:00:07 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523109596/real 1523109596] req@ffff885eb0b3e000 x1597074961258784/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523109607 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 00:00:07 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 13 previous similar messages Apr 8 00:06:04 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.151@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 00:06:04 warble1 kernel: LustreError: Skipped 1118 previous similar messages Apr 8 00:10:37 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523110196/real 1523110196] req@ffff88bd75675a00 x1597075106042000/t0(0) o38->dagg-MDT0001-osp-MDT0002@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523110237 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 00:10:37 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 17 previous similar messages Apr 8 00:12:36 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 00:12:36 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 8 00:12:36 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 8 00:12:36 warble2 pengine[14246]: notice: Calculated transition 46, saving inputs in /var/lib/pacemaker/pengine/pe-input-20.bz2 Apr 8 00:12:36 warble2 crmd[14247]: notice: Transition 46 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-20.bz2): Complete Apr 8 00:12:36 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 00:16:07 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.38@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 00:16:07 warble1 kernel: LustreError: Skipped 965 previous similar messages Apr 8 00:21:22 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523110871/real 1523110871] req@ffff885e6f5eef00 x1597075268959280/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523110882 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 00:21:22 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 13 previous similar messages Apr 8 00:26:07 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.130@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 00:26:07 warble1 kernel: LustreError: Skipped 1123 previous similar messages Apr 8 00:27:36 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 00:27:36 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 8 00:27:36 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 8 00:27:36 warble2 pengine[14246]: notice: Calculated transition 47, saving inputs in /var/lib/pacemaker/pengine/pe-input-20.bz2 Apr 8 00:27:36 warble2 crmd[14247]: notice: Transition 47 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-20.bz2): Complete Apr 8 00:27:36 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 00:31:52 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523111471/real 1523111471] req@ffff885e6fe26900 x1597075413956944/t0(0) o38->dagg-MDT0001-osp-MDT0002@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523111512 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 00:31:52 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 17 previous similar messages Apr 8 00:36:07 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.130@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 00:36:07 warble1 kernel: LustreError: Skipped 1019 previous similar messages Apr 8 00:42:36 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 00:42:36 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 8 00:42:36 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 8 00:42:36 warble2 pengine[14246]: notice: Calculated transition 48, saving inputs in /var/lib/pacemaker/pengine/pe-input-20.bz2 Apr 8 00:42:36 warble2 crmd[14247]: notice: Transition 48 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-20.bz2): Complete Apr 8 00:42:36 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 00:42:37 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523112146/real 1523112146] req@ffff885e90c7c200 x1597075577024896/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523112157 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 00:42:37 warble1 kernel: Lustre: 14887:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 13 previous similar messages Apr 8 00:46:07 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.102@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 00:46:07 warble1 kernel: LustreError: Skipped 1047 previous similar messages Apr 8 00:48:12 warble1 systemd: Stopped target Timers. Apr 8 00:48:12 warble1 systemd: Stopping Timers. Apr 8 00:48:12 warble1 systemd: Stopping Ganglia Monitoring Daemon... Apr 8 00:48:12 warble1 systemd: Stopping Authorization Manager... Apr 8 00:48:12 warble1 systemd: Unmounting RPC Pipe File System... Apr 8 00:48:12 warble1 systemd: Stopped Daily Cleanup of Temporary Directories. Apr 8 00:48:12 warble1 systemd: Stopping Daily Cleanup of Temporary Directories. Apr 8 00:48:12 warble1 systemd: Stopping RPC bind service... Apr 8 00:48:12 warble1 systemd: Stopping RDMA Node Description Daemon... Apr 8 00:48:12 warble1 systemd: Stopping LVM2 PV scan on device 8:2... Apr 8 00:48:12 warble1 systemd: Stopping Pacemaker High Availability Cluster Manager... Apr 8 00:48:12 warble1 pacemakerd[14597]: notice: Caught 'Terminated' signal Apr 8 00:48:12 warble1 pacemakerd[14597]: notice: Shutting down Pacemaker Apr 8 00:48:12 warble1 pacemakerd[14597]: notice: Stopping crmd Apr 8 00:48:12 warble1 systemd: Stopping Availability of block devices... Apr 8 00:48:12 warble1 crmd[14603]: notice: Caught 'Terminated' signal Apr 8 00:48:12 warble1 systemd: Stopped Dump dmesg to /var/log/dmesg. Apr 8 00:48:12 warble1 crmd[14603]: notice: Shutting down cluster resource manager Apr 8 00:48:12 warble1 systemd: Stopping Dump dmesg to /var/log/dmesg... Apr 8 00:48:12 warble1 multipathd: vol-mgt-a: stop event checker thread (140161582855936) Apr 8 00:48:12 warble1 systemd: Stopping Device-Mapper Multipath Device Controller... Apr 8 00:48:12 warble1 multipathd: vol-mgt-b: stop event checker thread (140161582409472) Apr 8 00:48:12 warble1 multipathd: vol-mdt0-a: stop event checker thread (140161582376704) Apr 8 00:48:12 warble1 multipathd: vol-mdt0-b: stop event checker thread (140161582343936) Apr 8 00:48:12 warble1 multipathd: vol-mdt1-a: stop event checker thread (140161582311168) Apr 8 00:48:12 warble1 multipathd: vol-mdt1-b: stop event checker thread (140161582278400) Apr 8 00:48:12 warble1 multipathd: vol-mdt2-a: stop event checker thread (140161582245632) Apr 8 00:48:12 warble1 multipathd: vol-mdt2-b: stop event checker thread (140161582212864) Apr 8 00:48:12 warble1 multipathd: vol-home-a: stop event checker thread (140161582180096) Apr 8 00:48:12 warble1 multipathd: vol-home-b: stop event checker thread (140161582147328) Apr 8 00:48:12 warble1 multipathd: vol-images-system-a: stop event checker thread (140161582114560) Apr 8 00:48:12 warble1 multipathd: vol-images-system-b: stop event checker thread (140161582081792) Apr 8 00:48:12 warble1 multipathd: vol-apps-a: stop event checker thread (140161582049024) Apr 8 00:48:12 warble1 multipathd: vol-apps-b: stop event checker thread (140161582016256) Apr 8 00:48:12 warble1 multipathd: --------shut down------- Apr 8 00:48:12 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 00:48:12 warble1 systemd: Stopped RDMA Node Description Daemon. Apr 8 00:48:12 warble1 systemd: Stopped RPC bind service. Apr 8 00:48:12 warble1 systemd: Stopped Authorization Manager. Apr 8 00:48:12 warble1 systemd: Stopped Ganglia Monitoring Daemon. Apr 8 00:48:12 warble1 systemd: Stopped target Multi-User System. Apr 8 00:48:12 warble1 ntpd[14521]: ntpd exiting on signal 15 Apr 8 00:48:12 warble1 systemd: Stopping Multi-User System. Apr 8 00:48:12 warble1 systemd: Stopping Network Time Service... Apr 8 00:48:12 warble1 systemd: Stopping SYSV: pslogger process logger... Apr 8 00:48:12 warble1 systemd: Stopped Builds and install new kernel modules through DKMS. Apr 8 00:48:12 warble1 systemd: Stopping Builds and install new kernel modules through DKMS... Apr 8 00:48:12 warble1 blkdeactivate: Deactivating block devices: Apr 8 00:48:12 warble1 systemd: Stopped Resets System Activity Logs. Apr 8 00:48:12 warble1 systemd: Stopping Resets System Activity Logs... Apr 8 00:48:12 warble1 systemd: Stopping D-Bus System Message Bus... Apr 8 00:48:12 warble1 systemd: Stopping Login Service... Apr 8 00:48:12 warble1 systemd: Stopping Postfix Mail Transport Agent... Apr 8 00:48:12 warble1 systemd: Stopping Machine Check Exception Logging Daemon... Apr 8 00:48:12 warble1 systemd: Stopping ZFS Event Daemon (zed)... Apr 8 00:48:12 warble1 zed: Exiting Apr 8 00:48:12 warble1 systemd: Stopping OpenSSH server daemon... Apr 8 00:48:12 warble1 systemd: Stopped target Login Prompts. Apr 8 00:48:12 warble1 systemd: Stopping Login Prompts. Apr 8 00:48:12 warble1 systemd: Stopping Getty on tty1... Apr 8 00:48:12 warble1 systemd: Stopping Serial Getty on ttyS0... Apr 8 00:48:12 warble1 systemd: Stopping PCS GUI and remote configuration interface... Apr 8 00:48:12 warble1 pslogger: Shutting down pslogger: Apr 8 00:48:12 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 8 00:48:12 warble1 blkdeactivate: [SKIP]: unmount of centos-swap (dm-14) mounted on [SWAP] Apr 8 00:48:12 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 8 00:48:12 warble2 pengine[14246]: notice: Scheduling Node warble1-host.oob for shutdown Apr 8 00:48:12 warble2 pengine[14246]: notice: * Shutdown warble1-host.oob Apr 8 00:48:12 warble2 pengine[14246]: notice: Calculated transition 49, saving inputs in /var/lib/pacemaker/pengine/pe-input-21.bz2 Apr 8 00:48:12 warble1 systemd: Stopping irqbalance daemon... Apr 8 00:48:12 warble2 crmd[14247]: notice: Transition 49 (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-21.bz2): Complete Apr 8 00:48:12 warble2 crmd[14247]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 00:48:12 warble1 crmd[14603]: notice: State transition S_NOT_DC -> S_STOPPING Apr 8 00:48:12 warble1 crmd[14603]: error: 18 resources were active at shutdown. Apr 8 00:48:12 warble1 crmd[14603]: notice: Disconnected from the LRM Apr 8 00:48:12 warble2 crmd[14247]: notice: do_shutdown of peer warble1-host.oob is complete Apr 8 00:48:12 warble1 crmd[14603]: notice: Disconnected from Corosync Apr 8 00:48:12 warble1 cib[14598]: warning: new_event_notification (14598-14603-12): Broken pipe (32) Apr 8 00:48:12 warble1 crmd[14603]: notice: Disconnected from the CIB Apr 8 00:48:12 warble1 cib[14598]: warning: A-Sync reply to crmd failed: No message of desired type Apr 8 00:48:12 warble1 pacemakerd[14597]: notice: Stopping pengine Apr 8 00:48:12 warble1 pengine[14602]: notice: Caught 'Terminated' signal Apr 8 00:48:12 warble1 pacemakerd[14597]: notice: Stopping attrd Apr 8 00:48:12 warble1 attrd[14601]: notice: Caught 'Terminated' signal Apr 8 00:48:12 warble1 pacemakerd[14597]: notice: Stopping lrmd Apr 8 00:48:12 warble1 lrmd[14600]: notice: Caught 'Terminated' signal Apr 8 00:48:12 warble2 attrd[14245]: notice: Node warble1-host.oob state is now lost Apr 8 00:48:12 warble1 pacemakerd[14597]: notice: Stopping stonith-ng Apr 8 00:48:12 warble2 attrd[14245]: notice: Removing all warble1-host.oob attributes for peer loss Apr 8 00:48:12 warble2 attrd[14245]: notice: Purged 1 peers with id=1 and/or uname=warble1-host.oob from the membership cache Apr 8 00:48:12 warble1 stonith-ng[14599]: notice: Caught 'Terminated' signal Apr 8 00:48:12 warble1 cib[14598]: warning: new_event_notification (14598-14599-11): Broken pipe (32) Apr 8 00:48:12 warble1 cib[14598]: warning: Notification of client stonithd/17e3f136-b58d-4a41-88a0-05a4929ab14f failed Apr 8 00:48:12 warble1 pacemakerd[14597]: notice: Stopping cib Apr 8 00:48:12 warble1 cib[14598]: notice: Caught 'Terminated' signal Apr 8 00:48:12 warble2 stonith-ng[14243]: notice: Node warble1-host.oob state is now lost Apr 8 00:48:12 warble2 stonith-ng[14243]: notice: Purged 1 peers with id=1 and/or uname=warble1-host.oob from the membership cache Apr 8 00:48:12 warble1 cib[14598]: notice: Disconnected from Corosync Apr 8 00:48:12 warble2 cib[14242]: notice: Node warble1-host.oob state is now lost Apr 8 00:48:12 warble1 cib[14598]: notice: Disconnected from Corosync Apr 8 00:48:12 warble2 cib[14242]: notice: Purged 1 peers with id=1 and/or uname=warble1-host.oob from the membership cache Apr 8 00:48:12 warble1 systemd: Unmounted /mnt/root. Apr 8 00:48:12 warble1 pacemakerd[14597]: notice: Shutdown complete Apr 8 00:48:12 warble1 systemd: Stopped Device-Mapper Multipath Device Controller. Apr 8 00:48:12 warble1 systemd: Stopped OpenSSH server daemon. Apr 8 00:48:12 warble1 kernel: XFS (dm-16): Unmounting Filesystem Apr 8 00:48:12 warble1 blkdeactivate: [UMOUNT]: unmounting centos-root (dm-16) mounted on /mnt/root... done Apr 8 00:48:12 warble1 systemd: Stopped ZFS Event Daemon (zed). Apr 8 00:48:12 warble1 systemd: Stopped D-Bus System Message Bus. Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-mgt-a (dm-0)... skipping Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-mgt-b (dm-1)... skipping Apr 8 00:48:12 warble1 systemd: Stopped Machine Check Exception Logging Daemon. Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-mdt0-a (dm-2)... skipping Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-mdt0-b (dm-3)... skipping Apr 8 00:48:12 warble1 systemd: Stopped Login Service. Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-mdt1-a (dm-4)... skipping Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-mdt1-b (dm-5)... skipping Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-mdt2-a (dm-6)... skipping Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-mdt2-b (dm-7)... skipping Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-home-a (dm-8)... skipping Apr 8 00:48:12 warble1 systemd: Stopped Getty on tty1. Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-home-b (dm-9)... skipping Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-images-system-a (dm-10)... skipping Apr 8 00:48:12 warble1 systemd: Stopped Serial Getty on ttyS0. Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-images-system-b (dm-11)... skipping Apr 8 00:48:12 warble1 systemd: Stopped irqbalance daemon. Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-apps-a (dm-12)... skipping Apr 8 00:48:12 warble1 blkdeactivate: [DM]: deactivating mpath device vol-apps-b (dm-13)... skipping Apr 8 00:48:12 warble1 systemd: Stopped PCS GUI and remote configuration interface. Apr 8 00:48:12 warble1 systemd: Stopped Network Time Service. Apr 8 00:48:12 warble1 systemd: Stopped Pacemaker High Availability Cluster Manager. Apr 8 00:48:12 warble1 systemd: Unmounted RPC Pipe File System. Apr 8 00:48:12 warble1 systemd: Stopped LVM2 PV scan on device 8:2. Apr 8 00:48:12 warble1 systemd: Stopped Availability of block devices. Apr 8 00:48:12 warble1 systemd: Stopped SYSV: pslogger process logger. Apr 8 00:48:12 warble1 systemd: Stopped Postfix Mail Transport Agent. Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 lvmetad[4275]: Failed to accept connection errno 11. Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:12 warble1 systemd: Stopping LVM2 metadata daemon... Apr 8 00:48:12 warble1 systemd: Removed slice system-lvm2\x2dpvscan.slice. Apr 8 00:48:12 warble1 systemd: Stopping system-lvm2\x2dpvscan.slice. Apr 8 00:48:13 warble2 corosync[14228]: [TOTEM ] A new membership (10.7.2.232:180) was formed. Members left: 1 Apr 8 00:48:13 warble2 corosync[14228]: [QUORUM] Members[1]: 2 Apr 8 00:48:13 warble2 corosync[14228]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 00:48:13 warble2 crmd[14247]: notice: Node warble1-host.oob state is now lost Apr 8 00:48:13 warble2 pacemakerd[14241]: notice: Node warble1-host.oob state is now lost Apr 8 00:48:13 warble2 crmd[14247]: notice: do_shutdown of peer warble1-host.oob is complete Apr 8 00:48:43 warble2 systemd: Stopped target Timers. Apr 8 00:48:43 warble2 systemd: Stopping Timers. Apr 8 00:48:43 warble2 systemd: Unmounting RPC Pipe File System... Apr 8 00:48:43 warble2 systemd: Stopped Dump dmesg to /var/log/dmesg. Apr 8 00:48:43 warble2 systemd: Stopping Dump dmesg to /var/log/dmesg... Apr 8 00:48:43 warble2 pacemakerd[14241]: notice: Caught 'Terminated' signal Apr 8 00:48:43 warble2 systemd: Stopping Pacemaker High Availability Cluster Manager... Apr 8 00:48:43 warble2 pacemakerd[14241]: notice: Shutting down Pacemaker Apr 8 00:48:43 warble2 systemd: Stopping RDMA Node Description Daemon... Apr 8 00:48:43 warble2 pacemakerd[14241]: notice: Stopping crmd Apr 8 00:48:43 warble2 systemd: Stopping LVM2 PV scan on device 8:2... Apr 8 00:48:43 warble2 crmd[14247]: notice: Caught 'Terminated' signal Apr 8 00:48:43 warble2 systemd: Stopping Ganglia Monitoring Daemon... Apr 8 00:48:43 warble2 crmd[14247]: notice: Shutting down cluster resource manager Apr 8 00:48:43 warble2 systemd: Stopping Device-Mapper Multipath Device Controller... Apr 8 00:48:43 warble2 crmd[14247]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 00:48:43 warble2 systemd: Stopped Daily Cleanup of Temporary Directories. Apr 8 00:48:43 warble2 multipathd: vol-mgt-b: stop event checker thread (140064937690880) Apr 8 00:48:43 warble2 systemd: Stopping Daily Cleanup of Temporary Directories. Apr 8 00:48:43 warble2 multipathd: vol-mdt0-a: stop event checker thread (140064937658112) Apr 8 00:48:43 warble2 systemd: Stopping Authorization Manager... Apr 8 00:48:43 warble2 multipathd: vol-mdt0-b: stop event checker thread (140064937625344) Apr 8 00:48:43 warble2 systemd: Stopping Availability of block devices... Apr 8 00:48:43 warble2 multipathd: vol-mdt1-a: stop event checker thread (140064937592576) Apr 8 00:48:43 warble2 multipathd: vol-mdt1-b: stop event checker thread (140064937559808) Apr 8 00:48:43 warble2 multipathd: vol-mdt2-a: stop event checker thread (140064937527040) Apr 8 00:48:43 warble2 multipathd: vol-mdt2-b: stop event checker thread (140064937494272) Apr 8 00:48:43 warble2 multipathd: vol-home-a: stop event checker thread (140064937461504) Apr 8 00:48:43 warble2 multipathd: vol-home-b: stop event checker thread (140064937428736) Apr 8 00:48:43 warble2 multipathd: vol-images-system-a: stop event checker thread (140064937395968) Apr 8 00:48:43 warble2 systemd: Stopped RDMA Node Description Daemon. Apr 8 00:48:43 warble2 multipathd: vol-images-system-b: stop event checker thread (140064937363200) Apr 8 00:48:43 warble2 multipathd: vol-apps-a: stop event checker thread (140064937330432) Apr 8 00:48:43 warble2 multipathd: vol-apps-b: stop event checker thread (140064937297664) Apr 8 00:48:43 warble2 systemd: Stopped Authorization Manager. Apr 8 00:48:43 warble2 multipathd: --------shut down------- Apr 8 00:48:43 warble2 systemd: Stopped Ganglia Monitoring Daemon. Apr 8 00:48:43 warble2 systemd: Stopped target Multi-User System. Apr 8 00:48:43 warble2 systemd: Stopping Multi-User System. Apr 8 00:48:43 warble2 systemd: Stopping D-Bus System Message Bus... Apr 8 00:48:43 warble2 systemd: Stopped target Login Prompts. Apr 8 00:48:43 warble2 systemd: Stopping Login Prompts. Apr 8 00:48:43 warble2 systemd: Stopping Getty on tty1... Apr 8 00:48:43 warble2 systemd: Stopping Serial Getty on ttyS0... Apr 8 00:48:43 warble2 systemd: Stopping Machine Check Exception Logging Daemon... Apr 8 00:48:43 warble2 blkdeactivate: Deactivating block devices: Apr 8 00:48:43 warble2 systemd: Stopping PCS GUI and remote configuration interface... Apr 8 00:48:43 warble2 blkdeactivate: [SKIP]: unmount of centos-swap (dm-7) mounted on [SWAP] Apr 8 00:48:43 warble2 pengine[14246]: notice: On loss of CCM Quorum: Ignore Apr 8 00:48:43 warble2 pengine[14246]: notice: Delaying fencing operations until there are resources to manage Apr 8 00:48:43 warble2 pengine[14246]: notice: Scheduling Node warble2-host.oob for shutdown Apr 8 00:48:43 warble2 pengine[14246]: notice: * Shutdown warble2-host.oob Apr 8 00:48:43 warble2 pengine[14246]: notice: Calculated transition 50, saving inputs in /var/lib/pacemaker/pengine/pe-input-22.bz2 Apr 8 00:48:43 warble2 crmd[14247]: notice: Transition 50 (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-22.bz2): Complete Apr 8 00:48:43 warble2 crmd[14247]: notice: Disconnected from the LRM Apr 8 00:48:43 warble2 systemd: Stopping Network Time Service... Apr 8 00:48:43 warble2 ntpd[13638]: ntpd exiting on signal 15 Apr 8 00:48:43 warble2 crmd[14247]: notice: Disconnected from Corosync Apr 8 00:48:43 warble2 cib[14242]: warning: new_event_notification (14242-14247-12): Broken pipe (32) Apr 8 00:48:43 warble2 cib[14242]: warning: A-Sync reply to crmd failed: No message of desired type Apr 8 00:48:43 warble2 crmd[14247]: notice: Disconnected from the CIB Apr 8 00:48:43 warble2 pacemakerd[14241]: notice: Stopping pengine Apr 8 00:48:43 warble2 pengine[14246]: notice: Caught 'Terminated' signal Apr 8 00:48:43 warble2 pacemakerd[14241]: notice: Stopping attrd Apr 8 00:48:43 warble2 attrd[14245]: notice: Caught 'Terminated' signal Apr 8 00:48:43 warble2 pacemakerd[14241]: notice: Stopping lrmd Apr 8 00:48:43 warble2 lrmd[14244]: notice: Caught 'Terminated' signal Apr 8 00:48:43 warble2 pacemakerd[14241]: notice: Stopping stonith-ng Apr 8 00:48:43 warble2 stonith-ng[14243]: notice: Caught 'Terminated' signal Apr 8 00:48:43 warble2 systemd: Stopped Resets System Activity Logs. Apr 8 00:48:43 warble2 systemd: Stopping Resets System Activity Logs... Apr 8 00:48:43 warble2 pacemakerd[14241]: notice: Stopping cib Apr 8 00:48:43 warble2 cib[14242]: notice: Caught 'Terminated' signal Apr 8 00:48:43 warble2 cib[14242]: notice: Disconnected from Corosync Apr 8 00:48:43 warble2 cib[14242]: notice: Disconnected from Corosync Apr 8 00:48:43 warble2 pacemakerd[14241]: notice: Shutdown complete Apr 8 00:48:43 warble2 kernel: XFS (dm-9): Unmounting Filesystem Apr 8 00:48:43 warble2 blkdeactivate: [UMOUNT]: unmounting centos-root (dm-9) mounted on /mnt/root... done Apr 8 00:48:43 warble2 systemd: Stopping Postfix Mail Transport Agent... Apr 8 00:48:43 warble2 systemd: Stopping irqbalance daemon... Apr 8 00:48:43 warble2 systemd: Stopping OpenSSH server daemon... Apr 8 00:48:43 warble2 systemd: Stopping SYSV: pslogger process logger... Apr 8 00:48:43 warble2 systemd: Stopping Login Service... Apr 8 00:48:43 warble2 pslogger: Shutting down pslogger: Apr 8 00:48:43 warble2 systemd: Stopping ZFS Event Daemon (zed)... Apr 8 00:48:43 warble2 zed: Exiting Apr 8 00:48:43 warble2 systemd: Stopped Builds and install new kernel modules through DKMS. Apr 8 00:48:43 warble2 systemd: Stopping Builds and install new kernel modules through DKMS... Apr 8 00:48:43 warble2 systemd: Unmounted /mnt/root. Apr 8 00:48:43 warble2 systemd: Stopped Device-Mapper Multipath Device Controller. Apr 8 00:48:43 warble2 systemd: Stopped ZFS Event Daemon (zed). Apr 8 00:48:43 warble2 systemd: Stopped D-Bus System Message Bus. Apr 8 00:48:43 warble2 systemd: Stopped OpenSSH server daemon. Apr 8 00:48:43 warble2 systemd: Stopped Login Service. Apr 8 00:48:43 warble2 blkdeactivate: [DM]: deactivating mpath device vol-mgt-a (dm-0)... done Apr 8 00:48:43 warble2 systemd: Stopped Serial Getty on ttyS0. Apr 8 00:48:43 warble2 systemd: Stopped Machine Check Exception Logging Daemon. Apr 8 00:48:43 warble2 systemd: Stopped Network Time Service. Apr 8 00:48:43 warble2 systemd: Stopped irqbalance daemon. Apr 8 00:48:43 warble2 systemd: Stopped PCS GUI and remote configuration interface. Apr 8 00:48:43 warble2 systemd: Stopped Getty on tty1. Apr 8 00:48:43 warble2 systemd: Stopped Pacemaker High Availability Cluster Manager. Apr 8 00:48:43 warble2 systemd: Unmounted RPC Pipe File System. Apr 8 00:48:43 warble2 systemd: Stopped LVM2 PV scan on device 8:2. Apr 8 00:48:43 warble2 systemd: Stopped Postfix Mail Transport Agent. Apr 8 00:48:43 warble2 systemd: Stopped SYSV: pslogger process logger. Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 blkdeactivate: [DM]: deactivating mpath device vol-mgt-b (dm-1)... done Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Failed to propagate agent release message: Transport endpoint is not connected Apr 8 00:48:43 warble2 systemd: Removed slice system-lvm2\x2dpvscan.slice. Apr 8 00:48:43 warble2 systemd: Stopping system-lvm2\x2dpvscan.slice. Apr 8 00:48:48 transom1 fm0_sm[240274]: WARN [PmAsyncRcv]: PM: PmPrintFailPort: Unable to Get(PortStatus) warble2 hfi1_0 Guid 0x001175010171d0f9 LID 0x78 Port 1 Apr 8 00:48:50 transom1 fm0_sm[240274]: transom1; MSG:NOTICE|SM:transom1:port 1|COND:#4 Disappearance from fabric|NODE:warble2 hfi1_0:port 1:0x001175010171d0f9|LINKEDTO:opa-l-6:port 3:0x00117501020c38c8|DETAIL:Node type: hfi Apr 8 00:48:54 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble2 not in post Apr 8 00:49:09 transom1 fm0_sm[240274]: WARN [PmAsyncRcv]: PM: PmPrintFailPort: Unable to Get(PortStatus) warble1 hfi1_0 Guid 0x001175010171de62 LID 0x63 Port 1 Apr 8 00:49:09 transom1 fm0_sm[240274]: WARN [PmEngine]: PM: PmPrintExceededPort: Integrity of 1265 Exceeded Threshold of 100. opa-l-5 Guid 0x00117501020c4c04 LID 0x2 Port 3 Neighbor: warble1 hfi1_0 Guid 0x001175010171de62 LID 0x63 Port 1 Apr 8 00:49:10 transom1 fm0_sm[240274]: transom1; MSG:NOTICE|SM:transom1:port 1|COND:#4 Disappearance from fabric|NODE:warble1 hfi1_0:port 1:0x001175010171de62|LINKEDTO:opa-l-5:port 3:0x00117501020c4c04|DETAIL:Node type: hfi Apr 8 00:49:12 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble1 not in post Apr 8 00:49:12 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble2 not in post Apr 8 00:49:30 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble1 not in post Apr 8 00:49:30 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble2 not in post Apr 8 00:49:50 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble1 not in post Apr 8 00:49:50 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble2 not in post Apr 8 00:50:07 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble1 not in post Apr 8 00:50:07 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble2 not in post Apr 8 00:50:25 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble2 not in post Apr 8 00:52:35 transom1 rsyncd[59591]: connect from warble2 (192.168.44.22) Apr 8 00:52:35 transom1 rsyncd[59591]: rsync on images/centos-7.4-minimal-server-05//etc/rsync.options.farnarkle from boot@warble2 (192.168.44.22) Apr 8 00:52:35 transom1 rsyncd[59592]: connect from warble2 (192.168.44.22) Apr 8 00:52:35 transom1 rsyncd[59592]: rsync on images/centos-7.4-minimal-server-05// from boot@warble2 (192.168.44.22) Apr 8 00:52:43 transom1 rsyncd[59604]: connect from warble2 (192.168.44.22) Apr 8 00:52:43 transom1 rsyncd[59604]: rsync on images/centos-7.4-minimal-server-05//lib/modules/3.10.0-693.17.1.el7.x86_64/ from boot@warble2 (192.168.44.22) Apr 8 00:52:20 warble2 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys cpuset Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys cpu Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys cpuacct Apr 8 00:52:20 warble2 kernel: Linux version 3.10.0-693.17.1.el7.x86_64 (builder@kbuilder.dev.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Thu Jan 25 20:13:58 UTC 2018 Apr 8 00:52:20 warble2 kernel: Command line: initrd=oneSIS/initramfs-3.10.0-693.17.1.el7.x86_64.onesis.server.01.img root=rsync://boot@192.168.44.11/images/centos-7.4-minimal-server-05/ ro crashkernel=auto vconsole.font=latarcyrheb-sun16 vconsole.keymap=us LANG=en_US.UTF-8 console=tty0 console=ttyS0,115200n8 rd.driver.blacklist=nouveau selinux=0 exec-shield=0 audit=0 timeshift=12 cluster=farnarkle ping=192.168.44.11 rd.shell bond=bond0:em1,em2:miimon=100,xmit_hash_policy=1,mode=4,lacp_rate=1:9000 nopti BOOT_IMAGE=oneSIS/vmlinuz-3.10.0-693.17.1.el7.x86_64 Apr 8 00:52:20 warble2 kernel: e820: BIOS-provided physical RAM map: Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009bfff] usable Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x000000000009c000-0x000000000009ffff] reserved Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x0000000000100000-0x000000006c5cefff] usable Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x000000006c5cf000-0x000000006e7cefff] reserved Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x000000006e7cf000-0x000000006f5fefff] ACPI NVS Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x000000006f5ff000-0x000000006f7fefff] ACPI data Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x000000006f7ff000-0x000000006f7fffff] usable Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x000000006f800000-0x000000008fffffff] reserved Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x00000000fd000000-0x00000000fe7fffff] reserved Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x00000000fec80000-0x00000000fed00fff] reserved Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved Apr 8 00:52:20 warble2 kernel: BIOS-e820: [mem 0x0000000100000000-0x000000c03fffffff] usable Apr 8 00:52:20 warble2 kernel: NX (Execute Disable) protection: active Apr 8 00:52:20 warble2 kernel: SMBIOS 3.0 present. Apr 8 00:52:20 warble2 kernel: e820: last_pfn = 0xc040000 max_arch_pfn = 0x400000000 Apr 8 00:52:20 warble2 kernel: x86 PAT enabled: cpu 0, old 0x5010600070406, new 0x7010600070106 Apr 8 00:52:20 warble2 kernel: total RAM covered: 785392M Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 64K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 128K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 256K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 64K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 64K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 64K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 64K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 64K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 64K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 64K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 128K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 256K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 128K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 128K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 128K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 128K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 128K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 128K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 128K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 256K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 256K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 256K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 256K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 256K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 256K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 256K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 256K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 512K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 512K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 512K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 512K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 512K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 512K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 512K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 1M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 1M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 1M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 1M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 1M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 1M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 1M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 2M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 2M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 2M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 2M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 2M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 2M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 2M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 4M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 4M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 4M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 4M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 4M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 4M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 4M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 8M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 8M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 8M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 8M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 8M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 8M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 8M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 16M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 16M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 16M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 16M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 16M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 16M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 16M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 32M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15344M Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 32M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30704M Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 32M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -61424M Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 32M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -122864M Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 32M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -229360M Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 32M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -196592M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:52:20 warble2 kernel: gran_size: 32M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:52:20 warble2 kernel: gran_size: 64M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 656432M Apr 8 00:52:20 warble2 kernel: gran_size: 64M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:52:20 warble2 kernel: gran_size: 64M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:52:20 warble2 kernel: gran_size: 64M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:52:20 warble2 kernel: gran_size: 64M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:52:20 warble2 kernel: gran_size: 64M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:52:20 warble2 kernel: gran_size: 64M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 656432M Apr 8 00:52:20 warble2 kernel: gran_size: 64M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:52:20 warble2 kernel: *BAD*gran_size: 64M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15312M Apr 8 00:52:20 warble2 kernel: mtrr_cleanup: can not find optimal value Apr 8 00:52:20 warble2 kernel: please specify mtrr_gran_size/mtrr_chunk_size Apr 8 00:52:20 warble2 kernel: e820: last_pfn = 0x6f800 max_arch_pfn = 0x400000000 Apr 8 00:52:20 warble2 kernel: Using GB pages for direct mapping Apr 8 00:52:20 warble2 kernel: RAMDISK: [mem 0x6982a000-0x6c5a9fff] Apr 8 00:52:20 warble2 kernel: Early table checksum verification disabled Apr 8 00:52:20 warble2 kernel: ACPI: RSDP 00000000000fe320 00024 (v02 DELL ) Apr 8 00:52:20 warble2 kernel: ACPI: XSDT 000000006f6c0188 000FC (v01 DELL PE_SC3 00000000 01000013) Apr 8 00:52:20 warble2 kernel: ACPI: FACP 000000006f7f8000 00114 (v06 DELL PE_SC3 00000000 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: DSDT 000000006f79e000 32342 (v02 DELL PE_SC3 00000003 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: FACS 000000006f4ef000 00040 Apr 8 00:52:20 warble2 kernel: ACPI: SSDT 000000006f7fc000 003C6 (v02 DELL Tpm2Tabl 00001000 INTL 20150818) Apr 8 00:52:20 warble2 kernel: ACPI: TPM2 000000006f7fb000 00038 (v04 DELL PE_SC3 00000002 01000013) Apr 8 00:52:20 warble2 kernel: ACPI: MCEJ 000000006f7fa000 00130 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: WD__ 000000006f7f9000 00134 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: HPET 000000006f7f7000 00038 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: APIC 000000006f7f5000 016DE (v04 DELL PE_SC3 00000000 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: MCFG 000000006f7f4000 0003C (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: MIGT 000000006f7f3000 00040 (v01 DELL PE_SC3 00000000 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: MSCT 000000006f7f2000 00090 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: NFIT 000000006f7d9000 18028 (v01 00000000 00000000) Apr 8 00:52:20 warble2 kernel: ACPI: PCAT 000000006f7d8000 00048 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: PCCT 000000006f7d7000 0006E (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: RASF 000000006f7d6000 00030 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: SLIT 000000006f7d5000 0006C (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: SRAT 000000006f7d2000 02830 (v03 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: SVOS 000000006f7d1000 00032 (v01 DELL PE_SC3 00000000 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: OEM4 000000006f6fb000 A27C4 (v02 INTEL CPU CST 00003000 INTL 20150818) Apr 8 00:52:20 warble2 kernel: ACPI: SSDT 000000006f6c5000 35130 (v02 INTEL SSDT PM 00004000 INTL 20150818) Apr 8 00:52:20 warble2 kernel: ACPI: SSDT 000000006f6c4000 00761 (v02 DELL PE_SC3 00000000 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: SSDT 000000006f6c1000 02541 (v02 INTEL SpsNm 00000002 INTL 20150818) Apr 8 00:52:20 warble2 kernel: ACPI: SPCR 000000006f7fd000 00050 (v01 00000000 00000000) Apr 8 00:52:20 warble2 kernel: ACPI: DMAR 000000006f6bf000 001D0 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: HEST 000000006f6be000 0017C (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: BERT 000000006f6bd000 00030 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: ERST 000000006f6bc000 00230 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:52:20 warble2 kernel: ACPI: EINJ 000000006f6bb000 00150 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:52:20 warble2 kernel: SRAT: PXM 0 -> APIC 0x00 -> Node 0 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 1 -> APIC 0x40 -> Node 1 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 0 -> APIC 0x0e -> Node 0 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 1 -> APIC 0x46 -> Node 1 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 0 -> APIC 0x08 -> Node 0 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 1 -> APIC 0x44 -> Node 1 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 0 -> APIC 0x0a -> Node 0 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 1 -> APIC 0x52 -> Node 1 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 0 -> APIC 0x24 -> Node 0 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 1 -> APIC 0x60 -> Node 1 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 0 -> APIC 0x2c -> Node 0 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 1 -> APIC 0x68 -> Node 1 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 0 -> APIC 0x26 -> Node 0 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 1 -> APIC 0x66 -> Node 1 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 0 -> APIC 0x2a -> Node 0 Apr 8 00:52:20 warble2 kernel: SRAT: PXM 1 -> APIC 0x74 -> Node 1 Apr 8 00:52:20 warble2 kernel: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff] Apr 8 00:52:20 warble2 kernel: SRAT: Node 0 PXM 0 [mem 0x100000000-0x603fffffff] Apr 8 00:52:20 warble2 kernel: SRAT: Node 1 PXM 1 [mem 0x6040000000-0xc03fffffff] Apr 8 00:52:20 warble2 kernel: NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x603fffffff] -> [mem 0x00000000-0x603fffffff] Apr 8 00:52:20 warble2 kernel: NODE_DATA(0) allocated [mem 0x603ffd9000-0x603fffffff] Apr 8 00:52:20 warble2 kernel: NODE_DATA(1) allocated [mem 0xc03ffd6000-0xc03fffcfff] Apr 8 00:52:20 warble2 kernel: Reserving 208MB of memory at 688MB for crashkernel (System RAM: 785093MB) Apr 8 00:52:20 warble2 kernel: Zone ranges: Apr 8 00:52:20 warble2 kernel: DMA [mem 0x00001000-0x00ffffff] Apr 8 00:52:20 warble2 kernel: DMA32 [mem 0x01000000-0xffffffff] Apr 8 00:52:20 warble2 kernel: Normal [mem 0x100000000-0xc03fffffff] Apr 8 00:52:20 warble2 kernel: Movable zone start for each node Apr 8 00:52:20 warble2 kernel: Early memory node ranges Apr 8 00:52:20 warble2 kernel: node 0: [mem 0x00001000-0x0009bfff] Apr 8 00:52:20 warble2 kernel: node 0: [mem 0x00100000-0x6c5cefff] Apr 8 00:52:20 warble2 kernel: node 0: [mem 0x6f7ff000-0x6f7fffff] Apr 8 00:52:20 warble2 kernel: node 0: [mem 0x100000000-0x603fffffff] Apr 8 00:52:20 warble2 kernel: node 1: [mem 0x6040000000-0xc03fffffff] Apr 8 00:52:20 warble2 kernel: Initmem setup node 0 [mem 0x00001000-0x603fffffff] Apr 8 00:52:20 warble2 kernel: Initmem setup node 1 [mem 0x6040000000-0xc03fffffff] Apr 8 00:52:20 warble2 kernel: ACPI: PM-Timer IO Port: 0x508 Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x38] lapic_id[0x40] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x0e] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x3a] lapic_id[0x46] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x08] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x39] lapic_id[0x44] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x0a] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x3b] lapic_id[0x52] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x24] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x3c] lapic_id[0x60] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id[0x2c] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x3e] lapic_id[0x68] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id[0x26] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x3d] lapic_id[0x66] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x2a] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0x3f] lapic_id[0x74] enabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x00] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x01] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x02] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x03] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x04] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x05] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x06] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x07] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x08] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x09] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0a] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0b] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0c] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0d] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0e] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0f] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x10] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x11] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x12] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x13] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x14] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x15] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x16] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x17] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x18] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x19] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1a] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1b] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1c] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1d] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1e] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1f] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x20] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x21] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x22] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x23] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x24] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x25] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x26] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x27] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x28] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x29] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2a] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2b] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2c] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2d] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2e] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2f] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x30] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x31] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x32] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x33] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x34] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x35] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x36] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x37] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x38] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x39] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3a] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3b] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3c] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3d] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3e] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3f] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x40] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x41] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x42] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x43] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x44] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x45] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x46] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x47] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x48] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x49] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4a] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4b] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4c] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4d] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4e] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4f] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x50] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x51] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x52] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x53] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x54] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x55] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x56] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x57] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x58] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x59] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5a] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5b] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5c] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5d] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5e] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5f] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x60] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x61] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x62] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x63] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x64] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x65] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x66] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x67] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x68] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x69] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6a] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6b] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6c] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6d] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6e] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6f] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x70] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x71] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x72] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x73] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x74] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x75] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x76] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x77] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x78] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x79] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7a] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7b] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7c] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7d] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7e] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7f] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x80] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x81] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x82] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x83] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x84] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x85] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x86] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x87] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x88] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x89] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8a] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8b] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8c] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8d] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8e] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8f] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x90] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x91] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x92] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x93] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x94] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x95] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x96] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x97] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x98] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x99] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9a] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9b] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9c] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9d] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9e] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9f] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa0] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa1] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa2] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa3] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa4] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa5] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa6] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa7] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa8] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa9] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xaa] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xab] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xac] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xad] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xae] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xaf] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb0] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb1] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb2] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb3] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb4] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb5] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb6] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb7] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb8] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb9] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xba] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbb] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbc] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbd] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbe] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbf] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc0] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc1] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc2] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc3] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc4] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc5] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc6] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc7] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc8] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc9] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xca] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcb] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcc] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcd] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xce] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcf] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd0] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd1] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd2] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd3] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd4] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd5] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd6] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd7] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd8] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd9] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xda] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdb] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdc] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdd] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xde] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdf] disabled) Apr 8 00:52:20 warble2 kernel: ACPI: X2APIC_NMI (uid[0xffffffff] high level lint[0x1]) Apr 8 00:52:20 warble2 kernel: ACPI: LAPIC_NMI (acpi_id[0xff] high level lint[0x1]) Apr 8 00:52:20 warble2 kernel: ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0]) Apr 8 00:52:20 warble2 kernel: IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23 Apr 8 00:52:20 warble2 kernel: ACPI: IOAPIC (id[0x09] address[0xfec01000] gsi_base[24]) Apr 8 00:52:20 warble2 kernel: IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-31 Apr 8 00:52:20 warble2 kernel: ACPI: IOAPIC (id[0x0a] address[0xfec08000] gsi_base[32]) Apr 8 00:52:20 warble2 kernel: IOAPIC[2]: apic_id 10, version 32, address 0xfec08000, GSI 32-39 Apr 8 00:52:20 warble2 kernel: ACPI: IOAPIC (id[0x0b] address[0xfec10000] gsi_base[40]) Apr 8 00:52:20 warble2 kernel: IOAPIC[3]: apic_id 11, version 32, address 0xfec10000, GSI 40-47 Apr 8 00:52:20 warble2 kernel: ACPI: IOAPIC (id[0x0c] address[0xfec18000] gsi_base[48]) Apr 8 00:52:20 warble2 kernel: IOAPIC[4]: apic_id 12, version 32, address 0xfec18000, GSI 48-55 Apr 8 00:52:20 warble2 kernel: ACPI: IOAPIC (id[0x0f] address[0xfec20000] gsi_base[72]) Apr 8 00:52:20 warble2 kernel: IOAPIC[5]: apic_id 15, version 32, address 0xfec20000, GSI 72-79 Apr 8 00:52:20 warble2 kernel: ACPI: IOAPIC (id[0x10] address[0xfec28000] gsi_base[80]) Apr 8 00:52:20 warble2 kernel: IOAPIC[6]: apic_id 16, version 32, address 0xfec28000, GSI 80-87 Apr 8 00:52:20 warble2 kernel: ACPI: IOAPIC (id[0x11] address[0xfec30000] gsi_base[88]) Apr 8 00:52:20 warble2 kernel: IOAPIC[7]: apic_id 17, version 32, address 0xfec30000, GSI 88-95 Apr 8 00:52:20 warble2 kernel: ACPI: IOAPIC (id[0x12] address[0xfec38000] gsi_base[96]) Apr 8 00:52:20 warble2 kernel: IOAPIC[8]: apic_id 18, version 32, address 0xfec38000, GSI 96-103 Apr 8 00:52:20 warble2 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Apr 8 00:52:20 warble2 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Apr 8 00:52:20 warble2 kernel: Using ACPI (MADT) for SMP configuration information Apr 8 00:52:20 warble2 kernel: ACPI: HPET id: 0x8086a701 base: 0xfed00000 Apr 8 00:52:20 warble2 kernel: smpboot: Allowing 448 CPUs, 432 hotplug CPUs Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0x0009c000-0x0009ffff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0x6c5cf000-0x6e7cefff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0x6e7cf000-0x6f5fefff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0x6f5ff000-0x6f7fefff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0x6f800000-0x8fffffff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0x90000000-0xfcffffff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0xfd000000-0xfe7fffff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0xfe800000-0xfebfffff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0xfec01000-0xfec7ffff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0xfec80000-0xfed00fff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0xfed01000-0xfeffffff] Apr 8 00:52:20 warble2 kernel: PM: Registered nosave memory: [mem 0xff000000-0xffffffff] Apr 8 00:52:20 warble2 kernel: e820: [mem 0x90000000-0xfcffffff] available for PCI devices Apr 8 00:52:20 warble2 kernel: Booting paravirtualized kernel on bare hardware Apr 8 00:52:20 warble2 kernel: setup_percpu: NR_CPUS:5120 nr_cpumask_bits:448 nr_cpu_ids:448 nr_node_ids:2 Apr 8 00:52:20 warble2 kernel: PERCPU: Embedded 35 pages/cpu @ffff885ebda00000 s104536 r8192 d30632 u262144 Apr 8 00:52:20 warble2 kernel: Built 2 zonelists in Zone order, mobility grouping on. Total pages: 197843518 Apr 8 00:52:20 warble2 kernel: Policy zone: Normal Apr 8 00:52:20 warble2 kernel: Kernel command line: initrd=oneSIS/initramfs-3.10.0-693.17.1.el7.x86_64.onesis.server.01.img root=rsync://boot@192.168.44.11/images/centos-7.4-minimal-server-05/ ro crashkernel=auto vconsole.font=latarcyrheb-sun16 vconsole.keymap=us LANG=en_US.UTF-8 console=tty0 console=ttyS0,115200n8 rd.driver.blacklist=nouveau selinux=0 exec-shield=0 audit=0 timeshift=12 cluster=farnarkle ping=192.168.44.11 rd.shell bond=bond0:em1,em2:miimon=100,xmit_hash_policy=1,mode=4,lacp_rate=1:9000 nopti BOOT_IMAGE=oneSIS/vmlinuz-3.10.0-693.17.1.el7.x86_64 Apr 8 00:52:20 warble2 kernel: audit: disabled (until reboot) Apr 8 00:52:20 warble2 kernel: PID hash table entries: 4096 (order: 3, 32768 bytes) Apr 8 00:52:20 warble2 kernel: x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 Apr 8 00:52:20 warble2 kernel: x86/fpu: xstate_offset[3]: 03c0, xstate_sizes[3]: 0040 Apr 8 00:52:20 warble2 kernel: x86/fpu: xstate_offset[4]: 0400, xstate_sizes[4]: 0040 Apr 8 00:52:20 warble2 kernel: x86/fpu: xstate_offset[5]: 0440, xstate_sizes[5]: 0040 Apr 8 00:52:20 warble2 kernel: x86/fpu: xstate_offset[6]: 0480, xstate_sizes[6]: 0200 Apr 8 00:52:20 warble2 kernel: x86/fpu: xstate_offset[7]: 0680, xstate_sizes[7]: 0400 Apr 8 00:52:20 warble2 kernel: xsave: enabled xstate_bv 0xff, cntxt size 0xa80 using standard form Apr 8 00:52:20 warble2 kernel: Memory: 7724828k/806354944k available (6916k kernel code, 2419284k absent, 12968396k reserved, 4551k data, 1800k init) Apr 8 00:52:20 warble2 kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=448, Nodes=2 Apr 8 00:52:20 warble2 kernel: Hierarchical RCU implementation. Apr 8 00:52:20 warble2 kernel: #011RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=448. Apr 8 00:52:20 warble2 kernel: NR_IRQS:327936 nr_irqs:5368 0 Apr 8 00:52:20 warble2 kernel: Console: colour VGA+ 80x25 Apr 8 00:52:20 warble2 kernel: console [tty0] enabled Apr 8 00:52:20 warble2 kernel: console [ttyS0] enabled Apr 8 00:52:20 warble2 kernel: allocated 3215982592 bytes of page_cgroup Apr 8 00:52:20 warble2 kernel: please try 'cgroup_disable=memory' option if you don't want memory cgroups Apr 8 00:52:20 warble2 kernel: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl Apr 8 00:52:20 warble2 kernel: tsc: Detected 3200.000 MHz processor Apr 8 00:52:20 warble2 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 6400.00 BogoMIPS (lpj=3200000) Apr 8 00:52:20 warble2 kernel: pid_max: default: 458752 minimum: 3584 Apr 8 00:52:20 warble2 kernel: Security Framework initialized Apr 8 00:52:20 warble2 kernel: SELinux: Disabled at boot. Apr 8 00:52:20 warble2 kernel: Yama: becoming mindful. Apr 8 00:52:20 warble2 kernel: Dentry cache hash table entries: 134217728 (order: 18, 1073741824 bytes) Apr 8 00:52:20 warble2 kernel: Inode-cache hash table entries: 67108864 (order: 17, 536870912 bytes) Apr 8 00:52:20 warble2 kernel: random: fast init done Apr 8 00:52:20 warble2 kernel: Mount-cache hash table entries: 2097152 (order: 12, 16777216 bytes) Apr 8 00:52:20 warble2 kernel: Mountpoint-cache hash table entries: 2097152 (order: 12, 16777216 bytes) Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys memory Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys devices Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys freezer Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys net_cls Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys blkio Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys perf_event Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys hugetlb Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys pids Apr 8 00:52:20 warble2 kernel: Initializing cgroup subsys net_prio Apr 8 00:52:20 warble2 kernel: CPU: Physical Processor ID: 0 Apr 8 00:52:20 warble2 kernel: CPU: Processor Core ID: 0 Apr 8 00:52:20 warble2 kernel: ENERGY_PERF_BIAS: Set to 'normal', was 'performance' Apr 8 00:52:20 warble2 kernel: ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8) Apr 8 00:52:20 warble2 kernel: FEATURE SPEC_CTRL Present Apr 8 00:52:20 warble2 kernel: FEATURE IBPB_SUPPORT Present Apr 8 00:52:20 warble2 kernel: mce: CPU supports 20 MCE banks Apr 8 00:52:20 warble2 kernel: CPU0: Thermal monitoring enabled (TM1) Apr 8 00:52:20 warble2 kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 Apr 8 00:52:20 warble2 kernel: Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0 Apr 8 00:52:20 warble2 kernel: tlb_flushall_shift: 6 Apr 8 00:52:20 warble2 kernel: Freeing SMP alternatives: 24k freed Apr 8 00:52:20 warble2 kernel: ACPI: Core revision 20130517 Apr 8 00:52:20 warble2 kernel: ACPI: All ACPI Tables successfully acquired Apr 8 00:52:20 warble2 kernel: ftrace: allocating 26618 entries in 104 pages Apr 8 00:52:20 warble2 kernel: DMAR: Host address width 46 Apr 8 00:52:20 warble2 kernel: DMAR: DRHD base: 0x000000d37fc000 flags: 0x0 Apr 8 00:52:20 warble2 kernel: DMAR: dmar0: reg_base_addr d37fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:52:20 warble2 kernel: DMAR: DRHD base: 0x000000e0ffc000 flags: 0x0 Apr 8 00:52:20 warble2 kernel: DMAR: dmar1: reg_base_addr e0ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:52:20 warble2 kernel: DMAR: DRHD base: 0x000000ee7fc000 flags: 0x0 Apr 8 00:52:20 warble2 kernel: DMAR: dmar2: reg_base_addr ee7fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:52:20 warble2 kernel: DMAR: DRHD base: 0x000000fbffc000 flags: 0x0 Apr 8 00:52:20 warble2 kernel: DMAR: dmar3: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:52:20 warble2 kernel: DMAR: DRHD base: 0x000000aaffc000 flags: 0x0 Apr 8 00:52:20 warble2 kernel: DMAR: dmar4: reg_base_addr aaffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:52:20 warble2 kernel: DMAR: DRHD base: 0x000000b87fc000 flags: 0x0 Apr 8 00:52:20 warble2 kernel: DMAR: dmar5: reg_base_addr b87fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:52:20 warble2 kernel: DMAR: DRHD base: 0x000000c5ffc000 flags: 0x0 Apr 8 00:52:20 warble2 kernel: DMAR: dmar6: reg_base_addr c5ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:52:20 warble2 kernel: DMAR: DRHD base: 0x0000009d7fc000 flags: 0x1 Apr 8 00:52:20 warble2 kernel: DMAR: dmar7: reg_base_addr 9d7fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:52:20 warble2 kernel: DMAR: RMRR base: 0x0000006e2cd000 end: 0x0000006e7ccfff Apr 8 00:52:20 warble2 kernel: DMAR: RMRR base: 0x0000006f4e1000 end: 0x0000006f4e3fff Apr 8 00:52:20 warble2 kernel: DMAR: ATSR flags: 0x0 Apr 8 00:52:20 warble2 kernel: DMAR: ATSR flags: 0x0 Apr 8 00:52:20 warble2 kernel: DMAR-IR: IOAPIC id 12 under DRHD base 0xc5ffc000 IOMMU 6 Apr 8 00:52:20 warble2 kernel: DMAR-IR: IOAPIC id 11 under DRHD base 0xb87fc000 IOMMU 5 Apr 8 00:52:20 warble2 kernel: DMAR-IR: IOAPIC id 10 under DRHD base 0xaaffc000 IOMMU 4 Apr 8 00:52:20 warble2 kernel: DMAR-IR: IOAPIC id 18 under DRHD base 0xfbffc000 IOMMU 3 Apr 8 00:52:20 warble2 kernel: DMAR-IR: IOAPIC id 17 under DRHD base 0xee7fc000 IOMMU 2 Apr 8 00:52:20 warble2 kernel: DMAR-IR: IOAPIC id 16 under DRHD base 0xe0ffc000 IOMMU 1 Apr 8 00:52:20 warble2 kernel: DMAR-IR: IOAPIC id 15 under DRHD base 0xd37fc000 IOMMU 0 Apr 8 00:52:20 warble2 kernel: DMAR-IR: IOAPIC id 8 under DRHD base 0x9d7fc000 IOMMU 7 Apr 8 00:52:20 warble2 kernel: DMAR-IR: IOAPIC id 9 under DRHD base 0x9d7fc000 IOMMU 7 Apr 8 00:52:20 warble2 kernel: DMAR-IR: HPET id 0 under DRHD base 0x9d7fc000 Apr 8 00:52:20 warble2 kernel: DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. Apr 8 00:52:20 warble2 kernel: DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. Apr 8 00:52:20 warble2 kernel: DMAR-IR: Enabled IRQ remapping in xapic mode Apr 8 00:52:20 warble2 kernel: IRQ remapping doesn't support X2APIC mode, disable x2apic. Apr 8 00:52:20 warble2 kernel: Switched APIC routing to physical flat. Apr 8 00:52:20 warble2 kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Apr 8 00:52:20 warble2 kernel: smpboot: CPU0: Intel(R) Xeon(R) Gold 6134 CPU @ 3.20GHz (fam: 06, model: 55, stepping: 04) Apr 8 00:52:20 warble2 kernel: Performance Events: PEBS fmt3+, 32-deep LBR, Skylake events, full-width counters, Intel PMU driver. Apr 8 00:52:20 warble2 kernel: ... version: 4 Apr 8 00:52:20 warble2 kernel: ... bit width: 48 Apr 8 00:52:20 warble2 kernel: ... generic registers: 8 Apr 8 00:52:20 warble2 kernel: ... value mask: 0000ffffffffffff Apr 8 00:52:20 warble2 kernel: ... max period: 00007fffffffffff Apr 8 00:52:20 warble2 kernel: ... fixed-purpose events: 3 Apr 8 00:52:20 warble2 kernel: ... event mask: 00000007000000ff Apr 8 00:52:20 warble2 kernel: NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 1, Processors #1 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 0, Processors #2 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 1, Processors #3 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 0, Processors #4 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 1, Processors #5 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 0, Processors #6 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 1, Processors #7 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 0, Processors #8 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 1, Processors #9 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 0, Processors #10 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 1, Processors #11 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 0, Processors #12 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 1, Processors #13 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 0, Processors #14 OK Apr 8 00:52:20 warble2 kernel: smpboot: Booting Node 1, Processors #15 Apr 8 00:52:20 warble2 kernel: Brought up 16 CPUs Apr 8 00:52:20 warble2 kernel: smpboot: Max logical packages: 56 Apr 8 00:52:20 warble2 kernel: smpboot: Total of 16 processors activated (102439.16 BogoMIPS) Apr 8 00:52:20 warble2 kernel: node 0 initialised, 97514679 pages in 1525ms Apr 8 00:52:20 warble2 kernel: node 1 initialised, 98295926 pages in 1529ms Apr 8 00:52:20 warble2 kernel: devtmpfs: initialized Apr 8 00:52:20 warble2 kernel: EVM: security.selinux Apr 8 00:52:20 warble2 kernel: EVM: security.ima Apr 8 00:52:20 warble2 kernel: EVM: security.capability Apr 8 00:52:20 warble2 kernel: PM: Registering ACPI NVS region [mem 0x6e7cf000-0x6f5fefff] (14876672 bytes) Apr 8 00:52:20 warble2 kernel: atomic64 test passed for x86-64 platform with CX8 and with SSE Apr 8 00:52:20 warble2 kernel: pinctrl core: initialized pinctrl subsystem Apr 8 00:52:20 warble2 kernel: RTC time: 14:52:15, date: 04/07/18 Apr 8 00:52:20 warble2 kernel: NET: Registered protocol family 16 Apr 8 00:52:20 warble2 kernel: ACPI FADT declares the system doesn't support PCIe ASPM, so disable it Apr 8 00:52:20 warble2 kernel: ACPI: bus type PCI registered Apr 8 00:52:20 warble2 kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Apr 8 00:52:20 warble2 kernel: PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) Apr 8 00:52:20 warble2 kernel: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 Apr 8 00:52:20 warble2 kernel: pmd_set_huge: Cannot satisfy [mem 0x80000000-0x80200000] with a huge-page mapping due to MTRR override. Apr 8 00:52:20 warble2 kernel: PCI: Using configuration type 1 for base access Apr 8 00:52:20 warble2 kernel: PCI: Dell System detected, enabling pci=bfsort. Apr 8 00:52:20 warble2 kernel: ACPI: Added _OSI(Module Device) Apr 8 00:52:20 warble2 kernel: ACPI: Added _OSI(Processor Device) Apr 8 00:52:20 warble2 kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Apr 8 00:52:20 warble2 kernel: ACPI: Added _OSI(Processor Aggregator Device) Apr 8 00:52:20 warble2 kernel: [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored Apr 8 00:52:20 warble2 kernel: ACPI: Dynamic OEM Table Load: Apr 8 00:52:20 warble2 kernel: ACPI: OEM4 (null) A27C4 (v02 INTEL CPU CST 00003000 INTL 20150818) Apr 8 00:52:20 warble2 kernel: ACPI: Interpreter enabled Apr 8 00:52:20 warble2 kernel: ACPI: (supports S0 S5) Apr 8 00:52:20 warble2 kernel: ACPI: Using IOAPIC for interrupt routing Apr 8 00:52:20 warble2 kernel: HEST: Table parsing has been initialized. Apr 8 00:52:20 warble2 kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Apr 8 00:52:20 warble2 kernel: ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00-16]) Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:00: PCIe AER handled by firmware Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:00: ignoring host bridge window [mem 0x000c4000-0x000cbfff window] (conflicts with Video ROM [mem 0x000c0000-0x000c7fff]) Apr 8 00:52:20 warble2 kernel: PCI host bridge to bus 0000:00 Apr 8 00:52:20 warble2 kernel: pci_bus 0000:00: root bus resource [bus 00-16] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:00: root bus resource [io 0x1000-0x3fff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:00: root bus resource [mem 0xfe010000-0xfe010fff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:00: root bus resource [mem 0x90000000-0x9d7fffff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:00: root bus resource [mem 0x380000000000-0x380fffffffff window] Apr 8 00:52:20 warble2 kernel: pci 0000:00:14.0: System wakeup disabled by ACPI Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.0: System wakeup disabled by ACPI Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.4: System wakeup disabled by ACPI Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.0: PCI bridge to [bus 01] Apr 8 00:52:20 warble2 kernel: pci 0000:02:00.0: System wakeup disabled by ACPI Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.4: PCI bridge to [bus 02-03] Apr 8 00:52:20 warble2 kernel: pci 0000:02:00.0: PCI bridge to [bus 03] Apr 8 00:52:20 warble2 kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 8 00:52:20 warble2 kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 *6 10 11 12 14 15) Apr 8 00:52:20 warble2 kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) Apr 8 00:52:20 warble2 kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 8 00:52:20 warble2 kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 8 00:52:20 warble2 kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 *6 10 11 12 14 15) Apr 8 00:52:20 warble2 kernel: ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 *5 6 10 11 12 14 15) Apr 8 00:52:20 warble2 kernel: ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 8 00:52:20 warble2 kernel: ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 17-39]) Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:01: PCIe AER handled by firmware Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:52:20 warble2 kernel: PCI host bridge to bus 0000:17 Apr 8 00:52:20 warble2 kernel: pci_bus 0000:17: root bus resource [bus 17-39] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:17: root bus resource [io 0x4000-0x5fff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:17: root bus resource [mem 0x9d800000-0xaaffffff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:17: root bus resource [mem 0x381000000000-0x381fffffffff window] Apr 8 00:52:20 warble2 kernel: pci 0000:17:00.0: System wakeup disabled by ACPI Apr 8 00:52:20 warble2 kernel: pci 0000:17:02.0: System wakeup disabled by ACPI Apr 8 00:52:20 warble2 kernel: pci 0000:17:00.0: PCI bridge to [bus 18] Apr 8 00:52:20 warble2 kernel: pci 0000:17:02.0: PCI bridge to [bus 19] Apr 8 00:52:20 warble2 kernel: ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 3a-5c]) Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:02: PCIe AER handled by firmware Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:52:20 warble2 kernel: PCI host bridge to bus 0000:3a Apr 8 00:52:20 warble2 kernel: pci_bus 0000:3a: root bus resource [bus 3a-5c] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:3a: root bus resource [io 0x6000-0x7fff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:3a: root bus resource [mem 0xab000000-0xb87fffff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:3a: root bus resource [mem 0x382000000000-0x382fffffffff window] Apr 8 00:52:20 warble2 kernel: pci 0000:3a:00.0: System wakeup disabled by ACPI Apr 8 00:52:20 warble2 kernel: pci 0000:3b:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit] (contains BAR0 for 16 VFs) Apr 8 00:52:20 warble2 kernel: pci 0000:3b:00.0: VF(n) BAR2 space: [mem 0x00000000-0x00ffffff 64bit] (contains BAR2 for 16 VFs) Apr 8 00:52:20 warble2 kernel: pci 0000:3a:00.0: PCI bridge to [bus 3b] Apr 8 00:52:20 warble2 kernel: ACPI: PCI Root Bridge [PC03] (domain 0000 [bus 5d-7f]) Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:03: PCIe AER handled by firmware Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:52:20 warble2 kernel: PCI host bridge to bus 0000:5d Apr 8 00:52:20 warble2 kernel: pci_bus 0000:5d: root bus resource [bus 5d-7f] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:5d: root bus resource [io 0x8000-0x9fff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:5d: root bus resource [mem 0xb8800000-0xc5ffffff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:5d: root bus resource [mem 0x383000000000-0x383fffffffff window] Apr 8 00:52:20 warble2 kernel: ACPI: PCI Root Bridge [PC06] (domain 0000 [bus 80-84]) Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:06: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:06: PCIe AER handled by firmware Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:06: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:06: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:06: host bridge window [io 0x0000 window] (ignored, not CPU addressable) Apr 8 00:52:20 warble2 kernel: PCI host bridge to bus 0000:80 Apr 8 00:52:20 warble2 kernel: pci_bus 0000:80: root bus resource [bus 80-84] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:80: root bus resource [mem 0xc6000000-0xd37fffff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:80: root bus resource [mem 0x384000000000-0x384fffffffff window] Apr 8 00:52:20 warble2 kernel: ACPI: PCI Root Bridge [PC07] (domain 0000 [bus 85-ad]) Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:07: PCIe AER handled by firmware Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:07: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:07: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:52:20 warble2 kernel: PCI host bridge to bus 0000:85 Apr 8 00:52:20 warble2 kernel: pci_bus 0000:85: root bus resource [bus 85-ad] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:85: root bus resource [io 0xa000-0xbfff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:85: root bus resource [mem 0xd3800000-0xe0ffffff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:85: root bus resource [mem 0x385000000000-0x385fffffffff window] Apr 8 00:52:20 warble2 kernel: ACPI: PCI Root Bridge [PC08] (domain 0000 [bus ae-d6]) Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:08: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:08: PCIe AER handled by firmware Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:08: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:08: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:52:20 warble2 kernel: PCI host bridge to bus 0000:ae Apr 8 00:52:20 warble2 kernel: pci_bus 0000:ae: root bus resource [bus ae-d6] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:ae: root bus resource [io 0xc000-0xdfff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:ae: root bus resource [mem 0xe1000000-0xee7fffff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:ae: root bus resource [mem 0x386000000000-0x386fffffffff window] Apr 8 00:52:20 warble2 kernel: ACPI: PCI Root Bridge [PC09] (domain 0000 [bus d7-ff]) Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:09: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:09: PCIe AER handled by firmware Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:09: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:52:20 warble2 kernel: acpi PNP0A08:09: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:52:20 warble2 kernel: PCI host bridge to bus 0000:d7 Apr 8 00:52:20 warble2 kernel: pci_bus 0000:d7: root bus resource [bus d7-ff] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:d7: root bus resource [io 0xe000-0xffff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:d7: root bus resource [mem 0xee800000-0xfbffffff window] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:d7: root bus resource [mem 0x387000000000-0x387fffffffff window] Apr 8 00:52:20 warble2 kernel: pci 0000:d7:00.0: System wakeup disabled by ACPI Apr 8 00:52:20 warble2 kernel: pci 0000:d7:00.0: PCI bridge to [bus d8] Apr 8 00:52:20 warble2 kernel: ACPI: Enabled 3 GPEs in block 00 to 7F Apr 8 00:52:20 warble2 kernel: vgaarb: device added: PCI:0000:03:00.0,decodes=io+mem,owns=io+mem,locks=none Apr 8 00:52:20 warble2 kernel: vgaarb: loaded Apr 8 00:52:20 warble2 kernel: vgaarb: bridge control possible 0000:03:00.0 Apr 8 00:52:20 warble2 kernel: SCSI subsystem initialized Apr 8 00:52:20 warble2 kernel: ACPI: bus type USB registered Apr 8 00:52:20 warble2 kernel: usbcore: registered new interface driver usbfs Apr 8 00:52:20 warble2 kernel: usbcore: registered new interface driver hub Apr 8 00:52:20 warble2 kernel: usbcore: registered new device driver usb Apr 8 00:52:20 warble2 kernel: PCI: Using ACPI for IRQ routing Apr 8 00:52:20 warble2 kernel: Expanded resource reserved due to conflict with PNP0003:00 Apr 8 00:52:20 warble2 kernel: NetLabel: Initializing Apr 8 00:52:20 warble2 kernel: NetLabel: domain hash size = 128 Apr 8 00:52:20 warble2 kernel: NetLabel: protocols = UNLABELED CIPSOv4 Apr 8 00:52:20 warble2 kernel: NetLabel: unlabeled traffic allowed by default Apr 8 00:52:20 warble2 kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 Apr 8 00:52:20 warble2 kernel: hpet0: 8 comparators, 64-bit 24.000000 MHz counter Apr 8 00:52:20 warble2 kernel: amd_nb: Cannot enumerate AMD northbridges Apr 8 00:52:20 warble2 kernel: Switched to clocksource hpet Apr 8 00:52:20 warble2 kernel: pnp: PnP ACPI init Apr 8 00:52:20 warble2 kernel: ACPI: bus type PNP registered Apr 8 00:52:20 warble2 kernel: system 00:01: [io 0x0500-0x053f] could not be reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [io 0x0400-0x047f] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [io 0x0540-0x057f] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [io 0x0600-0x061f] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [io 0x0ca0-0x0ca5] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [io 0x0880-0x0883] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [io 0x0800-0x081f] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [mem 0xff000000-0xffffffff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:04: [mem 0xfd000000-0xfdabffff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:04: [mem 0xfdad0000-0xfdadffff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:04: [mem 0xfdb00000-0xfdffffff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:04: [mem 0xfe000000-0xfe00ffff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:04: [mem 0xfe011000-0xfe01ffff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:04: [mem 0xfe036000-0xfe03bfff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:04: [mem 0xfe03d000-0xfe3fffff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:04: [mem 0xfe410000-0xfe7fffff] has been reserved Apr 8 00:52:20 warble2 kernel: system 00:05: [io 0x1000-0x10fe] has been reserved Apr 8 00:52:20 warble2 kernel: pnp: PnP ACPI: found 6 devices Apr 8 00:52:20 warble2 kernel: ACPI: bus type PNP unregistered Apr 8 00:52:20 warble2 kernel: pci 0000:18:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.0: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.1: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.2: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.3: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 8 00:52:20 warble2 kernel: pci 0000:3b:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window Apr 8 00:52:20 warble2 kernel: pci 0000:d8:00.0: can't claim BAR 6 [mem 0xfffe0000-0xffffffff pref]: no compatible bridge window Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.0: BAR 15: assigned [mem 0x380000000000-0x3800001fffff 64bit pref] Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.0: BAR 13: assigned [io 0x3000-0x3fff] Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.0: PCI bridge to [bus 01] Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.0: bridge window [io 0x3000-0x3fff] Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.0: bridge window [mem 0x92a00000-0x92bfffff] Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.0: bridge window [mem 0x380000000000-0x3800001fffff 64bit pref] Apr 8 00:52:20 warble2 kernel: pci 0000:02:00.0: PCI bridge to [bus 03] Apr 8 00:52:20 warble2 kernel: pci 0000:02:00.0: bridge window [mem 0x92000000-0x928fffff] Apr 8 00:52:20 warble2 kernel: pci 0000:02:00.0: bridge window [mem 0x91000000-0x91ffffff 64bit pref] Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.4: PCI bridge to [bus 02-03] Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.4: bridge window [mem 0x92000000-0x928fffff] Apr 8 00:52:20 warble2 kernel: pci 0000:00:1c.4: bridge window [mem 0x91000000-0x91ffffff 64bit pref] Apr 8 00:52:20 warble2 kernel: pci 0000:17:02.0: BAR 14: assigned [mem 0xa1c00000-0xa1dfffff] Apr 8 00:52:20 warble2 kernel: pci 0000:18:00.0: BAR 6: no space for [mem size 0x00100000 pref] Apr 8 00:52:20 warble2 kernel: pci 0000:18:00.0: BAR 6: failed to assign [mem size 0x00100000 pref] Apr 8 00:52:20 warble2 kernel: pci 0000:17:00.0: PCI bridge to [bus 18] Apr 8 00:52:20 warble2 kernel: pci 0000:17:00.0: bridge window [io 0x4000-0x4fff] Apr 8 00:52:20 warble2 kernel: pci 0000:17:00.0: bridge window [mem 0xa1900000-0xa1afffff] Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.0: BAR 6: assigned [mem 0xa1c00000-0xa1c7ffff pref] Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.1: BAR 6: assigned [mem 0xa1c80000-0xa1cfffff pref] Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.2: BAR 6: assigned [mem 0xa1d00000-0xa1d7ffff pref] Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.3: BAR 6: assigned [mem 0xa1d80000-0xa1dfffff pref] Apr 8 00:52:20 warble2 kernel: pci 0000:17:02.0: PCI bridge to [bus 19] Apr 8 00:52:20 warble2 kernel: pci 0000:17:02.0: bridge window [mem 0xa1c00000-0xa1dfffff] Apr 8 00:52:20 warble2 kernel: pci 0000:17:02.0: bridge window [mem 0x9d800000-0xa18fffff 64bit pref] Apr 8 00:52:20 warble2 kernel: pci 0000:3b:00.0: BAR 6: no space for [mem size 0x00100000 pref] Apr 8 00:52:20 warble2 kernel: pci 0000:3b:00.0: BAR 6: failed to assign [mem size 0x00100000 pref] Apr 8 00:52:20 warble2 kernel: pci 0000:3b:00.0: BAR 9: no space for [mem size 0x01000000 64bit] Apr 8 00:52:20 warble2 kernel: pci 0000:3b:00.0: BAR 9: failed to assign [mem size 0x01000000 64bit] Apr 8 00:52:20 warble2 kernel: pci 0000:3b:00.0: BAR 7: no space for [mem size 0x00100000 64bit] Apr 8 00:52:20 warble2 kernel: pci 0000:3b:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit] Apr 8 00:52:20 warble2 kernel: pci 0000:3a:00.0: PCI bridge to [bus 3b] Apr 8 00:52:20 warble2 kernel: pci 0000:3a:00.0: bridge window [io 0x6000-0x6fff] Apr 8 00:52:20 warble2 kernel: pci 0000:3a:00.0: bridge window [mem 0xab000000-0xab1fffff] Apr 8 00:52:20 warble2 kernel: pci_bus 0000:3a: Some PCI device resources are unassigned, try booting with pci=realloc Apr 8 00:52:20 warble2 kernel: pci 0000:d8:00.0: BAR 6: no space for [mem size 0x00020000 pref] Apr 8 00:52:20 warble2 kernel: pci 0000:d8:00.0: BAR 6: failed to assign [mem size 0x00020000 pref] Apr 8 00:52:20 warble2 kernel: pci 0000:d7:00.0: PCI bridge to [bus d8] Apr 8 00:52:20 warble2 kernel: pci 0000:d7:00.0: bridge window [mem 0xf0000000-0xf3ffffff] Apr 8 00:52:20 warble2 kernel: NET: Registered protocol family 2 Apr 8 00:52:20 warble2 kernel: TCP established hash table entries: 524288 (order: 10, 4194304 bytes) Apr 8 00:52:20 warble2 kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) Apr 8 00:52:20 warble2 kernel: TCP: Hash tables configured (established 524288 bind 65536) Apr 8 00:52:20 warble2 kernel: TCP: reno registered Apr 8 00:52:20 warble2 kernel: UDP hash table entries: 65536 (order: 9, 2097152 bytes) Apr 8 00:52:20 warble2 kernel: UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes) Apr 8 00:52:20 warble2 kernel: NET: Registered protocol family 1 Apr 8 00:52:20 warble2 kernel: Unpacking initramfs... Apr 8 00:52:20 warble2 kernel: Freeing initrd memory: 46592k freed Apr 8 00:52:20 warble2 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Apr 8 00:52:20 warble2 kernel: software IO TLB [mem 0x6582a000-0x6982a000] (64MB) mapped at [ffff88006582a000-ffff880069829fff] Apr 8 00:52:20 warble2 kernel: Intel CQM monitoring enabled Apr 8 00:52:20 warble2 kernel: Intel MBM enabled Apr 8 00:52:20 warble2 kernel: RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer Apr 8 00:52:20 warble2 kernel: RAPL PMU: hw unit of domain pp0-core 2^-14 Joules Apr 8 00:52:20 warble2 kernel: RAPL PMU: hw unit of domain package 2^-14 Joules Apr 8 00:52:20 warble2 kernel: RAPL PMU: hw unit of domain dram 2^-16 Joules Apr 8 00:52:20 warble2 kernel: sha1_ssse3: Using AVX2 optimized SHA-1 implementation Apr 8 00:52:20 warble2 kernel: sha256_ssse3: Using AVX2 optimized SHA-256 implementation Apr 8 00:52:20 warble2 kernel: futex hash table entries: 131072 (order: 11, 8388608 bytes) Apr 8 00:52:20 warble2 kernel: Initialise system trusted keyring Apr 8 00:52:20 warble2 kernel: HugeTLB registered 1 GB page size, pre-allocated 0 pages Apr 8 00:52:20 warble2 kernel: HugeTLB registered 2 MB page size, pre-allocated 0 pages Apr 8 00:52:20 warble2 kernel: zpool: loaded Apr 8 00:52:20 warble2 kernel: zbud: loaded Apr 8 00:52:20 warble2 kernel: VFS: Disk quotas dquot_6.5.2 Apr 8 00:52:20 warble2 kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Apr 8 00:52:20 warble2 kernel: msgmni has been set to 32768 Apr 8 00:52:20 warble2 kernel: Key type big_key registered Apr 8 00:52:20 warble2 kernel: NET: Registered protocol family 38 Apr 8 00:52:20 warble2 kernel: Key type asymmetric registered Apr 8 00:52:20 warble2 kernel: Asymmetric key parser 'x509' registered Apr 8 00:52:20 warble2 kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) Apr 8 00:52:20 warble2 kernel: io scheduler noop registered Apr 8 00:52:20 warble2 kernel: io scheduler deadline registered (default) Apr 8 00:52:20 warble2 kernel: io scheduler cfq registered Apr 8 00:52:20 warble2 kernel: pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pcieport 0000:00:1c.4: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pci 0000:02:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pci 0000:03:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pcieport 0000:17:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pci 0000:18:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pcieport 0000:17:02.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.1: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.2: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pci 0000:19:00.3: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pcieport 0000:3a:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pci 0000:3b:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pcieport 0000:d7:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pci 0000:d8:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:52:20 warble2 kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5 Apr 8 00:52:20 warble2 kernel: pciehp 0000:00:1c.0:pcie04: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl+ LLActRep+ Apr 8 00:52:20 warble2 kernel: pciehp: PCI Express Hot Plug Controller Driver version: 0.4 Apr 8 00:52:20 warble2 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 Apr 8 00:52:20 warble2 kernel: ACPI: Power Button [PWRF] Apr 8 00:52:20 warble2 kernel: ERST: Error Record Serialization Table (ERST) support is initialized. Apr 8 00:52:20 warble2 kernel: pstore: Registered erst as persistent store backend Apr 8 00:52:20 warble2 kernel: GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. Apr 8 00:52:20 warble2 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Apr 8 00:52:20 warble2 kernel: 00:02: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Apr 8 00:52:20 warble2 kernel: 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A Apr 8 00:52:20 warble2 kernel: Non-volatile memory driver v1.3 Apr 8 00:52:20 warble2 kernel: Linux agpgart interface v0.103 Apr 8 00:52:20 warble2 kernel: crash memory driver: version 1.1 Apr 8 00:52:20 warble2 kernel: rdac: device handler registered Apr 8 00:52:20 warble2 kernel: hp_sw: device handler registered Apr 8 00:52:20 warble2 kernel: emc: device handler registered Apr 8 00:52:20 warble2 kernel: alua: device handler registered Apr 8 00:52:20 warble2 kernel: libphy: Fixed MDIO Bus: probed Apr 8 00:52:20 warble2 kernel: ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver Apr 8 00:52:20 warble2 kernel: ehci-pci: EHCI PCI platform driver Apr 8 00:52:20 warble2 kernel: ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver Apr 8 00:52:20 warble2 kernel: ohci-pci: OHCI PCI platform driver Apr 8 00:52:20 warble2 kernel: uhci_hcd: USB Universal Host Controller Interface driver Apr 8 00:52:20 warble2 kernel: xhci_hcd 0000:00:14.0: xHCI Host Controller Apr 8 00:52:20 warble2 kernel: xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 1 Apr 8 00:52:20 warble2 kernel: xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810 Apr 8 00:52:20 warble2 kernel: usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 Apr 8 00:52:20 warble2 kernel: usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Apr 8 00:52:20 warble2 kernel: usb usb1: Product: xHCI Host Controller Apr 8 00:52:20 warble2 kernel: usb usb1: Manufacturer: Linux 3.10.0-693.17.1.el7.x86_64 xhci-hcd Apr 8 00:52:20 warble2 kernel: usb usb1: SerialNumber: 0000:00:14.0 Apr 8 00:52:20 warble2 kernel: hub 1-0:1.0: USB hub found Apr 8 00:52:20 warble2 kernel: hub 1-0:1.0: 16 ports detected Apr 8 00:52:20 warble2 kernel: xhci_hcd 0000:00:14.0: xHCI Host Controller Apr 8 00:52:20 warble2 kernel: xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 Apr 8 00:52:20 warble2 kernel: usb usb2: New USB device found, idVendor=1d6b, idProduct=0003 Apr 8 00:52:20 warble2 kernel: usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Apr 8 00:52:20 warble2 kernel: usb usb2: Product: xHCI Host Controller Apr 8 00:52:20 warble2 kernel: usb usb2: Manufacturer: Linux 3.10.0-693.17.1.el7.x86_64 xhci-hcd Apr 8 00:52:20 warble2 kernel: usb usb2: SerialNumber: 0000:00:14.0 Apr 8 00:52:20 warble2 kernel: hub 2-0:1.0: USB hub found Apr 8 00:52:20 warble2 kernel: hub 2-0:1.0: 10 ports detected Apr 8 00:52:20 warble2 kernel: usb: port power management may be unreliable Apr 8 00:52:20 warble2 kernel: usbcore: registered new interface driver usbserial Apr 8 00:52:20 warble2 kernel: usbcore: registered new interface driver usbserial_generic Apr 8 00:52:20 warble2 kernel: usbserial: USB Serial support registered for generic Apr 8 00:52:20 warble2 kernel: i8042: PNP: No PS/2 controller found. Probing ports directly. Apr 8 00:52:20 warble2 kernel: usb 1-14: new high-speed USB device number 2 using xhci_hcd Apr 8 00:52:20 warble2 kernel: usb 1-14: New USB device found, idVendor=1604, idProduct=10c0 Apr 8 00:52:20 warble2 kernel: usb 1-14: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Apr 8 00:52:20 warble2 kernel: hub 1-14:1.0: USB hub found Apr 8 00:52:20 warble2 kernel: hub 1-14:1.0: 4 ports detected Apr 8 00:52:20 warble2 kernel: i8042: No controller found Apr 8 00:52:20 warble2 kernel: tsc: Refined TSC clocksource calibration: 3192.499 MHz Apr 8 00:52:20 warble2 kernel: mousedev: PS/2 mouse device common for all mice Apr 8 00:52:20 warble2 kernel: usb 1-14.1: new high-speed USB device number 3 using xhci_hcd Apr 8 00:52:20 warble2 kernel: Switched to clocksource tsc Apr 8 00:52:20 warble2 kernel: rtc_cmos 00:00: RTC can wake from S4 Apr 8 00:52:20 warble2 kernel: rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0 Apr 8 00:52:20 warble2 kernel: rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs Apr 8 00:52:20 warble2 kernel: cpuidle: using governor menu Apr 8 00:52:20 warble2 kernel: hidraw: raw HID events driver (C) Jiri Kosina Apr 8 00:52:20 warble2 kernel: usbcore: registered new interface driver usbhid Apr 8 00:52:20 warble2 kernel: usbhid: USB HID core driver Apr 8 00:52:20 warble2 kernel: drop_monitor: Initializing network drop monitor service Apr 8 00:52:20 warble2 kernel: TCP: cubic registered Apr 8 00:52:20 warble2 kernel: Initializing XFRM netlink socket Apr 8 00:52:20 warble2 kernel: NET: Registered protocol family 10 Apr 8 00:52:20 warble2 kernel: NET: Registered protocol family 17 Apr 8 00:52:20 warble2 kernel: intel_rdt: Intel RDT L3 allocation detected Apr 8 00:52:20 warble2 kernel: intel_rdt: Intel RDT L3DATA allocation detected Apr 8 00:52:20 warble2 kernel: intel_rdt: Intel RDT L3CODE allocation detected Apr 8 00:52:20 warble2 kernel: microcode: CPU0 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU1 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU2 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU3 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU4 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU5 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU6 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU7 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU8 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU9 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU10 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU11 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU12 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU13 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU14 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: CPU15 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:52:20 warble2 kernel: microcode: Microcode Update Driver: v2.01 , Peter Oruba Apr 8 00:52:20 warble2 kernel: Loading compiled-in X.509 certificates Apr 8 00:52:20 warble2 kernel: Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' Apr 8 00:52:20 warble2 kernel: Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' Apr 8 00:52:20 warble2 kernel: Loaded X.509 cert 'CentOS Linux kernel signing key: 506c6868809d2cbf540bf0d983d5c6709dbc4f22' Apr 8 00:52:20 warble2 kernel: registered taskstats version 1 Apr 8 00:52:20 warble2 kernel: Key type trusted registered Apr 8 00:52:20 warble2 kernel: Key type encrypted registered Apr 8 00:52:20 warble2 kernel: IMA: No TPM chip found, activating TPM-bypass! Apr 8 00:52:20 warble2 kernel: Magic number: 14:336:889 Apr 8 00:52:20 warble2 kernel: event_source uncore_pcu: hash matches Apr 8 00:52:20 warble2 kernel: clockevents clockevent442: hash matches Apr 8 00:52:20 warble2 kernel: pci 0000:00:1f.2: hash matches Apr 8 00:52:20 warble2 kernel: acpi device:f8: hash matches Apr 8 00:52:20 warble2 kernel: acpi device:cb: hash matches Apr 8 00:52:20 warble2 kernel: memory memory5610: hash matches Apr 8 00:52:20 warble2 kernel: memory memory5164: hash matches Apr 8 00:52:20 warble2 kernel: memory memory4328: hash matches Apr 8 00:52:20 warble2 kernel: memory memory3042: hash matches Apr 8 00:52:20 warble2 kernel: memory memory1796: hash matches Apr 8 00:52:20 warble2 kernel: memory memory1115: hash matches Apr 8 00:52:20 warble2 kernel: memory memory328: hash matches Apr 8 00:52:20 warble2 kernel: rtc_cmos 00:00: setting system clock to 2018-04-07 14:52:19 UTC (1523112739) Apr 8 00:52:20 warble2 kernel: usb 1-14.1: New USB device found, idVendor=1604, idProduct=10c0 Apr 8 00:52:20 warble2 kernel: usb 1-14.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Apr 8 00:52:20 warble2 kernel: hub 1-14.1:1.0: USB hub found Apr 8 00:52:20 warble2 kernel: hub 1-14.1:1.0: 4 ports detected Apr 8 00:52:20 warble2 kernel: usb 1-14.4: new high-speed USB device number 4 using xhci_hcd Apr 8 00:52:20 warble2 kernel: usb 1-14.4: New USB device found, idVendor=1604, idProduct=10c0 Apr 8 00:52:20 warble2 kernel: usb 1-14.4: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Apr 8 00:52:20 warble2 kernel: hub 1-14.4:1.0: USB hub found Apr 8 00:52:20 warble2 kernel: hub 1-14.4:1.0: 4 ports detected Apr 8 00:52:20 warble2 kernel: Freeing unused kernel memory: 1800k freed Apr 8 00:52:20 warble2 systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) Apr 8 00:52:20 warble2 systemd[1]: Detected architecture x86-64. Apr 8 00:52:20 warble2 systemd[1]: Running in initial RAM disk. Apr 8 00:52:20 warble2 systemd[1]: No hostname configured. Apr 8 00:52:20 warble2 systemd[1]: Set hostname to . Apr 8 00:52:20 warble2 systemd[1]: Initializing machine ID from random generator. Apr 8 00:52:20 warble2 systemd[1]: Reached target Local File Systems. Apr 8 00:52:20 warble2 systemd[1]: Starting Local File Systems. Apr 8 00:52:20 warble2 systemd[1]: Started Dispatch Password Requests to Console Directory Watch. Apr 8 00:52:20 warble2 systemd[1]: Starting Dispatch Password Requests to Console Directory Watch. Apr 8 00:52:20 warble2 systemd[1]: Reached target Paths. Apr 8 00:52:20 warble2 systemd[1]: Starting Paths. Apr 8 00:52:20 warble2 systemd[1]: Reached target Timers. Apr 8 00:52:20 warble2 systemd[1]: Starting Timers. Apr 8 00:52:20 warble2 systemd[1]: Reached target Swap. Apr 8 00:52:20 warble2 systemd[1]: Starting Swap. Apr 8 00:52:20 warble2 systemd[1]: Created slice Root Slice. Apr 8 00:52:20 warble2 systemd[1]: Starting Root Slice. Apr 8 00:52:20 warble2 systemd[1]: Created slice System Slice. Apr 8 00:52:20 warble2 systemd[1]: Starting System Slice. Apr 8 00:52:20 warble2 systemd[1]: Reached target Slices. Apr 8 00:52:20 warble2 systemd[1]: Starting Slices. Apr 8 00:52:20 warble2 systemd[1]: Listening on udev Control Socket. Apr 8 00:52:20 warble2 systemd[1]: Starting udev Control Socket. Apr 8 00:52:20 warble2 systemd[1]: Listening on udev Kernel Socket. Apr 8 00:52:20 warble2 systemd[1]: Starting udev Kernel Socket. Apr 8 00:52:20 warble2 systemd[1]: Listening on Journal Socket. Apr 8 00:52:20 warble2 systemd[1]: Starting Journal Socket. Apr 8 00:52:20 warble2 systemd[1]: Starting dracut cmdline hook... Apr 8 00:52:20 warble2 systemd[1]: Reached target Sockets. Apr 8 00:52:20 warble2 systemd[1]: Starting Sockets. Apr 8 00:52:20 warble2 systemd[1]: Starting Create list of required static device nodes for the current kernel... Apr 8 00:52:20 warble2 systemd[1]: Starting Journal Service... Apr 8 00:52:20 warble2 systemd[1]: Starting Load Kernel Modules... Apr 8 00:52:20 warble2 systemd[1]: Started dracut cmdline hook. Apr 8 00:52:20 warble2 journal: Journal started Apr 8 00:52:20 warble2 systemd[1]: Started Create list of required static device nodes for the current kernel. Apr 8 00:52:20 warble2 systemd[1]: Started Load Kernel Modules. Apr 8 00:52:20 warble2 systemd[1]: Started Journal Service. Apr 8 00:52:20 warble2 systemd: Starting Apply Kernel Variables... Apr 8 00:52:20 warble2 systemd: Starting Create Static Device Nodes in /dev... Apr 8 00:52:20 warble2 systemd: Starting dracut pre-udev hook... Apr 8 00:52:20 warble2 systemd: Started Apply Kernel Variables. Apr 8 00:52:20 warble2 systemd: Started Create Static Device Nodes in /dev. Apr 8 00:52:20 warble2 systemd: Started dracut pre-udev hook. Apr 8 00:52:20 warble2 systemd: Starting udev Kernel Device Manager... Apr 8 00:52:20 warble2 systemd-udevd: starting version 219 Apr 8 00:52:20 warble2 systemd: Started udev Kernel Device Manager. Apr 8 00:52:20 warble2 systemd: Starting dracut pre-trigger hook... Apr 8 00:52:20 warble2 systemd: Started dracut pre-trigger hook. Apr 8 00:52:20 warble2 systemd: Starting udev Coldplug all Devices... Apr 8 00:52:20 warble2 systemd: Mounting Configuration File System... Apr 8 00:52:20 warble2 systemd: Mounted Configuration File System. Apr 8 00:52:20 warble2 systemd-udevd: could not find module by name='ipmi_si' Apr 8 00:52:20 warble2 systemd-udevd: could not find module by name='ipmi_devintf' Apr 8 00:52:20 warble2 systemd-udevd: could not find module by name='ipmi_msghandler' Apr 8 00:52:20 warble2 kernel: pps_core: LinuxPPS API ver. 1 registered Apr 8 00:52:20 warble2 kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Apr 8 00:52:20 warble2 kernel: PTP clock support registered Apr 8 00:52:20 warble2 kernel: megasas: 07.701.17.00-rh1 Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: FW now in Ready state Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: firmware supports msix#011: (96) Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: current msix/online cpus#011: (16/16) Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: RDPQ mode#011: (disabled) Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: Current firmware maximum commands: 928#011 LDIO threshold: 0 Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: FW supports sync cache#011: No Apr 8 00:52:20 warble2 systemd: Started udev Coldplug all Devices. Apr 8 00:52:20 warble2 kernel: bnx2x: QLogic 5771x/578xx 10/20-Gigabit Ethernet Driver bnx2x 1.712.30-0 (2014/02/10) Apr 8 00:52:20 warble2 kernel: mpt3sas version 15.100.00.00 loaded Apr 8 00:52:20 warble2 kernel: mpt3sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (791015680 kB) Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: Init cmd success Apr 8 00:52:20 warble2 kernel: bnx2x 0000:19:00.0: msix capability found Apr 8 00:52:20 warble2 kernel: bnx2x 0000:19:00.0: part number 0-0-0-0 Apr 8 00:52:20 warble2 kernel: ahci 0000:00:11.5: AHCI 0001.0301 32 slots 6 ports 6 Gbps 0x3f impl SATA mode Apr 8 00:52:20 warble2 kernel: ahci 0000:00:11.5: flags: 64bit ncq sntf pm led clo only pio slum part ems deso sadm sds apst Apr 8 00:52:20 warble2 systemd: Reached target System Initialization. Apr 8 00:52:20 warble2 systemd: Starting System Initialization. Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: firmware type#011: Extended VD(240 VD)firmware Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: controller type#011: MR(2048MB) Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: Online Controller Reset(OCR)#011: Enabled Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: Secure JBOD support#011: No Apr 8 00:52:20 warble2 kernel: scsi host2: ahci Apr 8 00:52:20 warble2 kernel: scsi host3: ahci Apr 8 00:52:20 warble2 kernel: scsi host4: ahci Apr 8 00:52:20 warble2 kernel: scsi host5: ahci Apr 8 00:52:20 warble2 kernel: scsi host6: ahci Apr 8 00:52:20 warble2 kernel: scsi host7: ahci Apr 8 00:52:20 warble2 kernel: ata1: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80100 irq 53 Apr 8 00:52:20 warble2 kernel: ata2: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80180 irq 53 Apr 8 00:52:20 warble2 kernel: ata3: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80200 irq 53 Apr 8 00:52:20 warble2 kernel: ata4: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80280 irq 53 Apr 8 00:52:20 warble2 kernel: ata5: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80300 irq 53 Apr 8 00:52:20 warble2 kernel: ata6: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80380 irq 53 Apr 8 00:52:20 warble2 kernel: ahci 0000:00:17.0: AHCI 0001.0301 32 slots 8 ports 6 Gbps 0xff impl SATA mode Apr 8 00:52:20 warble2 kernel: ahci 0000:00:17.0: flags: 64bit ncq sntf pm led clo only pio slum part ems deso sadm sds apst Apr 8 00:52:20 warble2 kernel: mpt3sas_cm0: MSI-X vectors supported: 96, no of cores: 16, max_msix_vectors: -1 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 55 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 56 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 57 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 58 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 59 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 60 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 61 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 62 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 63 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 64 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 65 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 66 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 67 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 68 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 69 Apr 8 00:52:20 warble2 kernel: mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 70 Apr 8 00:52:20 warble2 kernel: mpt3sas_cm0: iomem(0x00000000ab100000), mapped(0xffffc90063660000), size(65536) Apr 8 00:52:20 warble2 kernel: mpt3sas_cm0: ioport(0x0000000000006000), size(256) Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: INIT adapter done Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: Jbod map is not supported megasas_setup_jbod_map 5121 Apr 8 00:52:20 warble2 kernel: scsi host8: ahci Apr 8 00:52:20 warble2 kernel: scsi host9: ahci Apr 8 00:52:20 warble2 kernel: scsi host10: ahci Apr 8 00:52:20 warble2 kernel: scsi host11: ahci Apr 8 00:52:20 warble2 kernel: scsi host12: ahci Apr 8 00:52:20 warble2 kernel: scsi host13: ahci Apr 8 00:52:20 warble2 kernel: scsi host14: ahci Apr 8 00:52:20 warble2 kernel: scsi host15: ahci Apr 8 00:52:20 warble2 kernel: ata7: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00100 irq 54 Apr 8 00:52:20 warble2 kernel: ata8: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00180 irq 54 Apr 8 00:52:20 warble2 kernel: ata9: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00200 irq 54 Apr 8 00:52:20 warble2 kernel: ata10: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00280 irq 54 Apr 8 00:52:20 warble2 kernel: ata11: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00300 irq 54 Apr 8 00:52:20 warble2 kernel: ata12: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00380 irq 54 Apr 8 00:52:20 warble2 kernel: ata13: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00400 irq 54 Apr 8 00:52:20 warble2 kernel: ata14: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00480 irq 54 Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: pci id#011#011: (0x1000)/(0x005d)/(0x1028)/(0x1f42) Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: unevenspan support#011: yes Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: firmware crash dump#011: no Apr 8 00:52:20 warble2 kernel: megaraid_sas 0000:18:00.0: jbod sync map#011#011: no Apr 8 00:52:20 warble2 kernel: scsi host0: Avago SAS based MegaRAID driver Apr 8 00:52:21 warble2 kernel: scsi 0:2:0:0: Direct-Access DELL PERC H730P Adp 4.28 PQ: 0 ANSI: 5 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: Eager buffer size 2097152 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: enabling device (0000 -> 0002) Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: WC Remapped RcvArray: ffffc90063d00000 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Implementation: RTL silicon, revision 0x0 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: GUID 1175010171d0f9 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Resetting CSRs with FLR Apr 8 00:52:21 warble2 kernel: mpt3sas_cm0: Allocated physical memory: size(18353 kB) Apr 8 00:52:21 warble2 kernel: mpt3sas_cm0: Current Controller Queue Depth(9548),Max Controller Queue Depth(9680) Apr 8 00:52:21 warble2 kernel: mpt3sas_cm0: Scatter Gather Elements per IO(128) Apr 8 00:52:21 warble2 kernel: bnx2x 0000:19:00.1: msix capability found Apr 8 00:52:21 warble2 kernel: bnx2x 0000:19:00.1: part number 0-0-0-0 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe,8000MHz,x16 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: do_pcie_gen3_transition: PCIe already at gen3, skipping Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Board description not found Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: rcv contexts: chip 160, used 25 (kernel 9, user 16) Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: RcvArray groups 327, ctxts extra 17 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: unused send context blocks: 9 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: send contexts: chip 160, used 42 (kernel 16, ack 9, user 16, vl15 1) Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Using send context 16(143) for VL15 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA mod_num_sdma: 0 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_engines: 16 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_mem_size: 401408 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA engines 16 descq_cnt 2048 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA num_sdma: 16 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: 26 MSI-X interrupts allocated Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 83, type GENERAL -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 84, type SDMA engine 0 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 85, type SDMA engine 1 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 86, type SDMA engine 2 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 87, type SDMA engine 3 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 88, type SDMA engine 4 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 89, type SDMA engine 5 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 90, type SDMA engine 6 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 91, type SDMA engine 7 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 92, type SDMA engine 8 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 93, type SDMA engine 9 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 94, type SDMA engine 10 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 95, type SDMA engine 11 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 96, type SDMA engine 12 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 97, type SDMA engine 13 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 98, type SDMA engine 14 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 99, type SDMA engine 15 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 100, type RCVCTXT ctxt 0 -> cpu: 1 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 101, type RCVCTXT ctxt 1 -> cpu: 3 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 102, type RCVCTXT ctxt 2 -> cpu: 5 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 103, type RCVCTXT ctxt 3 -> cpu: 7 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 112, type RCVCTXT ctxt 4 -> cpu: 9 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 113, type RCVCTXT ctxt 5 -> cpu: 11 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 114, type RCVCTXT ctxt 6 -> cpu: 13 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 115, type RCVCTXT ctxt 7 -> cpu: 15 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 116, type RCVCTXT ctxt 8 -> cpu: 3 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 8 00:52:21 warble2 kernel: mpt3sas_cm0: LSISAS3008: FWVersion(13.15.02.00), ChipRevision(0x02), BiosVersion(15.00.02.00) Apr 8 00:52:21 warble2 kernel: mpt3sas_cm0: Protocol=( Apr 8 00:52:21 warble2 kernel: Initiator Apr 8 00:52:21 warble2 kernel: ,Target Apr 8 00:52:21 warble2 kernel: ), Apr 8 00:52:21 warble2 kernel: Capabilities=( Apr 8 00:52:21 warble2 kernel: TLR Apr 8 00:52:21 warble2 kernel: ,EEDP Apr 8 00:52:21 warble2 kernel: ,Snapshot Buffer Apr 8 00:52:21 warble2 kernel: ,Diag Trace Buffer Apr 8 00:52:21 warble2 kernel: ,Task Set Full Apr 8 00:52:21 warble2 kernel: ,NCQ Apr 8 00:52:21 warble2 kernel: ) Apr 8 00:52:21 warble2 kernel: scsi host1: Fusion MPT SAS Host Apr 8 00:52:21 warble2 kernel: mpt3sas_cm0: sending port enable !! Apr 8 00:52:21 warble2 kernel: ata6: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata2: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata5: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata4: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata3: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata1: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: bnx2x 0000:19:00.2: msix capability found Apr 8 00:52:21 warble2 kernel: bnx2x 0000:19:00.2: part number 0-0-0-0 Apr 8 00:52:21 warble2 kernel: ata8: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata7: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata9: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata12: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata14: SATA link up 1.5 Gbps (SStatus 113 SControl 300) Apr 8 00:52:21 warble2 kernel: ata10: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata11: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata13: SATA link down (SStatus 0 SControl 300) Apr 8 00:52:21 warble2 kernel: ata14.00: ATAPI: HL-DT-ST DVD-ROM DU90N, D3C0, max UDMA/100 Apr 8 00:52:21 warble2 kernel: ata14.00: configured for UDMA/100 Apr 8 00:52:21 warble2 kernel: scsi: waiting for bus probes to complete ... Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051 firmware version 1.24 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SBus Master firmware version 0x10130001 Apr 8 00:52:21 warble2 kernel: bnx2x 0000:19:00.3: msix capability found Apr 8 00:52:21 warble2 kernel: bnx2x 0000:19:00.3: part number 0-0-0-0 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe SerDes firmware version 0x4755 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric SerDes firmware version 0x1055 Apr 8 00:52:21 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Initializing thermal sensor Apr 8 00:52:21 warble2 systemd: Reached target Basic System. Apr 8 00:52:21 warble2 systemd: Starting Basic System. Apr 8 00:52:21 warble2 systemd: Starting dracut initqueue hook... Apr 8 00:52:21 warble2 kernel: sd 0:2:0:0: [sda] 584843264 512-byte logical blocks: (299 GB/278 GiB) Apr 8 00:52:21 warble2 kernel: sd 0:2:0:0: [sda] Write Protect is off Apr 8 00:52:21 warble2 kernel: sd 0:2:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA Apr 8 00:52:21 warble2 kernel: sda: sda1 sda2 Apr 8 00:52:21 warble2 kernel: sd 0:2:0:0: [sda] Attached SCSI disk Apr 8 00:52:22 warble2 kernel: Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011) Apr 8 00:52:22 warble2 kernel: bonding: bond0 is being created... Apr 8 00:52:22 warble2 kernel: mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x51866da0bde20500), phys(8) Apr 8 00:52:22 warble2 kernel: scsi 1:0:0:0: Direct-Access DELL MD34xx 0825 PQ: 1 ANSI: 5 Apr 8 00:52:22 warble2 kernel: scsi 1:0:0:0: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:22 warble2 kernel: scsi 1:0:0:0: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:22 warble2 kernel: scsi 1:0:0:0: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:22 warble2 kernel: scsi 1:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:22 warble2 kernel: bonding: bond0 already exists Apr 8 00:52:22 warble2 kernel: bond0: Setting MII monitoring interval to 100 Apr 8 00:52:22 warble2 kernel: bond0: Setting xmit hash policy to layer3+4 (1) Apr 8 00:52:22 warble2 kernel: bond0: Setting LACP rate to fast (1) Apr 8 00:52:22 warble2 kernel: IPv6: ADDRCONF(NETDEV_UP): bond0: link is not ready Apr 8 00:52:22 warble2 kernel: bond0: Adding slave em1 Apr 8 00:52:23 warble2 kernel: bnx2x 0000:19:00.0 em1: using MSI-X IRQs: sp 72 fp[0] 74 ... fp[7] 81 Apr 8 00:52:23 warble2 kernel: bnx2x 0000:19:00.0 em1: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 8 00:52:23 warble2 kernel: bnx2x 0000:19:00.0 em1: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 8 00:52:23 warble2 kernel: bond0: Enslaving em1 as a backup interface with an up link Apr 8 00:52:23 warble2 kernel: bond0: Adding slave em2 Apr 8 00:52:23 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: wait_for_qsfp_init: No IntN detected, reset complete Apr 8 00:52:23 warble2 kernel: bnx2x 0000:19:00.1 em2: using MSI-X IRQs: sp 117 fp[0] 119 ... fp[7] 126 Apr 8 00:52:23 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current OFFLINE, new POLL Apr 8 00:52:23 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 8 00:52:24 warble2 kernel: bnx2x 0000:19:00.1 em2: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 8 00:52:24 warble2 kernel: bnx2x 0000:19:00.1 em2: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 8 00:52:24 warble2 kernel: bond0: Enslaving em2 as a backup interface with an up link Apr 8 00:52:24 warble2 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready Apr 8 00:52:24 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Reserving QPNs from 0x800000 to 0x80ffff for non-verbs use Apr 8 00:52:24 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_POLL (0x2), phy 0x20 Apr 8 00:52:24 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Congestion Control Agent enabled for port 1 Apr 8 00:52:24 warble2 kernel: Couldn't create new SM AH Apr 8 00:52:24 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Registration with rdmavt done. Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:10: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:10: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:10: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:10: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:10: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:10: Mode parameters changed Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:11: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:11: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:11: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:11: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:11: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:11: Mode parameters changed Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:20: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:20: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:20: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:20: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:20: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:20: Mode parameters changed Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:21: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:21: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:21: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:21: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:21: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:21: Mode parameters changed Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:22: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:22: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:22: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:22: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:22: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:22: Mode parameters changed Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:23: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:23: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:23: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:23: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:23: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:23: Mode parameters changed Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:24: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:24: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:24: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:24: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:24: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:24: Mode parameters changed Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:25: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:25: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:25: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:25: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:25: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:25: Mode parameters changed Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:31: Direct-Access DELL Universal Xport 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:31: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:31: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:31: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:31: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:40: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:40: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:40: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:40: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:40: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:40: Mode parameters changed Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:41: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:41: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:41: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:41: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:41: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:41: Mode parameters changed Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:51: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:51: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:51: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:51: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:51: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:24 warble2 kernel: scsi 1:0:0:51: Mode parameters changed Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:52: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:52: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:52: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:52: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:52: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:52: Mode parameters changed Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:60: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:60: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:60: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:60: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:60: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:60: Mode parameters changed Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:61: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:61: SSP: handle(0x0009), sas_addr(0x500a0984b6603b10), phy(0), device_name(0x500a0984b6603b10) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:61: SSP: enclosure_logical_id(0x51866da0bde20500), slot(0) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:61: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:61: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:0:61: Mode parameters changed Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:0: Direct-Access DELL MD34xx 0825 PQ: 1 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:0: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:0: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:0: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:10: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:10: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:10: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: bnx2x 0000:19:00.0 em1: using MSI-X IRQs: sp 72 fp[0] 74 ... fp[7] 81 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:10: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:10: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:11: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:11: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:11: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:11: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:11: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:20: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:20: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:20: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:20: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:20: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:21: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:21: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:21: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:21: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: bnx2x 0000:19:00.0 em1: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 8 00:52:25 warble2 kernel: bnx2x 0000:19:00.0 em1: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:21: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:22: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:22: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:22: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:22: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:22: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:23: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:23: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:23: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:23: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:23: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:24: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:24: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:24: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:24: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:24: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:25: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:25: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:25: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:25: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:25: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:31: Direct-Access DELL Universal Xport 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:31: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:31: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:31: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:31: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:40: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:40: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:40: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:40: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:40: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:41: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:41: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:41: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:41: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:41: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:51: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:51: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:51: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:51: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:25 warble2 kernel: scsi 1:0:1:51: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:52: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:52: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:52: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:52: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:52: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:60: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:60: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:60: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:60: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:60: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:61: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:61: SSP: handle(0x000a), sas_addr(0x500a0984b65ea610), phy(4), device_name(0x500a0984b65ea610) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:61: SSP: enclosure_logical_id(0x51866da0bde20500), slot(4) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:61: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:52:26 warble2 kernel: scsi 1:0:1:61: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:52:26 warble2 kernel: bnx2x 0000:19:00.1 em2: using MSI-X IRQs: sp 117 fp[0] 119 ... fp[7] 126 Apr 8 00:52:26 warble2 kernel: bnx2x 0000:19:00.1 em2: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 8 00:52:26 warble2 kernel: bnx2x 0000:19:00.1 em2: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 8 00:52:26 warble2 dracut-initqueue: dhcp: PREINIT bond0 up Apr 8 00:52:26 warble2 dhclient[579]: DHCPDISCOVER on bond0 to 255.255.255.255 port 67 interval 5 (xid=0x2835235) Apr 8 00:52:27 warble2 kernel: mpt3sas_cm0: port enable: SUCCESS Apr 8 00:52:27 warble2 kernel: scsi 1:0:0:0: rdac: LUN 0 (IOSHIP) (unowned) Apr 8 00:52:27 warble2 kernel: scsi 1:0:0:10: rdac: LUN 10 (IOSHIP) (unowned) Apr 8 00:52:27 warble2 kernel: sd 1:0:0:10: [sdb] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:11: rdac: LUN 11 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:11: [sdc] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:20: rdac: LUN 20 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:20: [sdd] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:11: [sdc] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:21: rdac: LUN 21 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:11: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:0:21: [sde] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:20: [sdd] Write Protect is off Apr 8 00:52:28 warble2 kernel: sd 1:0:0:20: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:22: rdac: LUN 22 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:21: [sde] Write Protect is off Apr 8 00:52:28 warble2 kernel: sd 1:0:0:22: [sdf] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:21: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:23: rdac: LUN 23 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:23: [sdg] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:22: [sdf] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:24: rdac: LUN 24 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:22: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:0:24: [sdh] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:23: [sdg] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:25: rdac: LUN 25 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:23: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:0:25: [sdi] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:24: [sdh] Write Protect is off Apr 8 00:52:28 warble2 kernel: sd 1:0:0:24: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:40: rdac: LUN 40 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:11: [sdc] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:0:40: [sdj] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:25: [sdi] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:41: rdac: LUN 41 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:25: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:0:41: [sdk] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:40: [sdj] Write Protect is off Apr 8 00:52:28 warble2 kernel: sd 1:0:0:21: [sde] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:51: rdac: LUN 51 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:40: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:0:51: [sdl] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:20: [sdd] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:0:41: [sdk] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:52: rdac: LUN 52 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:41: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:0:52: [sdm] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:51: [sdl] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:60: rdac: LUN 60 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:51: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:0:23: [sdg] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:0:60: [sdn] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:22: [sdf] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:0:52: [sdm] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:0:61: rdac: LUN 61 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:52: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:0: rdac: LUN 0 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:61: [sdo] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:60: [sdn] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:10: rdac: LUN 10 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:10: [sdp] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:60: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:11: rdac: LUN 11 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:25: [sdi] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:0:24: [sdh] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:10: [sdp] Write Protect is off Apr 8 00:52:28 warble2 kernel: sd 1:0:1:11: [sdq] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:61: [sdo] Write Protect is off Apr 8 00:52:28 warble2 kernel: sd 1:0:1:10: [sdp] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:0:61: [sdo] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:20: rdac: LUN 20 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:20: [sdr] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:11: [sdq] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:21: rdac: LUN 21 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:11: [sdq] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:0:41: [sdk] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:21: [sds] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:20: [sdr] Write Protect is off Apr 8 00:52:28 warble2 kernel: sd 1:0:0:40: [sdj] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:22: rdac: LUN 22 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:52: [sdm] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:20: [sdr] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:22: [sdt] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:21: [sds] Write Protect is off Apr 8 00:52:28 warble2 kernel: sd 1:0:0:51: [sdl] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:0:61: [sdo] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:23: rdac: LUN 23 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:21: [sds] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:23: [sdu] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:0:60: [sdn] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:22: [sdt] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:24: rdac: LUN 24 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:22: [sdt] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:24: [sdv] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:23: [sdu] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:25: rdac: LUN 25 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:23: [sdu] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:10: [sdp] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:25: [sdw] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:24: [sdv] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:40: rdac: LUN 40 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:24: [sdv] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:40: [sdx] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:25: [sdw] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:41: rdac: LUN 41 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:25: [sdw] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:20: [sdr] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:41: [sdy] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:11: [sdq] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:40: [sdx] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:51: rdac: LUN 51 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:40: [sdx] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:51: [sdz] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:41: [sdy] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:52: rdac: LUN 52 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:41: [sdy] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:22: [sdt] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:52: [sdaa] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:21: [sds] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:51: [sdz] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:60: rdac: LUN 60 (IOSHIP) (owned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:51: [sdz] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:60: [sdab] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:52: [sdaa] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 1:0:1:61: rdac: LUN 61 (IOSHIP) (unowned) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:52: [sdaa] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:24: [sdv] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:61: [sdac] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:52:28 warble2 kernel: sd 1:0:1:23: [sdu] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:60: [sdab] Write Protect is off Apr 8 00:52:28 warble2 kernel: scsi 15:0:0:0: CD-ROM HL-DT-ST DVD-ROM DU90N D3C0 PQ: 0 ANSI: 5 Apr 8 00:52:28 warble2 kernel: sd 1:0:1:60: [sdab] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:61: [sdac] Write Protect is off Apr 8 00:52:28 warble2 kernel: sd 1:0:1:61: [sdac] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:1:40: [sdx] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:25: [sdw] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:51: [sdz] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:41: [sdy] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:60: [sdab] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:52: [sdaa] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:1:61: [sdac] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sd 1:0:0:10: [sdb] Write Protect is off Apr 8 00:52:28 warble2 kernel: sd 1:0:0:10: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:52:28 warble2 kernel: sd 1:0:0:10: [sdb] Attached SCSI disk Apr 8 00:52:28 warble2 kernel: sr 15:0:0:0: [sr0] scsi3-mmc drive: 24x/24x cd/rw xa/form2 cdda tray Apr 8 00:52:28 warble2 kernel: cdrom: Uniform CD-ROM driver Revision: 3.20 Apr 8 00:52:29 warble2 kernel: random: crng init done Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current POLL, new VERIFY_CAP Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer PHY: power management 0x0, continuous updates 0x0 Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Fabric: vAU 3, Z 1, vCU 0, vl15 credits 0x44, CRC sizes 0x3 Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Link Width: tx rate 0x2, widths 0x8 Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Device ID: 0xabc0, Revision 0x10 Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Final LCB CRC mode: 1 Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Neighbor Guid: 117501020c38c8 Neighbor type 1 MgmtAllowed 1 FM security bypass 0 Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_TRAINING (0x4), phy 0x46 Apr 8 00:52:30 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current VERIFY_CAP, new GOING_UP Apr 8 00:52:30 warble2 kernel: Couldn't create new SM AH Apr 8 00:52:31 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051: Link up Apr 8 00:52:31 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current GOING_UP, new INIT (LINKUP) Apr 8 00:52:31 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_INIT (0x2) Apr 8 00:52:31 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 8 00:52:31 warble2 dhclient[579]: DHCPDISCOVER on bond0 to 255.255.255.255 port 67 interval 7 (xid=0x2835235) Apr 8 00:52:31 warble2 dhclient[579]: DHCPREQUEST on bond0 to 255.255.255.255 port 67 (xid=0x2835235) Apr 8 00:52:31 warble2 dhclient[579]: DHCPOFFER from 10.8.44.11 Apr 8 00:52:31 warble2 dhclient[579]: DHCPACK from 10.8.44.11 (xid=0x2835235) Apr 8 00:52:31 warble2 dracut-initqueue: dhcp: BOND setting bond0 Apr 8 00:52:32 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_LINKUP (0x5), phy 0x50 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:52:33 warble2 kernel: Couldn't create new SM AH Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: port 1: got a lid: 0x78 Apr 8 00:52:33 warble2 kernel: SubnSet(OPA_PortInfo) smlid 0x8 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 1 from 10240 to 0 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 2 from 10240 to 0 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 3 from 10240 to 0 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 4 from 10240 to 0 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 5 from 10240 to 0 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 6 from 10240 to 0 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 7 from 10240 to 0 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current INIT, new ARMED Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ARMED (0x3) Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x103 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x103 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x1 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current ARMED, new ACTIVE Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ACTIVE (0x4) Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x203 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x203 Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x2 Apr 8 00:52:33 warble2 dhclient[579]: bound to 10.8.44.22 -- renewal in 20492 seconds. Apr 8 00:52:33 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Switching to NO_DMA_RTAIL Apr 8 00:52:34 warble2 kernel: IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready Apr 8 00:52:34 warble2 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready Apr 8 00:52:35 warble2 dracut-initqueue: . Apr 8 00:52:35 warble2 dracut-initqueue: Number of files: 1 Apr 8 00:52:35 warble2 dracut-initqueue: Number of files transferred: 1 Apr 8 00:52:35 warble2 dracut-initqueue: Total file size: 1172 bytes Apr 8 00:52:35 warble2 dracut-initqueue: Total transferred file size: 1172 bytes Apr 8 00:52:35 warble2 dracut-initqueue: Literal data: 1172 bytes Apr 8 00:52:35 warble2 dracut-initqueue: Matched data: 0 bytes Apr 8 00:52:35 warble2 dracut-initqueue: File list size: 39 Apr 8 00:52:35 warble2 dracut-initqueue: File list generation time: 0.001 seconds Apr 8 00:52:35 warble2 dracut-initqueue: File list transfer time: 0.000 seconds Apr 8 00:52:35 warble2 dracut-initqueue: Total bytes sent: 75 Apr 8 00:52:35 warble2 dracut-initqueue: Total bytes received: 1329 Apr 8 00:52:35 warble2 dracut-initqueue: sent 75 bytes received 1329 bytes 2808.00 bytes/sec Apr 8 00:52:35 warble2 dracut-initqueue: total size is 1172 speedup is 0.83 Apr 8 00:52:38 warble2 kernel: ib0: Budget exhausted after napi rescheduled Apr 8 00:52:43 warble2 dracut-initqueue: Number of files: 45008 Apr 8 00:52:43 warble2 dracut-initqueue: Number of files transferred: 35605 Apr 8 00:52:43 warble2 dracut-initqueue: Total file size: 1075962237 bytes Apr 8 00:52:43 warble2 dracut-initqueue: Total transferred file size: 1045524501 bytes Apr 8 00:52:43 warble2 dracut-initqueue: Literal data: 1045523329 bytes Apr 8 00:52:43 warble2 dracut-initqueue: Matched data: 1172 bytes Apr 8 00:52:43 warble2 dracut-initqueue: File list size: 924418 Apr 8 00:52:43 warble2 dracut-initqueue: File list generation time: 0.001 seconds Apr 8 00:52:43 warble2 dracut-initqueue: File list transfer time: 0.000 seconds Apr 8 00:52:43 warble2 dracut-initqueue: Total bytes sent: 836684 Apr 8 00:52:43 warble2 dracut-initqueue: Total bytes received: 1048256649 Apr 8 00:52:43 warble2 dracut-initqueue: sent 836684 bytes received 1048256649 bytes 123422745.06 bytes/sec Apr 8 00:52:43 warble2 dracut-initqueue: total size is 1075962237 speedup is 1.03 Apr 8 00:52:43 warble2 dracut-initqueue: Number of files: 3022 Apr 8 00:52:43 warble2 dracut-initqueue: Number of files transferred: 2461 Apr 8 00:52:43 warble2 dracut-initqueue: Total file size: 60768950 bytes Apr 8 00:52:43 warble2 dracut-initqueue: Total transferred file size: 60768902 bytes Apr 8 00:52:43 warble2 dracut-initqueue: Literal data: 60768902 bytes Apr 8 00:52:43 warble2 dracut-initqueue: Matched data: 0 bytes Apr 8 00:52:43 warble2 dracut-initqueue: File list size: 62854 Apr 8 00:52:43 warble2 dracut-initqueue: File list generation time: 0.001 seconds Apr 8 00:52:43 warble2 dracut-initqueue: File list transfer time: 0.000 seconds Apr 8 00:52:43 warble2 dracut-initqueue: Total bytes sent: 49056 Apr 8 00:52:43 warble2 dracut-initqueue: Total bytes received: 60946523 Apr 8 00:52:43 warble2 dracut-initqueue: sent 49056 bytes received 60946523 bytes 121991158.00 bytes/sec Apr 8 00:52:43 warble2 dracut-initqueue: total size is 60768950 speedup is 1.00 Apr 8 00:52:43 warble2 systemd: Started dracut initqueue hook. Apr 8 00:52:43 warble2 systemd: Reached target Remote File Systems (Pre). Apr 8 00:52:43 warble2 systemd: Starting Remote File Systems (Pre). Apr 8 00:52:43 warble2 systemd: Reached target Remote File Systems. Apr 8 00:52:43 warble2 systemd: Starting Remote File Systems. Apr 8 00:52:43 warble2 systemd: Reached target Initrd Root File System. Apr 8 00:52:43 warble2 systemd: Starting Initrd Root File System. Apr 8 00:52:43 warble2 systemd: Starting Reload Configuration from the Real Root... Apr 8 00:52:43 warble2 systemd: Reloading. Apr 8 00:52:44 warble2 systemd: Started Reload Configuration from the Real Root. Apr 8 00:52:44 warble2 systemd: Reached target Initrd File Systems. Apr 8 00:52:44 warble2 systemd: Starting Initrd File Systems. Apr 8 00:52:44 warble2 systemd: Reached target Initrd Default Target. Apr 8 00:52:44 warble2 systemd: Starting Initrd Default Target. Apr 8 00:52:44 warble2 systemd: Starting dracut pre-pivot and cleanup hook... Apr 8 00:52:44 warble2 systemd: Started dracut pre-pivot and cleanup hook. Apr 8 00:52:44 warble2 systemd: Starting Cleaning Up and Shutting Down Daemons... Apr 8 00:52:44 warble2 systemd: Stopped target Timers. Apr 8 00:52:44 warble2 systemd: Stopping Timers. Apr 8 00:52:44 warble2 systemd: Stopped Cleaning Up and Shutting Down Daemons. Apr 8 00:52:44 warble2 systemd: Stopped dracut pre-pivot and cleanup hook. Apr 8 00:52:44 warble2 systemd: Stopping dracut pre-pivot and cleanup hook... Apr 8 00:52:44 warble2 systemd: Stopped target Remote File Systems. Apr 8 00:52:44 warble2 systemd: Stopping Remote File Systems. Apr 8 00:52:44 warble2 systemd: Stopped target Remote File Systems (Pre). Apr 8 00:52:44 warble2 systemd: Stopping Remote File Systems (Pre). Apr 8 00:52:44 warble2 systemd: Stopped target Initrd Default Target. Apr 8 00:52:44 warble2 systemd: Stopping Initrd Default Target. Apr 8 00:52:44 warble2 systemd: Stopped dracut initqueue hook. Apr 8 00:52:44 warble2 systemd: Stopping dracut initqueue hook... Apr 8 00:52:44 warble2 systemd: Stopped target Basic System. Apr 8 00:52:44 warble2 systemd: Stopping Basic System. Apr 8 00:52:44 warble2 systemd: Stopped target Slices. Apr 8 00:52:44 warble2 systemd: Stopping Slices. Apr 8 00:52:44 warble2 systemd: Stopped target Paths. Apr 8 00:52:44 warble2 systemd: Stopping Paths. Apr 8 00:52:44 warble2 systemd: Stopped Dispatch Password Requests to Console Directory Watch. Apr 8 00:52:44 warble2 systemd: Stopping Dispatch Password Requests to Console Directory Watch. Apr 8 00:52:44 warble2 systemd: Stopped target System Initialization. Apr 8 00:52:44 warble2 systemd: Stopping System Initialization. Apr 8 00:52:44 warble2 systemd: Stopped target Local File Systems. Apr 8 00:52:44 warble2 systemd: Stopping Local File Systems. Apr 8 00:52:44 warble2 systemd: Stopped Apply Kernel Variables. Apr 8 00:52:44 warble2 systemd: Stopping Apply Kernel Variables... Apr 8 00:52:44 warble2 systemd: Stopped udev Coldplug all Devices. Apr 8 00:52:44 warble2 systemd: Stopping udev Coldplug all Devices... Apr 8 00:52:44 warble2 systemd: Stopped dracut pre-trigger hook. Apr 8 00:52:44 warble2 systemd: Stopping dracut pre-trigger hook... Apr 8 00:52:44 warble2 systemd: Stopping udev Kernel Device Manager... Apr 8 00:52:44 warble2 systemd: Stopped Load Kernel Modules. Apr 8 00:52:44 warble2 systemd: Stopping Load Kernel Modules... Apr 8 00:52:44 warble2 systemd: Stopped target Swap. Apr 8 00:52:44 warble2 systemd: Stopping Swap. Apr 8 00:52:44 warble2 systemd: Stopped target Sockets. Apr 8 00:52:44 warble2 systemd: Stopping Sockets. Apr 8 00:52:44 warble2 systemd: Stopped udev Kernel Device Manager. Apr 8 00:52:44 warble2 systemd: Stopped dracut pre-udev hook. Apr 8 00:52:44 warble2 systemd: Stopping dracut pre-udev hook... Apr 8 00:52:44 warble2 systemd: Stopped dracut cmdline hook. Apr 8 00:52:44 warble2 systemd: Stopping dracut cmdline hook... Apr 8 00:52:44 warble2 systemd: Stopped Create Static Device Nodes in /dev. Apr 8 00:52:44 warble2 systemd: Stopping Create Static Device Nodes in /dev... Apr 8 00:52:44 warble2 systemd: Stopped Create list of required static device nodes for the current kernel. Apr 8 00:52:44 warble2 systemd: Stopping Create list of required static device nodes for the current kernel... Apr 8 00:52:44 warble2 systemd: Closed udev Control Socket. Apr 8 00:52:44 warble2 systemd: Stopping udev Control Socket. Apr 8 00:52:44 warble2 systemd: Closed udev Kernel Socket. Apr 8 00:52:44 warble2 systemd: Stopping udev Kernel Socket. Apr 8 00:52:44 warble2 systemd: Starting Cleanup udevd DB... Apr 8 00:52:44 warble2 systemd: Started Cleanup udevd DB. Apr 8 00:52:44 warble2 systemd: Reached target Switch Root. Apr 8 00:52:44 warble2 systemd: Starting Switch Root. Apr 8 00:52:44 warble2 systemd: Starting Switch Root... Apr 8 00:52:44 warble2 systemd: Switching root. Apr 8 00:52:44 warble2 journal: Journal stopped Apr 8 00:52:44 warble2 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 8 00:52:44 warble2 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 8 00:52:44 warble2 systemd-journald[215]: Received SIGTERM from PID 1 (systemd). Apr 8 00:52:44 warble2 kernel: ip_tables: (C) 2000-2006 Netfilter Core Team Apr 8 00:52:44 warble2 systemd[1]: Inserted module 'ip_tables' Apr 8 00:52:44 warble2 journal: Journal started Apr 8 00:52:44 warble2 systemd: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) Apr 8 00:52:44 warble2 systemd: Detected architecture x86-64. Apr 8 00:52:44 warble2 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:52:44 warble2 systemd: Cannot add dependency job for unit cpupower.service, ignoring: Unit is masked. Apr 8 00:52:44 warble2 systemd: Cannot add dependency job for unit gssproxy.service, ignoring: Unit is masked. Apr 8 00:52:44 warble2 systemd: Started Availability of block devices. Apr 8 00:52:44 warble2 systemd: Started Create list of required static device nodes for the current kernel. Apr 8 00:52:44 warble2 systemd: Started Load Kernel Modules. Apr 8 00:52:44 warble2 systemd: Started Setup Virtual Console. Apr 8 00:52:44 warble2 systemd: Started Remount Root and Kernel File Systems. Apr 8 00:52:44 warble2 systemd: Got automount request for /proc/sys/fs/binfmt_misc, triggered by 901 (systemd-binfmt) Apr 8 00:52:44 warble2 systemd: Mounting Arbitrary Executable File Formats File System... Apr 8 00:52:44 warble2 systemd: Starting Rebuild Hardware Database... Apr 8 00:52:44 warble2 systemd: Starting Configure read-only root support... Apr 8 00:52:44 warble2 systemd: Starting Load/Save Random Seed... Apr 8 00:52:44 warble2 systemd: Starting Apply Kernel Variables... Apr 8 00:52:44 warble2 systemd: Starting Create Static Device Nodes in /dev... Apr 8 00:52:44 warble2 systemd: Starting Flush Journal to Persistent Storage... Apr 8 00:52:44 warble2 systemd: Mounted Arbitrary Executable File Formats File System. Apr 8 00:52:44 warble2 systemd: Started Configure read-only root support. Apr 8 00:52:44 warble2 systemd: Started Set Up Additional Binary Formats. Apr 8 00:52:44 warble2 systemd: Started Load/Save Random Seed. Apr 8 00:52:44 warble2 systemd: Started Apply Kernel Variables. Apr 8 00:52:44 warble2 systemd: Started Create Static Device Nodes in /dev. Apr 8 00:52:44 warble2 systemd: Starting udev Kernel Device Manager... Apr 8 00:52:44 warble2 systemd-udevd: starting version 219 Apr 8 00:52:44 warble2 systemd: Reached target Local File Systems (Pre). Apr 8 00:52:44 warble2 systemd: Starting Local File Systems (Pre). Apr 8 00:52:44 warble2 systemd: Started udev Kernel Device Manager. Apr 8 00:52:44 warble2 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 8 00:52:44 warble2 systemd: Started Flush Journal to Persistent Storage. Apr 8 00:52:44 warble2 systemd: Started Rebuild Hardware Database. Apr 8 00:52:44 warble2 systemd: Starting udev Coldplug all Devices... Apr 8 00:52:44 warble2 systemd: Starting Initialize the iWARP/InfiniBand/RDMA stack in the kernel... Apr 8 00:52:45 warble2 kernel: ACPI Error: No handler for Region [SYSI] (ffff88012e83dd38) [IPMI] (20130517/evregion-162) Apr 8 00:52:45 warble2 kernel: ACPI Error: Region IPMI (ID=7) has no handler (20130517/exfldio-305) Apr 8 00:52:45 warble2 kernel: ACPI Error: Method parse/execution failed [\_SB_.PMI0._GHL] (Node ffff88012e806550), AE_NOT_EXIST (20130517/psparse-536) Apr 8 00:52:45 warble2 kernel: ACPI Error: Method parse/execution failed [\_SB_.PMI0._PMC] (Node ffff88012e8064b0), AE_NOT_EXIST (20130517/psparse-536) Apr 8 00:52:45 warble2 kernel: ACPI Exception: AE_NOT_EXIST, Evaluating _PMC (20130517/power_meter-753) Apr 8 00:52:45 warble2 kernel: ipmi message handler version 39.2 Apr 8 00:52:45 warble2 kernel: ipmi device interface Apr 8 00:52:45 warble2 kernel: ipmi_si IPI0001:00: ipmi_si: probing via ACPI Apr 8 00:52:45 warble2 kernel: ipmi_si IPI0001:00: [io 0x0ca8] regsize 1 spacing 4 irq 10 Apr 8 00:52:45 warble2 kernel: ipmi_si: Adding ACPI-specified kcs state machine Apr 8 00:52:45 warble2 kernel: IPMI System Interface driver. Apr 8 00:52:45 warble2 kernel: ipmi_si: probing via SMBIOS Apr 8 00:52:45 warble2 kernel: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10 Apr 8 00:52:45 warble2 kernel: ipmi_si: Adding SMBIOS-specified kcs state machine duplicate interface Apr 8 00:52:45 warble2 kernel: ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca8, slave address 0x0, irq 10 Apr 8 00:52:45 warble2 kernel: lpc_ich 0000:00:1f.0: I/O space for ACPI uninitialized Apr 8 00:52:45 warble2 kernel: lpc_ich 0000:00:1f.0: No MFD cells added Apr 8 00:52:45 warble2 systemd: Found device /dev/ttyS0. Apr 8 00:52:45 warble2 kernel: input: PC Speaker as /devices/platform/pcspkr/input/input1 Apr 8 00:52:45 warble2 kernel: i801_smbus 0000:00:1f.4: SMBus using PCI interrupt Apr 8 00:52:45 warble2 kernel: ipmi_si IPI0001:00: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed. Apr 8 00:52:45 warble2 kernel: ipmi_si IPI0001:00: Using irq 10 Apr 8 00:52:45 warble2 systemd: Started udev Coldplug all Devices. Apr 8 00:52:45 warble2 kernel: sd 0:2:0:0: Attached scsi generic sg0 type 0 Apr 8 00:52:45 warble2 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Apr 8 00:52:45 warble2 kernel: ipmi_si IPI0001:00: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20) Apr 8 00:52:45 warble2 kernel: ipmi_si IPI0001:00: IPMI kcs interface initialized Apr 8 00:52:45 warble2 kernel: scsi 1:0:0:0: Attached scsi generic sg1 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:10: Attached scsi generic sg2 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:11: Attached scsi generic sg3 type 0 Apr 8 00:52:45 warble2 systemd: Starting Device-Mapper Multipath Device Controller... Apr 8 00:52:45 warble2 kernel: sd 1:0:0:20: Attached scsi generic sg4 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:21: Attached scsi generic sg5 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:22: Attached scsi generic sg6 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:23: Attached scsi generic sg7 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:24: Attached scsi generic sg8 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:25: Attached scsi generic sg9 type 0 Apr 8 00:52:45 warble2 kernel: scsi 1:0:0:31: Attached scsi generic sg10 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:40: Attached scsi generic sg11 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:41: Attached scsi generic sg12 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:51: Attached scsi generic sg13 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:52: Attached scsi generic sg14 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:60: Attached scsi generic sg15 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:0:61: Attached scsi generic sg16 type 0 Apr 8 00:52:45 warble2 kernel: scsi 1:0:1:0: Attached scsi generic sg17 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:10: Attached scsi generic sg18 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:11: Attached scsi generic sg19 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:20: Attached scsi generic sg20 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:21: Attached scsi generic sg21 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:22: Attached scsi generic sg22 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:23: Attached scsi generic sg23 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:24: Attached scsi generic sg24 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:25: Attached scsi generic sg25 type 0 Apr 8 00:52:45 warble2 kernel: scsi 1:0:1:31: Attached scsi generic sg26 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:40: Attached scsi generic sg27 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:41: Attached scsi generic sg28 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:51: Attached scsi generic sg29 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:52: Attached scsi generic sg30 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:60: Attached scsi generic sg31 type 0 Apr 8 00:52:45 warble2 kernel: sd 1:0:1:61: Attached scsi generic sg32 type 0 Apr 8 00:52:45 warble2 kernel: sr 15:0:0:0: Attached scsi generic sg33 type 5 Apr 8 00:52:45 warble2 kernel: [drm] Initialized Apr 8 00:52:45 warble2 kernel: device-mapper: uevent: version 1.0.3 Apr 8 00:52:45 warble2 kernel: device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com Apr 8 00:52:45 warble2 kernel: AES CTR mode by8 optimization enabled Apr 8 00:52:45 warble2 kernel: alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) Apr 8 00:52:45 warble2 kernel: alg: No test for crc32 (crc32-pclmul) Apr 8 00:52:45 warble2 kernel: [TTM] Zone kernel: Available graphics memory: 395507840 kiB Apr 8 00:52:45 warble2 kernel: [TTM] Zone dma32: Available graphics memory: 2097152 kiB Apr 8 00:52:45 warble2 kernel: [TTM] Initializing pool allocator Apr 8 00:52:45 warble2 kernel: [TTM] Initializing DMA pool allocator Apr 8 00:52:45 warble2 systemd: Started Device-Mapper Multipath Device Controller. Apr 8 00:52:45 warble2 systemd: Started Initialize the iWARP/InfiniBand/RDMA stack in the kernel. Apr 8 00:52:45 warble2 multipathd: path checkers start up Apr 8 00:52:45 warble2 kernel: intel_rapl: Found RAPL domain package Apr 8 00:52:45 warble2 kernel: intel_rapl: Found RAPL domain dram Apr 8 00:52:45 warble2 kernel: intel_rapl: DRAM domain energy unit 15300pj Apr 8 00:52:45 warble2 kernel: intel_rapl: Found RAPL domain package Apr 8 00:52:45 warble2 kernel: intel_rapl: Found RAPL domain dram Apr 8 00:52:45 warble2 kernel: intel_rapl: DRAM domain energy unit 15300pj Apr 8 00:52:45 warble2 systemd: Cannot add dependency job for unit onesis.service, ignoring: No such file or directory Apr 8 00:52:45 warble2 multipathd: sda: add path (uevent) Apr 8 00:52:46 warble2 kernel: fbcon: mgadrmfb (fb0) is primary device Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:52:46 warble2 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:52:46 warble2 kernel: spl: loading out-of-tree module taints kernel. Apr 8 00:52:46 warble2 kernel: spl: module verification failed: signature and/or required key missing - tainting kernel Apr 8 00:52:46 warble2 kernel: SPL: Loaded module v0.7.6-1 Apr 8 00:52:46 warble2 kernel: znvpair: module license 'CDDL' taints kernel. Apr 8 00:52:46 warble2 kernel: Disabling lock debugging due to kernel taint Apr 8 00:52:46 warble2 kernel: dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2) Apr 8 00:52:46 warble2 kernel: iTCO_vendor_support: vendor-support=0 Apr 8 00:52:46 warble2 kernel: iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 Apr 8 00:52:46 warble2 kernel: iTCO_wdt: Found a Intel PCH TCO device (Version=4, TCOBASE=0x0400) Apr 8 00:52:46 warble2 kernel: iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) Apr 8 00:52:46 warble2 kernel: Console: switching to colour frame buffer device 128x48 Apr 8 00:52:46 warble2 kernel: mgag200 0000:03:00.0: fb0: mgadrmfb frame buffer device Apr 8 00:52:46 warble2 systemd: Created slice system-lvm2\x2dpvscan.slice. Apr 8 00:52:46 warble2 systemd: Starting system-lvm2\x2dpvscan.slice. Apr 8 00:52:46 warble2 systemd: Starting LVM2 PV scan on device 8:2... Apr 8 00:52:46 warble2 kernel: [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0 Apr 8 00:52:46 warble2 systemd: Started LVM2 metadata daemon. Apr 8 00:52:46 warble2 systemd: Starting LVM2 metadata daemon... Apr 8 00:52:46 warble2 systemd: Found device /dev/centos/swap. Apr 8 00:52:46 warble2 systemd: Activating swap /dev/centos/swap... Apr 8 00:52:46 warble2 kernel: Adding 4194300k swap on /dev/mapper/centos-swap. Priority:-1 extents:1 across:4194300k FS Apr 8 00:52:46 warble2 systemd: Activated swap /dev/centos/swap. Apr 8 00:52:46 warble2 systemd: Reached target Swap. Apr 8 00:52:46 warble2 systemd: Starting Swap. Apr 8 00:52:46 warble2 lvm: 3 logical volume(s) in volume group "centos" now active Apr 8 00:52:46 warble2 systemd: Found device /dev/centos/root. Apr 8 00:52:46 warble2 systemd: Started LVM2 PV scan on device 8:2. Apr 8 00:52:46 warble2 systemd: Mounting /mnt/root... Apr 8 00:52:47 warble2 kernel: SGI XFS with ACLs, security attributes, no debug enabled Apr 8 00:52:47 warble2 kernel: XFS (dm-2): Mounting V5 Filesystem Apr 8 00:52:47 warble2 kernel: XFS (dm-2): Ending clean mount Apr 8 00:52:47 warble2 systemd: Mounted /mnt/root. Apr 8 00:52:47 warble2 systemd: Reached target Local File Systems. Apr 8 00:52:47 warble2 systemd: Starting Local File Systems. Apr 8 00:52:47 warble2 systemd: Starting Preprocess NFS configuration... Apr 8 00:52:47 warble2 systemd: Starting Import network configuration from initramfs... Apr 8 00:52:47 warble2 systemd: Starting Mark the need to relabel after reboot... Apr 8 00:52:47 warble2 systemd: Starting Rebuild Journal Catalog... Apr 8 00:52:47 warble2 systemd: Started Preprocess NFS configuration. Apr 8 00:52:47 warble2 systemd: Started Import network configuration from initramfs. Apr 8 00:52:47 warble2 systemd: Started Mark the need to relabel after reboot. Apr 8 00:52:47 warble2 systemd: Started Rebuild Journal Catalog. Apr 8 00:52:47 warble2 systemd: Starting Update is Completed... Apr 8 00:52:47 warble2 systemd: Starting Create Volatile Files and Directories... Apr 8 00:52:47 warble2 systemd: Starting Notify NFS peers of a restart... Apr 8 00:52:47 warble2 sm-notify[6007]: Version 1.3.0 starting Apr 8 00:52:47 warble2 systemd: Started Update is Completed. Apr 8 00:52:47 warble2 systemd: Started Create Volatile Files and Directories. Apr 8 00:52:47 warble2 systemd: Started Notify NFS peers of a restart. Apr 8 00:52:47 warble2 systemd: Starting Update UTMP about System Boot/Shutdown... Apr 8 00:52:47 warble2 systemd: Mounting RPC Pipe File System... Apr 8 00:52:47 warble2 systemd: Started Update UTMP about System Boot/Shutdown. Apr 8 00:52:47 warble2 systemd: Reached target System Initialization. Apr 8 00:52:47 warble2 systemd: Starting System Initialization. Apr 8 00:52:47 warble2 kernel: RPC: Registered named UNIX socket transport module. Apr 8 00:52:47 warble2 kernel: RPC: Registered udp transport module. Apr 8 00:52:47 warble2 kernel: RPC: Registered tcp transport module. Apr 8 00:52:47 warble2 kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. Apr 8 00:52:47 warble2 systemd: Listening on RPCbind Server Activation Socket. Apr 8 00:52:47 warble2 systemd: Starting RPCbind Server Activation Socket. Apr 8 00:52:47 warble2 systemd: Started Daily Cleanup of Temporary Directories. Apr 8 00:52:47 warble2 systemd: Starting Daily Cleanup of Temporary Directories. Apr 8 00:52:47 warble2 systemd: Reached target Timers. Apr 8 00:52:47 warble2 systemd: Starting Timers. Apr 8 00:52:47 warble2 systemd: Started Flexible branding. Apr 8 00:52:47 warble2 systemd: Starting Flexible branding. Apr 8 00:52:47 warble2 systemd: Reached target Paths. Apr 8 00:52:47 warble2 systemd: Starting Paths. Apr 8 00:52:47 warble2 systemd: Listening on D-Bus System Message Bus Socket. Apr 8 00:52:47 warble2 systemd: Starting D-Bus System Message Bus Socket. Apr 8 00:52:47 warble2 systemd: Reached target Sockets. Apr 8 00:52:47 warble2 systemd: Starting Sockets. Apr 8 00:52:47 warble2 systemd: Reached target Basic System. Apr 8 00:52:47 warble2 systemd: Starting Basic System. Apr 8 00:52:47 warble2 systemd: Starting Resets System Activity Logs... Apr 8 00:52:47 warble2 systemd: Starting Builds and install new kernel modules through DKMS... Apr 8 00:52:47 warble2 systemd: Starting SYSV: pslogger process logger... Apr 8 00:52:47 warble2 pslogger: Starting pslogger: Apr 8 00:52:47 warble2 systemd: Starting Postfix Mail Transport Agent... Apr 8 00:52:47 warble2 systemd: Starting Machine Check Exception Logging Daemon... Apr 8 00:52:47 warble2 systemd: Starting OpenSSH server daemon... Apr 8 00:52:47 warble2 systemd: Starting System Security Services Daemon... Apr 8 00:52:47 warble2 systemd: Starting System Logging Service... Apr 8 00:52:47 warble2 sssd: Starting up Apr 8 00:52:47 warble2 rsyslogd: [origin software="rsyslogd" swVersion="8.24.0" x-pid="6050" x-info="http://www.rsyslog.com"] start Apr 8 00:52:47 warble2 systemd: Starting Temporary: Start ifalias interface for oobview even after parent is brought up in the initramfs... Apr 8 00:52:47 warble2 sssd[be[default]]: Starting up Apr 8 00:52:47 warble2 systemd: Starting Initialize the OPA layer... Apr 8 00:52:47 warble2 sssd[nss]: Starting up Apr 8 00:52:47 warble2 sssd[pam]: Starting up Apr 8 00:52:47 warble2 systemd: Started RDMA Node Description Daemon. Apr 8 00:52:47 warble2 systemd: Starting RDMA Node Description Daemon... Apr 8 00:52:47 warble2 systemd: Starting Dump dmesg to /var/log/dmesg... Apr 8 00:52:47 warble2 systemd: Started Runs late. Kinda like rc.local. Apr 8 00:52:47 warble2 systemd: Starting Runs late. Kinda like rc.local... Apr 8 00:52:47 warble2 zed: ZFS Event Daemon 0.7.6-1 (PID 6090) Apr 8 00:52:47 warble2 systemd: Started ZFS Event Daemon (zed). Apr 8 00:52:47 warble2 systemd: Starting ZFS Event Daemon (zed)... Apr 8 00:52:47 warble2 opa-init-kernel: Renicing ib_mad processes...done. Apr 8 00:52:47 warble2 systemd: Starting Set time via NTP... Apr 8 00:52:47 warble2 systemd: Started irqbalance daemon. Apr 8 00:52:47 warble2 systemd: Starting irqbalance daemon... Apr 8 00:52:47 warble2 kinda_rc_local: rmmod: ERROR: Module lnet_selftest is not currently loaded Apr 8 00:52:47 warble2 kinda_rc_local: rmmod: ERROR: Module lnet_selftest is not currently loaded Apr 8 00:52:47 warble2 systemd: Started D-Bus System Message Bus. Apr 8 00:52:47 warble2 systemd: Starting D-Bus System Message Bus... Apr 8 00:52:47 warble2 systemd: Mounted RPC Pipe File System. Apr 8 00:52:47 warble2 kinda_rc_local: Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8). Apr 8 00:52:47 warble2 kinda_rc_local: Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8). Apr 8 00:52:47 warble2 systemd: Started OpenSSH server daemon. Apr 8 00:52:47 warble2 systemd: Started System Logging Service. Apr 8 00:52:47 warble2 systemd: Started System Security Services Daemon. Apr 8 00:52:47 warble2 systemd: Started Resets System Activity Logs. Apr 8 00:52:47 warble2 systemd: Started Builds and install new kernel modules through DKMS. Apr 8 00:52:47 warble2 systemd: Started SYSV: pslogger process logger. Apr 8 00:52:47 warble2 systemd: Started Initialize the OPA layer. Apr 8 00:52:47 warble2 systemd: Started Dump dmesg to /var/log/dmesg. Apr 8 00:52:47 warble2 systemd: Reached target User and Group Name Lookups. Apr 8 00:52:47 warble2 systemd: Starting User and Group Name Lookups. Apr 8 00:52:47 warble2 systemd: Starting Login Service... Apr 8 00:52:47 warble2 systemd: Reached target NFS client services. Apr 8 00:52:47 warble2 systemd: Starting NFS client services. Apr 8 00:52:47 warble2 systemd: Reached target Remote File Systems (Pre). Apr 8 00:52:47 warble2 systemd: Starting Remote File Systems (Pre). Apr 8 00:52:47 warble2 systemd: Reached target Remote File Systems. Apr 8 00:52:47 warble2 systemd: Starting Remote File Systems. Apr 8 00:52:47 warble2 systemd: Starting Permit User Sessions... Apr 8 00:52:47 warble2 systemd: Started Permit User Sessions. Apr 8 00:52:47 warble2 systemd-logind: New seat seat0. Apr 8 00:52:47 warble2 systemd-logind: Watching system buttons on /dev/input/event0 (Power Button) Apr 8 00:52:47 warble2 systemd: Started Getty on tty1. Apr 8 00:52:47 warble2 systemd: Starting Getty on tty1... Apr 8 00:52:47 warble2 systemd: Started Serial Getty on ttyS0. Apr 8 00:52:47 warble2 systemd: Starting Serial Getty on ttyS0... Apr 8 00:52:47 warble2 systemd: Reached target Login Prompts. Apr 8 00:52:47 warble2 systemd: Starting Login Prompts. Apr 8 00:52:47 warble2 systemd: Started Login Service. Apr 8 00:52:47 warble2 kernel: bnx2x 0000:19:00.2 em3: using MSI-X IRQs: sp 127 fp[0] 129 ... fp[7] 136 Apr 8 00:52:47 warble2 kernel: bnx2x 0000:19:00.2 em3: NIC Link is Up, 1000 Mbps full duplex, Flow control: none Apr 8 00:53:04 transom1 fm0_sm[240274]: transom1; MSG:NOTICE|SM:transom1:port 1|COND:#3 Appearance in fabric|NODE:warble2 hfi1_0:port 1:0x001175010171d0f9|LINKEDTO:opa-l-6:port 3:0x00117501020c38c8|DETAIL:Node type: hfi Apr 8 00:52:48 warble2 systemd: Started Machine Check Exception Logging Daemon. Apr 8 00:52:48 warble2 zed: Processing events since eid=0 Apr 8 00:52:48 warble2 kernel: ZFS: Loaded module v0.7.6-1, ZFS pool version 5000, ZFS filesystem version 5 Apr 8 00:52:48 warble2 multipathd: sdh: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdh: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 kernel: device-mapper: multipath round-robin: version 1.2.0 loaded Apr 8 00:52:48 warble2 multipathd: vol-mdt2-a: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:112 1] Apr 8 00:52:48 warble2 multipathd: vol-mdt2-a: event checker started Apr 8 00:52:48 warble2 multipathd: sdh [8:112]: path added to devmap vol-mdt2-a Apr 8 00:52:48 warble2 multipathd: sdr: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdr: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-mdt0-a: load table [0 1319780352 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 65:16 1] Apr 8 00:52:48 warble2 multipathd: vol-mdt0-a: event checker started Apr 8 00:52:48 warble2 multipathd: sdr [65:16]: path added to devmap vol-mdt0-a Apr 8 00:52:48 warble2 multipathd: sdz: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdz: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-images-system-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 65:144 1] Apr 8 00:52:48 warble2 multipathd: vol-images-system-a: event checker started Apr 8 00:52:48 warble2 multipathd: sdz [65:144]: path added to devmap vol-images-system-a Apr 8 00:52:48 warble2 multipathd: sdac: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdac: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-apps-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 65:192 1] Apr 8 00:52:48 warble2 multipathd: vol-apps-b: event checker started Apr 8 00:52:48 warble2 multipathd: sdac [65:192]: path added to devmap vol-apps-b Apr 8 00:52:48 warble2 multipathd: sdn: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdn: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-apps-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:208 1] Apr 8 00:52:48 warble2 multipathd: vol-apps-a: event checker started Apr 8 00:52:48 warble2 multipathd: sdn [8:208]: path added to devmap vol-apps-a Apr 8 00:52:48 warble2 multipathd: sdj: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdj: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-home-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:144 1] Apr 8 00:52:48 warble2 multipathd: vol-home-a: event checker started Apr 8 00:52:48 warble2 multipathd: sdj [8:144]: path added to devmap vol-home-a Apr 8 00:52:48 warble2 multipathd: sdo: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdo: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdo : delaying path addition until vol-apps-b is fully initialized Apr 8 00:52:48 warble2 multipathd: sds: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sds: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-mdt0-b: load table [0 1319780352 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 65:32 1] Apr 8 00:52:48 warble2 multipathd: vol-mdt0-b: event checker started Apr 8 00:52:48 warble2 multipathd: sds [65:32]: path added to devmap vol-mdt0-b Apr 8 00:52:48 warble2 multipathd: sdl: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdl: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdl : delaying path addition until vol-images-system-a is fully initialized Apr 8 00:52:48 warble2 multipathd: sdb: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdb: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-mgt-a: load table [0 819200 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:16 1] Apr 8 00:52:48 warble2 multipathd: vol-mgt-a: event checker started Apr 8 00:52:48 warble2 multipathd: sdb [8:16]: path added to devmap vol-mgt-a Apr 8 00:52:48 warble2 multipathd: sdf: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdf: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-mdt1-a: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:80 1] Apr 8 00:52:48 warble2 multipathd: vol-mdt1-a: event checker started Apr 8 00:52:48 warble2 multipathd: sdf [8:80]: path added to devmap vol-mdt1-a Apr 8 00:52:48 warble2 multipathd: sdi: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdi: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-mdt2-b: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:128 1] Apr 8 00:52:48 warble2 multipathd: vol-mdt2-b: event checker started Apr 8 00:52:48 warble2 multipathd: sdi [8:128]: path added to devmap vol-mdt2-b Apr 8 00:52:48 warble2 multipathd: sdw: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdw: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdw : delaying path addition until vol-mdt2-b is fully initialized Apr 8 00:52:48 warble2 multipathd: sdd: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdd: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdd : delaying path addition until vol-mdt0-a is fully initialized Apr 8 00:52:48 warble2 multipathd: sdy: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdy: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-home-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 65:128 1] Apr 8 00:52:48 warble2 multipathd: vol-home-b: event checker started Apr 8 00:52:48 warble2 multipathd: sdy [65:128]: path added to devmap vol-home-b Apr 8 00:52:48 warble2 multipathd: sdg: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdg: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-mdt1-b: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:96 1] Apr 8 00:52:48 warble2 multipathd: vol-mdt1-b: event checker started Apr 8 00:52:48 warble2 multipathd: sdg [8:96]: path added to devmap vol-mdt1-b Apr 8 00:52:48 warble2 multipathd: sde: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sde: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sde : delaying path addition until vol-mdt0-b is fully initialized Apr 8 00:52:48 warble2 multipathd: sdk: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdk: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdk : delaying path addition until vol-home-b is fully initialized Apr 8 00:52:48 warble2 multipathd: sdaa: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdaa: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-images-system-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 65:160 1] Apr 8 00:52:48 warble2 multipathd: vol-images-system-b: event checker started Apr 8 00:52:48 warble2 multipathd: sdaa [65:160]: path added to devmap vol-images-system-b Apr 8 00:52:48 warble2 multipathd: sdx: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdx: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdx : delaying path addition until vol-home-a is fully initialized Apr 8 00:52:48 warble2 multipathd: sdt: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdt: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdt : delaying path addition until vol-mdt1-a is fully initialized Apr 8 00:52:48 warble2 multipathd: sdq: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdq: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: vol-mgt-b: load table [0 819200 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 65:0 1] Apr 8 00:52:48 warble2 multipathd: vol-mgt-b: event checker started Apr 8 00:52:48 warble2 multipathd: sdq [65:0]: path added to devmap vol-mgt-b Apr 8 00:52:48 warble2 multipathd: sdc: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdc: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdc : delaying path addition until vol-mgt-b is fully initialized Apr 8 00:52:48 warble2 multipathd: sdv: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdv: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdv : delaying path addition until vol-mdt2-a is fully initialized Apr 8 00:52:48 warble2 multipathd: sdm: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdm: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdm : delaying path addition until vol-images-system-b is fully initialized Apr 8 00:52:48 warble2 multipathd: sdab: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdab: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdab : delaying path addition until vol-apps-a is fully initialized Apr 8 00:52:48 warble2 multipathd: sdu: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdu: spurious uevent, path already in pathvec Apr 8 00:52:48 warble2 multipathd: sdu : delaying path addition until vol-mdt1-b is fully initialized Apr 8 00:52:48 warble2 multipathd: sdp: add path (uevent) Apr 8 00:52:48 warble2 multipathd: sdp: spurious uevent, path already in pathvec Apr 8 00:52:49 warble2 multipathd: sdp : delaying path addition until vol-mgt-a is fully initialized Apr 8 00:52:49 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current ACTIVE, new OFFLINE Apr 8 00:52:49 warble2 multipathd: vol-mdt0-a: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-mdt0-a: load table [0 1319780352 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:16 1 round-robin 0 1 1 8:48 1] Apr 8 00:52:49 warble2 multipathd: vol-images-system-a: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-images-system-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:144 1 round-robin 0 1 1 8:176 1] Apr 8 00:52:49 warble2 multipathd: vol-mdt2-a: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-mdt2-a: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:80 1 round-robin 0 1 1 8:112 1] Apr 8 00:52:49 warble2 multipathd: vol-apps-a: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-apps-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:176 1 round-robin 0 1 1 8:208 1] Apr 8 00:52:49 warble2 multipathd: vol-apps-b: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-apps-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:224 1 round-robin 0 1 1 65:192 1] Apr 8 00:52:49 warble2 multipathd: vol-mdt0-b: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-mdt0-b: load table [0 1319780352 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:64 1 round-robin 0 1 1 65:32 1] Apr 8 00:52:49 warble2 multipathd: vol-home-a: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-home-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:112 1 round-robin 0 1 1 8:144 1] Apr 8 00:52:49 warble2 multipathd: vol-mdt1-a: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-mdt1-a: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:48 1 round-robin 0 1 1 8:80 1] Apr 8 00:52:49 warble2 multipathd: vol-mgt-a: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-mgt-a: load table [0 819200 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:240 1 round-robin 0 1 1 8:16 1] Apr 8 00:52:49 warble2 multipathd: vol-mdt1-b: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-mdt1-b: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:96 1 round-robin 0 1 1 65:64 1] Apr 8 00:52:49 warble2 multipathd: vol-mgt-b: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-mgt-b: load table [0 819200 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:32 1 round-robin 0 1 1 65:0 1] Apr 8 00:52:49 warble2 multipathd: vol-mdt2-b: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-mdt2-b: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:128 1 round-robin 0 1 1 65:96 1] Apr 8 00:52:49 warble2 multipathd: vol-images-system-b: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-images-system-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:192 1 round-robin 0 1 1 65:160 1] Apr 8 00:52:49 warble2 multipathd: vol-home-b: performing delayed actions Apr 8 00:52:49 warble2 multipathd: vol-home-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:160 1 round-robin 0 1 1 65:128 1] Apr 8 00:52:49 warble2 ntpdate[6107]: sendto(transom1): Network is unreachable Apr 8 00:52:50 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_DOWN (0x1) Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: Eager buffer size 2097152 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: WC Remapped RcvArray: ffffc90063d00000 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Implementation: RTL silicon, revision 0x0 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: GUID 1175010171d0f9 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Resetting CSRs with FLR Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe,8000MHz,x16 Apr 8 00:52:51 warble2 ntpdate[6107]: step time server 192.168.44.11 offset -0.123230 sec Apr 8 00:52:51 warble2 systemd: Time has been changed Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: do_pcie_gen3_transition: PCIe already at gen3, skipping Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Board description not found Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: rcv contexts: chip 160, used 21 (kernel 5, user 16) Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: RcvArray groups 390, ctxts extra 2 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: unused send context blocks: 9 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: send contexts: chip 160, used 38 (kernel 16, ack 5, user 16, vl15 1) Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Using send context 16(143) for VL15 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA mod_num_sdma: 0 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_engines: 16 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_mem_size: 401408 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA engines 16 descq_cnt 2048 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA num_sdma: 16 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: 22 MSI-X interrupts allocated Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 83, type GENERAL -> cpu: 1 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 84, type SDMA engine 0 -> cpu: 11 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 85, type SDMA engine 1 -> cpu: 13 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 86, type SDMA engine 2 -> cpu: 15 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 87, type SDMA engine 3 -> cpu: 11 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 88, type SDMA engine 4 -> cpu: 13 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 89, type SDMA engine 5 -> cpu: 15 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 90, type SDMA engine 6 -> cpu: 11 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 91, type SDMA engine 7 -> cpu: 13 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 92, type SDMA engine 8 -> cpu: 15 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 93, type SDMA engine 9 -> cpu: 11 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 94, type SDMA engine 10 -> cpu: 13 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 95, type SDMA engine 11 -> cpu: 15 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 96, type SDMA engine 12 -> cpu: 11 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 97, type SDMA engine 13 -> cpu: 13 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 98, type SDMA engine 14 -> cpu: 15 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 99, type SDMA engine 15 -> cpu: 11 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 100, type RCVCTXT ctxt 0 -> cpu: 1 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 101, type RCVCTXT ctxt 1 -> cpu: 3 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 102, type RCVCTXT ctxt 2 -> cpu: 5 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 103, type RCVCTXT ctxt 3 -> cpu: 7 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 112, type RCVCTXT ctxt 4 -> cpu: 9 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051 firmware version 1.24 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: SBus Master firmware version 0x10130001 Apr 8 00:52:51 warble2 systemd: Started Set time via NTP. Apr 8 00:52:51 warble2 systemd: Starting Network Time Service... Apr 8 00:52:51 warble2 ntpd[14483]: ntpd 4.2.6p5@1.2349-o Wed Apr 12 21:24:06 UTC 2017 (1) Apr 8 00:52:51 warble2 ntpd[14484]: proto: precision = 0.037 usec Apr 8 00:52:51 warble2 ntpd[14484]: 0.0.0.0 c01d 0d kern kernel time sync enabled Apr 8 00:52:51 warble2 ntpd[14484]: Listen and drop on 0 v4wildcard 0.0.0.0 UDP 123 Apr 8 00:52:51 warble2 ntpd[14484]: Listen and drop on 1 v6wildcard :: UDP 123 Apr 8 00:52:51 warble2 ntpd[14484]: Listen normally on 2 lo 127.0.0.1 UDP 123 Apr 8 00:52:51 warble2 ntpd[14484]: Listen normally on 3 bond0 10.8.44.22 UDP 123 Apr 8 00:52:51 warble2 ntpd[14484]: Listen normally on 4 lo ::1 UDP 123 Apr 8 00:52:51 warble2 ntpd[14484]: Listen normally on 5 em3 fe80::1a66:daff:febc:7baf UDP 123 Apr 8 00:52:51 warble2 ntpd[14484]: Listen normally on 6 bond0 fe80::1a66:daff:febc:7bab UDP 123 Apr 8 00:52:51 warble2 ntpd[14484]: Listening on routing socket on fd #23 for interface updates Apr 8 00:52:51 warble2 ntpd[14484]: 0.0.0.0 c016 06 restart Apr 8 00:52:51 warble2 ntpd[14484]: 0.0.0.0 c012 02 freq_set kernel 0.000 PPM Apr 8 00:52:51 warble2 ntpd[14484]: 0.0.0.0 c011 01 freq_not_set Apr 8 00:52:51 warble2 systemd: Reached target System Time Synchronized. Apr 8 00:52:51 warble2 systemd: Starting System Time Synchronized. Apr 8 00:52:51 warble2 systemd: Started Network Time Service. Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe SerDes firmware version 0x4755 Apr 8 00:52:51 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric SerDes firmware version 0x1055 Apr 8 00:52:54 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: wait_for_qsfp_init: No IntN detected, reset complete Apr 8 00:52:54 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current OFFLINE, new POLL Apr 8 00:52:54 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 8 00:52:54 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Reserving QPNs from 0x800000 to 0x80ffff for non-verbs use Apr 8 00:52:54 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_POLL (0x2), phy 0x20 Apr 8 00:52:54 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_TRAINING (0x4), phy 0x40 Apr 8 00:52:54 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Congestion Control Agent enabled for port 1 Apr 8 00:52:54 warble2 kernel: bnx2x 0000:19:00.3 em4: using MSI-X IRQs: sp 138 fp[0] 140 ... fp[7] 147 Apr 8 00:52:54 warble2 kernel: Couldn't create new SM AH Apr 8 00:52:54 warble2 kernel: bnx2x 0000:19:00.3 em4: NIC Link is Up, 1000 Mbps full duplex, Flow control: ON - receive & transmit Apr 8 00:52:54 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Registration with rdmavt done. Apr 8 00:52:55 warble2 systemd: Started Postfix Mail Transport Agent. Apr 8 00:52:55 warble2 kernel: ib0: P_Key 0x8000 is Invalid Apr 8 00:52:55 warble2 kernel: IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready Apr 8 00:52:55 warble2 kinda_rc_local: RTNETLINK answers: No such process Apr 8 00:52:55 warble2 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:52:55 warble2 systemd: Stopping irqbalance daemon... Apr 8 00:52:55 warble2 systemd: Started irqbalance daemon. Apr 8 00:52:55 warble2 systemd: Starting irqbalance daemon... Apr 8 00:52:55 warble2 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:52:55 warble2 systemd: Stopping System Security Services Daemon... Apr 8 00:52:55 warble2 sssd[be[default]]: Shutting down Apr 8 00:52:55 warble2 sssd[nss]: Shutting down Apr 8 00:52:55 warble2 ntpd[14484]: Listen normally on 7 em3 10.7.2.232 UDP 123 Apr 8 00:52:55 warble2 sssd[pam]: Shutting down Apr 8 00:52:55 warble2 ntpd[14484]: Listen normally on 8 ib0 192.168.44.22 UDP 123 Apr 8 00:52:55 warble2 systemd: Starting System Security Services Daemon... Apr 8 00:52:55 warble2 sssd: Starting up Apr 8 00:52:55 warble2 sssd[be[default]]: Starting up Apr 8 00:52:55 warble2 sssd[nss]: Starting up Apr 8 00:52:55 warble2 sssd[pam]: Starting up Apr 8 00:52:55 warble2 systemd: Started System Security Services Daemon. Apr 8 00:52:56 warble2 ntpd[14484]: 0.0.0.0 c514 04 freq_mode Apr 8 00:52:57 warble2 ntpd[14484]: Listen normally on 9 em4 fe80::1a66:daff:febc:7bb1 UDP 123 Apr 8 00:52:58 warble2 systemd: Started Temporary: Start ifalias interface for oobview even after parent is brought up in the initramfs. Apr 8 00:52:58 warble2 systemd: Starting PCS GUI and remote configuration interface... Apr 8 00:52:59 warble2 systemd: Started PCS GUI and remote configuration interface. Apr 8 00:52:59 warble2 systemd: Reached target Multi-User System. Apr 8 00:52:59 warble2 systemd: Starting Multi-User System. Apr 8 00:52:59 warble2 systemd: Starting Ganglia Monitoring Daemon... Apr 8 00:52:59 warble2 systemd: Starting Update UTMP about System Runlevel Changes... Apr 8 00:52:59 warble2 systemd: Started Ganglia Monitoring Daemon. Apr 8 00:52:59 warble2 systemd: Started Update UTMP about System Runlevel Changes. Apr 8 00:52:59 warble2 systemd: Startup finished in 6.514s (kernel) + 24.650s (initrd) + 14.710s (userspace) = 45.874s. Apr 8 00:52:59 warble2 kernel: 8021q: 802.1Q VLAN Support v1.8 Apr 8 00:52:59 warble2 kernel: 8021q: adding VLAN 0 to HW filter on device em1 Apr 8 00:52:59 warble2 kernel: 8021q: adding VLAN 0 to HW filter on device em2 Apr 8 00:52:59 warble2 kernel: 8021q: adding VLAN 0 to HW filter on device em3 Apr 8 00:52:59 warble2 kernel: 8021q: adding VLAN 0 to HW filter on device em4 Apr 8 00:52:59 warble2 kernel: 8021q: adding VLAN 0 to HW filter on device bond0 Apr 8 00:53:00 warble2 ntpd[14484]: Listen normally on 10 em4 10.1.1.22 UDP 123 Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current POLL, new VERIFY_CAP Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer PHY: power management 0x0, continuous updates 0x0 Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Fabric: vAU 3, Z 1, vCU 0, vl15 credits 0x44, CRC sizes 0x3 Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Link Width: tx rate 0x2, widths 0x8 Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Device ID: 0xabc0, Revision 0x10 Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Final LCB CRC mode: 1 Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Neighbor Guid: 117501020c38c8 Neighbor type 1 MgmtAllowed 1 FM security bypass 0 Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:53:01 warble2 kernel: Couldn't create new SM AH Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current VERIFY_CAP, new GOING_UP Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051: Link up Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current GOING_UP, new INIT (LINKUP) Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_INIT (0x2) Apr 8 00:53:01 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 8 00:53:03 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_LINKUP (0x5), phy 0x50 Apr 8 00:53:03 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:53:03 warble2 kernel: Couldn't create new SM AH Apr 8 00:53:03 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: port 1: got a lid: 0x78 Apr 8 00:53:04 warble2 kernel: SubnSet(OPA_PortInfo) smlid 0x8 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 1 from 10240 to 0 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 2 from 10240 to 0 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 3 from 10240 to 0 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 4 from 10240 to 0 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 5 from 10240 to 0 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 6 from 10240 to 0 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 7 from 10240 to 0 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current INIT, new ARMED Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ARMED (0x3) Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x103 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x103 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x1 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current ARMED, new ACTIVE Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ACTIVE (0x4) Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x203 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x203 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x2 Apr 8 00:53:04 warble2 kernel: hfi1 0000:d8:00.0: hfi1_0: Switching to NO_DMA_RTAIL Apr 8 00:53:06 warble2 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready Apr 8 00:53:09 warble2 ntpd[14484]: Listen normally on 11 ib0 fe80::211:7501:171:d0f9 UDP 123 Apr 8 00:53:50 transom1 rsyncd[60019]: connect from warble1 (192.168.44.21) Apr 8 00:53:50 transom1 rsyncd[60019]: rsync on images/centos-7.4-minimal-server-05//etc/rsync.options.farnarkle from boot@warble1 (192.168.44.21) Apr 8 00:53:50 transom1 rsyncd[60020]: connect from warble1 (192.168.44.21) Apr 8 00:53:50 transom1 rsyncd[60020]: rsync on images/centos-7.4-minimal-server-05// from boot@warble1 (192.168.44.21) Apr 8 00:53:59 transom1 rsyncd[60076]: connect from warble1 (192.168.44.21) Apr 8 00:53:59 transom1 rsyncd[60076]: rsync on images/centos-7.4-minimal-server-05//lib/modules/3.10.0-693.17.1.el7.x86_64/ from boot@warble1 (192.168.44.21) Apr 8 00:53:35 warble1 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys cpuset Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys cpu Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys cpuacct Apr 8 00:53:35 warble1 kernel: Linux version 3.10.0-693.17.1.el7.x86_64 (builder@kbuilder.dev.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Thu Jan 25 20:13:58 UTC 2018 Apr 8 00:53:35 warble1 kernel: Command line: initrd=oneSIS/initramfs-3.10.0-693.17.1.el7.x86_64.onesis.server.01.img root=rsync://boot@192.168.44.11/images/centos-7.4-minimal-server-05/ ro crashkernel=auto vconsole.font=latarcyrheb-sun16 vconsole.keymap=us LANG=en_US.UTF-8 console=tty0 console=ttyS0,115200n8 rd.driver.blacklist=nouveau selinux=0 exec-shield=0 audit=0 timeshift=12 cluster=farnarkle ping=192.168.44.11 rd.shell bond=bond0:em1,em2:miimon=100,xmit_hash_policy=1,mode=4,lacp_rate=1:9000 nopti BOOT_IMAGE=oneSIS/vmlinuz-3.10.0-693.17.1.el7.x86_64 Apr 8 00:53:35 warble1 kernel: e820: BIOS-provided physical RAM map: Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009bfff] usable Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x000000000009c000-0x000000000009ffff] reserved Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x0000000000100000-0x000000006c5cefff] usable Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x000000006c5cf000-0x000000006e7cefff] reserved Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x000000006e7cf000-0x000000006f5fefff] ACPI NVS Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x000000006f5ff000-0x000000006f7fefff] ACPI data Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x000000006f7ff000-0x000000006f7fffff] usable Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x000000006f800000-0x000000008fffffff] reserved Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x00000000fd000000-0x00000000fe7fffff] reserved Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x00000000fec80000-0x00000000fed00fff] reserved Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved Apr 8 00:53:35 warble1 kernel: BIOS-e820: [mem 0x0000000100000000-0x000000c03fffffff] usable Apr 8 00:53:35 warble1 kernel: NX (Execute Disable) protection: active Apr 8 00:53:35 warble1 kernel: SMBIOS 3.0 present. Apr 8 00:53:35 warble1 kernel: e820: last_pfn = 0xc040000 max_arch_pfn = 0x400000000 Apr 8 00:53:35 warble1 kernel: x86 PAT enabled: cpu 0, old 0x5010600070406, new 0x7010600070106 Apr 8 00:53:35 warble1 kernel: total RAM covered: 785392M Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 64K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 128K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 256K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 64K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 64K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 128K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 256K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 128K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 128K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 256K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 256K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 256K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 512K #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 512K #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 512K #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 1M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 1M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 1M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 2M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 2M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 2M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 4M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 4M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 4M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 8M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 8M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 8M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 16M #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -60G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -120G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -224G Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 16M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -192G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 16M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 737G Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 32M #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1040M Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15344M Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 32G #011num_reg: 10 #011lose cover RAM: -30704M Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 64G #011num_reg: 10 #011lose cover RAM: -61424M Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 128G #011num_reg: 10 #011lose cover RAM: -122864M Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 256G #011num_reg: 10 #011lose cover RAM: -229360M Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 32M #011chunk_size: 512G #011num_reg: 10 #011lose cover RAM: -196592M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 1024G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 2048G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 4096G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 8192G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 16384G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:53:35 warble1 kernel: gran_size: 32M #011chunk_size: 32768G #011num_reg: 10 #011lose cover RAM: 721936M Apr 8 00:53:35 warble1 kernel: gran_size: 64M #011chunk_size: 64M #011num_reg: 10 #011lose cover RAM: 656432M Apr 8 00:53:35 warble1 kernel: gran_size: 64M #011chunk_size: 128M #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:53:35 warble1 kernel: gran_size: 64M #011chunk_size: 256M #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:53:35 warble1 kernel: gran_size: 64M #011chunk_size: 512M #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:53:35 warble1 kernel: gran_size: 64M #011chunk_size: 1G #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:53:35 warble1 kernel: gran_size: 64M #011chunk_size: 2G #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:53:35 warble1 kernel: gran_size: 64M #011chunk_size: 4G #011num_reg: 10 #011lose cover RAM: 656432M Apr 8 00:53:35 warble1 kernel: gran_size: 64M #011chunk_size: 8G #011num_reg: 10 #011lose cover RAM: 1072M Apr 8 00:53:35 warble1 kernel: *BAD*gran_size: 64M #011chunk_size: 16G #011num_reg: 10 #011lose cover RAM: -15312M Apr 8 00:53:35 warble1 kernel: mtrr_cleanup: can not find optimal value Apr 8 00:53:35 warble1 kernel: please specify mtrr_gran_size/mtrr_chunk_size Apr 8 00:53:35 warble1 kernel: e820: last_pfn = 0x6f800 max_arch_pfn = 0x400000000 Apr 8 00:53:35 warble1 kernel: Using GB pages for direct mapping Apr 8 00:53:35 warble1 kernel: RAMDISK: [mem 0x6982a000-0x6c5a9fff] Apr 8 00:53:35 warble1 kernel: Early table checksum verification disabled Apr 8 00:53:35 warble1 kernel: ACPI: RSDP 00000000000fe320 00024 (v02 DELL ) Apr 8 00:53:35 warble1 kernel: ACPI: XSDT 000000006f6c0188 000FC (v01 DELL PE_SC3 00000000 01000013) Apr 8 00:53:35 warble1 kernel: ACPI: FACP 000000006f7f8000 00114 (v06 DELL PE_SC3 00000000 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: DSDT 000000006f79e000 32342 (v02 DELL PE_SC3 00000003 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: FACS 000000006f4ef000 00040 Apr 8 00:53:35 warble1 kernel: ACPI: SSDT 000000006f7fc000 003C6 (v02 DELL Tpm2Tabl 00001000 INTL 20150818) Apr 8 00:53:35 warble1 kernel: ACPI: TPM2 000000006f7fb000 00038 (v04 DELL PE_SC3 00000002 01000013) Apr 8 00:53:35 warble1 kernel: ACPI: MCEJ 000000006f7fa000 00130 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: WD__ 000000006f7f9000 00134 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: HPET 000000006f7f7000 00038 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: APIC 000000006f7f5000 016DE (v04 DELL PE_SC3 00000000 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: MCFG 000000006f7f4000 0003C (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: MIGT 000000006f7f3000 00040 (v01 DELL PE_SC3 00000000 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: MSCT 000000006f7f2000 00090 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: NFIT 000000006f7d9000 18028 (v01 00000000 00000000) Apr 8 00:53:35 warble1 kernel: ACPI: PCAT 000000006f7d8000 00048 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: PCCT 000000006f7d7000 0006E (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: RASF 000000006f7d6000 00030 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: SLIT 000000006f7d5000 0006C (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: SRAT 000000006f7d2000 02830 (v03 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: SVOS 000000006f7d1000 00032 (v01 DELL PE_SC3 00000000 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: OEM4 000000006f6fb000 A27C4 (v02 INTEL CPU CST 00003000 INTL 20150818) Apr 8 00:53:35 warble1 kernel: ACPI: SSDT 000000006f6c5000 35130 (v02 INTEL SSDT PM 00004000 INTL 20150818) Apr 8 00:53:35 warble1 kernel: ACPI: SSDT 000000006f6c4000 00761 (v02 DELL PE_SC3 00000000 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: SSDT 000000006f6c1000 02541 (v02 INTEL SpsNm 00000002 INTL 20150818) Apr 8 00:53:35 warble1 kernel: ACPI: SPCR 000000006f7fd000 00050 (v01 00000000 00000000) Apr 8 00:53:35 warble1 kernel: ACPI: DMAR 000000006f6bf000 001D0 (v01 DELL PE_SC3 00000001 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: HEST 000000006f6be000 0017C (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: BERT 000000006f6bd000 00030 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: ERST 000000006f6bc000 00230 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:53:35 warble1 kernel: ACPI: EINJ 000000006f6bb000 00150 (v01 DELL PE_SC3 00000002 DELL 00000001) Apr 8 00:53:35 warble1 kernel: SRAT: PXM 0 -> APIC 0x00 -> Node 0 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 1 -> APIC 0x42 -> Node 1 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 0 -> APIC 0x0c -> Node 0 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 1 -> APIC 0x4e -> Node 1 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 0 -> APIC 0x08 -> Node 0 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 1 -> APIC 0x46 -> Node 1 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 0 -> APIC 0x0a -> Node 0 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 1 -> APIC 0x4c -> Node 1 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 0 -> APIC 0x20 -> Node 0 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 1 -> APIC 0x48 -> Node 1 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 0 -> APIC 0x2c -> Node 0 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 1 -> APIC 0x6c -> Node 1 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 0 -> APIC 0x26 -> Node 0 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 1 -> APIC 0x64 -> Node 1 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 0 -> APIC 0x28 -> Node 0 Apr 8 00:53:35 warble1 kernel: SRAT: PXM 1 -> APIC 0x68 -> Node 1 Apr 8 00:53:35 warble1 kernel: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff] Apr 8 00:53:35 warble1 kernel: SRAT: Node 0 PXM 0 [mem 0x100000000-0x603fffffff] Apr 8 00:53:35 warble1 kernel: SRAT: Node 1 PXM 1 [mem 0x6040000000-0xc03fffffff] Apr 8 00:53:35 warble1 kernel: NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x603fffffff] -> [mem 0x00000000-0x603fffffff] Apr 8 00:53:35 warble1 kernel: NODE_DATA(0) allocated [mem 0x603ffd9000-0x603fffffff] Apr 8 00:53:35 warble1 kernel: NODE_DATA(1) allocated [mem 0xc03ffd6000-0xc03fffcfff] Apr 8 00:53:35 warble1 kernel: Reserving 208MB of memory at 688MB for crashkernel (System RAM: 785093MB) Apr 8 00:53:35 warble1 kernel: Zone ranges: Apr 8 00:53:35 warble1 kernel: DMA [mem 0x00001000-0x00ffffff] Apr 8 00:53:35 warble1 kernel: DMA32 [mem 0x01000000-0xffffffff] Apr 8 00:53:35 warble1 kernel: Normal [mem 0x100000000-0xc03fffffff] Apr 8 00:53:35 warble1 kernel: Movable zone start for each node Apr 8 00:53:35 warble1 kernel: Early memory node ranges Apr 8 00:53:35 warble1 kernel: node 0: [mem 0x00001000-0x0009bfff] Apr 8 00:53:35 warble1 kernel: node 0: [mem 0x00100000-0x6c5cefff] Apr 8 00:53:35 warble1 kernel: node 0: [mem 0x6f7ff000-0x6f7fffff] Apr 8 00:53:35 warble1 kernel: node 0: [mem 0x100000000-0x603fffffff] Apr 8 00:53:35 warble1 kernel: node 1: [mem 0x6040000000-0xc03fffffff] Apr 8 00:53:35 warble1 kernel: Initmem setup node 0 [mem 0x00001000-0x603fffffff] Apr 8 00:53:35 warble1 kernel: Initmem setup node 1 [mem 0x6040000000-0xc03fffffff] Apr 8 00:53:35 warble1 kernel: ACPI: PM-Timer IO Port: 0x508 Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x38] lapic_id[0x42] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x0c] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x3c] lapic_id[0x4e] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x08] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x39] lapic_id[0x46] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x0a] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x3b] lapic_id[0x4c] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x20] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x3a] lapic_id[0x48] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id[0x2c] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x3f] lapic_id[0x6c] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id[0x26] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x3d] lapic_id[0x64] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x28] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0x3e] lapic_id[0x68] enabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC (acpi_id[0xff] lapic_id[0xff] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x00] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x01] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x02] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x03] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x04] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x05] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x06] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x07] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x08] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x09] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0a] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0b] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0c] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0d] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0e] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x0f] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x10] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x11] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x12] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x13] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x14] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x15] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x16] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x17] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x18] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x19] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1a] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1b] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1c] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1d] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1e] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x1f] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x20] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x21] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x22] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x23] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x24] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x25] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x26] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x27] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x28] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x29] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2a] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2b] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2c] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2d] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2e] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x2f] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x30] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x31] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x32] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x33] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x34] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x35] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x36] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x37] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x38] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x39] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3a] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3b] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3c] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3d] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3e] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x3f] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x40] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x41] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x42] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x43] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x44] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x45] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x46] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x47] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x48] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x49] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4a] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4b] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4c] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4d] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4e] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x4f] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x50] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x51] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x52] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x53] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x54] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x55] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x56] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x57] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x58] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x59] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5a] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5b] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5c] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5d] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5e] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x5f] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x60] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x61] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x62] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x63] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x64] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x65] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x66] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x67] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x68] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x69] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6a] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6b] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6c] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6d] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6e] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x6f] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x70] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x71] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x72] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x73] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x74] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x75] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x76] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x77] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x78] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x79] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7a] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7b] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7c] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7d] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7e] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x7f] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x80] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x81] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x82] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x83] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x84] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x85] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x86] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x87] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x88] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x89] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8a] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8b] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8c] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8d] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8e] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x8f] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x90] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x91] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x92] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x93] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x94] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x95] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x96] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x97] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x98] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x99] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9a] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9b] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9c] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9d] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9e] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0x9f] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa0] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa1] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa2] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa3] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa4] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa5] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa6] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa7] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa8] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xa9] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xaa] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xab] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xac] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xad] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xae] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xaf] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb0] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb1] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb2] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb3] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb4] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb5] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb6] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb7] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb8] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xb9] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xba] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbb] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbc] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbd] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbe] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xbf] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc0] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc1] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc2] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc3] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc4] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc5] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc6] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc7] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc8] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xc9] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xca] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcb] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcc] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcd] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xce] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xcf] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd0] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd1] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd2] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd3] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd4] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd5] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd6] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd7] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd8] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xd9] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xda] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdb] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdc] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdd] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xde] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC (apic_id[0xffffffff] uid[0xdf] disabled) Apr 8 00:53:35 warble1 kernel: ACPI: X2APIC_NMI (uid[0xffffffff] high level lint[0x1]) Apr 8 00:53:35 warble1 kernel: ACPI: LAPIC_NMI (acpi_id[0xff] high level lint[0x1]) Apr 8 00:53:35 warble1 kernel: ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0]) Apr 8 00:53:35 warble1 kernel: IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23 Apr 8 00:53:35 warble1 kernel: ACPI: IOAPIC (id[0x09] address[0xfec01000] gsi_base[24]) Apr 8 00:53:35 warble1 kernel: IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-31 Apr 8 00:53:35 warble1 kernel: ACPI: IOAPIC (id[0x0a] address[0xfec08000] gsi_base[32]) Apr 8 00:53:35 warble1 kernel: IOAPIC[2]: apic_id 10, version 32, address 0xfec08000, GSI 32-39 Apr 8 00:53:35 warble1 kernel: ACPI: IOAPIC (id[0x0b] address[0xfec10000] gsi_base[40]) Apr 8 00:53:35 warble1 kernel: IOAPIC[3]: apic_id 11, version 32, address 0xfec10000, GSI 40-47 Apr 8 00:53:35 warble1 kernel: ACPI: IOAPIC (id[0x0c] address[0xfec18000] gsi_base[48]) Apr 8 00:53:35 warble1 kernel: IOAPIC[4]: apic_id 12, version 32, address 0xfec18000, GSI 48-55 Apr 8 00:53:35 warble1 kernel: ACPI: IOAPIC (id[0x0f] address[0xfec20000] gsi_base[72]) Apr 8 00:53:35 warble1 kernel: IOAPIC[5]: apic_id 15, version 32, address 0xfec20000, GSI 72-79 Apr 8 00:53:35 warble1 kernel: ACPI: IOAPIC (id[0x10] address[0xfec28000] gsi_base[80]) Apr 8 00:53:35 warble1 kernel: IOAPIC[6]: apic_id 16, version 32, address 0xfec28000, GSI 80-87 Apr 8 00:53:35 warble1 kernel: ACPI: IOAPIC (id[0x11] address[0xfec30000] gsi_base[88]) Apr 8 00:53:35 warble1 kernel: IOAPIC[7]: apic_id 17, version 32, address 0xfec30000, GSI 88-95 Apr 8 00:53:35 warble1 kernel: ACPI: IOAPIC (id[0x12] address[0xfec38000] gsi_base[96]) Apr 8 00:53:35 warble1 kernel: IOAPIC[8]: apic_id 18, version 32, address 0xfec38000, GSI 96-103 Apr 8 00:53:35 warble1 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Apr 8 00:53:35 warble1 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Apr 8 00:53:35 warble1 kernel: Using ACPI (MADT) for SMP configuration information Apr 8 00:53:35 warble1 kernel: ACPI: HPET id: 0x8086a701 base: 0xfed00000 Apr 8 00:53:35 warble1 kernel: smpboot: Allowing 448 CPUs, 432 hotplug CPUs Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0x0009c000-0x0009ffff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0x6c5cf000-0x6e7cefff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0x6e7cf000-0x6f5fefff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0x6f5ff000-0x6f7fefff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0x6f800000-0x8fffffff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0x90000000-0xfcffffff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0xfd000000-0xfe7fffff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0xfe800000-0xfebfffff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0xfec01000-0xfec7ffff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0xfec80000-0xfed00fff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0xfed01000-0xfeffffff] Apr 8 00:53:35 warble1 kernel: PM: Registered nosave memory: [mem 0xff000000-0xffffffff] Apr 8 00:53:35 warble1 kernel: e820: [mem 0x90000000-0xfcffffff] available for PCI devices Apr 8 00:53:35 warble1 kernel: Booting paravirtualized kernel on bare hardware Apr 8 00:53:35 warble1 kernel: setup_percpu: NR_CPUS:5120 nr_cpumask_bits:448 nr_cpu_ids:448 nr_node_ids:2 Apr 8 00:53:35 warble1 kernel: PERCPU: Embedded 35 pages/cpu @ffff885ebda00000 s104536 r8192 d30632 u262144 Apr 8 00:53:35 warble1 kernel: Built 2 zonelists in Zone order, mobility grouping on. Total pages: 197843518 Apr 8 00:53:35 warble1 kernel: Policy zone: Normal Apr 8 00:53:35 warble1 kernel: Kernel command line: initrd=oneSIS/initramfs-3.10.0-693.17.1.el7.x86_64.onesis.server.01.img root=rsync://boot@192.168.44.11/images/centos-7.4-minimal-server-05/ ro crashkernel=auto vconsole.font=latarcyrheb-sun16 vconsole.keymap=us LANG=en_US.UTF-8 console=tty0 console=ttyS0,115200n8 rd.driver.blacklist=nouveau selinux=0 exec-shield=0 audit=0 timeshift=12 cluster=farnarkle ping=192.168.44.11 rd.shell bond=bond0:em1,em2:miimon=100,xmit_hash_policy=1,mode=4,lacp_rate=1:9000 nopti BOOT_IMAGE=oneSIS/vmlinuz-3.10.0-693.17.1.el7.x86_64 Apr 8 00:53:35 warble1 kernel: audit: disabled (until reboot) Apr 8 00:53:35 warble1 kernel: PID hash table entries: 4096 (order: 3, 32768 bytes) Apr 8 00:53:35 warble1 kernel: x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 Apr 8 00:53:35 warble1 kernel: x86/fpu: xstate_offset[3]: 03c0, xstate_sizes[3]: 0040 Apr 8 00:53:35 warble1 kernel: x86/fpu: xstate_offset[4]: 0400, xstate_sizes[4]: 0040 Apr 8 00:53:35 warble1 kernel: x86/fpu: xstate_offset[5]: 0440, xstate_sizes[5]: 0040 Apr 8 00:53:35 warble1 kernel: x86/fpu: xstate_offset[6]: 0480, xstate_sizes[6]: 0200 Apr 8 00:53:35 warble1 kernel: x86/fpu: xstate_offset[7]: 0680, xstate_sizes[7]: 0400 Apr 8 00:53:35 warble1 kernel: xsave: enabled xstate_bv 0xff, cntxt size 0xa80 using standard form Apr 8 00:53:35 warble1 kernel: Memory: 7724828k/806354944k available (6916k kernel code, 2419284k absent, 12968396k reserved, 4551k data, 1800k init) Apr 8 00:53:35 warble1 kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=448, Nodes=2 Apr 8 00:53:35 warble1 kernel: Hierarchical RCU implementation. Apr 8 00:53:35 warble1 kernel: #011RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=448. Apr 8 00:53:35 warble1 kernel: NR_IRQS:327936 nr_irqs:5368 0 Apr 8 00:53:35 warble1 kernel: Console: colour VGA+ 80x25 Apr 8 00:53:35 warble1 kernel: console [tty0] enabled Apr 8 00:53:35 warble1 kernel: console [ttyS0] enabled Apr 8 00:53:35 warble1 kernel: allocated 3215982592 bytes of page_cgroup Apr 8 00:53:35 warble1 kernel: please try 'cgroup_disable=memory' option if you don't want memory cgroups Apr 8 00:53:35 warble1 kernel: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl Apr 8 00:53:35 warble1 kernel: tsc: Detected 3200.000 MHz processor Apr 8 00:53:35 warble1 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 6400.00 BogoMIPS (lpj=3200000) Apr 8 00:53:35 warble1 kernel: pid_max: default: 458752 minimum: 3584 Apr 8 00:53:35 warble1 kernel: Security Framework initialized Apr 8 00:53:35 warble1 kernel: SELinux: Disabled at boot. Apr 8 00:53:35 warble1 kernel: Yama: becoming mindful. Apr 8 00:53:35 warble1 kernel: Dentry cache hash table entries: 134217728 (order: 18, 1073741824 bytes) Apr 8 00:53:35 warble1 kernel: random: fast init done Apr 8 00:53:35 warble1 kernel: Inode-cache hash table entries: 67108864 (order: 17, 536870912 bytes) Apr 8 00:53:35 warble1 kernel: Mount-cache hash table entries: 2097152 (order: 12, 16777216 bytes) Apr 8 00:53:35 warble1 kernel: Mountpoint-cache hash table entries: 2097152 (order: 12, 16777216 bytes) Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys memory Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys devices Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys freezer Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys net_cls Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys blkio Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys perf_event Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys hugetlb Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys pids Apr 8 00:53:35 warble1 kernel: Initializing cgroup subsys net_prio Apr 8 00:53:35 warble1 kernel: CPU: Physical Processor ID: 0 Apr 8 00:53:35 warble1 kernel: CPU: Processor Core ID: 0 Apr 8 00:53:35 warble1 kernel: ENERGY_PERF_BIAS: Set to 'normal', was 'performance' Apr 8 00:53:35 warble1 kernel: ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8) Apr 8 00:53:35 warble1 kernel: FEATURE SPEC_CTRL Present Apr 8 00:53:35 warble1 kernel: FEATURE IBPB_SUPPORT Present Apr 8 00:53:35 warble1 kernel: mce: CPU supports 20 MCE banks Apr 8 00:53:35 warble1 kernel: CPU0: Thermal monitoring enabled (TM1) Apr 8 00:53:35 warble1 kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 Apr 8 00:53:35 warble1 kernel: Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0 Apr 8 00:53:35 warble1 kernel: tlb_flushall_shift: 6 Apr 8 00:53:35 warble1 kernel: Freeing SMP alternatives: 24k freed Apr 8 00:53:35 warble1 kernel: ACPI: Core revision 20130517 Apr 8 00:53:35 warble1 kernel: ACPI: All ACPI Tables successfully acquired Apr 8 00:53:35 warble1 kernel: ftrace: allocating 26618 entries in 104 pages Apr 8 00:53:35 warble1 kernel: DMAR: Host address width 46 Apr 8 00:53:35 warble1 kernel: DMAR: DRHD base: 0x000000d37fc000 flags: 0x0 Apr 8 00:53:35 warble1 kernel: DMAR: dmar0: reg_base_addr d37fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:53:35 warble1 kernel: DMAR: DRHD base: 0x000000e0ffc000 flags: 0x0 Apr 8 00:53:35 warble1 kernel: DMAR: dmar1: reg_base_addr e0ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:53:35 warble1 kernel: DMAR: DRHD base: 0x000000ee7fc000 flags: 0x0 Apr 8 00:53:35 warble1 kernel: DMAR: dmar2: reg_base_addr ee7fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:53:35 warble1 kernel: DMAR: DRHD base: 0x000000fbffc000 flags: 0x0 Apr 8 00:53:35 warble1 kernel: DMAR: dmar3: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:53:35 warble1 kernel: DMAR: DRHD base: 0x000000aaffc000 flags: 0x0 Apr 8 00:53:35 warble1 kernel: DMAR: dmar4: reg_base_addr aaffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:53:35 warble1 kernel: DMAR: DRHD base: 0x000000b87fc000 flags: 0x0 Apr 8 00:53:35 warble1 kernel: DMAR: dmar5: reg_base_addr b87fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:53:35 warble1 kernel: DMAR: DRHD base: 0x000000c5ffc000 flags: 0x0 Apr 8 00:53:35 warble1 kernel: DMAR: dmar6: reg_base_addr c5ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:53:35 warble1 kernel: DMAR: DRHD base: 0x0000009d7fc000 flags: 0x1 Apr 8 00:53:35 warble1 kernel: DMAR: dmar7: reg_base_addr 9d7fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df Apr 8 00:53:35 warble1 kernel: DMAR: RMRR base: 0x0000006e2cd000 end: 0x0000006e7ccfff Apr 8 00:53:35 warble1 kernel: DMAR: RMRR base: 0x0000006f4e1000 end: 0x0000006f4e3fff Apr 8 00:53:35 warble1 kernel: DMAR: ATSR flags: 0x0 Apr 8 00:53:35 warble1 kernel: DMAR: ATSR flags: 0x0 Apr 8 00:53:35 warble1 kernel: DMAR-IR: IOAPIC id 12 under DRHD base 0xc5ffc000 IOMMU 6 Apr 8 00:53:35 warble1 kernel: DMAR-IR: IOAPIC id 11 under DRHD base 0xb87fc000 IOMMU 5 Apr 8 00:53:35 warble1 kernel: DMAR-IR: IOAPIC id 10 under DRHD base 0xaaffc000 IOMMU 4 Apr 8 00:53:35 warble1 kernel: DMAR-IR: IOAPIC id 18 under DRHD base 0xfbffc000 IOMMU 3 Apr 8 00:53:35 warble1 kernel: DMAR-IR: IOAPIC id 17 under DRHD base 0xee7fc000 IOMMU 2 Apr 8 00:53:35 warble1 kernel: DMAR-IR: IOAPIC id 16 under DRHD base 0xe0ffc000 IOMMU 1 Apr 8 00:53:35 warble1 kernel: DMAR-IR: IOAPIC id 15 under DRHD base 0xd37fc000 IOMMU 0 Apr 8 00:53:35 warble1 kernel: DMAR-IR: IOAPIC id 8 under DRHD base 0x9d7fc000 IOMMU 7 Apr 8 00:53:35 warble1 kernel: DMAR-IR: IOAPIC id 9 under DRHD base 0x9d7fc000 IOMMU 7 Apr 8 00:53:35 warble1 kernel: DMAR-IR: HPET id 0 under DRHD base 0x9d7fc000 Apr 8 00:53:35 warble1 kernel: DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. Apr 8 00:53:35 warble1 kernel: DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. Apr 8 00:53:35 warble1 kernel: DMAR-IR: Enabled IRQ remapping in xapic mode Apr 8 00:53:35 warble1 kernel: IRQ remapping doesn't support X2APIC mode, disable x2apic. Apr 8 00:53:35 warble1 kernel: Switched APIC routing to physical flat. Apr 8 00:53:35 warble1 kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Apr 8 00:53:35 warble1 kernel: smpboot: CPU0: Intel(R) Xeon(R) Gold 6134 CPU @ 3.20GHz (fam: 06, model: 55, stepping: 04) Apr 8 00:53:35 warble1 kernel: Performance Events: PEBS fmt3+, 32-deep LBR, Skylake events, full-width counters, Intel PMU driver. Apr 8 00:53:35 warble1 kernel: ... version: 4 Apr 8 00:53:35 warble1 kernel: ... bit width: 48 Apr 8 00:53:35 warble1 kernel: ... generic registers: 8 Apr 8 00:53:35 warble1 kernel: ... value mask: 0000ffffffffffff Apr 8 00:53:35 warble1 kernel: ... max period: 00007fffffffffff Apr 8 00:53:35 warble1 kernel: ... fixed-purpose events: 3 Apr 8 00:53:35 warble1 kernel: ... event mask: 00000007000000ff Apr 8 00:53:35 warble1 kernel: NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 1, Processors #1 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 0, Processors #2 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 1, Processors #3 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 0, Processors #4 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 1, Processors #5 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 0, Processors #6 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 1, Processors #7 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 0, Processors #8 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 1, Processors #9 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 0, Processors #10 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 1, Processors #11 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 0, Processors #12 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 1, Processors #13 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 0, Processors #14 OK Apr 8 00:53:35 warble1 kernel: smpboot: Booting Node 1, Processors #15 Apr 8 00:53:35 warble1 kernel: Brought up 16 CPUs Apr 8 00:53:35 warble1 kernel: smpboot: Max logical packages: 56 Apr 8 00:53:35 warble1 kernel: smpboot: Total of 16 processors activated (102439.66 BogoMIPS) Apr 8 00:53:35 warble1 kernel: node 0 initialised, 97514679 pages in 1546ms Apr 8 00:53:35 warble1 kernel: node 1 initialised, 98295926 pages in 1546ms Apr 8 00:53:35 warble1 kernel: devtmpfs: initialized Apr 8 00:53:35 warble1 kernel: EVM: security.selinux Apr 8 00:53:35 warble1 kernel: EVM: security.ima Apr 8 00:53:35 warble1 kernel: EVM: security.capability Apr 8 00:53:35 warble1 kernel: PM: Registering ACPI NVS region [mem 0x6e7cf000-0x6f5fefff] (14876672 bytes) Apr 8 00:53:35 warble1 kernel: atomic64 test passed for x86-64 platform with CX8 and with SSE Apr 8 00:53:35 warble1 kernel: pinctrl core: initialized pinctrl subsystem Apr 8 00:53:35 warble1 kernel: RTC time: 14:53:30, date: 04/07/18 Apr 8 00:53:35 warble1 kernel: NET: Registered protocol family 16 Apr 8 00:53:35 warble1 kernel: ACPI FADT declares the system doesn't support PCIe ASPM, so disable it Apr 8 00:53:35 warble1 kernel: ACPI: bus type PCI registered Apr 8 00:53:35 warble1 kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Apr 8 00:53:35 warble1 kernel: PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) Apr 8 00:53:35 warble1 kernel: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 Apr 8 00:53:35 warble1 kernel: pmd_set_huge: Cannot satisfy [mem 0x80000000-0x80200000] with a huge-page mapping due to MTRR override. Apr 8 00:53:35 warble1 kernel: PCI: Using configuration type 1 for base access Apr 8 00:53:35 warble1 kernel: PCI: Dell System detected, enabling pci=bfsort. Apr 8 00:53:35 warble1 kernel: ACPI: Added _OSI(Module Device) Apr 8 00:53:35 warble1 kernel: ACPI: Added _OSI(Processor Device) Apr 8 00:53:35 warble1 kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Apr 8 00:53:35 warble1 kernel: ACPI: Added _OSI(Processor Aggregator Device) Apr 8 00:53:35 warble1 kernel: [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored Apr 8 00:53:35 warble1 kernel: ACPI: Dynamic OEM Table Load: Apr 8 00:53:35 warble1 kernel: ACPI: OEM4 (null) A27C4 (v02 INTEL CPU CST 00003000 INTL 20150818) Apr 8 00:53:35 warble1 kernel: ACPI: Interpreter enabled Apr 8 00:53:35 warble1 kernel: ACPI: (supports S0 S5) Apr 8 00:53:35 warble1 kernel: ACPI: Using IOAPIC for interrupt routing Apr 8 00:53:35 warble1 kernel: HEST: Table parsing has been initialized. Apr 8 00:53:35 warble1 kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Apr 8 00:53:35 warble1 kernel: ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00-16]) Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:00: PCIe AER handled by firmware Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:00: ignoring host bridge window [mem 0x000c4000-0x000cbfff window] (conflicts with Video ROM [mem 0x000c0000-0x000c7fff]) Apr 8 00:53:35 warble1 kernel: PCI host bridge to bus 0000:00 Apr 8 00:53:35 warble1 kernel: pci_bus 0000:00: root bus resource [bus 00-16] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:00: root bus resource [io 0x1000-0x3fff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:00: root bus resource [mem 0xfe010000-0xfe010fff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:00: root bus resource [mem 0x90000000-0x9d7fffff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:00: root bus resource [mem 0x380000000000-0x380fffffffff window] Apr 8 00:53:35 warble1 kernel: pci 0000:00:14.0: System wakeup disabled by ACPI Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.0: System wakeup disabled by ACPI Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.4: System wakeup disabled by ACPI Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.0: PCI bridge to [bus 01] Apr 8 00:53:35 warble1 kernel: pci 0000:02:00.0: System wakeup disabled by ACPI Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.4: PCI bridge to [bus 02-03] Apr 8 00:53:35 warble1 kernel: pci 0000:02:00.0: PCI bridge to [bus 03] Apr 8 00:53:35 warble1 kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 8 00:53:35 warble1 kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 *6 10 11 12 14 15) Apr 8 00:53:35 warble1 kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) Apr 8 00:53:35 warble1 kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 8 00:53:35 warble1 kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 8 00:53:35 warble1 kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 *6 10 11 12 14 15) Apr 8 00:53:35 warble1 kernel: ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 *5 6 10 11 12 14 15) Apr 8 00:53:35 warble1 kernel: ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 10 *11 12 14 15) Apr 8 00:53:35 warble1 kernel: ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 17-39]) Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:01: PCIe AER handled by firmware Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:53:35 warble1 kernel: PCI host bridge to bus 0000:17 Apr 8 00:53:35 warble1 kernel: pci_bus 0000:17: root bus resource [bus 17-39] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:17: root bus resource [io 0x4000-0x5fff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:17: root bus resource [mem 0x9d800000-0xaaffffff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:17: root bus resource [mem 0x381000000000-0x381fffffffff window] Apr 8 00:53:35 warble1 kernel: pci 0000:17:00.0: System wakeup disabled by ACPI Apr 8 00:53:35 warble1 kernel: pci 0000:17:02.0: System wakeup disabled by ACPI Apr 8 00:53:35 warble1 kernel: pci 0000:17:00.0: PCI bridge to [bus 18] Apr 8 00:53:35 warble1 kernel: pci 0000:17:02.0: PCI bridge to [bus 19] Apr 8 00:53:35 warble1 kernel: ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 3a-5c]) Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:02: PCIe AER handled by firmware Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:53:35 warble1 kernel: PCI host bridge to bus 0000:3a Apr 8 00:53:35 warble1 kernel: pci_bus 0000:3a: root bus resource [bus 3a-5c] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:3a: root bus resource [io 0x6000-0x7fff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:3a: root bus resource [mem 0xab000000-0xb87fffff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:3a: root bus resource [mem 0x382000000000-0x382fffffffff window] Apr 8 00:53:35 warble1 kernel: pci 0000:3a:00.0: System wakeup disabled by ACPI Apr 8 00:53:35 warble1 kernel: pci 0000:3b:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit] (contains BAR0 for 16 VFs) Apr 8 00:53:35 warble1 kernel: pci 0000:3b:00.0: VF(n) BAR2 space: [mem 0x00000000-0x00ffffff 64bit] (contains BAR2 for 16 VFs) Apr 8 00:53:35 warble1 kernel: pci 0000:3a:00.0: PCI bridge to [bus 3b] Apr 8 00:53:35 warble1 kernel: ACPI: PCI Root Bridge [PC03] (domain 0000 [bus 5d-7f]) Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:03: PCIe AER handled by firmware Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:53:35 warble1 kernel: PCI host bridge to bus 0000:5d Apr 8 00:53:35 warble1 kernel: pci_bus 0000:5d: root bus resource [bus 5d-7f] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:5d: root bus resource [io 0x8000-0x9fff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:5d: root bus resource [mem 0xb8800000-0xc5ffffff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:5d: root bus resource [mem 0x383000000000-0x383fffffffff window] Apr 8 00:53:35 warble1 kernel: ACPI: PCI Root Bridge [PC06] (domain 0000 [bus 80-84]) Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:06: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:06: PCIe AER handled by firmware Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:06: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:06: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:06: host bridge window [io 0x0000 window] (ignored, not CPU addressable) Apr 8 00:53:35 warble1 kernel: PCI host bridge to bus 0000:80 Apr 8 00:53:35 warble1 kernel: pci_bus 0000:80: root bus resource [bus 80-84] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:80: root bus resource [mem 0xc6000000-0xd37fffff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:80: root bus resource [mem 0x384000000000-0x384fffffffff window] Apr 8 00:53:35 warble1 kernel: ACPI: PCI Root Bridge [PC07] (domain 0000 [bus 85-ad]) Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:07: PCIe AER handled by firmware Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:07: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:07: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:53:35 warble1 kernel: PCI host bridge to bus 0000:85 Apr 8 00:53:35 warble1 kernel: pci_bus 0000:85: root bus resource [bus 85-ad] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:85: root bus resource [io 0xa000-0xbfff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:85: root bus resource [mem 0xd3800000-0xe0ffffff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:85: root bus resource [mem 0x385000000000-0x385fffffffff window] Apr 8 00:53:35 warble1 kernel: ACPI: PCI Root Bridge [PC08] (domain 0000 [bus ae-d6]) Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:08: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:08: PCIe AER handled by firmware Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:08: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:08: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:53:35 warble1 kernel: PCI host bridge to bus 0000:ae Apr 8 00:53:35 warble1 kernel: pci_bus 0000:ae: root bus resource [bus ae-d6] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:ae: root bus resource [io 0xc000-0xdfff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:ae: root bus resource [mem 0xe1000000-0xee7fffff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:ae: root bus resource [mem 0x386000000000-0x386fffffffff window] Apr 8 00:53:35 warble1 kernel: ACPI: PCI Root Bridge [PC09] (domain 0000 [bus d7-ff]) Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:09: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:09: PCIe AER handled by firmware Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:09: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Apr 8 00:53:35 warble1 kernel: acpi PNP0A08:09: FADT indicates ASPM is unsupported, using BIOS configuration Apr 8 00:53:35 warble1 kernel: PCI host bridge to bus 0000:d7 Apr 8 00:53:35 warble1 kernel: pci_bus 0000:d7: root bus resource [bus d7-ff] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:d7: root bus resource [io 0xe000-0xffff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:d7: root bus resource [mem 0xee800000-0xfbffffff window] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:d7: root bus resource [mem 0x387000000000-0x387fffffffff window] Apr 8 00:53:35 warble1 kernel: pci 0000:d7:00.0: System wakeup disabled by ACPI Apr 8 00:53:35 warble1 kernel: pci 0000:d7:00.0: PCI bridge to [bus d8] Apr 8 00:53:35 warble1 kernel: ACPI: Enabled 3 GPEs in block 00 to 7F Apr 8 00:53:35 warble1 kernel: vgaarb: device added: PCI:0000:03:00.0,decodes=io+mem,owns=io+mem,locks=none Apr 8 00:53:35 warble1 kernel: vgaarb: loaded Apr 8 00:53:35 warble1 kernel: vgaarb: bridge control possible 0000:03:00.0 Apr 8 00:53:35 warble1 kernel: SCSI subsystem initialized Apr 8 00:53:35 warble1 kernel: ACPI: bus type USB registered Apr 8 00:53:35 warble1 kernel: usbcore: registered new interface driver usbfs Apr 8 00:53:35 warble1 kernel: usbcore: registered new interface driver hub Apr 8 00:53:35 warble1 kernel: usbcore: registered new device driver usb Apr 8 00:53:35 warble1 kernel: PCI: Using ACPI for IRQ routing Apr 8 00:53:35 warble1 kernel: Expanded resource reserved due to conflict with PNP0003:00 Apr 8 00:53:35 warble1 kernel: NetLabel: Initializing Apr 8 00:53:35 warble1 kernel: NetLabel: domain hash size = 128 Apr 8 00:53:35 warble1 kernel: NetLabel: protocols = UNLABELED CIPSOv4 Apr 8 00:53:35 warble1 kernel: NetLabel: unlabeled traffic allowed by default Apr 8 00:53:35 warble1 kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 Apr 8 00:53:35 warble1 kernel: hpet0: 8 comparators, 64-bit 24.000000 MHz counter Apr 8 00:53:35 warble1 kernel: amd_nb: Cannot enumerate AMD northbridges Apr 8 00:53:35 warble1 kernel: Switched to clocksource hpet Apr 8 00:53:35 warble1 kernel: pnp: PnP ACPI init Apr 8 00:53:35 warble1 kernel: ACPI: bus type PNP registered Apr 8 00:53:35 warble1 kernel: system 00:01: [io 0x0500-0x053f] could not be reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [io 0x0400-0x047f] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [io 0x0540-0x057f] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [io 0x0600-0x061f] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [io 0x0ca0-0x0ca5] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [io 0x0880-0x0883] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [io 0x0800-0x081f] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [mem 0xff000000-0xffffffff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:04: [mem 0xfd000000-0xfdabffff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:04: [mem 0xfdad0000-0xfdadffff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:04: [mem 0xfdb00000-0xfdffffff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:04: [mem 0xfe000000-0xfe00ffff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:04: [mem 0xfe011000-0xfe01ffff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:04: [mem 0xfe036000-0xfe03bfff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:04: [mem 0xfe03d000-0xfe3fffff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:04: [mem 0xfe410000-0xfe7fffff] has been reserved Apr 8 00:53:35 warble1 kernel: system 00:05: [io 0x1000-0x10fe] has been reserved Apr 8 00:53:35 warble1 kernel: pnp: PnP ACPI: found 6 devices Apr 8 00:53:35 warble1 kernel: ACPI: bus type PNP unregistered Apr 8 00:53:35 warble1 kernel: pci 0000:18:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.0: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.1: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.2: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.3: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window Apr 8 00:53:35 warble1 kernel: pci 0000:3b:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window Apr 8 00:53:35 warble1 kernel: pci 0000:d8:00.0: can't claim BAR 6 [mem 0xfffe0000-0xffffffff pref]: no compatible bridge window Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.0: BAR 15: assigned [mem 0x380000000000-0x3800001fffff 64bit pref] Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.0: BAR 13: assigned [io 0x3000-0x3fff] Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.0: PCI bridge to [bus 01] Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.0: bridge window [io 0x3000-0x3fff] Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.0: bridge window [mem 0x92a00000-0x92bfffff] Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.0: bridge window [mem 0x380000000000-0x3800001fffff 64bit pref] Apr 8 00:53:35 warble1 kernel: pci 0000:02:00.0: PCI bridge to [bus 03] Apr 8 00:53:35 warble1 kernel: pci 0000:02:00.0: bridge window [mem 0x92000000-0x928fffff] Apr 8 00:53:35 warble1 kernel: pci 0000:02:00.0: bridge window [mem 0x91000000-0x91ffffff 64bit pref] Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.4: PCI bridge to [bus 02-03] Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.4: bridge window [mem 0x92000000-0x928fffff] Apr 8 00:53:35 warble1 kernel: pci 0000:00:1c.4: bridge window [mem 0x91000000-0x91ffffff 64bit pref] Apr 8 00:53:35 warble1 kernel: pci 0000:17:02.0: BAR 14: assigned [mem 0xa1c00000-0xa1dfffff] Apr 8 00:53:35 warble1 kernel: pci 0000:18:00.0: BAR 6: no space for [mem size 0x00100000 pref] Apr 8 00:53:35 warble1 kernel: pci 0000:18:00.0: BAR 6: failed to assign [mem size 0x00100000 pref] Apr 8 00:53:35 warble1 kernel: pci 0000:17:00.0: PCI bridge to [bus 18] Apr 8 00:53:35 warble1 kernel: pci 0000:17:00.0: bridge window [io 0x4000-0x4fff] Apr 8 00:53:35 warble1 kernel: pci 0000:17:00.0: bridge window [mem 0xa1900000-0xa1afffff] Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.0: BAR 6: assigned [mem 0xa1c00000-0xa1c7ffff pref] Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.1: BAR 6: assigned [mem 0xa1c80000-0xa1cfffff pref] Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.2: BAR 6: assigned [mem 0xa1d00000-0xa1d7ffff pref] Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.3: BAR 6: assigned [mem 0xa1d80000-0xa1dfffff pref] Apr 8 00:53:35 warble1 kernel: pci 0000:17:02.0: PCI bridge to [bus 19] Apr 8 00:53:35 warble1 kernel: pci 0000:17:02.0: bridge window [mem 0xa1c00000-0xa1dfffff] Apr 8 00:53:35 warble1 kernel: pci 0000:17:02.0: bridge window [mem 0x9d800000-0xa18fffff 64bit pref] Apr 8 00:53:35 warble1 kernel: pci 0000:3b:00.0: BAR 6: no space for [mem size 0x00100000 pref] Apr 8 00:53:35 warble1 kernel: pci 0000:3b:00.0: BAR 6: failed to assign [mem size 0x00100000 pref] Apr 8 00:53:35 warble1 kernel: pci 0000:3b:00.0: BAR 9: no space for [mem size 0x01000000 64bit] Apr 8 00:53:35 warble1 kernel: pci 0000:3b:00.0: BAR 9: failed to assign [mem size 0x01000000 64bit] Apr 8 00:53:35 warble1 kernel: pci 0000:3b:00.0: BAR 7: no space for [mem size 0x00100000 64bit] Apr 8 00:53:35 warble1 kernel: pci 0000:3b:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit] Apr 8 00:53:35 warble1 kernel: pci 0000:3a:00.0: PCI bridge to [bus 3b] Apr 8 00:53:35 warble1 kernel: pci 0000:3a:00.0: bridge window [io 0x6000-0x6fff] Apr 8 00:53:35 warble1 kernel: pci 0000:3a:00.0: bridge window [mem 0xab000000-0xab1fffff] Apr 8 00:53:35 warble1 kernel: pci_bus 0000:3a: Some PCI device resources are unassigned, try booting with pci=realloc Apr 8 00:53:35 warble1 kernel: pci 0000:d8:00.0: BAR 6: no space for [mem size 0x00020000 pref] Apr 8 00:53:35 warble1 kernel: pci 0000:d8:00.0: BAR 6: failed to assign [mem size 0x00020000 pref] Apr 8 00:53:35 warble1 kernel: pci 0000:d7:00.0: PCI bridge to [bus d8] Apr 8 00:53:35 warble1 kernel: pci 0000:d7:00.0: bridge window [mem 0xf0000000-0xf3ffffff] Apr 8 00:53:35 warble1 kernel: NET: Registered protocol family 2 Apr 8 00:53:35 warble1 kernel: TCP established hash table entries: 524288 (order: 10, 4194304 bytes) Apr 8 00:53:35 warble1 kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) Apr 8 00:53:35 warble1 kernel: TCP: Hash tables configured (established 524288 bind 65536) Apr 8 00:53:35 warble1 kernel: TCP: reno registered Apr 8 00:53:35 warble1 kernel: UDP hash table entries: 65536 (order: 9, 2097152 bytes) Apr 8 00:53:35 warble1 kernel: UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes) Apr 8 00:53:35 warble1 kernel: NET: Registered protocol family 1 Apr 8 00:53:35 warble1 kernel: Unpacking initramfs... Apr 8 00:53:35 warble1 kernel: Freeing initrd memory: 46592k freed Apr 8 00:53:35 warble1 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Apr 8 00:53:35 warble1 kernel: software IO TLB [mem 0x6582a000-0x6982a000] (64MB) mapped at [ffff88006582a000-ffff880069829fff] Apr 8 00:53:35 warble1 kernel: Intel CQM monitoring enabled Apr 8 00:53:35 warble1 kernel: Intel MBM enabled Apr 8 00:53:35 warble1 kernel: RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer Apr 8 00:53:35 warble1 kernel: RAPL PMU: hw unit of domain pp0-core 2^-14 Joules Apr 8 00:53:35 warble1 kernel: RAPL PMU: hw unit of domain package 2^-14 Joules Apr 8 00:53:35 warble1 kernel: RAPL PMU: hw unit of domain dram 2^-16 Joules Apr 8 00:53:35 warble1 kernel: sha1_ssse3: Using AVX2 optimized SHA-1 implementation Apr 8 00:53:35 warble1 kernel: sha256_ssse3: Using AVX2 optimized SHA-256 implementation Apr 8 00:53:35 warble1 kernel: futex hash table entries: 131072 (order: 11, 8388608 bytes) Apr 8 00:53:35 warble1 kernel: Initialise system trusted keyring Apr 8 00:53:35 warble1 kernel: HugeTLB registered 1 GB page size, pre-allocated 0 pages Apr 8 00:53:35 warble1 kernel: HugeTLB registered 2 MB page size, pre-allocated 0 pages Apr 8 00:53:35 warble1 kernel: zpool: loaded Apr 8 00:53:35 warble1 kernel: zbud: loaded Apr 8 00:53:35 warble1 kernel: VFS: Disk quotas dquot_6.5.2 Apr 8 00:53:35 warble1 kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Apr 8 00:53:35 warble1 kernel: msgmni has been set to 32768 Apr 8 00:53:35 warble1 kernel: Key type big_key registered Apr 8 00:53:35 warble1 kernel: NET: Registered protocol family 38 Apr 8 00:53:35 warble1 kernel: Key type asymmetric registered Apr 8 00:53:35 warble1 kernel: Asymmetric key parser 'x509' registered Apr 8 00:53:35 warble1 kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) Apr 8 00:53:35 warble1 kernel: io scheduler noop registered Apr 8 00:53:35 warble1 kernel: io scheduler deadline registered (default) Apr 8 00:53:35 warble1 kernel: io scheduler cfq registered Apr 8 00:53:35 warble1 kernel: pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pcieport 0000:00:1c.4: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pci 0000:02:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pci 0000:03:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pcieport 0000:17:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pci 0000:18:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pcieport 0000:17:02.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.1: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.2: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pci 0000:19:00.3: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pcieport 0000:3a:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pci 0000:3b:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pcieport 0000:d7:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pci 0000:d8:00.0: Signaling PME through PCIe PME interrupt Apr 8 00:53:35 warble1 kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5 Apr 8 00:53:35 warble1 kernel: pciehp 0000:00:1c.0:pcie04: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl+ LLActRep+ Apr 8 00:53:35 warble1 kernel: pciehp: PCI Express Hot Plug Controller Driver version: 0.4 Apr 8 00:53:35 warble1 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 Apr 8 00:53:35 warble1 kernel: ACPI: Power Button [PWRF] Apr 8 00:53:35 warble1 kernel: ERST: Error Record Serialization Table (ERST) support is initialized. Apr 8 00:53:35 warble1 kernel: pstore: Registered erst as persistent store backend Apr 8 00:53:35 warble1 kernel: GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. Apr 8 00:53:35 warble1 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Apr 8 00:53:35 warble1 kernel: 00:02: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Apr 8 00:53:35 warble1 kernel: 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A Apr 8 00:53:35 warble1 kernel: Non-volatile memory driver v1.3 Apr 8 00:53:35 warble1 kernel: Linux agpgart interface v0.103 Apr 8 00:53:35 warble1 kernel: crash memory driver: version 1.1 Apr 8 00:53:35 warble1 kernel: rdac: device handler registered Apr 8 00:53:35 warble1 kernel: hp_sw: device handler registered Apr 8 00:53:35 warble1 kernel: emc: device handler registered Apr 8 00:53:35 warble1 kernel: alua: device handler registered Apr 8 00:53:35 warble1 kernel: libphy: Fixed MDIO Bus: probed Apr 8 00:53:35 warble1 kernel: ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver Apr 8 00:53:35 warble1 kernel: ehci-pci: EHCI PCI platform driver Apr 8 00:53:35 warble1 kernel: ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver Apr 8 00:53:35 warble1 kernel: ohci-pci: OHCI PCI platform driver Apr 8 00:53:35 warble1 kernel: uhci_hcd: USB Universal Host Controller Interface driver Apr 8 00:53:35 warble1 kernel: xhci_hcd 0000:00:14.0: xHCI Host Controller Apr 8 00:53:35 warble1 kernel: xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 1 Apr 8 00:53:35 warble1 kernel: xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810 Apr 8 00:53:35 warble1 kernel: usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 Apr 8 00:53:35 warble1 kernel: usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Apr 8 00:53:35 warble1 kernel: usb usb1: Product: xHCI Host Controller Apr 8 00:53:35 warble1 kernel: usb usb1: Manufacturer: Linux 3.10.0-693.17.1.el7.x86_64 xhci-hcd Apr 8 00:53:35 warble1 kernel: usb usb1: SerialNumber: 0000:00:14.0 Apr 8 00:53:35 warble1 kernel: hub 1-0:1.0: USB hub found Apr 8 00:53:35 warble1 kernel: hub 1-0:1.0: 16 ports detected Apr 8 00:53:35 warble1 kernel: xhci_hcd 0000:00:14.0: xHCI Host Controller Apr 8 00:53:35 warble1 kernel: xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 Apr 8 00:53:35 warble1 kernel: usb usb2: New USB device found, idVendor=1d6b, idProduct=0003 Apr 8 00:53:35 warble1 kernel: usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Apr 8 00:53:35 warble1 kernel: usb usb2: Product: xHCI Host Controller Apr 8 00:53:35 warble1 kernel: usb usb2: Manufacturer: Linux 3.10.0-693.17.1.el7.x86_64 xhci-hcd Apr 8 00:53:35 warble1 kernel: usb usb2: SerialNumber: 0000:00:14.0 Apr 8 00:53:35 warble1 kernel: hub 2-0:1.0: USB hub found Apr 8 00:53:35 warble1 kernel: hub 2-0:1.0: 10 ports detected Apr 8 00:53:35 warble1 kernel: usb: port power management may be unreliable Apr 8 00:53:35 warble1 kernel: usbcore: registered new interface driver usbserial Apr 8 00:53:35 warble1 kernel: usbcore: registered new interface driver usbserial_generic Apr 8 00:53:35 warble1 kernel: usbserial: USB Serial support registered for generic Apr 8 00:53:35 warble1 kernel: i8042: PNP: No PS/2 controller found. Probing ports directly. Apr 8 00:53:35 warble1 kernel: usb 1-14: new high-speed USB device number 2 using xhci_hcd Apr 8 00:53:35 warble1 kernel: usb 1-14: New USB device found, idVendor=1604, idProduct=10c0 Apr 8 00:53:35 warble1 kernel: usb 1-14: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Apr 8 00:53:35 warble1 kernel: hub 1-14:1.0: USB hub found Apr 8 00:53:35 warble1 kernel: hub 1-14:1.0: 4 ports detected Apr 8 00:53:35 warble1 kernel: tsc: Refined TSC clocksource calibration: 3192.499 MHz Apr 8 00:53:35 warble1 kernel: i8042: No controller found Apr 8 00:53:35 warble1 kernel: Switched to clocksource tsc Apr 8 00:53:35 warble1 kernel: mousedev: PS/2 mouse device common for all mice Apr 8 00:53:35 warble1 kernel: rtc_cmos 00:00: RTC can wake from S4 Apr 8 00:53:35 warble1 kernel: rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0 Apr 8 00:53:35 warble1 kernel: rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs Apr 8 00:53:35 warble1 kernel: cpuidle: using governor menu Apr 8 00:53:35 warble1 kernel: hidraw: raw HID events driver (C) Jiri Kosina Apr 8 00:53:35 warble1 kernel: usbcore: registered new interface driver usbhid Apr 8 00:53:35 warble1 kernel: usbhid: USB HID core driver Apr 8 00:53:35 warble1 kernel: drop_monitor: Initializing network drop monitor service Apr 8 00:53:35 warble1 kernel: TCP: cubic registered Apr 8 00:53:35 warble1 kernel: Initializing XFRM netlink socket Apr 8 00:53:35 warble1 kernel: NET: Registered protocol family 10 Apr 8 00:53:35 warble1 kernel: NET: Registered protocol family 17 Apr 8 00:53:35 warble1 kernel: intel_rdt: Intel RDT L3 allocation detected Apr 8 00:53:35 warble1 kernel: intel_rdt: Intel RDT L3DATA allocation detected Apr 8 00:53:35 warble1 kernel: intel_rdt: Intel RDT L3CODE allocation detected Apr 8 00:53:35 warble1 kernel: microcode: CPU0 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU1 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU2 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU3 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU4 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU5 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU6 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU7 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU8 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU9 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU10 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU11 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU12 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU13 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU14 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: CPU15 sig=0x50654, pf=0x80, revision=0x2000043 Apr 8 00:53:35 warble1 kernel: microcode: Microcode Update Driver: v2.01 , Peter Oruba Apr 8 00:53:35 warble1 kernel: Loading compiled-in X.509 certificates Apr 8 00:53:35 warble1 kernel: Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' Apr 8 00:53:35 warble1 kernel: Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' Apr 8 00:53:35 warble1 kernel: Loaded X.509 cert 'CentOS Linux kernel signing key: 506c6868809d2cbf540bf0d983d5c6709dbc4f22' Apr 8 00:53:35 warble1 kernel: registered taskstats version 1 Apr 8 00:53:35 warble1 kernel: Key type trusted registered Apr 8 00:53:35 warble1 kernel: Key type encrypted registered Apr 8 00:53:35 warble1 kernel: IMA: No TPM chip found, activating TPM-bypass! Apr 8 00:53:35 warble1 kernel: Magic number: 14:336:889 Apr 8 00:53:35 warble1 kernel: event_source uncore_pcu: hash matches Apr 8 00:53:35 warble1 kernel: clockevents clockevent442: hash matches Apr 8 00:53:35 warble1 kernel: pci 0000:00:1f.2: hash matches Apr 8 00:53:35 warble1 kernel: acpi device:f8: hash matches Apr 8 00:53:35 warble1 kernel: acpi device:cb: hash matches Apr 8 00:53:35 warble1 kernel: memory memory5610: hash matches Apr 8 00:53:35 warble1 kernel: memory memory5164: hash matches Apr 8 00:53:35 warble1 kernel: memory memory4328: hash matches Apr 8 00:53:35 warble1 kernel: memory memory3042: hash matches Apr 8 00:53:35 warble1 kernel: memory memory1796: hash matches Apr 8 00:53:35 warble1 kernel: memory memory1115: hash matches Apr 8 00:53:35 warble1 kernel: memory memory328: hash matches Apr 8 00:53:35 warble1 kernel: rtc_cmos 00:00: setting system clock to 2018-04-07 14:53:34 UTC (1523112814) Apr 8 00:53:35 warble1 kernel: usb 1-14.1: new high-speed USB device number 3 using xhci_hcd Apr 8 00:53:35 warble1 kernel: usb 1-14.1: New USB device found, idVendor=1604, idProduct=10c0 Apr 8 00:53:35 warble1 kernel: usb 1-14.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Apr 8 00:53:35 warble1 kernel: hub 1-14.1:1.0: USB hub found Apr 8 00:53:35 warble1 kernel: hub 1-14.1:1.0: 4 ports detected Apr 8 00:53:35 warble1 kernel: usb 1-14.4: new high-speed USB device number 4 using xhci_hcd Apr 8 00:53:35 warble1 kernel: Freeing unused kernel memory: 1800k freed Apr 8 00:53:35 warble1 kernel: usb 1-14.4: New USB device found, idVendor=1604, idProduct=10c0 Apr 8 00:53:35 warble1 kernel: usb 1-14.4: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Apr 8 00:53:35 warble1 kernel: hub 1-14.4:1.0: USB hub found Apr 8 00:53:35 warble1 systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) Apr 8 00:53:35 warble1 systemd[1]: Detected architecture x86-64. Apr 8 00:53:35 warble1 systemd[1]: Running in initial RAM disk. Apr 8 00:53:35 warble1 kernel: hub 1-14.4:1.0: 4 ports detected Apr 8 00:53:35 warble1 systemd[1]: No hostname configured. Apr 8 00:53:35 warble1 systemd[1]: Set hostname to . Apr 8 00:53:35 warble1 systemd[1]: Initializing machine ID from random generator. Apr 8 00:53:35 warble1 systemd[1]: Started Dispatch Password Requests to Console Directory Watch. Apr 8 00:53:35 warble1 systemd[1]: Starting Dispatch Password Requests to Console Directory Watch. Apr 8 00:53:35 warble1 systemd[1]: Created slice Root Slice. Apr 8 00:53:35 warble1 systemd[1]: Starting Root Slice. Apr 8 00:53:35 warble1 systemd[1]: Created slice System Slice. Apr 8 00:53:35 warble1 systemd[1]: Starting System Slice. Apr 8 00:53:35 warble1 systemd[1]: Listening on udev Kernel Socket. Apr 8 00:53:35 warble1 systemd[1]: Starting udev Kernel Socket. Apr 8 00:53:35 warble1 systemd[1]: Listening on Journal Socket. Apr 8 00:53:35 warble1 systemd[1]: Starting Journal Socket. Apr 8 00:53:35 warble1 systemd[1]: Starting Journal Service... Apr 8 00:53:35 warble1 systemd[1]: Starting Create list of required static device nodes for the current kernel... Apr 8 00:53:35 warble1 systemd[1]: Starting Load Kernel Modules... Apr 8 00:53:35 warble1 journal: Journal started Apr 8 00:53:35 warble1 systemd[1]: Reached target Paths. Apr 8 00:53:35 warble1 systemd[1]: Starting Paths. Apr 8 00:53:35 warble1 systemd[1]: Reached target Timers. Apr 8 00:53:35 warble1 systemd[1]: Starting Timers. Apr 8 00:53:35 warble1 systemd[1]: Starting dracut cmdline hook... Apr 8 00:53:35 warble1 systemd[1]: Reached target Local File Systems. Apr 8 00:53:35 warble1 systemd[1]: Starting Local File Systems. Apr 8 00:53:35 warble1 systemd[1]: Reached target Swap. Apr 8 00:53:35 warble1 systemd[1]: Starting Swap. Apr 8 00:53:35 warble1 systemd[1]: Reached target Slices. Apr 8 00:53:35 warble1 systemd[1]: Starting Slices. Apr 8 00:53:35 warble1 systemd[1]: Listening on udev Control Socket. Apr 8 00:53:35 warble1 systemd[1]: Starting udev Control Socket. Apr 8 00:53:35 warble1 systemd[1]: Reached target Sockets. Apr 8 00:53:35 warble1 systemd[1]: Starting Sockets. Apr 8 00:53:35 warble1 systemd[1]: Started Journal Service. Apr 8 00:53:35 warble1 systemd: Started Create list of required static device nodes for the current kernel. Apr 8 00:53:35 warble1 systemd: Started Load Kernel Modules. Apr 8 00:53:35 warble1 systemd: Started dracut cmdline hook. Apr 8 00:53:35 warble1 systemd: Starting dracut pre-udev hook... Apr 8 00:53:35 warble1 systemd: Starting Apply Kernel Variables... Apr 8 00:53:35 warble1 systemd: Starting Create Static Device Nodes in /dev... Apr 8 00:53:35 warble1 systemd: Started Apply Kernel Variables. Apr 8 00:53:35 warble1 systemd: Started Create Static Device Nodes in /dev. Apr 8 00:53:35 warble1 systemd: Started dracut pre-udev hook. Apr 8 00:53:35 warble1 systemd: Starting udev Kernel Device Manager... Apr 8 00:53:35 warble1 systemd-udevd: starting version 219 Apr 8 00:53:35 warble1 systemd: Started udev Kernel Device Manager. Apr 8 00:53:35 warble1 systemd: Starting dracut pre-trigger hook... Apr 8 00:53:35 warble1 systemd: Started dracut pre-trigger hook. Apr 8 00:53:35 warble1 systemd: Starting udev Coldplug all Devices... Apr 8 00:53:35 warble1 systemd: Mounting Configuration File System... Apr 8 00:53:35 warble1 systemd: Mounted Configuration File System. Apr 8 00:53:35 warble1 systemd-udevd: could not find module by name='ipmi_si' Apr 8 00:53:35 warble1 systemd-udevd: could not find module by name='ipmi_devintf' Apr 8 00:53:35 warble1 systemd-udevd: could not find module by name='ipmi_msghandler' Apr 8 00:53:35 warble1 kernel: pps_core: LinuxPPS API ver. 1 registered Apr 8 00:53:35 warble1 kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Apr 8 00:53:35 warble1 kernel: megasas: 07.701.17.00-rh1 Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: FW now in Ready state Apr 8 00:53:35 warble1 kernel: PTP clock support registered Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: firmware supports msix#011: (96) Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: current msix/online cpus#011: (16/16) Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: RDPQ mode#011: (disabled) Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: Current firmware maximum commands: 928#011 LDIO threshold: 0 Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: FW supports sync cache#011: No Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: Init cmd success Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: firmware type#011: Extended VD(240 VD)firmware Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: controller type#011: MR(2048MB) Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: Online Controller Reset(OCR)#011: Enabled Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: Secure JBOD support#011: No Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: INIT adapter done Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: Jbod map is not supported megasas_setup_jbod_map 5121 Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: pci id#011#011: (0x1000)/(0x005d)/(0x1028)/(0x1f42) Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: unevenspan support#011: yes Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: firmware crash dump#011: no Apr 8 00:53:35 warble1 kernel: megaraid_sas 0000:18:00.0: jbod sync map#011#011: no Apr 8 00:53:35 warble1 kernel: scsi host0: Avago SAS based MegaRAID driver Apr 8 00:53:35 warble1 kernel: scsi 0:2:0:0: Direct-Access DELL PERC H730P Adp 4.28 PQ: 0 ANSI: 5 Apr 8 00:53:35 warble1 kernel: mpt3sas version 15.100.00.00 loaded Apr 8 00:53:35 warble1 kernel: mpt3sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (791015680 kB) Apr 8 00:53:35 warble1 kernel: ahci 0000:00:11.5: AHCI 0001.0301 32 slots 6 ports 6 Gbps 0x3f impl SATA mode Apr 8 00:53:35 warble1 kernel: ahci 0000:00:11.5: flags: 64bit ncq sntf pm led clo only pio slum part ems deso sadm sds apst Apr 8 00:53:35 warble1 systemd: Started udev Coldplug all Devices. Apr 8 00:53:35 warble1 systemd: Starting dracut initqueue hook... Apr 8 00:53:35 warble1 kernel: scsi host2: ahci Apr 8 00:53:35 warble1 kernel: scsi host3: ahci Apr 8 00:53:35 warble1 kernel: scsi host4: ahci Apr 8 00:53:35 warble1 kernel: scsi host5: ahci Apr 8 00:53:35 warble1 kernel: scsi host6: ahci Apr 8 00:53:35 warble1 kernel: scsi host7: ahci Apr 8 00:53:35 warble1 kernel: ata1: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80100 irq 52 Apr 8 00:53:35 warble1 kernel: ata2: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80180 irq 52 Apr 8 00:53:35 warble1 kernel: ata3: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80200 irq 52 Apr 8 00:53:35 warble1 kernel: ata4: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80280 irq 52 Apr 8 00:53:35 warble1 kernel: ata5: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80300 irq 52 Apr 8 00:53:35 warble1 kernel: ata6: SATA max UDMA/133 abar m524288@0x92c80000 port 0x92c80380 irq 52 Apr 8 00:53:35 warble1 kernel: ahci 0000:00:17.0: AHCI 0001.0301 32 slots 8 ports 6 Gbps 0xff impl SATA mode Apr 8 00:53:35 warble1 kernel: ahci 0000:00:17.0: flags: 64bit ncq sntf pm led clo only pio slum part ems deso sadm sds apst Apr 8 00:53:36 warble1 kernel: scsi host8: ahci Apr 8 00:53:36 warble1 kernel: scsi host9: ahci Apr 8 00:53:36 warble1 kernel: scsi host10: ahci Apr 8 00:53:36 warble1 kernel: scsi host11: ahci Apr 8 00:53:36 warble1 kernel: scsi host12: ahci Apr 8 00:53:36 warble1 kernel: scsi host13: ahci Apr 8 00:53:36 warble1 kernel: scsi host14: ahci Apr 8 00:53:36 warble1 kernel: scsi host15: ahci Apr 8 00:53:36 warble1 kernel: ata7: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00100 irq 53 Apr 8 00:53:36 warble1 kernel: ata8: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00180 irq 53 Apr 8 00:53:36 warble1 kernel: ata9: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00200 irq 53 Apr 8 00:53:36 warble1 kernel: ata10: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00280 irq 53 Apr 8 00:53:36 warble1 kernel: ata11: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00300 irq 53 Apr 8 00:53:36 warble1 kernel: ata12: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00380 irq 53 Apr 8 00:53:36 warble1 kernel: ata13: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00400 irq 53 Apr 8 00:53:36 warble1 kernel: ata14: SATA max UDMA/133 abar m524288@0x92c00000 port 0x92c00480 irq 53 Apr 8 00:53:36 warble1 kernel: mpt3sas_cm0: MSI-X vectors supported: 96, no of cores: 16, max_msix_vectors: -1 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 54 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 55 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 56 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 57 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 58 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 59 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 60 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 61 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 62 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 63 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 64 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 65 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 66 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 67 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 68 Apr 8 00:53:36 warble1 kernel: mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 69 Apr 8 00:53:36 warble1 kernel: mpt3sas_cm0: iomem(0x00000000ab100000), mapped(0xffffc900636a0000), size(65536) Apr 8 00:53:36 warble1 kernel: mpt3sas_cm0: ioport(0x0000000000006000), size(256) Apr 8 00:53:36 warble1 kernel: bnx2x: QLogic 5771x/578xx 10/20-Gigabit Ethernet Driver bnx2x 1.712.30-0 (2014/02/10) Apr 8 00:53:36 warble1 kernel: bnx2x 0000:19:00.0: msix capability found Apr 8 00:53:36 warble1 kernel: bnx2x 0000:19:00.0: part number 0-0-0-0 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: Eager buffer size 2097152 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: enabling device (0000 -> 0002) Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: WC Remapped RcvArray: ffffc90063900000 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Implementation: RTL silicon, revision 0x0 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: GUID 1175010171de62 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Resetting CSRs with FLR Apr 8 00:53:36 warble1 kernel: mpt3sas_cm0: Allocated physical memory: size(18353 kB) Apr 8 00:53:36 warble1 kernel: mpt3sas_cm0: Current Controller Queue Depth(9548),Max Controller Queue Depth(9680) Apr 8 00:53:36 warble1 kernel: mpt3sas_cm0: Scatter Gather Elements per IO(128) Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe,8000MHz,x16 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: do_pcie_gen3_transition: PCIe already at gen3, skipping Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Board description not found Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: rcv contexts: chip 160, used 25 (kernel 9, user 16) Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: RcvArray groups 327, ctxts extra 17 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: unused send context blocks: 9 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send contexts: chip 160, used 42 (kernel 16, ack 9, user 16, vl15 1) Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Using send context 16(143) for VL15 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA mod_num_sdma: 0 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_engines: 16 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_mem_size: 401408 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA engines 16 descq_cnt 2048 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA num_sdma: 16 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 26 MSI-X interrupts allocated Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 77, type GENERAL -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 79, type SDMA engine 0 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 81, type SDMA engine 1 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 83, type SDMA engine 2 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 85, type SDMA engine 3 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 87, type SDMA engine 4 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 88, type SDMA engine 5 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 89, type SDMA engine 6 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 90, type SDMA engine 7 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 91, type SDMA engine 8 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 92, type SDMA engine 9 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 93, type SDMA engine 10 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 94, type SDMA engine 11 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 95, type SDMA engine 12 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 96, type SDMA engine 13 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 97, type SDMA engine 14 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 98, type SDMA engine 15 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 99, type RCVCTXT ctxt 0 -> cpu: 1 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 100, type RCVCTXT ctxt 1 -> cpu: 3 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 101, type RCVCTXT ctxt 2 -> cpu: 5 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 102, type RCVCTXT ctxt 3 -> cpu: 7 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 103, type RCVCTXT ctxt 4 -> cpu: 9 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 112, type RCVCTXT ctxt 5 -> cpu: 11 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 113, type RCVCTXT ctxt 6 -> cpu: 13 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 114, type RCVCTXT ctxt 7 -> cpu: 15 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 115, type RCVCTXT ctxt 8 -> cpu: 3 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 8 00:53:36 warble1 kernel: bnx2x 0000:19:00.1: msix capability found Apr 8 00:53:36 warble1 kernel: bnx2x 0000:19:00.1: part number 0-0-0-0 Apr 8 00:53:36 warble1 kernel: mpt3sas_cm0: LSISAS3008: FWVersion(13.15.02.00), ChipRevision(0x02), BiosVersion(15.00.02.00) Apr 8 00:53:36 warble1 kernel: mpt3sas_cm0: Protocol=( Apr 8 00:53:36 warble1 kernel: Initiator Apr 8 00:53:36 warble1 kernel: ,Target Apr 8 00:53:36 warble1 kernel: ), Apr 8 00:53:36 warble1 kernel: Capabilities=( Apr 8 00:53:36 warble1 kernel: TLR Apr 8 00:53:36 warble1 kernel: ,EEDP Apr 8 00:53:36 warble1 kernel: ,Snapshot Buffer Apr 8 00:53:36 warble1 kernel: ,Diag Trace Buffer Apr 8 00:53:36 warble1 kernel: ,Task Set Full Apr 8 00:53:36 warble1 kernel: ,NCQ Apr 8 00:53:36 warble1 kernel: ) Apr 8 00:53:36 warble1 kernel: scsi host1: Fusion MPT SAS Host Apr 8 00:53:36 warble1 kernel: mpt3sas_cm0: sending port enable !! Apr 8 00:53:36 warble1 kernel: ata1: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata4: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata2: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata3: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata5: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata6: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata7: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata8: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata13: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata9: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata12: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata10: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata11: SATA link down (SStatus 0 SControl 300) Apr 8 00:53:36 warble1 kernel: ata14: SATA link up 1.5 Gbps (SStatus 113 SControl 300) Apr 8 00:53:36 warble1 kernel: ata14.00: ATAPI: HL-DT-ST DVD-ROM DU90N, D3C0, max UDMA/100 Apr 8 00:53:36 warble1 kernel: ata14.00: configured for UDMA/100 Apr 8 00:53:36 warble1 kernel: bnx2x 0000:19:00.2: msix capability found Apr 8 00:53:36 warble1 kernel: bnx2x 0000:19:00.2: part number 0-0-0-0 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051 firmware version 1.24 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SBus Master firmware version 0x10130001 Apr 8 00:53:36 warble1 kernel: bnx2x 0000:19:00.3: msix capability found Apr 8 00:53:36 warble1 kernel: bnx2x 0000:19:00.3: part number 0-0-0-0 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe SerDes firmware version 0x4755 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric SerDes firmware version 0x1055 Apr 8 00:53:36 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Initializing thermal sensor Apr 8 00:53:36 warble1 systemd: Reached target System Initialization. Apr 8 00:53:36 warble1 systemd: Starting System Initialization. Apr 8 00:53:36 warble1 systemd: Reached target Basic System. Apr 8 00:53:36 warble1 systemd: Starting Basic System. Apr 8 00:53:36 warble1 kernel: scsi: waiting for bus probes to complete ... Apr 8 00:53:36 warble1 kernel: sd 0:2:0:0: [sda] 584843264 512-byte logical blocks: (299 GB/278 GiB) Apr 8 00:53:36 warble1 kernel: sd 0:2:0:0: [sda] Write Protect is off Apr 8 00:53:36 warble1 kernel: sd 0:2:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA Apr 8 00:53:36 warble1 kernel: sda: sda1 sda2 Apr 8 00:53:36 warble1 kernel: sd 0:2:0:0: [sda] Attached SCSI disk Apr 8 00:53:36 warble1 kernel: Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011) Apr 8 00:53:36 warble1 kernel: bonding: bond0 is being created... Apr 8 00:53:36 warble1 kernel: bonding: bond0 already exists Apr 8 00:53:36 warble1 kernel: bond0: Setting MII monitoring interval to 100 Apr 8 00:53:36 warble1 kernel: bond0: Setting xmit hash policy to layer3+4 (1) Apr 8 00:53:36 warble1 kernel: bond0: Setting LACP rate to fast (1) Apr 8 00:53:36 warble1 kernel: IPv6: ADDRCONF(NETDEV_UP): bond0: link is not ready Apr 8 00:53:36 warble1 kernel: bond0: Adding slave em1 Apr 8 00:53:37 warble1 kernel: bnx2x 0000:19:00.0 em1: using MSI-X IRQs: sp 72 fp[0] 74 ... fp[7] 86 Apr 8 00:53:37 warble1 kernel: bnx2x 0000:19:00.0 em1: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 8 00:53:37 warble1 kernel: bnx2x 0000:19:00.0 em1: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 8 00:53:37 warble1 kernel: bond0: Enslaving em1 as a backup interface with an up link Apr 8 00:53:37 warble1 kernel: bond0: Adding slave em2 Apr 8 00:53:37 warble1 kernel: mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x51866da0bde21000), phys(8) Apr 8 00:53:37 warble1 kernel: scsi 1:0:0:0: Direct-Access DELL MD34xx 0825 PQ: 1 ANSI: 5 Apr 8 00:53:37 warble1 kernel: scsi 1:0:0:0: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:37 warble1 kernel: scsi 1:0:0:0: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:37 warble1 kernel: scsi 1:0:0:0: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:37 warble1 kernel: scsi 1:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:37 warble1 kernel: bnx2x 0000:19:00.1 em2: using MSI-X IRQs: sp 117 fp[0] 119 ... fp[7] 126 Apr 8 00:53:38 warble1 kernel: bnx2x 0000:19:00.1 em2: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 8 00:53:38 warble1 kernel: bnx2x 0000:19:00.1 em2: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 8 00:53:38 warble1 kernel: bond0: Enslaving em2 as a backup interface with an up link Apr 8 00:53:38 warble1 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready Apr 8 00:53:38 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: wait_for_qsfp_init: No IntN detected, reset complete Apr 8 00:53:38 warble1 kernel: sched: RT throttling activated Apr 8 00:53:38 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current OFFLINE, new POLL Apr 8 00:53:38 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:10: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: bnx2x 0000:19:00.0 em1: using MSI-X IRQs: sp 72 fp[0] 74 ... fp[7] 86 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:10: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:10: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:10: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:10: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:10: Mode parameters changed Apr 8 00:53:39 warble1 kernel: bnx2x 0000:19:00.0 em1: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 8 00:53:39 warble1 kernel: bnx2x 0000:19:00.0 em1: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 8 00:53:39 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Reserving QPNs from 0x800000 to 0x80ffff for non-verbs use Apr 8 00:53:39 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_POLL (0x2), phy 0x20 Apr 8 00:53:39 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Congestion Control Agent enabled for port 1 Apr 8 00:53:39 warble1 kernel: Couldn't create new SM AH Apr 8 00:53:39 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Registration with rdmavt done. Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:11: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:11: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:11: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:11: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:11: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:11: Mode parameters changed Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:20: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:20: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:20: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:20: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:20: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:20: Mode parameters changed Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:21: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:21: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:21: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:21: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:21: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:21: Mode parameters changed Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:22: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:22: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:22: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:22: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:22: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:22: Mode parameters changed Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:23: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:23: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:23: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:23: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:23: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:23: Mode parameters changed Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:24: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:24: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:24: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:24: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:24: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:24: Mode parameters changed Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:25: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:25: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:25: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:25: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:25: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:25: Mode parameters changed Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:31: Direct-Access DELL Universal Xport 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:31: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:31: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:31: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:31: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:40: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:40: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:40: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:40: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:40: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:40: Mode parameters changed Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:41: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:41: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:41: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:41: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:41: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:41: Mode parameters changed Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:51: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:51: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:51: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:51: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:51: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:39 warble1 kernel: scsi 1:0:0:51: Mode parameters changed Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:52: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:52: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:52: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:52: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:52: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:52: Mode parameters changed Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:60: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:60: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:60: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:60: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:60: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:60: Mode parameters changed Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:61: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:61: SSP: handle(0x0009), sas_addr(0x500a0984b6603b14), phy(0), device_name(0x500a0984b6603b14) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:61: SSP: enclosure_logical_id(0x51866da0bde21000), slot(0) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:61: SSP: enclosure level(0x0000), connector name( 0 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:61: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:0:61: Mode parameters changed Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:0: Direct-Access DELL MD34xx 0825 PQ: 1 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:0: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:0: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:0: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:10: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:10: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:10: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:10: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:10: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:11: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:11: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:11: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:11: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:11: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: bnx2x 0000:19:00.1 em2: using MSI-X IRQs: sp 117 fp[0] 119 ... fp[7] 126 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:20: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:20: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:20: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:20: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:20: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:21: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:21: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:21: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:21: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:21: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:22: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:22: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:22: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:22: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:22: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:23: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:23: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:23: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:23: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:23: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:24: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:24: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:24: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:24: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:24: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: bnx2x 0000:19:00.1 em2: Warning: Unqualified SFP+ module detected, Port 0 from Mellanox part number MC2609130-003 Apr 8 00:53:40 warble1 kernel: bnx2x 0000:19:00.1 em2: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:25: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:25: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:25: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:25: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:25: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:31: Direct-Access DELL Universal Xport 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:31: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:31: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:31: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:31: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:40: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:40: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:40: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:40: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:40: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 dracut-initqueue: dhcp: PREINIT bond0 up Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:41: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:41: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:41: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:41: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:41: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:40 warble1 dhclient[580]: DHCPDISCOVER on bond0 to 255.255.255.255 port 67 interval 7 (xid=0xaefe44e) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:51: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:51: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:51: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:51: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:40 warble1 kernel: scsi 1:0:1:51: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:52: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:52: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:52: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:52: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:52: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:60: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:60: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:60: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:60: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:60: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:61: Direct-Access DELL MD34xx 0825 PQ: 0 ANSI: 5 Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:61: SSP: handle(0x000a), sas_addr(0x500a0984b65ea614), phy(4), device_name(0x500a0984b65ea614) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:61: SSP: enclosure_logical_id(0x51866da0bde21000), slot(4) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:61: SSP: enclosure level(0x0000), connector name( 1 ) Apr 8 00:53:41 warble1 kernel: scsi 1:0:1:61: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Apr 8 00:53:42 warble1 kernel: mpt3sas_cm0: port enable: SUCCESS Apr 8 00:53:42 warble1 kernel: scsi 1:0:0:0: rdac: LUN 0 (IOSHIP) (unowned) Apr 8 00:53:42 warble1 kernel: scsi 1:0:0:10: rdac: LUN 10 (IOSHIP) (unowned) Apr 8 00:53:42 warble1 kernel: sd 1:0:0:10: [sdb] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 8 00:53:42 warble1 kernel: scsi 1:0:0:11: rdac: LUN 11 (IOSHIP) (owned) Apr 8 00:53:42 warble1 kernel: sd 1:0:0:10: [sdb] Write Protect is off Apr 8 00:53:42 warble1 kernel: sd 1:0:0:11: [sdc] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 8 00:53:42 warble1 kernel: sd 1:0:0:10: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:20: rdac: LUN 20 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:20: [sdd] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:11: [sdc] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:21: rdac: LUN 21 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:11: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:20: [sdd] Write Protect is off Apr 8 00:53:43 warble1 kernel: sd 1:0:0:21: [sde] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:20: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:22: rdac: LUN 22 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:22: [sdf] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:21: [sde] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:23: rdac: LUN 23 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:21: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:23: [sdg] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:22: [sdf] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:24: rdac: LUN 24 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:22: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:24: [sdh] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:23: [sdg] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:25: rdac: LUN 25 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:23: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:25: [sdi] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:24: [sdh] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:40: rdac: LUN 40 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:24: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:11: [sdc] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:0:40: [sdj] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:25: [sdi] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:41: rdac: LUN 41 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:25: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:41: [sdk] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:40: [sdj] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:51: rdac: LUN 51 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:40: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:21: [sde] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:0:20: [sdd] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:0:51: [sdl] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:41: [sdk] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:52: rdac: LUN 52 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:41: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:52: [sdm] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:51: [sdl] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:60: rdac: LUN 60 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:51: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:23: [sdg] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:0:22: [sdf] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:0:60: [sdn] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:52: [sdm] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:0:61: rdac: LUN 61 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:52: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:0: rdac: LUN 0 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:61: [sdo] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:10: rdac: LUN 10 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:10: [sdp] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:60: [sdn] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:11: rdac: LUN 11 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:10: [sdp] Write Protect is off Apr 8 00:53:43 warble1 kernel: sd 1:0:1:11: [sdq] 819200 512-byte logical blocks: (419 MB/400 MiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:60: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:1:10: [sdp] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:20: rdac: LUN 20 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:25: [sdi] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:0:24: [sdh] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:0:61: [sdo] Write Protect is off Apr 8 00:53:43 warble1 kernel: sd 1:0:1:20: [sdr] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:11: [sdq] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:21: rdac: LUN 21 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:11: [sdq] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:61: [sdo] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:1:21: [sds] 1319780352 512-byte logical blocks: (675 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:20: [sdr] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:22: rdac: LUN 22 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:20: [sdr] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:41: [sdk] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:22: [sdt] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:40: [sdj] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:21: [sds] Write Protect is off Apr 8 00:53:43 warble1 kernel: sd 1:0:1:21: [sds] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:23: rdac: LUN 23 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:23: [sdu] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:52: [sdm] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:22: [sdt] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:24: rdac: LUN 24 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:51: [sdl] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:22: [sdt] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:0:61: [sdo] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:24: [sdv] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:23: [sdu] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:25: rdac: LUN 25 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:0:60: [sdn] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:10: [sdp] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:23: [sdu] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:1:25: [sdw] 1320599552 512-byte logical blocks: (676 GB/629 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:24: [sdv] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:40: rdac: LUN 40 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:24: [sdv] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:1:40: [sdx] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:25: [sdw] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:41: rdac: LUN 41 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:25: [sdw] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:1:20: [sdr] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:41: [sdy] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:40: [sdx] Write Protect is off Apr 8 00:53:43 warble1 kernel: sd 1:0:1:11: [sdq] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:51: rdac: LUN 51 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:40: [sdx] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:1:51: [sdz] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:41: [sdy] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:52: rdac: LUN 52 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:41: [sdy] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:1:22: [sdt] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:52: [sdaa] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:51: [sdz] Write Protect is off Apr 8 00:53:43 warble1 kernel: sd 1:0:1:21: [sds] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:60: rdac: LUN 60 (IOSHIP) (owned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:51: [sdz] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:1:60: [sdab] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:52: [sdaa] Write Protect is off Apr 8 00:53:43 warble1 kernel: scsi 1:0:1:61: rdac: LUN 61 (IOSHIP) (unowned) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:52: [sdaa] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:1:24: [sdv] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:61: [sdac] 230686720 512-byte logical blocks: (118 GB/110 GiB) Apr 8 00:53:43 warble1 kernel: sd 1:0:1:23: [sdu] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:60: [sdab] Write Protect is off Apr 8 00:53:43 warble1 kernel: sd 1:0:1:60: [sdab] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: scsi 15:0:0:0: CD-ROM HL-DT-ST DVD-ROM DU90N D3C0 PQ: 0 ANSI: 5 Apr 8 00:53:43 warble1 kernel: sd 1:0:1:61: [sdac] Write Protect is off Apr 8 00:53:43 warble1 kernel: sd 1:0:1:61: [sdac] Write cache: enabled, read cache: enabled, supports DPO and FUA Apr 8 00:53:43 warble1 kernel: sd 1:0:1:40: [sdx] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:25: [sdw] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:41: [sdy] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:51: [sdz] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:60: [sdab] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:52: [sdaa] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sd 1:0:1:61: [sdac] Attached SCSI disk Apr 8 00:53:43 warble1 kernel: sr 15:0:0:0: [sr0] scsi3-mmc drive: 24x/24x cd/rw xa/form2 cdda tray Apr 8 00:53:43 warble1 kernel: cdrom: Uniform CD-ROM driver Revision: 3.20 Apr 8 00:53:43 warble1 kernel: sd 1:0:0:10: [sdb] Attached SCSI disk Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current POLL, new VERIFY_CAP Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer PHY: power management 0x0, continuous updates 0x0 Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Fabric: vAU 3, Z 1, vCU 0, vl15 credits 0x44, CRC sizes 0x3 Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Link Width: tx rate 0x2, widths 0x8 Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Device ID: 0xabc0, Revision 0x10 Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Final LCB CRC mode: 1 Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Neighbor Guid: 117501020c4c04 Neighbor type 1 MgmtAllowed 1 FM security bypass 0 Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_TRAINING (0x4), phy 0x46 Apr 8 00:53:45 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current VERIFY_CAP, new GOING_UP Apr 8 00:53:45 warble1 kernel: Couldn't create new SM AH Apr 8 00:53:46 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051: Link up Apr 8 00:53:46 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current GOING_UP, new INIT (LINKUP) Apr 8 00:53:46 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_INIT (0x2) Apr 8 00:53:46 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 8 00:53:47 warble1 dhclient[580]: DHCPDISCOVER on bond0 to 255.255.255.255 port 67 interval 15 (xid=0xaefe44e) Apr 8 00:53:47 warble1 dhclient[580]: DHCPREQUEST on bond0 to 255.255.255.255 port 67 (xid=0xaefe44e) Apr 8 00:53:47 warble1 dhclient[580]: DHCPOFFER from 10.8.44.11 Apr 8 00:53:47 warble1 dhclient[580]: DHCPACK from 10.8.44.11 (xid=0xaefe44e) Apr 8 00:53:47 warble1 dracut-initqueue: dhcp: BOND setting bond0 Apr 8 00:53:47 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_LINKUP (0x5), phy 0x50 Apr 8 00:53:47 warble1 kernel: random: crng init done Apr 8 00:53:48 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:53:48 warble1 kernel: Couldn't create new SM AH Apr 8 00:53:48 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: port 1: got a lid: 0x63 Apr 8 00:53:48 warble1 kernel: SubnSet(OPA_PortInfo) smlid 0x8 Apr 8 00:53:48 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 1 from 10240 to 0 Apr 8 00:53:48 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 2 from 10240 to 0 Apr 8 00:53:48 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 3 from 10240 to 0 Apr 8 00:53:48 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 4 from 10240 to 0 Apr 8 00:53:48 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 5 from 10240 to 0 Apr 8 00:53:48 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 6 from 10240 to 0 Apr 8 00:53:48 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 7 from 10240 to 0 Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current INIT, new ARMED Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ARMED (0x3) Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x103 Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x103 Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x1 Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current ARMED, new ACTIVE Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ACTIVE (0x4) Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x203 Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x203 Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x2 Apr 8 00:53:49 warble1 dhclient[580]: bound to 10.8.44.21 -- renewal in 16345 seconds. Apr 8 00:53:49 warble1 kernel: IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready Apr 8 00:53:49 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Switching to NO_DMA_RTAIL Apr 8 00:53:49 warble1 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready Apr 8 00:53:50 warble1 dracut-initqueue: . Apr 8 00:53:50 warble1 dracut-initqueue: Number of files: 1 Apr 8 00:53:50 warble1 dracut-initqueue: Number of files transferred: 1 Apr 8 00:53:50 warble1 dracut-initqueue: Total file size: 1172 bytes Apr 8 00:53:50 warble1 dracut-initqueue: Total transferred file size: 1172 bytes Apr 8 00:53:50 warble1 dracut-initqueue: Literal data: 1172 bytes Apr 8 00:53:50 warble1 dracut-initqueue: Matched data: 0 bytes Apr 8 00:53:50 warble1 dracut-initqueue: File list size: 39 Apr 8 00:53:50 warble1 dracut-initqueue: File list generation time: 0.001 seconds Apr 8 00:53:50 warble1 dracut-initqueue: File list transfer time: 0.000 seconds Apr 8 00:53:50 warble1 dracut-initqueue: Total bytes sent: 75 Apr 8 00:53:50 warble1 dracut-initqueue: Total bytes received: 1329 Apr 8 00:53:50 warble1 dracut-initqueue: sent 75 bytes received 1329 bytes 2808.00 bytes/sec Apr 8 00:53:50 warble1 dracut-initqueue: total size is 1172 speedup is 0.83 Apr 8 00:53:59 warble1 dracut-initqueue: Number of files: 45008 Apr 8 00:53:59 warble1 dracut-initqueue: Number of files transferred: 35605 Apr 8 00:53:59 warble1 dracut-initqueue: Total file size: 1075962237 bytes Apr 8 00:53:59 warble1 dracut-initqueue: Total transferred file size: 1045524501 bytes Apr 8 00:53:59 warble1 dracut-initqueue: Literal data: 1045523329 bytes Apr 8 00:53:59 warble1 dracut-initqueue: Matched data: 1172 bytes Apr 8 00:53:59 warble1 dracut-initqueue: File list size: 924418 Apr 8 00:53:59 warble1 dracut-initqueue: File list generation time: 0.001 seconds Apr 8 00:53:59 warble1 dracut-initqueue: File list transfer time: 0.000 seconds Apr 8 00:53:59 warble1 dracut-initqueue: Total bytes sent: 836690 Apr 8 00:53:59 warble1 dracut-initqueue: Total bytes received: 1048256655 Apr 8 00:53:59 warble1 dracut-initqueue: sent 836690 bytes received 1048256655 bytes 110430878.42 bytes/sec Apr 8 00:53:59 warble1 dracut-initqueue: total size is 1075962237 speedup is 1.03 Apr 8 00:53:59 warble1 dracut-initqueue: Number of files: 3022 Apr 8 00:53:59 warble1 dracut-initqueue: Number of files transferred: 2461 Apr 8 00:53:59 warble1 dracut-initqueue: Total file size: 60768950 bytes Apr 8 00:53:59 warble1 dracut-initqueue: Total transferred file size: 60768902 bytes Apr 8 00:53:59 warble1 dracut-initqueue: Literal data: 60768902 bytes Apr 8 00:53:59 warble1 dracut-initqueue: Matched data: 0 bytes Apr 8 00:53:59 warble1 dracut-initqueue: File list size: 62854 Apr 8 00:53:59 warble1 dracut-initqueue: File list generation time: 0.001 seconds Apr 8 00:53:59 warble1 dracut-initqueue: File list transfer time: 0.000 seconds Apr 8 00:53:59 warble1 dracut-initqueue: Total bytes sent: 49056 Apr 8 00:53:59 warble1 dracut-initqueue: Total bytes received: 60946523 Apr 8 00:53:59 warble1 dracut-initqueue: sent 49056 bytes received 60946523 bytes 121991158.00 bytes/sec Apr 8 00:53:59 warble1 dracut-initqueue: total size is 60768950 speedup is 1.00 Apr 8 00:54:00 warble1 systemd: Started dracut initqueue hook. Apr 8 00:54:00 warble1 systemd: Reached target Remote File Systems (Pre). Apr 8 00:54:00 warble1 systemd: Starting Remote File Systems (Pre). Apr 8 00:54:00 warble1 systemd: Reached target Remote File Systems. Apr 8 00:54:00 warble1 systemd: Starting Remote File Systems. Apr 8 00:54:00 warble1 systemd: Reached target Initrd Root File System. Apr 8 00:54:00 warble1 systemd: Starting Initrd Root File System. Apr 8 00:54:00 warble1 systemd: Starting Reload Configuration from the Real Root... Apr 8 00:54:00 warble1 systemd: Reloading. Apr 8 00:54:00 warble1 systemd: Started Reload Configuration from the Real Root. Apr 8 00:54:00 warble1 systemd: Reached target Initrd File Systems. Apr 8 00:54:00 warble1 systemd: Starting Initrd File Systems. Apr 8 00:54:00 warble1 systemd: Reached target Initrd Default Target. Apr 8 00:54:00 warble1 systemd: Starting Initrd Default Target. Apr 8 00:54:00 warble1 systemd: Starting dracut pre-pivot and cleanup hook... Apr 8 00:54:00 warble1 systemd: Started dracut pre-pivot and cleanup hook. Apr 8 00:54:00 warble1 systemd: Starting Cleaning Up and Shutting Down Daemons... Apr 8 00:54:00 warble1 systemd: Stopped target Timers. Apr 8 00:54:00 warble1 systemd: Stopping Timers. Apr 8 00:54:00 warble1 systemd: Stopped Cleaning Up and Shutting Down Daemons. Apr 8 00:54:00 warble1 systemd: Stopped dracut pre-pivot and cleanup hook. Apr 8 00:54:00 warble1 systemd: Stopping dracut pre-pivot and cleanup hook... Apr 8 00:54:00 warble1 systemd: Stopped target Remote File Systems. Apr 8 00:54:00 warble1 systemd: Stopping Remote File Systems. Apr 8 00:54:00 warble1 systemd: Stopped target Remote File Systems (Pre). Apr 8 00:54:00 warble1 systemd: Stopping Remote File Systems (Pre). Apr 8 00:54:00 warble1 systemd: Stopped dracut initqueue hook. Apr 8 00:54:00 warble1 systemd: Stopping dracut initqueue hook... Apr 8 00:54:00 warble1 systemd: Stopped target Initrd Default Target. Apr 8 00:54:00 warble1 systemd: Stopping Initrd Default Target. Apr 8 00:54:00 warble1 systemd: Stopped target Basic System. Apr 8 00:54:00 warble1 systemd: Stopping Basic System. Apr 8 00:54:00 warble1 systemd: Stopped target System Initialization. Apr 8 00:54:00 warble1 systemd: Stopping System Initialization. Apr 8 00:54:00 warble1 systemd: Stopped Apply Kernel Variables. Apr 8 00:54:00 warble1 systemd: Stopping Apply Kernel Variables... Apr 8 00:54:00 warble1 systemd: Stopped Load Kernel Modules. Apr 8 00:54:00 warble1 systemd: Stopping Load Kernel Modules... Apr 8 00:54:00 warble1 systemd: Stopped udev Coldplug all Devices. Apr 8 00:54:00 warble1 systemd: Stopping udev Coldplug all Devices... Apr 8 00:54:00 warble1 systemd: Stopped dracut pre-trigger hook. Apr 8 00:54:00 warble1 systemd: Stopping dracut pre-trigger hook... Apr 8 00:54:00 warble1 systemd: Stopped target Swap. Apr 8 00:54:00 warble1 systemd: Stopping Swap. Apr 8 00:54:00 warble1 systemd: Stopping udev Kernel Device Manager... Apr 8 00:54:00 warble1 systemd: Stopped target Local File Systems. Apr 8 00:54:00 warble1 systemd: Stopping Local File Systems. Apr 8 00:54:00 warble1 systemd: Stopped target Paths. Apr 8 00:54:00 warble1 systemd: Stopping Paths. Apr 8 00:54:00 warble1 systemd: Stopped Dispatch Password Requests to Console Directory Watch. Apr 8 00:54:00 warble1 systemd: Stopping Dispatch Password Requests to Console Directory Watch. Apr 8 00:54:00 warble1 systemd: Stopped target Sockets. Apr 8 00:54:00 warble1 systemd: Stopping Sockets. Apr 8 00:54:00 warble1 systemd: Stopped target Slices. Apr 8 00:54:00 warble1 systemd: Stopping Slices. Apr 8 00:54:00 warble1 systemd: Stopped udev Kernel Device Manager. Apr 8 00:54:00 warble1 systemd: Stopped dracut pre-udev hook. Apr 8 00:54:00 warble1 systemd: Stopping dracut pre-udev hook... Apr 8 00:54:00 warble1 systemd: Stopped dracut cmdline hook. Apr 8 00:54:00 warble1 systemd: Stopping dracut cmdline hook... Apr 8 00:54:00 warble1 systemd: Stopped Create Static Device Nodes in /dev. Apr 8 00:54:00 warble1 systemd: Stopping Create Static Device Nodes in /dev... Apr 8 00:54:00 warble1 systemd: Stopped Create list of required static device nodes for the current kernel. Apr 8 00:54:00 warble1 systemd: Stopping Create list of required static device nodes for the current kernel... Apr 8 00:54:00 warble1 systemd: Closed udev Kernel Socket. Apr 8 00:54:00 warble1 systemd: Stopping udev Kernel Socket. Apr 8 00:54:00 warble1 systemd: Closed udev Control Socket. Apr 8 00:54:00 warble1 systemd: Stopping udev Control Socket. Apr 8 00:54:00 warble1 systemd: Starting Cleanup udevd DB... Apr 8 00:54:00 warble1 systemd: Started Cleanup udevd DB. Apr 8 00:54:00 warble1 systemd: Reached target Switch Root. Apr 8 00:54:00 warble1 systemd: Starting Switch Root. Apr 8 00:54:00 warble1 systemd: Starting Switch Root... Apr 8 00:54:00 warble1 systemd: Switching root. Apr 8 00:54:00 warble1 journal: Journal stopped Apr 8 00:54:00 warble1 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 8 00:54:00 warble1 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 8 00:54:00 warble1 systemd-journald[164]: Received SIGTERM from PID 1 (systemd). Apr 8 00:54:00 warble1 kernel: ip_tables: (C) 2000-2006 Netfilter Core Team Apr 8 00:54:00 warble1 systemd[1]: Inserted module 'ip_tables' Apr 8 00:54:00 warble1 journal: Journal started Apr 8 00:54:00 warble1 systemd: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) Apr 8 00:54:00 warble1 systemd: Detected architecture x86-64. Apr 8 00:54:00 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:54:00 warble1 systemd: Cannot add dependency job for unit gssproxy.service, ignoring: Unit is masked. Apr 8 00:54:00 warble1 systemd: Cannot add dependency job for unit cpupower.service, ignoring: Unit is masked. Apr 8 00:54:00 warble1 systemd: Started Setup Virtual Console. Apr 8 00:54:00 warble1 systemd: Started Load Kernel Modules. Apr 8 00:54:00 warble1 systemd: Started Availability of block devices. Apr 8 00:54:00 warble1 systemd: Started Create list of required static device nodes for the current kernel. Apr 8 00:54:00 warble1 systemd: Started Remount Root and Kernel File Systems. Apr 8 00:54:00 warble1 systemd: Got automount request for /proc/sys/fs/binfmt_misc, triggered by 903 (systemd-binfmt) Apr 8 00:54:00 warble1 systemd: Mounting Arbitrary Executable File Formats File System... Apr 8 00:54:00 warble1 systemd: Starting Load/Save Random Seed... Apr 8 00:54:00 warble1 systemd: Starting Configure read-only root support... Apr 8 00:54:00 warble1 systemd: Starting Rebuild Hardware Database... Apr 8 00:54:00 warble1 systemd: Starting Create Static Device Nodes in /dev... Apr 8 00:54:00 warble1 systemd: Starting Apply Kernel Variables... Apr 8 00:54:00 warble1 systemd: Starting Flush Journal to Persistent Storage... Apr 8 00:54:00 warble1 systemd: Mounted Arbitrary Executable File Formats File System. Apr 8 00:54:00 warble1 systemd: Started Load/Save Random Seed. Apr 8 00:54:00 warble1 systemd: Started Set Up Additional Binary Formats. Apr 8 00:54:00 warble1 systemd: Started Configure read-only root support. Apr 8 00:54:00 warble1 systemd: Started Create Static Device Nodes in /dev. Apr 8 00:54:00 warble1 systemd: Started Apply Kernel Variables. Apr 8 00:54:00 warble1 systemd: Reached target Local File Systems (Pre). Apr 8 00:54:00 warble1 systemd: Starting Local File Systems (Pre). Apr 8 00:54:00 warble1 systemd: Starting udev Kernel Device Manager... Apr 8 00:54:00 warble1 systemd-udevd: starting version 219 Apr 8 00:54:00 warble1 systemd: Started udev Kernel Device Manager. Apr 8 00:54:00 warble1 journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 377.1G available → current limit 4.0G). Apr 8 00:54:00 warble1 systemd: Started Flush Journal to Persistent Storage. Apr 8 00:54:01 warble1 systemd: Started Rebuild Hardware Database. Apr 8 00:54:01 warble1 systemd: Starting udev Coldplug all Devices... Apr 8 00:54:01 warble1 systemd: Starting Initialize the iWARP/InfiniBand/RDMA stack in the kernel... Apr 8 00:54:01 warble1 kernel: ACPI Error: No handler for Region [SYSI] (ffff88012e847d38) [IPMI] (20130517/evregion-162) Apr 8 00:54:01 warble1 kernel: ACPI Error: Region IPMI (ID=7) has no handler (20130517/exfldio-305) Apr 8 00:54:01 warble1 kernel: ACPI Error: Method parse/execution failed [\_SB_.PMI0._GHL] (Node ffff88012e806550), AE_NOT_EXIST (20130517/psparse-536) Apr 8 00:54:01 warble1 kernel: ACPI Error: Method parse/execution failed [\_SB_.PMI0._PMC] (Node ffff88012e8064b0), AE_NOT_EXIST (20130517/psparse-536) Apr 8 00:54:01 warble1 kernel: ACPI Exception: AE_NOT_EXIST, Evaluating _PMC (20130517/power_meter-753) Apr 8 00:54:01 warble1 kernel: ipmi message handler version 39.2 Apr 8 00:54:01 warble1 kernel: ipmi device interface Apr 8 00:54:01 warble1 kernel: ipmi_si IPI0001:00: ipmi_si: probing via ACPI Apr 8 00:54:01 warble1 kernel: ipmi_si IPI0001:00: [io 0x0ca8] regsize 1 spacing 4 irq 10 Apr 8 00:54:01 warble1 kernel: ipmi_si: Adding ACPI-specified kcs state machine Apr 8 00:54:01 warble1 kernel: IPMI System Interface driver. Apr 8 00:54:01 warble1 kernel: ipmi_si: probing via SMBIOS Apr 8 00:54:01 warble1 kernel: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10 Apr 8 00:54:01 warble1 kernel: ipmi_si: Adding SMBIOS-specified kcs state machine duplicate interface Apr 8 00:54:01 warble1 kernel: ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca8, slave address 0x0, irq 10 Apr 8 00:54:01 warble1 systemd: Started udev Coldplug all Devices. Apr 8 00:54:01 warble1 kernel: lpc_ich 0000:00:1f.0: I/O space for ACPI uninitialized Apr 8 00:54:01 warble1 kernel: lpc_ich 0000:00:1f.0: No MFD cells added Apr 8 00:54:01 warble1 systemd: Found device /dev/ttyS0. Apr 8 00:54:01 warble1 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Apr 8 00:54:01 warble1 kernel: ipmi_si IPI0001:00: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed. Apr 8 00:54:01 warble1 kernel: ipmi_si IPI0001:00: Using irq 10 Apr 8 00:54:01 warble1 kernel: ipmi_si IPI0001:00: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20) Apr 8 00:54:01 warble1 kernel: ipmi_si IPI0001:00: IPMI kcs interface initialized Apr 8 00:54:01 warble1 kernel: sd 0:2:0:0: Attached scsi generic sg0 type 0 Apr 8 00:54:01 warble1 kernel: i801_smbus 0000:00:1f.4: SMBus using PCI interrupt Apr 8 00:54:01 warble1 systemd: Starting Device-Mapper Multipath Device Controller... Apr 8 00:54:01 warble1 kernel: scsi 1:0:0:0: Attached scsi generic sg1 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:10: Attached scsi generic sg2 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:11: Attached scsi generic sg3 type 0 Apr 8 00:54:01 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: No such file or directory Apr 8 00:54:01 warble1 kernel: sd 1:0:0:20: Attached scsi generic sg4 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:21: Attached scsi generic sg5 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:22: Attached scsi generic sg6 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:23: Attached scsi generic sg7 type 0 Apr 8 00:54:01 warble1 kernel: input: PC Speaker as /devices/platform/pcspkr/input/input1 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:24: Attached scsi generic sg8 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:25: Attached scsi generic sg9 type 0 Apr 8 00:54:01 warble1 kernel: scsi 1:0:0:31: Attached scsi generic sg10 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:40: Attached scsi generic sg11 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:41: Attached scsi generic sg12 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:51: Attached scsi generic sg13 type 0 Apr 8 00:54:01 warble1 kernel: device-mapper: uevent: version 1.0.3 Apr 8 00:54:01 warble1 kernel: device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com Apr 8 00:54:01 warble1 kernel: sd 1:0:0:52: Attached scsi generic sg14 type 0 Apr 8 00:54:01 warble1 kernel: AES CTR mode by8 optimization enabled Apr 8 00:54:01 warble1 kernel: alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) Apr 8 00:54:01 warble1 kernel: sd 1:0:0:60: Attached scsi generic sg15 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:0:61: Attached scsi generic sg16 type 0 Apr 8 00:54:01 warble1 kernel: scsi 1:0:1:0: Attached scsi generic sg17 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:10: Attached scsi generic sg18 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:11: Attached scsi generic sg19 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:20: Attached scsi generic sg20 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:21: Attached scsi generic sg21 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:22: Attached scsi generic sg22 type 0 Apr 8 00:54:01 warble1 kernel: alg: No test for crc32 (crc32-pclmul) Apr 8 00:54:01 warble1 systemd: Started Initialize the iWARP/InfiniBand/RDMA stack in the kernel. Apr 8 00:54:01 warble1 kernel: sd 1:0:1:23: Attached scsi generic sg23 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:24: Attached scsi generic sg24 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:25: Attached scsi generic sg25 type 0 Apr 8 00:54:01 warble1 kernel: scsi 1:0:1:31: Attached scsi generic sg26 type 0 Apr 8 00:54:01 warble1 kernel: spl: loading out-of-tree module taints kernel. Apr 8 00:54:01 warble1 kernel: sd 1:0:1:40: Attached scsi generic sg27 type 0 Apr 8 00:54:01 warble1 kernel: spl: module verification failed: signature and/or required key missing - tainting kernel Apr 8 00:54:01 warble1 kernel: sd 1:0:1:41: Attached scsi generic sg28 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:51: Attached scsi generic sg29 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:52: Attached scsi generic sg30 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:60: Attached scsi generic sg31 type 0 Apr 8 00:54:01 warble1 kernel: sd 1:0:1:61: Attached scsi generic sg32 type 0 Apr 8 00:54:01 warble1 kernel: sr 15:0:0:0: Attached scsi generic sg33 type 5 Apr 8 00:54:01 warble1 kernel: intel_rapl: Found RAPL domain package Apr 8 00:54:01 warble1 kernel: intel_rapl: Found RAPL domain dram Apr 8 00:54:01 warble1 kernel: intel_rapl: DRAM domain energy unit 15300pj Apr 8 00:54:01 warble1 kernel: intel_rapl: Found RAPL domain package Apr 8 00:54:01 warble1 kernel: SPL: Loaded module v0.7.6-1 Apr 8 00:54:01 warble1 systemd: Started Device-Mapper Multipath Device Controller. Apr 8 00:54:01 warble1 kernel: znvpair: module license 'CDDL' taints kernel. Apr 8 00:54:01 warble1 kernel: Disabling lock debugging due to kernel taint Apr 8 00:54:01 warble1 kernel: intel_rapl: Found RAPL domain dram Apr 8 00:54:01 warble1 kernel: intel_rapl: DRAM domain energy unit 15300pj Apr 8 00:54:01 warble1 kernel: [drm] Initialized Apr 8 00:54:01 warble1 kernel: device-mapper: multipath round-robin: version 1.2.0 loaded Apr 8 00:54:01 warble1 systemd: Created slice system-lvm2\x2dpvscan.slice. Apr 8 00:54:01 warble1 systemd: Starting system-lvm2\x2dpvscan.slice. Apr 8 00:54:01 warble1 systemd: Starting LVM2 PV scan on device 8:2... Apr 8 00:54:01 warble1 multipathd: vol-mgt-a: load table [0 819200 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:240 1 round-robin 0 1 1 8:16 1] Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 multipathd: vol-mdt0-a: load table [0 1319780352 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:16 1 round-robin 0 1 1 8:48 1] Apr 8 00:54:01 warble1 multipathd: vol-mdt0-b: load table [0 1319780352 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:64 1] Apr 8 00:54:01 warble1 multipathd: vol-mdt1-a: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:80 1] Apr 8 00:54:01 warble1 multipathd: vol-mdt1-b: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:96 1] Apr 8 00:54:01 warble1 multipathd: vol-mdt2-b: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:128 1] Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 multipathd: vol-home-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:144 1] Apr 8 00:54:01 warble1 multipathd: vol-home-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:160 1] Apr 8 00:54:01 warble1 multipathd: vol-apps-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:208 1] Apr 8 00:54:01 warble1 multipathd: vol-apps-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:224 1] Apr 8 00:54:01 warble1 multipathd: vol-mgt-b: load table [0 819200 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 65:0 1] Apr 8 00:54:01 warble1 multipathd: vol-mgt-a: event checker started Apr 8 00:54:01 warble1 multipathd: vol-mdt0-a: event checker started Apr 8 00:54:01 warble1 multipathd: vol-mdt0-b: event checker started Apr 8 00:54:01 warble1 multipathd: vol-mdt1-a: event checker started Apr 8 00:54:01 warble1 multipathd: vol-mdt1-b: event checker started Apr 8 00:54:01 warble1 multipathd: vol-mdt2-b: event checker started Apr 8 00:54:01 warble1 multipathd: vol-home-a: event checker started Apr 8 00:54:01 warble1 multipathd: vol-home-b: event checker started Apr 8 00:54:01 warble1 multipathd: vol-apps-a: event checker started Apr 8 00:54:01 warble1 multipathd: vol-apps-b: event checker started Apr 8 00:54:01 warble1 multipathd: vol-mgt-b: event checker started Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 systemd: Started LVM2 metadata daemon. Apr 8 00:54:01 warble1 systemd: Starting LVM2 metadata daemon... Apr 8 00:54:01 warble1 multipathd: path checkers start up Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: [TTM] Zone kernel: Available graphics memory: 395507840 kiB Apr 8 00:54:01 warble1 kernel: [TTM] Zone dma32: Available graphics memory: 2097152 kiB Apr 8 00:54:01 warble1 kernel: [TTM] Initializing pool allocator Apr 8 00:54:01 warble1 kernel: [TTM] Initializing DMA pool allocator Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: fbcon: mgadrmfb (fb0) is primary device Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_del_mc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_alloc (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_free (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_handle_error (err 0) Apr 8 00:54:01 warble1 kernel: skx_edac: Unknown symbol edac_mc_add_mc_with_groups (err 0) Apr 8 00:54:02 warble1 kernel: dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2) Apr 8 00:54:02 warble1 kernel: iTCO_vendor_support: vendor-support=0 Apr 8 00:54:02 warble1 kernel: iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 Apr 8 00:54:02 warble1 kernel: iTCO_wdt: Found a Intel PCH TCO device (Version=4, TCOBASE=0x0400) Apr 8 00:54:02 warble1 kernel: iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) Apr 8 00:54:02 warble1 kernel: Console: switching to colour frame buffer device 128x48 Apr 8 00:54:02 warble1 kernel: mgag200 0000:03:00.0: fb0: mgadrmfb frame buffer device Apr 8 00:54:02 warble1 multipathd: sdx: add path (uevent) Apr 8 00:54:02 warble1 multipathd: sdx: spurious uevent, path already in pathvec Apr 8 00:54:02 warble1 multipathd: sdx : delaying path addition until vol-home-a is fully initialized Apr 8 00:54:02 warble1 multipathd: sdab: add path (uevent) Apr 8 00:54:02 warble1 multipathd: sdab: spurious uevent, path already in pathvec Apr 8 00:54:02 warble1 multipathd: sdab : delaying path addition until vol-apps-a is fully initialized Apr 8 00:54:02 warble1 multipathd: sdy: add path (uevent) Apr 8 00:54:02 warble1 multipathd: sdy: spurious uevent, path already in pathvec Apr 8 00:54:02 warble1 multipathd: sdy : delaying path addition until vol-home-b is fully initialized Apr 8 00:54:02 warble1 multipathd: sdac: add path (uevent) Apr 8 00:54:02 warble1 multipathd: sdac: spurious uevent, path already in pathvec Apr 8 00:54:02 warble1 multipathd: sdac : delaying path addition until vol-apps-b is fully initialized Apr 8 00:54:02 warble1 systemd: Found device /dev/centos/swap. Apr 8 00:54:02 warble1 systemd: Activating swap /dev/centos/swap... Apr 8 00:54:02 warble1 kernel: Adding 4194300k swap on /dev/mapper/centos-swap. Priority:-1 extents:1 across:4194300k FS Apr 8 00:54:02 warble1 kernel: [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0 Apr 8 00:54:02 warble1 systemd: Activated swap /dev/centos/swap. Apr 8 00:54:02 warble1 systemd: Reached target Swap. Apr 8 00:54:02 warble1 systemd: Starting Swap. Apr 8 00:54:03 warble1 lvm: 3 logical volume(s) in volume group "centos" now active Apr 8 00:54:03 warble1 systemd: Found device /dev/centos/root. Apr 8 00:54:03 warble1 systemd: Started LVM2 PV scan on device 8:2. Apr 8 00:54:03 warble1 systemd: Mounting /mnt/root... Apr 8 00:54:03 warble1 kernel: SGI XFS with ACLs, security attributes, no debug enabled Apr 8 00:54:03 warble1 kernel: XFS (dm-13): Mounting V5 Filesystem Apr 8 00:54:03 warble1 kernel: XFS (dm-13): Ending clean mount Apr 8 00:54:03 warble1 systemd: Mounted /mnt/root. Apr 8 00:54:03 warble1 systemd: Reached target Local File Systems. Apr 8 00:54:03 warble1 systemd: Starting Local File Systems. Apr 8 00:54:03 warble1 systemd: Starting Import network configuration from initramfs... Apr 8 00:54:03 warble1 systemd: Starting Preprocess NFS configuration... Apr 8 00:54:03 warble1 systemd: Starting Rebuild Journal Catalog... Apr 8 00:54:03 warble1 systemd: Starting Mark the need to relabel after reboot... Apr 8 00:54:03 warble1 systemd: Started Import network configuration from initramfs. Apr 8 00:54:03 warble1 systemd: Started Preprocess NFS configuration. Apr 8 00:54:03 warble1 systemd: Started Rebuild Journal Catalog. Apr 8 00:54:03 warble1 systemd: Started Mark the need to relabel after reboot. Apr 8 00:54:03 warble1 systemd: Starting Update is Completed... Apr 8 00:54:03 warble1 systemd: Starting Notify NFS peers of a restart... Apr 8 00:54:03 warble1 sm-notify[8888]: Version 1.3.0 starting Apr 8 00:54:03 warble1 systemd: Starting Create Volatile Files and Directories... Apr 8 00:54:03 warble1 systemd: Started Update is Completed. Apr 8 00:54:03 warble1 systemd: Started Notify NFS peers of a restart. Apr 8 00:54:03 warble1 systemd: Started Create Volatile Files and Directories. Apr 8 00:54:03 warble1 systemd: Mounting RPC Pipe File System... Apr 8 00:54:03 warble1 systemd: Starting Update UTMP about System Boot/Shutdown... Apr 8 00:54:03 warble1 systemd: Started Update UTMP about System Boot/Shutdown. Apr 8 00:54:03 warble1 kernel: RPC: Registered named UNIX socket transport module. Apr 8 00:54:03 warble1 kernel: RPC: Registered udp transport module. Apr 8 00:54:03 warble1 kernel: RPC: Registered tcp transport module. Apr 8 00:54:03 warble1 kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. Apr 8 00:54:03 warble1 systemd: Reached target System Initialization. Apr 8 00:54:03 warble1 systemd: Starting System Initialization. Apr 8 00:54:03 warble1 systemd: Listening on RPCbind Server Activation Socket. Apr 8 00:54:03 warble1 systemd: Starting RPCbind Server Activation Socket. Apr 8 00:54:03 warble1 systemd: Started Daily Cleanup of Temporary Directories. Apr 8 00:54:03 warble1 systemd: Starting Daily Cleanup of Temporary Directories. Apr 8 00:54:03 warble1 systemd: Reached target Timers. Apr 8 00:54:03 warble1 systemd: Starting Timers. Apr 8 00:54:03 warble1 systemd: Listening on D-Bus System Message Bus Socket. Apr 8 00:54:03 warble1 systemd: Starting D-Bus System Message Bus Socket. Apr 8 00:54:03 warble1 systemd: Reached target Sockets. Apr 8 00:54:03 warble1 systemd: Starting Sockets. Apr 8 00:54:03 warble1 systemd: Started Flexible branding. Apr 8 00:54:03 warble1 systemd: Starting Flexible branding. Apr 8 00:54:03 warble1 systemd: Reached target Paths. Apr 8 00:54:03 warble1 systemd: Starting Paths. Apr 8 00:54:03 warble1 systemd: Reached target Basic System. Apr 8 00:54:03 warble1 systemd: Starting Basic System. Apr 8 00:54:03 warble1 systemd: Starting Dump dmesg to /var/log/dmesg... Apr 8 00:54:03 warble1 systemd: Starting System Logging Service... Apr 8 00:54:03 warble1 rsyslogd: [origin software="rsyslogd" swVersion="8.24.0" x-pid="8904" x-info="http://www.rsyslog.com"] start Apr 8 00:54:03 warble1 systemd: Starting Machine Check Exception Logging Daemon... Apr 8 00:54:03 warble1 systemd: Starting Resets System Activity Logs... Apr 8 00:54:03 warble1 systemd: Started D-Bus System Message Bus. Apr 8 00:54:03 warble1 systemd: Starting D-Bus System Message Bus... Apr 8 00:54:03 warble1 systemd: Starting SYSV: pslogger process logger... Apr 8 00:54:03 warble1 pslogger: Starting pslogger: Apr 8 00:54:03 warble1 systemd: Starting Postfix Mail Transport Agent... Apr 8 00:54:03 warble1 systemd: Starting Initialize the OPA layer... Apr 8 00:54:03 warble1 zed: ZFS Event Daemon 0.7.6-1 (PID 8932) Apr 8 00:54:03 warble1 systemd: Started ZFS Event Daemon (zed). Apr 8 00:54:03 warble1 systemd: Starting ZFS Event Daemon (zed)... Apr 8 00:54:03 warble1 systemd: Starting System Security Services Daemon... Apr 8 00:54:03 warble1 sssd: Starting up Apr 8 00:54:03 warble1 systemd: Started Runs late. Kinda like rc.local. Apr 8 00:54:03 warble1 systemd: Starting Runs late. Kinda like rc.local... Apr 8 00:54:03 warble1 sssd[be[default]]: Starting up Apr 8 00:54:03 warble1 systemd: Started RDMA Node Description Daemon. Apr 8 00:54:03 warble1 systemd: Starting RDMA Node Description Daemon... Apr 8 00:54:03 warble1 sssd[nss]: Starting up Apr 8 00:54:03 warble1 sssd[pam]: Starting up Apr 8 00:54:03 warble1 systemd: Starting OpenSSH server daemon... Apr 8 00:54:03 warble1 opa-init-kernel: Renicing ib_mad processes...done. Apr 8 00:54:03 warble1 systemd: Starting Builds and install new kernel modules through DKMS... Apr 8 00:54:03 warble1 systemd: Starting Temporary: Start ifalias interface for oobview even after parent is brought up in the initramfs... Apr 8 00:54:03 warble1 kinda_rc_local: rmmod: ERROR: Module lnet_selftest is not currently loaded Apr 8 00:54:03 warble1 kinda_rc_local: rmmod: ERROR: Module lnet_selftest is not currently loaded Apr 8 00:54:03 warble1 systemd: Starting Set time via NTP... Apr 8 00:54:03 warble1 systemd: Started irqbalance daemon. Apr 8 00:54:03 warble1 systemd: Starting irqbalance daemon... Apr 8 00:54:03 warble1 systemd: Mounted RPC Pipe File System. Apr 8 00:54:03 warble1 systemd: Started System Logging Service. Apr 8 00:54:03 warble1 systemd: Started OpenSSH server daemon. Apr 8 00:54:03 warble1 systemd: Started System Security Services Daemon. Apr 8 00:54:03 warble1 systemd: Started Dump dmesg to /var/log/dmesg. Apr 8 00:54:03 warble1 systemd: Started Resets System Activity Logs. Apr 8 00:54:03 warble1 systemd: Started SYSV: pslogger process logger. Apr 8 00:54:03 warble1 systemd: Started Initialize the OPA layer. Apr 8 00:54:03 warble1 systemd: Reached target User and Group Name Lookups. Apr 8 00:54:03 warble1 systemd: Starting User and Group Name Lookups. Apr 8 00:54:03 warble1 systemd: Starting Login Service... Apr 8 00:54:03 warble1 systemd: Reached target NFS client services. Apr 8 00:54:03 warble1 systemd: Starting NFS client services. Apr 8 00:54:03 warble1 systemd: Reached target Remote File Systems (Pre). Apr 8 00:54:03 warble1 systemd: Starting Remote File Systems (Pre). Apr 8 00:54:03 warble1 systemd: Reached target Remote File Systems. Apr 8 00:54:03 warble1 systemd: Starting Remote File Systems. Apr 8 00:54:03 warble1 systemd: Starting Permit User Sessions... Apr 8 00:54:03 warble1 systemd: Started Permit User Sessions. Apr 8 00:54:03 warble1 systemd-logind: New seat seat0. Apr 8 00:54:03 warble1 systemd-logind: Watching system buttons on /dev/input/event0 (Power Button) Apr 8 00:54:03 warble1 systemd: Started Serial Getty on ttyS0. Apr 8 00:54:03 warble1 systemd: Starting Serial Getty on ttyS0... Apr 8 00:54:03 warble1 systemd: Started Getty on tty1. Apr 8 00:54:03 warble1 systemd: Starting Getty on tty1... Apr 8 00:54:03 warble1 systemd: Reached target Login Prompts. Apr 8 00:54:03 warble1 systemd: Starting Login Prompts. Apr 8 00:54:03 warble1 systemd: Started Builds and install new kernel modules through DKMS. Apr 8 00:54:03 warble1 systemd: Started Login Service. Apr 8 00:54:03 warble1 kernel: bnx2x 0000:19:00.2 em3: using MSI-X IRQs: sp 127 fp[0] 129 ... fp[7] 136 Apr 8 00:54:03 warble1 kernel: bnx2x 0000:19:00.2 em3: NIC Link is Up, 1000 Mbps full duplex, Flow control: none Apr 8 00:54:03 warble1 kinda_rc_local: Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8). Apr 8 00:54:03 warble1 kinda_rc_local: Infiniband hardware address can be incorrect! Please read BUGS section in ifconfig(8). Apr 8 00:54:20 transom1 fm0_sm[240274]: transom1; MSG:NOTICE|SM:transom1:port 1|COND:#3 Appearance in fabric|NODE:warble1 hfi1_0:port 1:0x001175010171de62|LINKEDTO:opa-l-5:port 3:0x00117501020c4c04|DETAIL:Node type: hfi Apr 8 00:54:04 warble1 systemd: Started Machine Check Exception Logging Daemon. Apr 8 00:54:04 warble1 zed: Processing events since eid=0 Apr 8 00:54:04 warble1 kernel: ZFS: Loaded module v0.7.6-1, ZFS pool version 5000, ZFS filesystem version 5 Apr 8 00:54:04 warble1 multipathd: sdl: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdl: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: vol-images-system-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:176 1] Apr 8 00:54:04 warble1 multipathd: vol-images-system-a: event checker started Apr 8 00:54:04 warble1 multipathd: sdl [8:176]: path added to devmap vol-images-system-a Apr 8 00:54:04 warble1 multipathd: sdo: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdo: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdk: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdk: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdt: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdt: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdt : delaying path addition until vol-mdt1-a is fully initialized Apr 8 00:54:04 warble1 multipathd: sdn: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdn: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdi: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdi: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdm: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdm: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: vol-images-system-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:192 1] Apr 8 00:54:04 warble1 multipathd: vol-images-system-b: event checker started Apr 8 00:54:04 warble1 multipathd: sdm [8:192]: path added to devmap vol-images-system-b Apr 8 00:54:04 warble1 multipathd: sds: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sds: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sds : delaying path addition until vol-mdt0-b is fully initialized Apr 8 00:54:04 warble1 multipathd: sdc: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdc: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdc : delaying path addition until vol-mgt-b is fully initialized Apr 8 00:54:04 warble1 multipathd: sdv: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdv: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: vol-mdt2-a: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 65:80 1] Apr 8 00:54:04 warble1 multipathd: vol-mdt2-a: event checker started Apr 8 00:54:04 warble1 multipathd: sdv [65:80]: path added to devmap vol-mdt2-a Apr 8 00:54:04 warble1 multipathd: sdb: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdb: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdaa: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdaa: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdaa : delaying path addition until vol-images-system-b is fully initialized Apr 8 00:54:04 warble1 multipathd: sdd: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdd: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdz: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdz: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdz : delaying path addition until vol-images-system-a is fully initialized Apr 8 00:54:04 warble1 multipathd: sdf: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdf: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdg: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdg: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdq: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdq: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdu: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdu: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdu : delaying path addition until vol-mdt1-b is fully initialized Apr 8 00:54:04 warble1 multipathd: sdj: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdj: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdw: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdw: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdw : delaying path addition until vol-mdt2-b is fully initialized Apr 8 00:54:04 warble1 multipathd: sdp: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdp: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdr: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdr: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sde: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sde: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdh: add path (uevent) Apr 8 00:54:04 warble1 multipathd: sdh: spurious uevent, path already in pathvec Apr 8 00:54:04 warble1 multipathd: sdh : delaying path addition until vol-mdt2-a is fully initialized Apr 8 00:54:04 warble1 multipathd: vol-mdt1-b: performing delayed actions Apr 8 00:54:04 warble1 multipathd: vol-mdt1-b: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:96 1 round-robin 0 1 1 65:64 1] Apr 8 00:54:04 warble1 multipathd: vol-home-b: performing delayed actions Apr 8 00:54:04 warble1 multipathd: vol-home-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:160 1 round-robin 0 1 1 65:128 1] Apr 8 00:54:04 warble1 multipathd: vol-apps-a: performing delayed actions Apr 8 00:54:04 warble1 multipathd: vol-apps-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:176 1 round-robin 0 1 1 8:208 1] Apr 8 00:54:04 warble1 multipathd: vol-home-a: performing delayed actions Apr 8 00:54:04 warble1 multipathd: vol-home-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:112 1 round-robin 0 1 1 8:144 1] Apr 8 00:54:04 warble1 multipathd: vol-mgt-b: performing delayed actions Apr 8 00:54:04 warble1 multipathd: vol-mgt-b: load table [0 819200 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:32 1 round-robin 0 1 1 65:0 1] Apr 8 00:54:04 warble1 multipathd: vol-mdt2-b: performing delayed actions Apr 8 00:54:04 warble1 multipathd: vol-mdt2-b: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:128 1 round-robin 0 1 1 65:96 1] Apr 8 00:54:04 warble1 multipathd: vol-mdt0-b: performing delayed actions Apr 8 00:54:04 warble1 multipathd: vol-mdt0-b: load table [0 1319780352 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:64 1 round-robin 0 1 1 65:32 1] Apr 8 00:54:04 warble1 multipathd: vol-apps-b: performing delayed actions Apr 8 00:54:04 warble1 multipathd: vol-apps-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:224 1 round-robin 0 1 1 65:192 1] Apr 8 00:54:04 warble1 multipathd: vol-mdt1-a: performing delayed actions Apr 8 00:54:04 warble1 multipathd: vol-mdt1-a: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:48 1 round-robin 0 1 1 8:80 1] Apr 8 00:54:05 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current ACTIVE, new OFFLINE Apr 8 00:54:05 warble1 multipathd: vol-mdt2-a: performing delayed actions Apr 8 00:54:05 warble1 multipathd: vol-mdt2-a: load table [0 1320599552 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:80 1 round-robin 0 1 1 8:112 1] Apr 8 00:54:05 warble1 multipathd: vol-images-system-b: performing delayed actions Apr 8 00:54:05 warble1 multipathd: vol-images-system-b: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 8:192 1 round-robin 0 1 1 65:160 1] Apr 8 00:54:05 warble1 multipathd: vol-images-system-a: performing delayed actions Apr 8 00:54:05 warble1 multipathd: vol-images-system-a: load table [0 230686720 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 2 1 round-robin 0 1 1 65:144 1 round-robin 0 1 1 8:176 1] Apr 8 00:54:05 warble1 ntpdate[8996]: sendto(transom1): Network is unreachable Apr 8 00:54:06 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_DOWN (0x1) Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: Eager buffer size 2097152 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: WC Remapped RcvArray: ffffc90063800000 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Implementation: RTL silicon, revision 0x0 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: GUID 1175010171de62 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Resetting CSRs with FLR Apr 8 00:54:07 warble1 ntpdate[8996]: step time server 192.168.44.11 offset -0.101467 sec Apr 8 00:54:07 warble1 systemd: Time has been changed Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe,8000MHz,x16 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: do_pcie_gen3_transition: PCIe already at gen3, skipping Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Board description not found Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: rcv contexts: chip 160, used 21 (kernel 5, user 16) Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: RcvArray groups 390, ctxts extra 2 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: unused send context blocks: 9 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send contexts: chip 160, used 38 (kernel 16, ack 5, user 16, vl15 1) Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Using send context 16(143) for VL15 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA mod_num_sdma: 0 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_engines: 16 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA chip_sdma_mem_size: 401408 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA engines 16 descq_cnt 2048 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SDMA num_sdma: 16 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 22 MSI-X interrupts allocated Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 77, type GENERAL -> cpu: 1 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 79, type SDMA engine 0 -> cpu: 11 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 81, type SDMA engine 1 -> cpu: 13 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 83, type SDMA engine 2 -> cpu: 15 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 85, type SDMA engine 3 -> cpu: 11 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 87, type SDMA engine 4 -> cpu: 13 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 88, type SDMA engine 5 -> cpu: 15 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 89, type SDMA engine 6 -> cpu: 11 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 90, type SDMA engine 7 -> cpu: 13 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 91, type SDMA engine 8 -> cpu: 15 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 92, type SDMA engine 9 -> cpu: 11 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 93, type SDMA engine 10 -> cpu: 13 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 94, type SDMA engine 11 -> cpu: 15 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 95, type SDMA engine 12 -> cpu: 11 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 96, type SDMA engine 13 -> cpu: 13 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 97, type SDMA engine 14 -> cpu: 15 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 98, type SDMA engine 15 -> cpu: 11 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 99, type RCVCTXT ctxt 0 -> cpu: 1 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 100, type RCVCTXT ctxt 1 -> cpu: 3 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 101, type RCVCTXT ctxt 2 -> cpu: 5 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 102, type RCVCTXT ctxt 3 -> cpu: 7 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: IRQ vector: 103, type RCVCTXT ctxt 4 -> cpu: 9 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051 firmware version 1.24 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: SBus Master firmware version 0x10130001 Apr 8 00:54:07 warble1 systemd: Started Set time via NTP. Apr 8 00:54:07 warble1 systemd: Reached target System Time Synchronized. Apr 8 00:54:07 warble1 systemd: Starting System Time Synchronized. Apr 8 00:54:07 warble1 systemd: Starting Network Time Service... Apr 8 00:54:07 warble1 ntpd[14368]: ntpd 4.2.6p5@1.2349-o Wed Apr 12 21:24:06 UTC 2017 (1) Apr 8 00:54:07 warble1 ntpd[14369]: proto: precision = 0.037 usec Apr 8 00:54:07 warble1 ntpd[14369]: 0.0.0.0 c01d 0d kern kernel time sync enabled Apr 8 00:54:07 warble1 ntpd[14369]: Listen and drop on 0 v4wildcard 0.0.0.0 UDP 123 Apr 8 00:54:07 warble1 ntpd[14369]: Listen and drop on 1 v6wildcard :: UDP 123 Apr 8 00:54:07 warble1 ntpd[14369]: Listen normally on 2 lo 127.0.0.1 UDP 123 Apr 8 00:54:07 warble1 ntpd[14369]: Listen normally on 3 bond0 10.8.44.21 UDP 123 Apr 8 00:54:07 warble1 ntpd[14369]: Listen normally on 4 lo ::1 UDP 123 Apr 8 00:54:07 warble1 ntpd[14369]: Listen normally on 5 em3 fe80::1a66:daff:febc:88e1 UDP 123 Apr 8 00:54:07 warble1 ntpd[14369]: Listen normally on 6 bond0 fe80::1a66:daff:febc:88dd UDP 123 Apr 8 00:54:07 warble1 ntpd[14369]: Listening on routing socket on fd #23 for interface updates Apr 8 00:54:07 warble1 ntpd[14369]: 0.0.0.0 c016 06 restart Apr 8 00:54:07 warble1 ntpd[14369]: 0.0.0.0 c012 02 freq_set kernel 0.000 PPM Apr 8 00:54:07 warble1 ntpd[14369]: 0.0.0.0 c011 01 freq_not_set Apr 8 00:54:07 warble1 systemd: Started Network Time Service. Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: PCIe SerDes firmware version 0x4755 Apr 8 00:54:07 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric SerDes firmware version 0x1055 Apr 8 00:54:10 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: wait_for_qsfp_init: No IntN detected, reset complete Apr 8 00:54:10 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current OFFLINE, new POLL Apr 8 00:54:10 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Downloading fabric firmware Apr 8 00:54:10 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Reserving QPNs from 0x800000 to 0x80ffff for non-verbs use Apr 8 00:54:10 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_POLL (0x2), phy 0x20 Apr 8 00:54:10 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_TRAINING (0x4), phy 0x40 Apr 8 00:54:10 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Congestion Control Agent enabled for port 1 Apr 8 00:54:10 warble1 kernel: Couldn't create new SM AH Apr 8 00:54:10 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Registration with rdmavt done. Apr 8 00:54:10 warble1 kernel: bnx2x 0000:19:00.3 em4: using MSI-X IRQs: sp 138 fp[0] 140 ... fp[7] 147 Apr 8 00:54:10 warble1 kernel: bnx2x 0000:19:00.3 em4: NIC Link is Up, 1000 Mbps full duplex, Flow control: ON - receive & transmit Apr 8 00:54:10 warble1 systemd: Started Postfix Mail Transport Agent. Apr 8 00:54:11 warble1 kernel: ib0: P_Key 0x8000 is Invalid Apr 8 00:54:11 warble1 kernel: IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready Apr 8 00:54:11 warble1 kinda_rc_local: RTNETLINK answers: No such process Apr 8 00:54:11 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:54:11 warble1 systemd: Stopping irqbalance daemon... Apr 8 00:54:11 warble1 systemd: Started irqbalance daemon. Apr 8 00:54:11 warble1 systemd: Starting irqbalance daemon... Apr 8 00:54:11 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:54:11 warble1 systemd: Stopping System Security Services Daemon... Apr 8 00:54:11 warble1 sssd[nss]: Shutting down Apr 8 00:54:11 warble1 ntpd[14369]: Listen normally on 7 em3 10.7.2.231 UDP 123 Apr 8 00:54:11 warble1 sssd[be[default]]: Shutting down Apr 8 00:54:11 warble1 ntpd[14369]: Listen normally on 8 ib0 192.168.44.21 UDP 123 Apr 8 00:54:11 warble1 sssd[pam]: Shutting down Apr 8 00:54:11 warble1 systemd: Starting System Security Services Daemon... Apr 8 00:54:11 warble1 sssd: Starting up Apr 8 00:54:11 warble1 sssd[be[default]]: Starting up Apr 8 00:54:11 warble1 sssd[pam]: Starting up Apr 8 00:54:11 warble1 sssd[nss]: Starting up Apr 8 00:54:11 warble1 systemd: Started System Security Services Daemon. Apr 8 00:54:12 warble1 ntpd[14369]: 0.0.0.0 c514 04 freq_mode Apr 8 00:54:13 warble1 ntpd[14369]: Listen normally on 9 em4 fe80::1a66:daff:febc:88e3 UDP 123 Apr 8 00:54:14 warble1 systemd: Started Temporary: Start ifalias interface for oobview even after parent is brought up in the initramfs. Apr 8 00:54:14 warble1 systemd: Starting PCS GUI and remote configuration interface... Apr 8 00:54:15 warble1 systemd: Started PCS GUI and remote configuration interface. Apr 8 00:54:15 warble1 systemd: Reached target Multi-User System. Apr 8 00:54:15 warble1 systemd: Starting Multi-User System. Apr 8 00:54:15 warble1 systemd: Starting Update UTMP about System Runlevel Changes... Apr 8 00:54:15 warble1 systemd: Starting Ganglia Monitoring Daemon... Apr 8 00:54:15 warble1 systemd: Started Update UTMP about System Runlevel Changes. Apr 8 00:54:15 warble1 systemd: Started Ganglia Monitoring Daemon. Apr 8 00:54:15 warble1 systemd: Startup finished in 6.492s (kernel) + 25.706s (initrd) + 14.790s (userspace) = 46.989s. Apr 8 00:54:15 warble1 kernel: 8021q: 802.1Q VLAN Support v1.8 Apr 8 00:54:15 warble1 kernel: 8021q: adding VLAN 0 to HW filter on device em1 Apr 8 00:54:15 warble1 kernel: 8021q: adding VLAN 0 to HW filter on device em2 Apr 8 00:54:15 warble1 kernel: 8021q: adding VLAN 0 to HW filter on device em3 Apr 8 00:54:15 warble1 kernel: 8021q: adding VLAN 0 to HW filter on device em4 Apr 8 00:54:15 warble1 kernel: 8021q: adding VLAN 0 to HW filter on device bond0 Apr 8 00:54:16 warble1 ntpd[14369]: Listen normally on 10 em4 10.1.1.21 UDP 123 Apr 8 00:54:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current POLL, new VERIFY_CAP Apr 8 00:54:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 8 00:54:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer PHY: power management 0x0, continuous updates 0x0 Apr 8 00:54:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Fabric: vAU 3, Z 1, vCU 0, vl15 credits 0x44, CRC sizes 0x3 Apr 8 00:54:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Link Width: tx rate 0x2, widths 0x8 Apr 8 00:54:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Peer Device ID: 0xabc0, Revision 0x10 Apr 8 00:54:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Final LCB CRC mode: 1 Apr 8 00:54:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Neighbor Guid: 117501020c4c04 Neighbor type 1 MgmtAllowed 1 FM security bypass 0 Apr 8 00:54:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:54:17 warble1 kernel: Couldn't create new SM AH Apr 8 00:54:17 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current VERIFY_CAP, new GOING_UP Apr 8 00:54:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: 8051: Link up Apr 8 00:54:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current GOING_UP, new INIT (LINKUP) Apr 8 00:54:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_INIT (0x2) Apr 8 00:54:18 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Fabric active lanes (width): tx 0xf (4), rx 0xf (4) Apr 8 00:54:19 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: hfi1_ibphys_portstate: physical state changed to PHYS_LINKUP (0x5), phy 0x50 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Setting partition keys Apr 8 00:54:20 warble1 kernel: Couldn't create new SM AH Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: port 1: got a lid: 0x63 Apr 8 00:54:20 warble1 kernel: SubnSet(OPA_PortInfo) smlid 0x8 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 1 from 10240 to 0 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 2 from 10240 to 0 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 3 from 10240 to 0 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 4 from 10240 to 0 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 5 from 10240 to 0 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 6 from 10240 to 0 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: MTU change on vl 7 from 10240 to 0 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current INIT, new ARMED Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ARMED (0x3) Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x103 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x103 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x1 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: set_link_state: current ARMED, new ACTIVE Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: logical state changed to PORT_ACTIVE (0x4) Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: send_idle_message: sending idle message 0x203 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: read_idle_message: read idle message 0x203 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: handle_sma_message: SMA message 0x2 Apr 8 00:54:20 warble1 kernel: hfi1 0000:d8:00.0: hfi1_0: Switching to NO_DMA_RTAIL Apr 8 00:54:22 warble1 kernel: IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready Apr 8 00:54:25 warble1 ntpd[14369]: Listen normally on 11 ib0 fe80::211:7501:171:de62 UDP 123 Apr 8 00:54:37 transom1 opaQueryGmetric: ./opaQueryGmetric.py: Error: host warble1 not in post Apr 8 00:55:59 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:55:59 warble1 systemd: Starting RPC bind service... Apr 8 00:55:59 warble1 systemd: Started RPC bind service. Apr 8 00:55:59 warble2 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:55:59 warble2 systemd: Starting RPC bind service... Apr 8 00:55:59 warble2 systemd: Started RPC bind service. Apr 8 00:55:59 warble1 kernel: DCCP: Activated CCID 2 (TCP-like) Apr 8 00:55:59 warble1 kernel: DCCP: Activated CCID 3 (TCP-Friendly Rate Control) Apr 8 00:55:59 warble2 kernel: DCCP: Activated CCID 2 (TCP-like) Apr 8 00:55:59 warble2 kernel: DCCP: Activated CCID 3 (TCP-Friendly Rate Control) Apr 8 00:55:59 warble1 kernel: sctp: Hash tables configured (bind 16384/16384) Apr 8 00:55:59 warble2 kernel: sctp: Hash tables configured (bind 16384/16384) Apr 8 00:56:28 warble2 dbus-daemon: dbus[6114]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' Apr 8 00:56:28 warble2 dbus[6114]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' Apr 8 00:56:28 warble2 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:56:28 warble2 systemd: Starting Authorization Manager... Apr 8 00:56:28 warble2 polkitd[15629]: Started polkitd version 0.112 Apr 8 00:56:28 warble2 dbus-daemon: dbus[6114]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Apr 8 00:56:28 warble2 dbus[6114]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Apr 8 00:56:28 warble2 systemd: Started Authorization Manager. Apr 8 00:56:28 warble2 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:56:28 warble2 systemd: Starting Corosync Cluster Engine... Apr 8 00:56:28 warble2 corosync[15647]: [MAIN ] Corosync Cluster Engine ('2.4.0'): started and ready to provide service. Apr 8 00:56:28 warble2 corosync[15647]: [MAIN ] Corosync built-in features: dbus systemd xmlconf qdevices qnetd snmp libcgroup pie relro bindnow Apr 8 00:56:28 warble2 corosync[15648]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 8 00:56:28 warble2 corosync[15648]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none Apr 8 00:56:28 warble2 corosync[15648]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 8 00:56:28 warble2 corosync[15648]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none Apr 8 00:56:28 warble2 corosync[15648]: [TOTEM ] The network interface [10.7.2.232] is now up. Apr 8 00:56:28 warble2 corosync[15648]: [SERV ] Service engine loaded: corosync configuration map access [0] Apr 8 00:56:28 warble2 corosync[15648]: [QB ] server name: cmap Apr 8 00:56:28 warble2 corosync[15648]: [SERV ] Service engine loaded: corosync configuration service [1] Apr 8 00:56:28 warble2 corosync[15648]: [QB ] server name: cfg Apr 8 00:56:28 warble2 corosync[15648]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 [2] Apr 8 00:56:28 warble2 corosync[15648]: [QB ] server name: cpg Apr 8 00:56:28 warble2 corosync[15648]: [SERV ] Service engine loaded: corosync profile loading service [4] Apr 8 00:56:28 warble2 corosync[15648]: [QUORUM] Using quorum provider corosync_votequorum Apr 8 00:56:28 warble2 corosync[15648]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 00:56:28 warble2 corosync[15648]: [SERV ] Service engine loaded: corosync vote quorum service v1.0 [5] Apr 8 00:56:28 warble2 corosync[15648]: [QB ] server name: votequorum Apr 8 00:56:28 warble2 corosync[15648]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1 [3] Apr 8 00:56:28 warble2 corosync[15648]: [QB ] server name: quorum Apr 8 00:56:28 warble2 corosync[15648]: [TOTEM ] The network interface [10.1.1.22] is now up. Apr 8 00:56:28 warble2 corosync[15648]: [TOTEM ] A new membership (10.7.2.232:4) was formed. Members joined: 2 Apr 8 00:56:28 warble2 corosync[15648]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 00:56:28 warble2 corosync[15648]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 00:56:28 warble2 corosync[15648]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 00:56:28 warble2 corosync[15648]: [QUORUM] Members[1]: 2 Apr 8 00:56:28 warble2 corosync[15648]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 00:56:28 warble2 corosync: Starting Corosync Cluster Engine (corosync): [ OK ] Apr 8 00:56:28 warble2 systemd: Started Corosync Cluster Engine. Apr 8 00:56:28 warble2 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:56:28 warble2 systemd: Reached target resource-agents dependencies. Apr 8 00:56:28 warble2 systemd: Starting resource-agents dependencies. Apr 8 00:56:28 warble2 systemd: Started Pacemaker High Availability Cluster Manager. Apr 8 00:56:28 warble2 systemd: Starting Pacemaker High Availability Cluster Manager... Apr 8 00:56:28 warble2 pacemakerd[15660]: notice: Additional logging available in /var/log/pacemaker.log Apr 8 00:56:28 warble2 pacemakerd[15660]: notice: Switching to /var/log/cluster/corosync.log Apr 8 00:56:28 warble2 pacemakerd[15660]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:28 warble2 pacemakerd[15660]: notice: Starting Pacemaker 1.1.16-12.el7_4.7 Apr 8 00:56:28 warble2 pacemakerd[15660]: warning: Quorum lost Apr 8 00:56:28 warble2 pacemakerd[15660]: notice: Node warble2-host.oob state is now member Apr 8 00:56:28 warble2 cib[15661]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:28 warble2 cib[15661]: notice: Using new config location: /var/lib/pacemaker/cib Apr 8 00:56:28 warble2 cib[15661]: warning: Could not verify cluster configuration file /var/lib/pacemaker/cib/cib.xml: No such file or directory (2) Apr 8 00:56:28 warble2 cib[15661]: warning: Primary configuration corrupt or unusable, trying backups in /var/lib/pacemaker/cib Apr 8 00:56:28 warble2 cib[15661]: warning: Continuing with an empty configuration. Apr 8 00:56:28 warble2 lrmd[15663]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:28 warble2 attrd[15664]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:28 warble2 stonith-ng[15662]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:28 warble2 pengine[15665]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:28 warble2 attrd[15664]: notice: Connecting to cluster infrastructure: corosync Apr 8 00:56:28 warble2 stonith-ng[15662]: notice: Connecting to cluster infrastructure: corosync Apr 8 00:56:28 warble2 crmd[15666]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:28 warble2 cib[15661]: notice: Connecting to cluster infrastructure: corosync Apr 8 00:56:28 warble2 attrd[15664]: notice: Node warble2-host.oob state is now member Apr 8 00:56:28 warble2 stonith-ng[15662]: notice: Node warble2-host.oob state is now member Apr 8 00:56:28 warble2 cib[15661]: notice: Node warble2-host.oob state is now member Apr 8 00:56:28 warble2 cib[15667]: warning: Could not verify cluster configuration file /var/lib/pacemaker/cib/cib.xml: No such file or directory (2) Apr 8 00:56:29 warble2 crmd[15666]: notice: Connecting to cluster infrastructure: corosync Apr 8 00:56:29 warble2 crmd[15666]: warning: Quorum lost Apr 8 00:56:29 warble2 crmd[15666]: notice: Node warble2-host.oob state is now member Apr 8 00:56:29 warble2 crmd[15666]: notice: The local CRM is operational Apr 8 00:56:29 warble2 crmd[15666]: notice: State transition S_STARTING -> S_PENDING Apr 8 00:56:36 warble1 dbus[8915]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' Apr 8 00:56:36 warble1 dbus-daemon: dbus[8915]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' Apr 8 00:56:36 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:56:36 warble1 systemd: Starting Authorization Manager... Apr 8 00:56:36 warble1 polkitd[15449]: Started polkitd version 0.112 Apr 8 00:56:36 warble1 dbus[8915]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Apr 8 00:56:36 warble1 dbus-daemon: dbus[8915]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Apr 8 00:56:36 warble1 systemd: Started Authorization Manager. Apr 8 00:56:36 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:56:36 warble1 systemd: Starting Corosync Cluster Engine... Apr 8 00:56:37 warble1 corosync[15467]: [MAIN ] Corosync Cluster Engine ('2.4.0'): started and ready to provide service. Apr 8 00:56:37 warble1 corosync[15467]: [MAIN ] Corosync built-in features: dbus systemd xmlconf qdevices qnetd snmp libcgroup pie relro bindnow Apr 8 00:56:37 warble1 corosync[15468]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 8 00:56:37 warble1 corosync[15468]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none Apr 8 00:56:37 warble1 corosync[15468]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 8 00:56:37 warble1 corosync[15468]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none Apr 8 00:56:37 warble1 corosync[15468]: [TOTEM ] The network interface [10.7.2.231] is now up. Apr 8 00:56:37 warble1 corosync[15468]: [SERV ] Service engine loaded: corosync configuration map access [0] Apr 8 00:56:37 warble1 corosync[15468]: [QB ] server name: cmap Apr 8 00:56:37 warble1 corosync[15468]: [SERV ] Service engine loaded: corosync configuration service [1] Apr 8 00:56:37 warble1 corosync[15468]: [QB ] server name: cfg Apr 8 00:56:37 warble1 corosync[15468]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 [2] Apr 8 00:56:37 warble1 corosync[15468]: [QB ] server name: cpg Apr 8 00:56:37 warble1 corosync[15468]: [SERV ] Service engine loaded: corosync profile loading service [4] Apr 8 00:56:37 warble1 corosync[15468]: [QUORUM] Using quorum provider corosync_votequorum Apr 8 00:56:37 warble1 corosync[15468]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 00:56:37 warble1 corosync[15468]: [SERV ] Service engine loaded: corosync vote quorum service v1.0 [5] Apr 8 00:56:37 warble1 corosync[15468]: [QB ] server name: votequorum Apr 8 00:56:37 warble1 corosync[15468]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1 [3] Apr 8 00:56:37 warble1 corosync[15468]: [QB ] server name: quorum Apr 8 00:56:37 warble1 corosync[15468]: [TOTEM ] The network interface [10.1.1.21] is now up. Apr 8 00:56:37 warble1 corosync[15468]: [TOTEM ] A new membership (10.7.2.231:4) was formed. Members joined: 1 Apr 8 00:56:37 warble1 corosync[15468]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 00:56:37 warble1 corosync[15468]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 00:56:37 warble1 corosync[15468]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 00:56:37 warble1 corosync[15468]: [QUORUM] Members[1]: 1 Apr 8 00:56:37 warble1 corosync[15468]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 00:56:37 warble2 corosync[15648]: [TOTEM ] A new membership (10.7.2.231:8) was formed. Members joined: 1 Apr 8 00:56:37 warble1 corosync[15468]: [TOTEM ] A new membership (10.7.2.231:8) was formed. Members joined: 2 Apr 8 00:56:37 warble1 corosync[15468]: [QUORUM] This node is within the primary component and will provide service. Apr 8 00:56:37 warble1 corosync[15468]: [QUORUM] Members[2]: 1 2 Apr 8 00:56:37 warble1 corosync[15468]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 00:56:37 warble2 corosync[15648]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 00:56:37 warble2 corosync[15648]: [QUORUM] This node is within the primary component and will provide service. Apr 8 00:56:37 warble2 corosync[15648]: [QUORUM] Members[2]: 1 2 Apr 8 00:56:37 warble2 corosync[15648]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 00:56:37 warble2 crmd[15666]: notice: Quorum acquired Apr 8 00:56:37 warble2 crmd[15666]: notice: Node warble1-host.oob state is now member Apr 8 00:56:37 warble2 pacemakerd[15660]: notice: Quorum acquired Apr 8 00:56:37 warble2 pacemakerd[15660]: notice: Node warble1-host.oob state is now member Apr 8 00:56:37 warble1 corosync: Starting Corosync Cluster Engine (corosync): [ OK ] Apr 8 00:56:37 warble1 systemd: Started Corosync Cluster Engine. Apr 8 00:56:37 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 00:56:37 warble1 systemd: Reached target resource-agents dependencies. Apr 8 00:56:37 warble1 systemd: Starting resource-agents dependencies. Apr 8 00:56:37 warble1 systemd: Started Pacemaker High Availability Cluster Manager. Apr 8 00:56:37 warble1 systemd: Starting Pacemaker High Availability Cluster Manager... Apr 8 00:56:37 warble1 pacemakerd[15480]: notice: Additional logging available in /var/log/pacemaker.log Apr 8 00:56:37 warble1 pacemakerd[15480]: notice: Switching to /var/log/cluster/corosync.log Apr 8 00:56:37 warble1 pacemakerd[15480]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:37 warble1 pacemakerd[15480]: notice: Starting Pacemaker 1.1.16-12.el7_4.7 Apr 8 00:56:37 warble1 pacemakerd[15480]: notice: Quorum acquired Apr 8 00:56:37 warble1 pacemakerd[15480]: notice: Node warble1-host.oob state is now member Apr 8 00:56:37 warble1 pacemakerd[15480]: notice: Node warble2-host.oob state is now member Apr 8 00:56:37 warble1 cib[15481]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:37 warble1 cib[15481]: notice: Using new config location: /var/lib/pacemaker/cib Apr 8 00:56:37 warble1 cib[15481]: warning: Could not verify cluster configuration file /var/lib/pacemaker/cib/cib.xml: No such file or directory (2) Apr 8 00:56:37 warble1 cib[15481]: warning: Primary configuration corrupt or unusable, trying backups in /var/lib/pacemaker/cib Apr 8 00:56:37 warble1 cib[15481]: warning: Continuing with an empty configuration. Apr 8 00:56:37 warble1 lrmd[15483]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:37 warble1 attrd[15484]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:37 warble1 pengine[15485]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:37 warble1 crmd[15486]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:37 warble1 attrd[15484]: notice: Connecting to cluster infrastructure: corosync Apr 8 00:56:37 warble1 stonith-ng[15482]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 00:56:37 warble1 stonith-ng[15482]: notice: Connecting to cluster infrastructure: corosync Apr 8 00:56:37 warble1 cib[15481]: notice: Connecting to cluster infrastructure: corosync Apr 8 00:56:37 warble2 attrd[15664]: notice: Node warble1-host.oob state is now member Apr 8 00:56:37 warble2 stonith-ng[15662]: notice: Node warble1-host.oob state is now member Apr 8 00:56:37 warble2 cib[15661]: notice: Node warble1-host.oob state is now member Apr 8 00:56:37 warble1 attrd[15484]: notice: Node warble1-host.oob state is now member Apr 8 00:56:37 warble1 cib[15481]: notice: Node warble1-host.oob state is now member Apr 8 00:56:37 warble1 stonith-ng[15482]: notice: Node warble1-host.oob state is now member Apr 8 00:56:37 warble1 cib[15481]: notice: Node warble2-host.oob state is now member Apr 8 00:56:37 warble1 cib[15487]: warning: Could not verify cluster configuration file /var/lib/pacemaker/cib/cib.xml: No such file or directory (2) Apr 8 00:56:37 warble1 stonith-ng[15482]: notice: Node warble2-host.oob state is now member Apr 8 00:56:38 warble1 crmd[15486]: notice: Connecting to cluster infrastructure: corosync Apr 8 00:56:38 warble1 crmd[15486]: notice: Quorum acquired Apr 8 00:56:38 warble1 crmd[15486]: notice: Node warble1-host.oob state is now member Apr 8 00:56:38 warble1 crmd[15486]: notice: Node warble2-host.oob state is now member Apr 8 00:56:38 warble1 crmd[15486]: notice: The local CRM is operational Apr 8 00:56:38 warble1 crmd[15486]: notice: State transition S_STARTING -> S_PENDING Apr 8 00:56:38 warble1 attrd[15484]: notice: Node warble2-host.oob state is now member Apr 8 00:56:50 warble2 crmd[15666]: warning: Input I_DC_TIMEOUT received in state S_PENDING from crm_timer_popped Apr 8 00:56:50 warble2 crmd[15666]: notice: State transition S_ELECTION -> S_PENDING Apr 8 00:56:50 warble1 crmd[15486]: notice: State transition S_ELECTION -> S_INTEGRATION Apr 8 00:56:50 warble1 crmd[15486]: warning: Input I_ELECTION_DC received in state S_INTEGRATION from do_election_check Apr 8 00:56:50 warble2 crmd[15666]: notice: State transition S_PENDING -> S_NOT_DC Apr 8 00:56:51 warble1 pengine[15485]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 00:56:51 warble1 pengine[15485]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 00:56:51 warble1 pengine[15485]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 00:56:51 warble1 pengine[15485]: notice: Delaying fencing operations until there are resources to manage Apr 8 00:56:51 warble1 pengine[15485]: notice: Calculated transition 0, saving inputs in /var/lib/pacemaker/pengine/pe-input-0.bz2 Apr 8 00:56:51 warble1 pengine[15485]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 00:56:51 warble1 crmd[15486]: notice: Transition 0 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-0.bz2): Complete Apr 8 00:56:51 warble1 crmd[15486]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 00:57:37 warble1 crmd[15486]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 00:57:38 warble1 pengine[15485]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 00:57:38 warble1 pengine[15485]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 00:57:38 warble1 pengine[15485]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 00:57:38 warble1 pengine[15485]: notice: Delaying fencing operations until there are resources to manage Apr 8 00:57:38 warble1 pengine[15485]: notice: Calculated transition 1, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 00:57:38 warble1 pengine[15485]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 00:57:38 warble1 crmd[15486]: notice: Transition 1 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 00:57:38 warble1 crmd[15486]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 00:57:43 warble1 crmd[15486]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 00:57:44 warble1 pengine[15485]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 00:57:44 warble1 pengine[15485]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 00:57:44 warble1 pengine[15485]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 00:57:44 warble1 pengine[15485]: notice: Delaying fencing operations until there are resources to manage Apr 8 00:57:44 warble1 pengine[15485]: notice: Calculated transition 2, saving inputs in /var/lib/pacemaker/pengine/pe-input-2.bz2 Apr 8 00:57:44 warble1 pengine[15485]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 00:57:44 warble1 crmd[15486]: notice: Transition 2 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-2.bz2): Complete Apr 8 00:57:44 warble1 crmd[15486]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 01:03:14 warble2 systemd: Stopping Pacemaker High Availability Cluster Manager... Apr 8 01:03:14 warble2 pacemakerd[15660]: notice: Caught 'Terminated' signal Apr 8 01:03:14 warble2 pacemakerd[15660]: notice: Shutting down Pacemaker Apr 8 01:03:14 warble2 pacemakerd[15660]: notice: Stopping crmd Apr 8 01:03:14 warble2 crmd[15666]: notice: Caught 'Terminated' signal Apr 8 01:03:14 warble2 crmd[15666]: notice: Shutting down cluster resource manager Apr 8 01:03:14 warble1 crmd[15486]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 01:03:14 warble1 pengine[15485]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 01:03:14 warble1 pengine[15485]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 01:03:14 warble1 pengine[15485]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 01:03:14 warble1 pengine[15485]: notice: Delaying fencing operations until there are resources to manage Apr 8 01:03:14 warble1 pengine[15485]: notice: Scheduling Node warble2-host.oob for shutdown Apr 8 01:03:14 warble1 pengine[15485]: notice: * Shutdown warble2-host.oob Apr 8 01:03:14 warble1 pengine[15485]: notice: Calculated transition 3, saving inputs in /var/lib/pacemaker/pengine/pe-input-3.bz2 Apr 8 01:03:14 warble1 pengine[15485]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 01:03:14 warble2 crmd[15666]: notice: State transition S_NOT_DC -> S_STOPPING Apr 8 01:03:14 warble1 crmd[15486]: notice: Transition 3 (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-3.bz2): Complete Apr 8 01:03:14 warble2 crmd[15666]: notice: Disconnected from the LRM Apr 8 01:03:14 warble1 crmd[15486]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 01:03:14 warble1 crmd[15486]: notice: do_shutdown of peer warble2-host.oob is complete Apr 8 01:03:14 warble2 crmd[15666]: notice: Disconnected from Corosync Apr 8 01:03:14 warble2 crmd[15666]: notice: Disconnected from the CIB Apr 8 01:03:14 warble2 cib[15661]: warning: new_event_notification (15661-15666-11): Broken pipe (32) Apr 8 01:03:14 warble2 cib[15661]: warning: A-Sync reply to crmd failed: No message of desired type Apr 8 01:03:14 warble2 pacemakerd[15660]: notice: Stopping pengine Apr 8 01:03:14 warble2 pengine[15665]: notice: Caught 'Terminated' signal Apr 8 01:03:14 warble2 pacemakerd[15660]: notice: Stopping attrd Apr 8 01:03:14 warble2 attrd[15664]: notice: Caught 'Terminated' signal Apr 8 01:03:14 warble2 pacemakerd[15660]: notice: Stopping lrmd Apr 8 01:03:14 warble2 lrmd[15663]: notice: Caught 'Terminated' signal Apr 8 01:03:14 warble2 pacemakerd[15660]: notice: Stopping stonith-ng Apr 8 01:03:14 warble2 stonith-ng[15662]: notice: Caught 'Terminated' signal Apr 8 01:03:14 warble1 attrd[15484]: notice: Node warble2-host.oob state is now lost Apr 8 01:03:14 warble1 attrd[15484]: notice: Removing all warble2-host.oob attributes for peer loss Apr 8 01:03:14 warble1 attrd[15484]: notice: Lost attribute writer warble2-host.oob Apr 8 01:03:14 warble1 attrd[15484]: notice: Purged 1 peers with id=2 and/or uname=warble2-host.oob from the membership cache Apr 8 01:03:14 warble2 pacemakerd[15660]: notice: Stopping cib Apr 8 01:03:14 warble2 cib[15661]: notice: Caught 'Terminated' signal Apr 8 01:03:14 warble2 cib[15661]: notice: Disconnected from Corosync Apr 8 01:03:14 warble2 cib[15661]: notice: Disconnected from Corosync Apr 8 01:03:14 warble1 stonith-ng[15482]: notice: Node warble2-host.oob state is now lost Apr 8 01:03:14 warble1 stonith-ng[15482]: notice: Purged 1 peers with id=2 and/or uname=warble2-host.oob from the membership cache Apr 8 01:03:14 warble1 cib[15481]: notice: Node warble2-host.oob state is now lost Apr 8 01:03:14 warble1 cib[15481]: notice: Purged 1 peers with id=2 and/or uname=warble2-host.oob from the membership cache Apr 8 01:03:14 warble2 pacemakerd[15660]: notice: Shutdown complete Apr 8 01:03:14 warble2 systemd: Stopped Pacemaker High Availability Cluster Manager. Apr 8 01:03:14 warble2 systemd: Stopping Corosync Cluster Engine... Apr 8 01:03:14 warble2 corosync[15648]: [MAIN ] Node was shut down by a signal Apr 8 01:03:14 warble2 corosync: Signaling Corosync Cluster Engine (corosync) to terminate: [ OK ] Apr 8 01:03:14 warble2 corosync[15648]: [SERV ] Unloading all Corosync service engines. Apr 8 01:03:14 warble2 corosync[15648]: [QB ] withdrawing server sockets Apr 8 01:03:14 warble2 corosync[15648]: [SERV ] Service engine unloaded: corosync vote quorum service v1.0 Apr 8 01:03:14 warble2 corosync[15648]: [QB ] withdrawing server sockets Apr 8 01:03:14 warble2 corosync[15648]: [SERV ] Service engine unloaded: corosync configuration map access Apr 8 01:03:14 warble2 corosync[15648]: [QB ] withdrawing server sockets Apr 8 01:03:14 warble2 corosync[15648]: [SERV ] Service engine unloaded: corosync configuration service Apr 8 01:03:14 warble2 corosync[15648]: [QB ] withdrawing server sockets Apr 8 01:03:14 warble2 corosync[15648]: [SERV ] Service engine unloaded: corosync cluster closed process group service v1.01 Apr 8 01:03:14 warble2 corosync[15648]: [QB ] withdrawing server sockets Apr 8 01:03:14 warble2 corosync[15648]: [SERV ] Service engine unloaded: corosync cluster quorum service v0.1 Apr 8 01:03:14 warble2 corosync[15648]: [SERV ] Service engine unloaded: corosync profile loading service Apr 8 01:03:14 warble2 corosync[15648]: [MAIN ] Corosync Cluster Engine exiting normally Apr 8 01:03:14 warble1 corosync[15468]: [TOTEM ] A new membership (10.7.2.231:12) was formed. Members left: 2 Apr 8 01:03:14 warble1 corosync[15468]: [QUORUM] Members[1]: 1 Apr 8 01:03:14 warble1 corosync[15468]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 01:03:14 warble1 crmd[15486]: notice: Node warble2-host.oob state is now lost Apr 8 01:03:14 warble1 pacemakerd[15480]: notice: Node warble2-host.oob state is now lost Apr 8 01:03:14 warble1 crmd[15486]: notice: do_shutdown of peer warble2-host.oob is complete Apr 8 01:03:15 warble2 corosync: Waiting for corosync services to unload:.[ OK ] Apr 8 01:03:15 warble2 systemd: Stopped Corosync Cluster Engine. Apr 8 01:03:27 warble1 systemd: Stopping Pacemaker High Availability Cluster Manager... Apr 8 01:03:27 warble1 pacemakerd[15480]: notice: Caught 'Terminated' signal Apr 8 01:03:27 warble1 pacemakerd[15480]: notice: Shutting down Pacemaker Apr 8 01:03:27 warble1 pacemakerd[15480]: notice: Stopping crmd Apr 8 01:03:27 warble1 crmd[15486]: notice: Caught 'Terminated' signal Apr 8 01:03:27 warble1 crmd[15486]: notice: Shutting down cluster resource manager Apr 8 01:03:27 warble1 crmd[15486]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 01:03:27 warble1 pengine[15485]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 01:03:27 warble1 pengine[15485]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 01:03:27 warble1 pengine[15485]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 01:03:27 warble1 pengine[15485]: notice: Delaying fencing operations until there are resources to manage Apr 8 01:03:27 warble1 pengine[15485]: notice: Scheduling Node warble1-host.oob for shutdown Apr 8 01:03:27 warble1 pengine[15485]: notice: * Shutdown warble1-host.oob Apr 8 01:03:27 warble1 pengine[15485]: notice: Calculated transition 4, saving inputs in /var/lib/pacemaker/pengine/pe-input-4.bz2 Apr 8 01:03:27 warble1 pengine[15485]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 01:03:27 warble1 crmd[15486]: notice: Transition 4 (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-4.bz2): Complete Apr 8 01:03:27 warble1 crmd[15486]: notice: Disconnected from the LRM Apr 8 01:03:27 warble1 crmd[15486]: notice: Disconnected from Corosync Apr 8 01:03:27 warble1 crmd[15486]: notice: Disconnected from the CIB Apr 8 01:03:27 warble1 cib[15481]: warning: new_event_notification (15481-15486-12): Broken pipe (32) Apr 8 01:03:27 warble1 cib[15481]: warning: A-Sync reply to crmd failed: No message of desired type Apr 8 01:03:27 warble1 pacemakerd[15480]: notice: Stopping pengine Apr 8 01:03:27 warble1 pengine[15485]: notice: Caught 'Terminated' signal Apr 8 01:03:27 warble1 pacemakerd[15480]: notice: Stopping attrd Apr 8 01:03:27 warble1 attrd[15484]: notice: Caught 'Terminated' signal Apr 8 01:03:27 warble1 pacemakerd[15480]: notice: Stopping lrmd Apr 8 01:03:27 warble1 lrmd[15483]: notice: Caught 'Terminated' signal Apr 8 01:03:27 warble1 pacemakerd[15480]: notice: Stopping stonith-ng Apr 8 01:03:27 warble1 stonith-ng[15482]: notice: Caught 'Terminated' signal Apr 8 01:03:27 warble1 pacemakerd[15480]: notice: Stopping cib Apr 8 01:03:27 warble1 cib[15481]: notice: Caught 'Terminated' signal Apr 8 01:03:27 warble1 cib[15481]: notice: Disconnected from Corosync Apr 8 01:03:27 warble1 cib[15481]: notice: Disconnected from Corosync Apr 8 01:03:27 warble1 pacemakerd[15480]: notice: Shutdown complete Apr 8 01:03:27 warble1 systemd: Stopped Pacemaker High Availability Cluster Manager. Apr 8 01:03:27 warble1 systemd: Stopping Corosync Cluster Engine... Apr 8 01:03:27 warble1 corosync[15468]: [MAIN ] Node was shut down by a signal Apr 8 01:03:27 warble1 corosync: Signaling Corosync Cluster Engine (corosync) to terminate: [ OK ] Apr 8 01:03:27 warble1 corosync[15468]: [SERV ] Unloading all Corosync service engines. Apr 8 01:03:27 warble1 corosync[15468]: [QB ] withdrawing server sockets Apr 8 01:03:27 warble1 corosync[15468]: [SERV ] Service engine unloaded: corosync vote quorum service v1.0 Apr 8 01:03:27 warble1 corosync[15468]: [QB ] withdrawing server sockets Apr 8 01:03:27 warble1 corosync[15468]: [SERV ] Service engine unloaded: corosync configuration map access Apr 8 01:03:27 warble1 corosync[15468]: [QB ] withdrawing server sockets Apr 8 01:03:27 warble1 corosync[15468]: [SERV ] Service engine unloaded: corosync configuration service Apr 8 01:03:27 warble1 corosync[15468]: [QB ] withdrawing server sockets Apr 8 01:03:27 warble1 corosync[15468]: [SERV ] Service engine unloaded: corosync cluster closed process group service v1.01 Apr 8 01:03:27 warble1 corosync[15468]: [QB ] withdrawing server sockets Apr 8 01:03:27 warble1 corosync[15468]: [SERV ] Service engine unloaded: corosync cluster quorum service v0.1 Apr 8 01:03:27 warble1 corosync[15468]: [SERV ] Service engine unloaded: corosync profile loading service Apr 8 01:03:27 warble1 corosync[15468]: [MAIN ] Corosync Cluster Engine exiting normally Apr 8 01:03:28 warble1 corosync: Waiting for corosync services to unload:.[ OK ] Apr 8 01:03:28 warble1 systemd: Stopped Corosync Cluster Engine. Apr 8 01:03:44 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 01:03:44 warble1 systemd: Starting Corosync Cluster Engine... Apr 8 01:03:44 warble1 corosync[17344]: [MAIN ] Corosync Cluster Engine ('2.4.0'): started and ready to provide service. Apr 8 01:03:44 warble1 corosync[17344]: [MAIN ] Corosync built-in features: dbus systemd xmlconf qdevices qnetd snmp libcgroup pie relro bindnow Apr 8 01:03:44 warble1 corosync[17345]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 8 01:03:44 warble1 corosync[17345]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none Apr 8 01:03:44 warble1 corosync[17345]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 8 01:03:44 warble1 corosync[17345]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none Apr 8 01:03:44 warble1 corosync[17345]: [TOTEM ] The network interface [10.7.2.231] is now up. Apr 8 01:03:44 warble1 corosync[17345]: [SERV ] Service engine loaded: corosync configuration map access [0] Apr 8 01:03:44 warble1 corosync[17345]: [QB ] server name: cmap Apr 8 01:03:44 warble1 corosync[17345]: [SERV ] Service engine loaded: corosync configuration service [1] Apr 8 01:03:44 warble1 corosync[17345]: [QB ] server name: cfg Apr 8 01:03:44 warble1 corosync[17345]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 [2] Apr 8 01:03:44 warble1 corosync[17345]: [QB ] server name: cpg Apr 8 01:03:44 warble1 corosync[17345]: [SERV ] Service engine loaded: corosync profile loading service [4] Apr 8 01:03:44 warble1 corosync[17345]: [QUORUM] Using quorum provider corosync_votequorum Apr 8 01:03:44 warble1 corosync[17345]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 01:03:44 warble1 corosync[17345]: [SERV ] Service engine loaded: corosync vote quorum service v1.0 [5] Apr 8 01:03:44 warble1 corosync[17345]: [QB ] server name: votequorum Apr 8 01:03:44 warble1 corosync[17345]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1 [3] Apr 8 01:03:44 warble1 corosync[17345]: [QB ] server name: quorum Apr 8 01:03:44 warble1 corosync[17345]: [TOTEM ] The network interface [10.1.1.21] is now up. Apr 8 01:03:44 warble1 corosync[17345]: [TOTEM ] A new membership (10.7.2.231:16) was formed. Members joined: 1 Apr 8 01:03:44 warble1 corosync[17345]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 01:03:44 warble1 corosync[17345]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 01:03:44 warble1 corosync[17345]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 01:03:44 warble1 corosync[17345]: [QUORUM] Members[1]: 1 Apr 8 01:03:44 warble1 corosync[17345]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 01:03:44 warble1 corosync: Starting Corosync Cluster Engine (corosync): [ OK ] Apr 8 01:03:44 warble1 systemd: Started Corosync Cluster Engine. Apr 8 01:03:44 warble1 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 01:03:44 warble1 systemd: Started Pacemaker High Availability Cluster Manager. Apr 8 01:03:44 warble1 systemd: Starting Pacemaker High Availability Cluster Manager... Apr 8 01:03:44 warble1 pacemakerd[17358]: notice: Additional logging available in /var/log/pacemaker.log Apr 8 01:03:44 warble1 pacemakerd[17358]: notice: Switching to /var/log/cluster/corosync.log Apr 8 01:03:44 warble1 pacemakerd[17358]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:03:44 warble1 pacemakerd[17358]: notice: Starting Pacemaker 1.1.16-12.el7_4.7 Apr 8 01:03:44 warble1 pacemakerd[17358]: warning: Quorum lost Apr 8 01:03:44 warble1 pacemakerd[17358]: notice: Node warble1-host.oob state is now member Apr 8 01:03:44 warble1 cib[17359]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:03:44 warble1 lrmd[17361]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:03:44 warble1 attrd[17362]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:03:44 warble1 pengine[17363]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:03:44 warble1 crmd[17364]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:03:44 warble1 attrd[17362]: notice: Connecting to cluster infrastructure: corosync Apr 8 01:03:44 warble1 stonith-ng[17360]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:03:44 warble1 stonith-ng[17360]: notice: Connecting to cluster infrastructure: corosync Apr 8 01:03:44 warble1 cib[17359]: notice: Connecting to cluster infrastructure: corosync Apr 8 01:03:44 warble1 attrd[17362]: notice: Node warble1-host.oob state is now member Apr 8 01:03:44 warble1 stonith-ng[17360]: notice: Node warble1-host.oob state is now member Apr 8 01:03:44 warble1 cib[17359]: notice: Node warble1-host.oob state is now member Apr 8 01:03:45 warble1 crmd[17364]: notice: Connecting to cluster infrastructure: corosync Apr 8 01:03:45 warble1 crmd[17364]: warning: Quorum lost Apr 8 01:03:45 warble1 crmd[17364]: notice: Node warble1-host.oob state is now member Apr 8 01:03:45 warble1 crmd[17364]: notice: The local CRM is operational Apr 8 01:03:45 warble1 crmd[17364]: notice: State transition S_STARTING -> S_PENDING Apr 8 01:04:03 warble2 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 01:04:03 warble2 systemd: Starting Corosync Cluster Engine... Apr 8 01:04:03 warble2 corosync[17624]: [MAIN ] Corosync Cluster Engine ('2.4.0'): started and ready to provide service. Apr 8 01:04:03 warble2 corosync[17624]: [MAIN ] Corosync built-in features: dbus systemd xmlconf qdevices qnetd snmp libcgroup pie relro bindnow Apr 8 01:04:03 warble2 corosync[17625]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 8 01:04:03 warble2 corosync[17625]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none Apr 8 01:04:03 warble2 corosync[17625]: [TOTEM ] Initializing transport (UDP/IP Multicast). Apr 8 01:04:03 warble2 corosync[17625]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: none hash: none Apr 8 01:04:03 warble2 corosync[17625]: [TOTEM ] The network interface [10.7.2.232] is now up. Apr 8 01:04:03 warble2 corosync[17625]: [SERV ] Service engine loaded: corosync configuration map access [0] Apr 8 01:04:03 warble2 corosync[17625]: [QB ] server name: cmap Apr 8 01:04:03 warble2 corosync[17625]: [SERV ] Service engine loaded: corosync configuration service [1] Apr 8 01:04:03 warble2 corosync[17625]: [QB ] server name: cfg Apr 8 01:04:03 warble2 corosync[17625]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 [2] Apr 8 01:04:03 warble2 corosync[17625]: [QB ] server name: cpg Apr 8 01:04:03 warble2 corosync[17625]: [SERV ] Service engine loaded: corosync profile loading service [4] Apr 8 01:04:03 warble2 corosync[17625]: [QUORUM] Using quorum provider corosync_votequorum Apr 8 01:04:03 warble2 corosync[17625]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 01:04:03 warble2 corosync[17625]: [SERV ] Service engine loaded: corosync vote quorum service v1.0 [5] Apr 8 01:04:03 warble2 corosync[17625]: [QB ] server name: votequorum Apr 8 01:04:03 warble2 corosync[17625]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1 [3] Apr 8 01:04:03 warble2 corosync[17625]: [QB ] server name: quorum Apr 8 01:04:03 warble2 corosync[17625]: [TOTEM ] The network interface [10.1.1.22] is now up. Apr 8 01:04:03 warble2 corosync[17625]: [TOTEM ] A new membership (10.7.2.232:12) was formed. Members joined: 2 Apr 8 01:04:03 warble2 corosync[17625]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 01:04:03 warble2 corosync[17625]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 01:04:03 warble2 corosync[17625]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 01:04:03 warble2 corosync[17625]: [QUORUM] Members[1]: 2 Apr 8 01:04:03 warble2 corosync[17625]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 01:04:03 warble2 corosync[17625]: [TOTEM ] A new membership (10.7.2.231:20) was formed. Members joined: 1 Apr 8 01:04:03 warble1 corosync[17345]: [TOTEM ] A new membership (10.7.2.231:20) was formed. Members joined: 2 Apr 8 01:04:03 warble2 corosync[17625]: [QUORUM] This node is within the primary component and will provide service. Apr 8 01:04:03 warble2 corosync[17625]: [QUORUM] Members[2]: 1 2 Apr 8 01:04:03 warble2 corosync[17625]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 01:04:03 warble1 corosync[17345]: [VOTEQ ] Waiting for all cluster members. Current votes: 1 expected_votes: 2 Apr 8 01:04:03 warble1 corosync[17345]: [QUORUM] This node is within the primary component and will provide service. Apr 8 01:04:03 warble1 corosync[17345]: [QUORUM] Members[2]: 1 2 Apr 8 01:04:03 warble1 corosync[17345]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 01:04:03 warble1 crmd[17364]: notice: Quorum acquired Apr 8 01:04:03 warble1 pacemakerd[17358]: notice: Quorum acquired Apr 8 01:04:03 warble1 crmd[17364]: notice: Node warble2-host.oob state is now member Apr 8 01:04:03 warble1 pacemakerd[17358]: notice: Node warble2-host.oob state is now member Apr 8 01:04:04 warble2 corosync: Starting Corosync Cluster Engine (corosync): [ OK ] Apr 8 01:04:04 warble2 systemd: Started Corosync Cluster Engine. Apr 8 01:04:04 warble2 systemd: Cannot add dependency job for unit onesis.service, ignoring: Unit not found. Apr 8 01:04:04 warble2 systemd: Started Pacemaker High Availability Cluster Manager. Apr 8 01:04:04 warble2 systemd: Starting Pacemaker High Availability Cluster Manager... Apr 8 01:04:04 warble2 pacemakerd[17637]: notice: Additional logging available in /var/log/pacemaker.log Apr 8 01:04:04 warble2 pacemakerd[17637]: notice: Switching to /var/log/cluster/corosync.log Apr 8 01:04:04 warble2 pacemakerd[17637]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:04:04 warble2 pacemakerd[17637]: notice: Starting Pacemaker 1.1.16-12.el7_4.7 Apr 8 01:04:04 warble2 pacemakerd[17637]: notice: Quorum acquired Apr 8 01:04:04 warble2 pacemakerd[17637]: notice: Node warble1-host.oob state is now member Apr 8 01:04:04 warble2 pacemakerd[17637]: notice: Node warble2-host.oob state is now member Apr 8 01:04:04 warble2 cib[17638]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:04:04 warble2 lrmd[17640]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:04:04 warble2 attrd[17641]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:04:04 warble2 pengine[17642]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:04:04 warble2 attrd[17641]: notice: Connecting to cluster infrastructure: corosync Apr 8 01:04:04 warble2 stonith-ng[17639]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:04:04 warble2 stonith-ng[17639]: notice: Connecting to cluster infrastructure: corosync Apr 8 01:04:04 warble2 crmd[17643]: notice: Additional logging available in /var/log/cluster/corosync.log Apr 8 01:04:04 warble1 stonith-ng[17360]: notice: Node warble2-host.oob state is now member Apr 8 01:04:04 warble1 attrd[17362]: notice: Node warble2-host.oob state is now member Apr 8 01:04:04 warble1 cib[17359]: notice: Node warble2-host.oob state is now member Apr 8 01:04:04 warble2 cib[17638]: notice: Connecting to cluster infrastructure: corosync Apr 8 01:04:04 warble2 attrd[17641]: notice: Node warble2-host.oob state is now member Apr 8 01:04:04 warble2 stonith-ng[17639]: notice: Node warble2-host.oob state is now member Apr 8 01:04:04 warble2 cib[17638]: notice: Node warble2-host.oob state is now member Apr 8 01:04:04 warble2 cib[17638]: notice: Node warble1-host.oob state is now member Apr 8 01:04:05 warble2 crmd[17643]: notice: Connecting to cluster infrastructure: corosync Apr 8 01:04:05 warble2 crmd[17643]: notice: Quorum acquired Apr 8 01:04:05 warble2 crmd[17643]: notice: Node warble1-host.oob state is now member Apr 8 01:04:05 warble2 crmd[17643]: notice: Node warble2-host.oob state is now member Apr 8 01:04:05 warble2 crmd[17643]: notice: The local CRM is operational Apr 8 01:04:05 warble2 crmd[17643]: notice: State transition S_STARTING -> S_PENDING Apr 8 01:04:05 warble2 attrd[17641]: notice: Node warble1-host.oob state is now member Apr 8 01:04:05 warble2 stonith-ng[17639]: notice: Node warble1-host.oob state is now member Apr 8 01:04:06 warble1 crmd[17364]: warning: Input I_DC_TIMEOUT received in state S_PENDING from crm_timer_popped Apr 8 01:04:07 warble1 crmd[17364]: notice: State transition S_ELECTION -> S_INTEGRATION Apr 8 01:04:07 warble1 crmd[17364]: warning: Input I_ELECTION_DC received in state S_INTEGRATION from do_election_check Apr 8 01:04:07 warble2 crmd[17643]: notice: State transition S_PENDING -> S_NOT_DC Apr 8 01:04:08 warble1 pengine[17363]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 01:04:08 warble1 pengine[17363]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 01:04:08 warble1 pengine[17363]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 01:04:08 warble1 pengine[17363]: notice: Delaying fencing operations until there are resources to manage Apr 8 01:04:08 warble1 pengine[17363]: notice: Calculated transition 0, saving inputs in /var/lib/pacemaker/pengine/pe-input-5.bz2 Apr 8 01:04:08 warble1 pengine[17363]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 01:04:08 warble1 crmd[17364]: notice: Transition 0 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-5.bz2): Complete Apr 8 01:04:08 warble1 crmd[17364]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 01:04:14 warble1 crmd[17364]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 01:04:14 warble1 pengine[17363]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 01:04:14 warble1 pengine[17363]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 01:04:14 warble1 pengine[17363]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 01:04:14 warble1 pengine[17363]: notice: Delaying fencing operations until there are resources to manage Apr 8 01:04:14 warble1 pengine[17363]: notice: Calculated transition 1, saving inputs in /var/lib/pacemaker/pengine/pe-input-6.bz2 Apr 8 01:04:14 warble1 pengine[17363]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 01:04:14 warble1 crmd[17364]: notice: Transition 1 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-6.bz2): Complete Apr 8 01:04:14 warble1 crmd[17364]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 01:04:54 warble1 systemd: Stopping Pacemaker High Availability Cluster Manager... Apr 8 01:04:54 warble1 pacemakerd[17358]: notice: Caught 'Terminated' signal Apr 8 01:04:54 warble1 pacemakerd[17358]: notice: Shutting down Pacemaker Apr 8 01:04:54 warble1 pacemakerd[17358]: notice: Stopping crmd Apr 8 01:04:54 warble1 crmd[17364]: notice: Caught 'Terminated' signal Apr 8 01:04:54 warble1 crmd[17364]: notice: Shutting down cluster resource manager Apr 8 01:04:54 warble1 crmd[17364]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 01:04:54 warble1 pengine[17363]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 01:04:54 warble1 pengine[17363]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 01:04:54 warble1 pengine[17363]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 01:04:54 warble1 pengine[17363]: notice: Delaying fencing operations until there are resources to manage Apr 8 01:04:54 warble1 pengine[17363]: notice: Scheduling Node warble1-host.oob for shutdown Apr 8 01:04:54 warble1 pengine[17363]: notice: * Shutdown warble1-host.oob Apr 8 01:04:54 warble1 pengine[17363]: notice: Calculated transition 2, saving inputs in /var/lib/pacemaker/pengine/pe-input-7.bz2 Apr 8 01:04:54 warble1 pengine[17363]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 01:04:54 warble1 crmd[17364]: notice: Transition 2 (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-7.bz2): Complete Apr 8 01:04:54 warble1 crmd[17364]: notice: Disconnected from the LRM Apr 8 01:04:54 warble1 crmd[17364]: notice: Disconnected from Corosync Apr 8 01:04:54 warble1 crmd[17364]: notice: Disconnected from the CIB Apr 8 01:04:54 warble1 cib[17359]: warning: new_event_notification (17359-17364-11): Broken pipe (32) Apr 8 01:04:54 warble1 cib[17359]: warning: A-Sync reply to crmd failed: No message of desired type Apr 8 01:04:54 warble1 pacemakerd[17358]: notice: Stopping pengine Apr 8 01:04:54 warble1 pengine[17363]: notice: Caught 'Terminated' signal Apr 8 01:04:54 warble1 pacemakerd[17358]: notice: Stopping attrd Apr 8 01:04:54 warble2 crmd[17643]: notice: Our peer on the DC (warble1-host.oob) is dead Apr 8 01:04:54 warble2 crmd[17643]: notice: State transition S_NOT_DC -> S_ELECTION Apr 8 01:04:54 warble1 attrd[17362]: notice: Caught 'Terminated' signal Apr 8 01:04:54 warble2 crmd[17643]: notice: State transition S_ELECTION -> S_INTEGRATION Apr 8 01:04:54 warble1 pacemakerd[17358]: notice: Stopping lrmd Apr 8 01:04:54 warble1 lrmd[17361]: notice: Caught 'Terminated' signal Apr 8 01:04:54 warble1 pacemakerd[17358]: notice: Stopping stonith-ng Apr 8 01:04:54 warble1 stonith-ng[17360]: notice: Caught 'Terminated' signal Apr 8 01:04:54 warble2 attrd[17641]: notice: Node warble1-host.oob state is now lost Apr 8 01:04:54 warble2 attrd[17641]: notice: Removing all warble1-host.oob attributes for peer loss Apr 8 01:04:54 warble2 attrd[17641]: notice: Lost attribute writer warble1-host.oob Apr 8 01:04:54 warble2 attrd[17641]: notice: Purged 1 peers with id=1 and/or uname=warble1-host.oob from the membership cache Apr 8 01:04:54 warble1 pacemakerd[17358]: notice: Stopping cib Apr 8 01:04:54 warble1 cib[17359]: notice: Caught 'Terminated' signal Apr 8 01:04:54 warble1 cib[17359]: notice: Disconnected from Corosync Apr 8 01:04:54 warble1 cib[17359]: notice: Disconnected from Corosync Apr 8 01:04:54 warble2 stonith-ng[17639]: notice: Node warble1-host.oob state is now lost Apr 8 01:04:54 warble2 stonith-ng[17639]: notice: Purged 1 peers with id=1 and/or uname=warble1-host.oob from the membership cache Apr 8 01:04:54 warble2 cib[17638]: notice: Node warble1-host.oob state is now lost Apr 8 01:04:54 warble2 cib[17638]: notice: Purged 1 peers with id=1 and/or uname=warble1-host.oob from the membership cache Apr 8 01:04:54 warble1 pacemakerd[17358]: notice: Shutdown complete Apr 8 01:04:54 warble1 systemd: Stopped Pacemaker High Availability Cluster Manager. Apr 8 01:04:54 warble1 systemd: Stopping Corosync Cluster Engine... Apr 8 01:04:54 warble2 crmd[17643]: warning: Input I_ELECTION_DC received in state S_INTEGRATION from do_election_check Apr 8 01:04:54 warble1 corosync[17345]: [MAIN ] Node was shut down by a signal Apr 8 01:04:54 warble1 corosync: Signaling Corosync Cluster Engine (corosync) to terminate: [ OK ] Apr 8 01:04:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 01:04:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 01:04:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 01:04:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 01:04:54 warble2 pengine[17642]: notice: Calculated transition 0, saving inputs in /var/lib/pacemaker/pengine/pe-input-0.bz2 Apr 8 01:04:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 01:04:54 warble2 crmd[17643]: notice: Transition 0 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-0.bz2): Complete Apr 8 01:04:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 01:04:54 warble1 corosync[17345]: [SERV ] Unloading all Corosync service engines. Apr 8 01:04:54 warble1 corosync[17345]: [QB ] withdrawing server sockets Apr 8 01:04:54 warble1 corosync[17345]: [SERV ] Service engine unloaded: corosync vote quorum service v1.0 Apr 8 01:04:54 warble1 corosync[17345]: [QB ] withdrawing server sockets Apr 8 01:04:54 warble1 corosync[17345]: [SERV ] Service engine unloaded: corosync configuration map access Apr 8 01:04:54 warble1 corosync[17345]: [QB ] withdrawing server sockets Apr 8 01:04:54 warble1 corosync[17345]: [SERV ] Service engine unloaded: corosync configuration service Apr 8 01:04:54 warble1 corosync[17345]: [QB ] withdrawing server sockets Apr 8 01:04:54 warble2 corosync[17625]: [TOTEM ] A new membership (10.7.2.232:24) was formed. Members left: 1 Apr 8 01:04:54 warble2 corosync[17625]: [QUORUM] Members[1]: 2 Apr 8 01:04:54 warble2 corosync[17625]: [MAIN ] Completed service synchronization, ready to provide service. Apr 8 01:04:54 warble2 crmd[17643]: notice: Node warble1-host.oob state is now lost Apr 8 01:04:54 warble2 pacemakerd[17637]: notice: Node warble1-host.oob state is now lost Apr 8 01:04:54 warble2 crmd[17643]: warning: No reason to expect node 1 to be down Apr 8 01:04:54 warble2 crmd[17643]: notice: Stonith/shutdown of warble1-host.oob not matched Apr 8 01:04:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 01:04:54 warble1 corosync[17345]: [SERV ] Service engine unloaded: corosync cluster closed process group service v1.01 Apr 8 01:04:54 warble1 corosync[17345]: [QB ] withdrawing server sockets Apr 8 01:04:54 warble1 corosync[17345]: [SERV ] Service engine unloaded: corosync cluster quorum service v0.1 Apr 8 01:04:54 warble1 corosync[17345]: [SERV ] Service engine unloaded: corosync profile loading service Apr 8 01:04:54 warble1 corosync[17345]: [MAIN ] Corosync Cluster Engine exiting normally Apr 8 01:04:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 01:04:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 01:04:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 01:04:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 01:04:54 warble2 pengine[17642]: notice: Calculated transition 1, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 01:04:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 01:04:54 warble2 crmd[17643]: notice: Transition 1 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 01:04:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 01:04:55 warble1 corosync: Waiting for corosync services to unload:.[ OK ] Apr 8 01:04:55 warble1 systemd: Stopped Corosync Cluster Engine. Apr 8 01:05:33 warble1 zed: eid=1 class=history_event pool_guid=0xC0BDFB4695D313E6 Apr 8 01:05:33 warble1 zed: eid=2 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 8 01:05:33 warble1 zed: eid=3 class=pool_import pool_guid=0xC0BDFB4695D313E6 Apr 8 01:05:33 warble1 zed: eid=4 class=history_event pool_guid=0xC0BDFB4695D313E6 Apr 8 01:05:33 warble1 zed: eid=5 class=config_sync pool_guid=0xC0BDFB4695D313E6 Apr 8 01:05:39 warble1 zed: eid=6 class=history_event pool_guid=0xFC863664CC04C875 Apr 8 01:05:39 warble1 zed: eid=7 class=config_sync pool_guid=0xFC863664CC04C875 Apr 8 01:05:39 warble1 zed: eid=8 class=pool_import pool_guid=0xFC863664CC04C875 Apr 8 01:05:40 warble1 zed: eid=9 class=history_event pool_guid=0xFC863664CC04C875 Apr 8 01:05:40 warble1 zed: eid=10 class=config_sync pool_guid=0xFC863664CC04C875 Apr 8 01:05:44 warble1 zed: eid=11 class=history_event pool_guid=0xE146DD6489A1819A Apr 8 01:05:44 warble1 zed: eid=12 class=config_sync pool_guid=0xE146DD6489A1819A Apr 8 01:05:44 warble1 zed: eid=13 class=pool_import pool_guid=0xE146DD6489A1819A Apr 8 01:05:44 warble1 zed: eid=14 class=history_event pool_guid=0xE146DD6489A1819A Apr 8 01:05:44 warble1 zed: eid=15 class=config_sync pool_guid=0xE146DD6489A1819A Apr 8 01:05:48 warble1 zed: eid=16 class=history_event pool_guid=0x13C167322AB5F5E9 Apr 8 01:05:48 warble1 zed: eid=17 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 8 01:05:48 warble1 zed: eid=18 class=pool_import pool_guid=0x13C167322AB5F5E9 Apr 8 01:05:48 warble1 zed: eid=19 class=history_event pool_guid=0x13C167322AB5F5E9 Apr 8 01:05:48 warble1 zed: eid=20 class=config_sync pool_guid=0x13C167322AB5F5E9 Apr 8 01:05:53 warble1 zed: eid=21 class=history_event pool_guid=0x5ED256D9C36340D3 Apr 8 01:05:53 warble1 zed: eid=22 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 8 01:05:53 warble1 zed: eid=23 class=pool_import pool_guid=0x5ED256D9C36340D3 Apr 8 01:05:53 warble1 zed: eid=24 class=history_event pool_guid=0x5ED256D9C36340D3 Apr 8 01:05:53 warble1 zed: eid=25 class=config_sync pool_guid=0x5ED256D9C36340D3 Apr 8 01:05:58 warble1 zed: eid=26 class=history_event pool_guid=0x979BA0B2D95A8C68 Apr 8 01:05:58 warble1 zed: eid=27 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 8 01:05:58 warble1 zed: eid=28 class=pool_import pool_guid=0x979BA0B2D95A8C68 Apr 8 01:05:58 warble1 zed: eid=29 class=history_event pool_guid=0x979BA0B2D95A8C68 Apr 8 01:05:58 warble1 zed: eid=30 class=config_sync pool_guid=0x979BA0B2D95A8C68 Apr 8 01:06:03 warble1 zed: eid=31 class=history_event pool_guid=0xCF79F68EBE891CC3 Apr 8 01:06:03 warble1 zed: eid=32 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 8 01:06:03 warble1 zed: eid=33 class=pool_import pool_guid=0xCF79F68EBE891CC3 Apr 8 01:06:03 warble1 zed: eid=34 class=history_event pool_guid=0xCF79F68EBE891CC3 Apr 8 01:06:03 warble1 zed: eid=35 class=config_sync pool_guid=0xCF79F68EBE891CC3 Apr 8 01:07:13 warble2 systemd: Starting Cleanup of Temporary Directories... Apr 8 01:07:13 warble2 systemd: Started Cleanup of Temporary Directories. Apr 8 01:07:37 warble1 kernel: LNet: HW NUMA nodes: 2, HW CPU cores: 16, npartitions: 2 Apr 8 01:07:37 warble1 kernel: alg: No test for adler32 (adler32-zlib) Apr 8 01:07:37 warble1 kernel: alg: No test for crc32 (crc32-table) Apr 8 01:07:38 warble1 kernel: Lustre: Lustre: Build Version: 2.10.3 Apr 8 01:07:38 warble1 kernel: LNet: Using FMR for registration Apr 8 01:07:38 warble1 kernel: LNetError: 100:0:(o2iblnd_cb.c:2299:kiblnd_passive_connect()) Can't accept conn from 192.168.44.113@o2ib44 on NA (ib0:0:192.168.44.21): bad dst nid 192.168.44.21@o2ib44 Apr 8 01:07:38 warble1 kernel: LNet: Added LNI 192.168.44.21@o2ib44 [128/2048/0/180] Apr 8 01:07:38 warble1 kernel: Lustre: MGS: Connection restored to 8927becc-b287-05e2-800d-31183befbe50 (at 0@lo) Apr 8 01:07:38 warble1 kernel: Lustre: Skipped 1 previous similar message Apr 8 01:07:39 warble1 kernel: Lustre: MGS: Connection restored to a096be74-4ad4-83bf-0b97-f207ff27b53e (at 192.168.44.167@o2ib44) Apr 8 01:07:39 warble1 kernel: Lustre: Skipped 17 previous similar messages Apr 8 01:07:40 warble1 kernel: Lustre: MGS: Connection restored to 248acce4-8bfa-cd17-8176-88c3ffc5b89a (at 192.168.44.184@o2ib44) Apr 8 01:07:40 warble1 kernel: Lustre: Skipped 18 previous similar messages Apr 8 01:07:42 warble1 kernel: Lustre: MGS: Connection restored to 5fc2d0fc-5d2a-31a4-98f4-a4f1dbff6956 (at 192.168.44.136@o2ib44) Apr 8 01:07:42 warble1 kernel: Lustre: Skipped 10 previous similar messages Apr 8 01:07:47 warble1 kernel: Lustre: MGS: Connection restored to 6b7d8f40-9886-d045-8100-3e702c056d11 (at 192.168.44.14@o2ib44) Apr 8 01:07:47 warble1 kernel: Lustre: Skipped 7 previous similar messages Apr 8 01:07:55 warble1 kernel: Lustre: MGS: Connection restored to 68bc0e4c-56a5-d64a-f5ab-3eb1695bc5a6 (at 192.168.44.217@o2ib44) Apr 8 01:07:55 warble1 kernel: Lustre: Skipped 9 previous similar messages Apr 8 01:07:59 warble1 kernel: Lustre: images-MDT0000: Not available for connect from 192.168.44.169@o2ib44 (not set up) Apr 8 01:07:59 warble1 kernel: LustreError: 137-5: dagg-MDT0001_UUID: not available for connect from 192.168.44.169@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 01:07:59 warble1 kernel: Lustre: images-MDT0000: Imperative Recovery not enabled, recovery window 300-900 Apr 8 01:07:59 warble1 kernel: LustreError: 11-0: images-OST0000-osc-MDT0000: operation ost_connect to node 192.168.44.51@o2ib44 failed: rc = -16 Apr 8 01:08:00 warble1 kernel: LustreError: 137-5: home-MDT0000_UUID: not available for connect from 192.168.44.122@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 01:08:00 warble1 kernel: LustreError: Skipped 8 previous similar messages Apr 8 01:08:00 warble1 kernel: Lustre: images-MDT0000: Will be in recovery for at least 5:00, or until 121 clients reconnect Apr 8 01:08:01 warble1 kernel: LustreError: 137-5: apps-MDT0000_UUID: not available for connect from 192.168.44.119@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 01:08:01 warble1 kernel: LustreError: Skipped 7 previous similar messages Apr 8 01:08:03 warble1 kernel: LustreError: 137-5: apps-MDT0000_UUID: not available for connect from 192.168.44.205@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 01:08:03 warble1 kernel: LustreError: Skipped 37 previous similar messages Apr 8 01:08:04 warble1 kernel: Lustre: 23085:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523113679/real 1523113679] req@ffff88bd8e2e0300 x1597100427054064/t0(0) o8->images-OST0001-osc-MDT0000@192.168.44.52@o2ib44:28/4 lens 520/544 e 0 to 1 dl 1523113684 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 01:08:04 warble1 kernel: LustreError: 11-0: images-OST0001-osc-MDT0000: operation ost_connect to node 192.168.44.51@o2ib44 failed: rc = -16 Apr 8 01:08:04 warble1 kernel: LustreError: Skipped 1 previous similar message Apr 8 01:08:07 warble1 kernel: LustreError: 137-5: apps-MDT0000_UUID: not available for connect from 192.168.44.128@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 01:08:07 warble1 kernel: LustreError: Skipped 59 previous similar messages Apr 8 01:08:11 warble1 kernel: Lustre: images-MDT0000: Connection restored to 05ed89e0-71c0-4e87-f22b-81816a462064 (at 192.168.44.197@o2ib44) Apr 8 01:08:11 warble1 kernel: Lustre: Skipped 76 previous similar messages Apr 8 01:08:15 warble1 kernel: LustreError: 137-5: dagg-MDT0002_UUID: not available for connect from 192.168.44.183@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 01:08:15 warble1 kernel: LustreError: Skipped 82 previous similar messages Apr 8 01:08:23 warble1 kernel: Lustre: apps-MDT0000: Imperative Recovery not enabled, recovery window 300-900 Apr 8 01:08:23 warble1 kernel: LustreError: 11-0: apps-OST0000-osc-MDT0000: operation ost_connect to node 192.168.44.51@o2ib44 failed: rc = -16 Apr 8 01:08:23 warble1 kernel: Lustre: apps-MDT0000: Will be in recovery for at least 5:00, or until 121 clients reconnect Apr 8 01:08:28 warble1 kernel: Lustre: 23085:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523113703/real 1523113703] req@ffff885eb3ae0c00 x1597100427054624/t0(0) o8->apps-OST0001-osc-MDT0000@192.168.44.52@o2ib44:28/4 lens 520/544 e 0 to 1 dl 1523113708 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 01:08:28 warble1 kernel: LustreError: 11-0: apps-OST0001-osc-MDT0000: operation ost_connect to node 192.168.44.51@o2ib44 failed: rc = -16 Apr 8 01:08:28 warble1 kernel: LustreError: Skipped 1 previous similar message Apr 8 01:08:28 warble1 systemd: Starting Cleanup of Temporary Directories... Apr 8 01:08:28 warble1 systemd: Started Cleanup of Temporary Directories. Apr 8 01:08:31 warble1 kernel: LustreError: 137-5: dagg-MDT0000_UUID: not available for connect from 192.168.44.220@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 01:08:31 warble1 kernel: LustreError: Skipped 57 previous similar messages Apr 8 01:08:40 warble1 kernel: LustreError: 11-0: images-OST0001-osc-MDT0000: operation ost_connect to node 192.168.44.51@o2ib44 failed: rc = -16 Apr 8 01:08:40 warble1 kernel: LustreError: Skipped 1 previous similar message Apr 8 01:08:40 warble1 kernel: Lustre: home-MDT0000: Imperative Recovery not enabled, recovery window 300-900 Apr 8 01:08:40 warble1 kernel: Lustre: home-MDT0000: Will be in recovery for at least 5:00, or until 121 clients reconnect Apr 8 01:08:44 warble1 kernel: Lustre: apps-MDT0000: Connection restored to 7f452276-4d8a-7a81-e845-d2bb889f7504 (at 192.168.44.189@o2ib44) Apr 8 01:08:44 warble1 kernel: Lustre: Skipped 177 previous similar messages Apr 8 01:08:45 warble1 kernel: Lustre: 23085:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1523113720/real 1523113720] req@ffff885e737ea400 x1597100427056672/t0(0) o8->home-OST0001-osc-MDT0000@192.168.44.52@o2ib44:28/4 lens 520/544 e 0 to 1 dl 1523113725 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 01:09:03 warble1 kernel: LustreError: 137-5: dagg-MDT0000_UUID: not available for connect from 192.168.44.33@o2ib44 (no target). If you are running an HA pair check that the target is mounted on the other server. Apr 8 01:09:03 warble1 kernel: LustreError: Skipped 107 previous similar messages Apr 8 01:09:06 warble1 kernel: LustreError: 11-0: home-OST0000-osc-MDT0000: operation ost_connect to node 192.168.44.51@o2ib44 failed: rc = -16 Apr 8 01:09:06 warble1 kernel: LustreError: Skipped 2 previous similar messages Apr 8 01:09:06 warble1 kernel: Lustre: dagg-MDT0000: Imperative Recovery not enabled, recovery window 300-900 Apr 8 01:09:06 warble1 kernel: Lustre: dagg-MDT0000: Will be in recovery for at least 5:00, or until 122 clients reconnect Apr 8 01:09:11 warble1 kernel: Lustre: 23085:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1523113746/real 0] req@ffff88bd85764b00 x1597100427061648/t0(0) o38->dagg-MDT0000-lwp-MDT0000@192.168.44.22@o2ib44:12/10 lens 520/544 e 0 to 1 dl 1523113751 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 01:09:18 warble1 kernel: Lustre: apps-MDT0000: Recovery over after 0:55, of 121 clients 121 recovered and 0 were evicted. Apr 8 01:09:23 warble1 kernel: LustreError: 11-0: dagg-OST0000-osc-MDT0001: operation ost_connect to node 192.168.44.31@o2ib44 failed: rc = -16 Apr 8 01:09:23 warble1 kernel: LustreError: Skipped 8 previous similar messages Apr 8 01:09:23 warble1 kernel: Lustre: dagg-MDT0001: Imperative Recovery not enabled, recovery window 300-900 Apr 8 01:09:23 warble1 kernel: Lustre: dagg-MDT0001: Will be in recovery for at least 5:00, or until 124 clients reconnect Apr 8 01:09:28 warble1 kernel: Lustre: 23085:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1523113763/real 0] req@ffff885e7119e600 x1597100427063008/t0(0) o38->dagg-MDT0000-lwp-MDT0001@192.168.44.22@o2ib44:12/10 lens 520/544 e 0 to 1 dl 1523113768 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 01:09:28 warble1 kernel: Lustre: 23085:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Apr 8 01:09:31 warble1 kernel: Lustre: dagg-MDT0002: Imperative Recovery not enabled, recovery window 300-900 Apr 8 01:09:36 warble1 ntpd[14369]: 0.0.0.0 0612 02 freq_set kernel 54.013 PPM Apr 8 01:09:36 warble1 ntpd[14369]: 0.0.0.0 0615 05 clock_sync Apr 8 01:09:40 warble1 kernel: Lustre: images-MDT0000: Recovery over after 1:40, of 121 clients 121 recovered and 0 were evicted. Apr 8 01:09:42 warble1 kernel: Lustre: 23085:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1523113776/real 0] req@ffff885e6d5df200 x1597100427067920/t0(0) o38->dagg-MDT0001-osp-MDT0000@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523113782 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 01:09:42 warble1 kernel: Lustre: 23085:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages Apr 8 01:09:43 warble1 kernel: Lustre: home-MDT0000: Recovery over after 1:03, of 121 clients 121 recovered and 0 were evicted. Apr 8 01:09:48 warble1 kernel: Lustre: dagg-MDT0002: Connection restored to 1e781308-11cb-2c33-9d63-4794a7af99f2 (at 192.168.44.180@o2ib44) Apr 8 01:09:48 warble1 kernel: Lustre: Skipped 514 previous similar messages Apr 8 01:10:01 warble1 kernel: LustreError: 11-0: dagg-OST0003-osc-MDT0001: operation ost_connect to node 192.168.44.31@o2ib44 failed: rc = -16 Apr 8 01:10:01 warble1 kernel: LustreError: Skipped 13 previous similar messages Apr 8 01:10:04 warble1 kernel: LNet: 23073:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.44.22@o2ib44: 8 seconds Apr 8 01:10:07 warble1 kernel: Lustre: 23085:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1523113801/real 0] req@ffff88bd81d0bc00 x1597100427070368/t0(0) o38->dagg-MDT0001-osp-MDT0002@192.168.44.22@o2ib44:24/4 lens 520/544 e 0 to 1 dl 1523113807 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Apr 8 01:10:07 warble1 kernel: Lustre: 23085:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message Apr 8 01:10:17 warble1 kernel: LNet: 23073:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.44.22@o2ib44: 4 seconds Apr 8 01:10:24 warble2 ntpd[14484]: 0.0.0.0 0612 02 freq_set kernel 64.311 PPM Apr 8 01:10:24 warble2 ntpd[14484]: 0.0.0.0 0615 05 clock_sync Apr 8 01:10:30 warble1 kernel: LNet: 23073:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Timed out tx for 192.168.44.22@o2ib44: 9 seconds Apr 8 01:10:30 warble1 kernel: LNet: 23073:0:(o2iblnd_cb.c:3192:kiblnd_check_conns()) Skipped 1 previous similar message Apr 8 01:10:51 warble1 kernel: Lustre: dagg-MDT0000: Recovery over after 1:45, of 123 clients 123 recovered and 0 were evicted. Apr 8 01:15:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:15:31 warble1 kernel: Lustre: 31538:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:15:31 warble1 kernel: Lustre: 31538:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages Apr 8 01:16:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:16:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages Apr 8 01:16:31 warble1 kernel: Lustre: 31538:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:16:31 warble1 kernel: Lustre: 31538:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages Apr 8 01:17:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:17:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages Apr 8 01:17:31 warble1 kernel: Lustre: 31538:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:17:31 warble1 kernel: Lustre: 31538:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages Apr 8 01:18:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:18:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 2 previous similar messages Apr 8 01:19:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:19:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 5 previous similar messages Apr 8 01:19:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 01:19:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 01:19:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 01:19:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 01:19:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 01:19:54 warble2 pengine[17642]: notice: Calculated transition 2, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 01:19:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 01:19:54 warble2 crmd[17643]: notice: Transition 2 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 01:19:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 01:20:31 warble1 kernel: Lustre: 31538:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0002: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:20:31 warble1 kernel: Lustre: 31538:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 8 previous similar messages Apr 8 01:21:20 warble2 ntpd[14484]: 0.0.0.0 0618 08 no_sys_peer Apr 8 01:23:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:23:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 14 previous similar messages Apr 8 01:28:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:28:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 31 previous similar messages Apr 8 01:34:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 01:34:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 01:34:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 01:34:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 01:34:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 01:34:54 warble2 pengine[17642]: notice: Calculated transition 3, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 01:34:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 01:34:54 warble2 crmd[17643]: notice: Transition 3 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 01:34:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 01:37:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:37:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 53 previous similar messages Apr 8 01:47:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:47:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 01:49:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 01:49:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 01:49:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 01:49:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 01:49:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 01:49:54 warble2 pengine[17642]: notice: Calculated transition 4, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 01:49:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 01:49:54 warble2 crmd[17643]: notice: Transition 4 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 01:49:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 01:57:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 01:57:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 02:04:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 02:04:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 02:04:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 02:04:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 02:04:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 02:04:54 warble2 pengine[17642]: notice: Calculated transition 5, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 02:04:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 02:04:54 warble2 crmd[17643]: notice: Transition 5 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 02:04:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 02:07:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 02:07:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 02:17:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 02:17:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 02:19:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 02:19:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 02:19:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 02:19:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 02:19:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 02:19:54 warble2 pengine[17642]: notice: Calculated transition 6, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 02:19:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 02:19:54 warble2 crmd[17643]: notice: Transition 6 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 02:19:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 02:27:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 02:27:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 02:34:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 02:34:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 02:34:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 02:34:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 02:34:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 02:34:54 warble2 pengine[17642]: notice: Calculated transition 7, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 02:34:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 02:34:54 warble2 crmd[17643]: notice: Transition 7 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 02:34:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 02:37:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 02:37:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 02:47:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 02:47:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 02:49:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 02:49:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 02:49:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 02:49:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 02:49:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 02:49:54 warble2 pengine[17642]: notice: Calculated transition 8, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 02:49:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 02:49:54 warble2 crmd[17643]: notice: Transition 8 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 02:49:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 02:57:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 02:57:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 03:04:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 03:04:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 03:04:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 03:04:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 03:04:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 03:04:54 warble2 pengine[17642]: notice: Calculated transition 9, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 03:04:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 03:04:54 warble2 crmd[17643]: notice: Transition 9 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 03:04:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 03:07:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 03:07:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 03:17:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 03:17:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 03:19:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 03:19:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 03:19:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 03:19:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 03:19:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 03:19:54 warble2 pengine[17642]: notice: Calculated transition 10, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 03:19:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 03:19:54 warble2 crmd[17643]: notice: Transition 10 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 03:19:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 03:27:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 03:27:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages Apr 8 03:34:54 warble2 crmd[17643]: notice: State transition S_IDLE -> S_POLICY_ENGINE Apr 8 03:34:54 warble2 pengine[17642]: error: Resource start-up disabled since no STONITH resources have been defined Apr 8 03:34:54 warble2 pengine[17642]: error: Either configure some or disable STONITH with the stonith-enabled option Apr 8 03:34:54 warble2 pengine[17642]: error: NOTE: Clusters with shared data need STONITH to ensure data integrity Apr 8 03:34:54 warble2 pengine[17642]: notice: Delaying fencing operations until there are resources to manage Apr 8 03:34:54 warble2 pengine[17642]: notice: Calculated transition 11, saving inputs in /var/lib/pacemaker/pengine/pe-input-1.bz2 Apr 8 03:34:54 warble2 pengine[17642]: notice: Configuration ERRORs found during PE processing. Please run "crm_verify -L" to identify issues. Apr 8 03:34:54 warble2 crmd[17643]: notice: Transition 11 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1.bz2): Complete Apr 8 03:34:54 warble2 crmd[17643]: notice: State transition S_TRANSITION_ENGINE -> S_IDLE Apr 8 03:37:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) dagg-MDT0001: extended recovery timer reaching hard limit: 900, extend: 1 Apr 8 03:37:23 warble1 kernel: Lustre: 29650:0:(ldlm_lib.c:1773:extend_recovery_timer()) Skipped 59 previous similar messages