<ConMan> Console [lola-10] log opened at 2016-10-16 03:27:03 UTC.
Oct 16 00:20:01 lola-10 TIME: Time stamp for console
Oct 16 00:25:01 lola-10 TIME: Time stamp for console
Oct 16 00:30:01 lola-10 TIME: Time stamp for console
Oct 16 00:35:01 lola-10 TIME: Time stamp for console
Oct 16 00:40:01 lola-10 TIME: Time stamp for console
Oct 16 00:45:01 lola-10 TIME: Time stamp for console
Oct 16 00:50:01 lola-10 TIME: Time stamp for console
Oct 16 00:55:01 lola-10 TIME: Time stamp for console
Oct 16 01:00:01 lola-10 TIME: Time stamp for console
Oct 16 01:05:01 lola-10 TIME: Time stamp for console
Oct 16 01:10:01 lola-10 TIME: Time stamp for console
Oct 16 01:15:01 lola-10 TIME: Time stamp for console
Oct 16 01:20:01 lola-10 TIME: Time stamp for console
Oct 16 01:25:01 lola-10 TIME: Time stamp for console
Oct 16 01:30:01 lola-10 TIME: Time stamp for console
Oct 16 01:35:01 lola-10 TIME: Time stamp for console
Oct 16 01:40:01 lola-10 TIME: Time stamp for console
Oct 16 01:45:01 lola-10 TIME: Time stamp for console
Oct 16 01:50:01 lola-10 TIME: Time stamp for console
Oct 16 01:55:01 lola-10 TIME: Time stamp for console
Oct 16 02:00:01 lola-10 TIME: Time stamp for console
Oct 16 02:05:01 lola-10 TIME: Time stamp for console
Oct 16 02:10:01 lola-10 TIME: Time stamp for console
Oct 16 02:15:01 lola-10 TIME: Time stamp for console
Oct 16 02:20:02 lola-10 TIME: Time stamp for console
Oct 16 02:25:01 lola-10 TIME: Time stamp for console
Oct 16 02:30:01 lola-10 TIME: Time stamp for console
Oct 16 02:35:01 lola-10 TIME: Time stamp for console
Oct 16 02:40:01 lola-10 TIME: Time stamp for console
Oct 16 02:45:01 lola-10 TIME: Time stamp for console
Oct 16 02:50:01 lola-10 TIME: Time stamp for console
Oct 16 02:55:01 lola-10 TIME: Time stamp for console
Oct 16 03:00:01 lola-10 TIME: Time stamp for console
Oct 16 03:05:01 lola-10 TIME: Time stamp for console
Oct 16 03:10:01 lola-10 TIME: Time stamp for console
Oct 16 03:15:01 lola-10 TIME: Time stamp for console
Oct 16 03:20:01 lola-10 TIME: Time stamp for console
Oct 16 03:25:01 lola-10 TIME: Time stamp for console
Oct 16 03:30:01 lola-10 TIME: Time stamp for console
Oct 16 03:35:01 lola-10 TIME: Time stamp for console
Oct 16 03:40:01 lola-10 TIME: Time stamp for console
Oct 16 03:45:01 lola-10 TIME: Time stamp for console
Oct 16 03:50:01 lola-10 TIME: Time stamp for console
Oct 16 03:55:01 lola-10 TIME: Time stamp for console
Oct 16 04:00:01 lola-10 TIME: Time stamp for console
Oct 16 04:05:01 lola-10 TIME: Time stamp for console
Oct 16 04:10:01 lola-10 TIME: Time stamp for console
Oct 16 04:15:01 lola-10 TIME: Time stamp for console
Oct 16 04:20:01 lola-10 TIME: Time stamp for console
Oct 16 04:25:01 lola-10 TIME: Time stamp for console
Oct 16 04:30:01 lola-10 TIME: Time stamp for console
Oct 16 04:35:01 lola-10 TIME: Time stamp for console
Oct 16 04:40:01 lola-10 TIME: Time stamp for console
Oct 16 04:45:01 lola-10 TIME: Time stamp for console
Oct 16 04:50:01 lola-10 TIME: Time stamp for console
Oct 16 04:55:01 lola-10 TIME: Time stamp for console
Oct 16 05:00:01 lola-10 TIME: Time stamp for console
Oct 16 05:05:01 lola-10 TIME: Time stamp for console
Oct 16 05:10:01 lola-10 TIME: Time stamp for console
Oct 16 05:15:01 lola-10 TIME: Time stamp for console
Oct 16 05:20:01 lola-10 TIME: Time stamp for console
Oct 16 05:25:01 lola-10 TIME: Time stamp for console
Oct 16 05:30:01 lola-10 TIME: Time stamp for console
Oct 16 05:35:01 lola-10 TIME: Time stamp for console
Oct 16 05:40:01 lola-10 TIME: Time stamp for console
Oct 16 05:45:01 lola-10 TIME: Time stamp for console
Oct 16 05:50:01 lola-10 TIME: Time stamp for console
Oct 16 05:55:01 lola-10 TIME: Time stamp for console
Oct 16 06:00:01 lola-10 TIME: Time stamp for console
Oct 16 06:05:01 lola-10 TIME: Time stamp for console
Oct 16 06:10:01 lola-10 TIME: Time stamp for console
Oct 16 06:15:01 lola-10 TIME: Time stamp for console
Oct 16 06:20:01 lola-10 TIME: Time stamp for console
Oct 16 06:25:01 lola-10 TIME: Time stamp for console
Oct 16 06:30:01 lola-10 TIME: Time stamp for console
Oct 16 06:35:01 lola-10 TIME: Time stamp for console
Oct 16 06:40:01 lola-10 TIME: Time stamp for console
Oct 16 06:45:01 lola-10 TIME: Time stamp for console
Oct 16 06:50:01 lola-10 TIME: Time stamp for console
Oct 16 06:55:01 lola-10 TIME: Time stamp for console
Oct 16 07:00:01 lola-10 TIME: Time stamp for console
Oct 16 07:05:01 lola-10 TIME: Time stamp for console
Oct 16 07:10:01 lola-10 TIME: Time stamp for console
Oct 16 07:15:01 lola-10 TIME: Time stamp for console
Oct 16 07:20:01 lola-10 TIME: Time stamp for console
Oct 16 07:25:01 lola-10 TIME: Time stamp for console
Oct 16 07:30:01 lola-10 TIME: Time stamp for console
Oct 16 07:35:01 lola-10 TIME: Time stamp for console
Oct 16 07:40:01 lola-10 TIME: Time stamp for console
Oct 16 07:45:01 lola-10 TIME: Time stamp for console
Oct 16 07:50:01 lola-10 TIME: Time stamp for console
Oct 16 07:55:01 lola-10 TIME: Time stamp for console
Oct 16 08:00:01 lola-10 TIME: Time stamp for console
Oct 16 08:05:01 lola-10 TIME: Time stamp for console
Oct 16 08:10:01 lola-10 TIME: Time stamp for console
Oct 16 08:15:01 lola-10 TIME: Time stamp for console
Oct 16 08:20:01 lola-10 TIME: Time stamp for console
Oct 16 08:25:01 lola-10 TIME: Time stamp for console
Oct 16 08:30:01 lola-10 TIME: Time stamp for console
Oct 16 08:35:01 lola-10 TIME: Time stamp for console
Oct 16 08:40:01 lola-10 TIME: Time stamp for console
Oct 16 08:45:01 lola-10 TIME: Time stamp for console
Oct 16 08:50:01 lola-10 TIME: Time stamp for console
Oct 16 08:55:01 lola-10 TIME: Time stamp for console
Oct 16 09:00:01 lola-10 TIME: Time stamp for console
Oct 16 09:05:01 lola-10 TIME: Time stamp for console
Oct 16 09:10:01 lola-10 TIME: Time stamp for console
Oct 16 09:15:01 lola-10 TIME: Time stamp for console
Oct 16 09:20:01 lola-10 TIME: Time stamp for console
Oct 16 09:25:01 lola-10 TIME: Time stamp for console
Oct 16 09:30:01 lola-10 TIME: Time stamp for console
Oct 16 09:35:01 lola-10 TIME: Time stamp for console
Oct 16 09:40:01 lola-10 TIME: Time stamp for console
Oct 16 09:45:01 lola-10 TIME: Time stamp for console
Oct 16 09:50:01 lola-10 TIME: Time stamp for console
Oct 16 09:55:01 lola-10 TIME: Time stamp for console
Oct 16 10:00:01 lola-10 TIME: Time stamp for console
Oct 16 10:05:01 lola-10 TIME: Time stamp for console
Oct 16 10:10:01 lola-10 TIME: Time stamp for console
Oct 16 10:15:01 lola-10 TIME: Time stamp for console
Oct 16 10:20:01 lola-10 TIME: Time stamp for console
Oct 16 10:25:01 lola-10 TIME: Time stamp for console
Oct 16 10:30:01 lola-10 TIME: Time stamp for console
Oct 16 10:35:01 lola-10 TIME: Time stamp for console
Oct 16 10:40:01 lola-10 TIME: Time stamp for console
Oct 16 10:45:01 lola-10 TIME: Time stamp for console
Oct 16 10:50:01 lola-10 TIME: Time stamp for console
Oct 16 10:55:01 lola-10 TIME: Time stamp for console
Oct 16 11:00:01 lola-10 TIME: Time stamp for console
Oct 16 11:05:01 lola-10 TIME: Time stamp for console
Oct 16 11:10:01 lola-10 TIME: Time stamp for console
Oct 16 11:15:01 lola-10 TIME: Time stamp for console
Oct 16 11:20:01 lola-10 TIME: Time stamp for console
Oct 16 11:25:01 lola-10 TIME: Time stamp for console
Oct 16 11:30:01 lola-10 TIME: Time stamp for console
Oct 16 11:35:01 lola-10 TIME: Time stamp for console
Oct 16 11:40:01 lola-10 TIME: Time stamp for console
Oct 16 11:45:02 lola-10 TIME: Time stamp for console
Oct 16 11:50:01 lola-10 TIME: Time stamp for console
Oct 16 11:55:01 lola-10 TIME: Time stamp for console
Oct 16 12:00:01 lola-10 TIME: Time stamp for console
Oct 16 12:05:01 lola-10 TIME: Time stamp for console
Oct 16 12:10:01 lola-10 TIME: Time stamp for console
Oct 16 12:15:01 lola-10 TIME: Time stamp for console
Oct 16 12:20:01 lola-10 TIME: Time stamp for console
Oct 16 12:25:01 lola-10 TIME: Time stamp for console
Oct 16 12:30:01 lola-10 TIME: Time stamp for console
Oct 16 12:35:01 lola-10 TIME: Time stamp for console
Oct 16 12:40:01 lola-10 TIME: Time stamp for console
Oct 16 12:45:01 lola-10 TIME: Time stamp for console
Oct 16 12:50:01 lola-10 TIME: Time stamp for console
Oct 16 12:55:01 lola-10 TIME: Time stamp for console
Oct 16 13:00:01 lola-10 TIME: Time stamp for console
Oct 16 13:05:01 lola-10 TIME: Time stamp for console
Oct 16 13:10:01 lola-10 TIME: Time stamp for console
Oct 16 13:15:01 lola-10 TIME: Time stamp for console
Oct 16 13:20:01 lola-10 TIME: Time stamp for console
Oct 16 13:25:01 lola-10 TIME: Time stamp for console
Oct 16 13:30:01 lola-10 TIME: Time stamp for console
Oct 16 13:35:01 lola-10 TIME: Time stamp for console
Oct 16 13:40:01 lola-10 TIME: Time stamp for console
Oct 16 13:45:01 lola-10 TIME: Time stamp for console
Oct 16 13:50:01 lola-10 TIME: Time stamp for console
Oct 16 13:55:01 lola-10 TIME: Time stamp for console
Oct 16 14:00:01 lola-10 TIME: Time stamp for console
Oct 16 14:05:01 lola-10 TIME: Time stamp for console
Oct 16 14:10:01 lola-10 TIME: Time stamp for console
Oct 16 14:15:01 lola-10 TIME: Time stamp for console
Oct 16 14:20:01 lola-10 TIME: Time stamp for console
Oct 16 14:25:01 lola-10 TIME: Time stamp for console
Oct 16 14:30:01 lola-10 TIME: Time stamp for console
Oct 16 14:35:01 lola-10 TIME: Time stamp for console
Oct 16 14:40:01 lola-10 TIME: Time stamp for console
Oct 16 14:45:01 lola-10 TIME: Time stamp for console
Oct 16 14:50:01 lola-10 TIME: Time stamp for console
Oct 16 14:55:01 lola-10 TIME: Time stamp for console
Oct 16 15:00:01 lola-10 TIME: Time stamp for console
Oct 16 15:05:01 lola-10 TIME: Time stamp for console
Oct 16 15:10:01 lola-10 TIME: Time stamp for console
Oct 16 15:15:01 lola-10 TIME: Time stamp for console
Oct 16 15:20:01 lola-10 TIME: Time stamp for console
Oct 16 15:25:01 lola-10 TIME: Time stamp for console
Oct 16 15:30:01 lola-10 TIME: Time stamp for console
Oct 16 15:35:01 lola-10 TIME: Time stamp for console
Oct 16 15:40:01 lola-10 TIME: Time stamp for console
Oct 16 15:45:02 lola-10 TIME: Time stamp for console
Oct 16 15:50:01 lola-10 TIME: Time stamp for console
Oct 16 15:55:01 lola-10 TIME: Time stamp for console
Oct 16 16:00:01 lola-10 TIME: Time stamp for console
Oct 16 16:05:01 lola-10 TIME: Time stamp for console
Oct 16 16:10:01 lola-10 TIME: Time stamp for console
Oct 16 16:15:01 lola-10 TIME: Time stamp for console
Oct 16 16:20:01 lola-10 TIME: Time stamp for console
Oct 16 16:25:01 lola-10 TIME: Time stamp for console
Oct 16 16:30:01 lola-10 TIME: Time stamp for console
Oct 16 16:35:01 lola-10 TIME: Time stamp for console
Oct 16 16:40:01 lola-10 TIME: Time stamp for console
Oct 16 16:45:01 lola-10 TIME: Time stamp for console
Oct 16 16:50:01 lola-10 TIME: Time stamp for console
Oct 16 16:55:01 lola-10 TIME: Time stamp for console
Oct 16 17:00:01 lola-10 TIME: Time stamp for console
Oct 16 17:05:01 lola-10 TIME: Time stamp for console
Oct 16 17:10:01 lola-10 TIME: Time stamp for console
Oct 16 17:15:01 lola-10 TIME: Time stamp for console
Oct 16 17:20:01 lola-10 TIME: Time stamp for console
Oct 16 17:25:01 lola-10 TIME: Time stamp for console
Oct 16 17:30:01 lola-10 TIME: Time stamp for console
Oct 16 17:35:01 lola-10 TIME: Time stamp for console
Oct 16 17:40:01 lola-10 TIME: Time stamp for console
Oct 16 17:45:01 lola-10 TIME: Time stamp for console
Oct 16 17:50:01 lola-10 TIME: Time stamp for console
Oct 16 17:55:01 lola-10 TIME: Time stamp for console
Oct 16 18:00:01 lola-10 TIME: Time stamp for console
Oct 16 18:05:01 lola-10 TIME: Time stamp for console
Oct 16 18:10:01 lola-10 TIME: Time stamp for console
Oct 16 18:15:01 lola-10 TIME: Time stamp for console
Oct 16 18:20:01 lola-10 TIME: Time stamp for console
Oct 16 18:25:01 lola-10 TIME: Time stamp for console
Oct 16 18:30:01 lola-10 TIME: Time stamp for console
Oct 16 18:35:01 lola-10 TIME: Time stamp for console
Oct 16 18:40:01 lola-10 TIME: Time stamp for console
Oct 16 18:45:01 lola-10 TIME: Time stamp for console
Oct 16 18:50:01 lola-10 TIME: Time stamp for console
Oct 16 18:55:01 lola-10 TIME: Time stamp for console
Oct 16 19:00:01 lola-10 TIME: Time stamp for console
Oct 16 19:05:01 lola-10 TIME: Time stamp for console
Oct 16 19:10:01 lola-10 TIME: Time stamp for console
Oct 16 19:15:01 lola-10 TIME: Time stamp for console
Oct 16 19:20:01 lola-10 TIME: Time stamp for console
Oct 16 19:25:01 lola-10 TIME: Time stamp for console
Oct 16 19:30:01 lola-10 TIME: Time stamp for console
Oct 16 19:35:01 lola-10 TIME: Time stamp for console
Oct 16 19:40:01 lola-10 TIME: Time stamp for console
Oct 16 19:45:01 lola-10 TIME: Time stamp for console
Oct 16 19:50:01 lola-10 TIME: Time stamp for console
Oct 16 19:55:01 lola-10 TIME: Time stamp for console
Oct 16 20:00:01 lola-10 TIME: Time stamp for console
Oct 16 20:05:01 lola-10 TIME: Time stamp for console
Oct 16 20:10:01 lola-10 TIME: Time stamp for console
Oct 16 20:15:01 lola-10 TIME: Time stamp for console
Oct 16 20:20:01 lola-10 TIME: Time stamp for console
Oct 16 20:25:01 lola-10 TIME: Time stamp for console
Oct 16 20:30:01 lola-10 TIME: Time stamp for console
Oct 16 20:35:01 lola-10 TIME: Time stamp for console
Oct 16 20:40:01 lola-10 TIME: Time stamp for console
Oct 16 20:45:01 lola-10 TIME: Time stamp for console
Oct 16 20:50:01 lola-10 TIME: Time stamp for console
Oct 16 20:55:01 lola-10 TIME: Time stamp for console
Oct 16 21:00:01 lola-10 TIME: Time stamp for console
Oct 16 21:05:01 lola-10 TIME: Time stamp for console
Oct 16 21:10:01 lola-10 TIME: Time stamp for console
Oct 16 21:15:02 lola-10 TIME: Time stamp for console
Oct 16 21:20:01 lola-10 TIME: Time stamp for console
Oct 16 21:25:01 lola-10 TIME: Time stamp for console
Oct 16 21:30:01 lola-10 TIME: Time stamp for console
Oct 16 21:35:01 lola-10 TIME: Time stamp for console
Oct 16 21:40:01 lola-10 TIME: Time stamp for console
Oct 16 21:45:01 lola-10 TIME: Time stamp for console
Oct 16 21:50:01 lola-10 TIME: Time stamp for console
Oct 16 21:55:01 lola-10 TIME: Time stamp for console
Oct 16 22:00:01 lola-10 TIME: Time stamp for console
Oct 16 22:05:01 lola-10 TIME: Time stamp for console
Oct 16 22:10:01 lola-10 TIME: Time stamp for console
Oct 16 22:15:01 lola-10 TIME: Time stamp for console
Oct 16 22:20:01 lola-10 TIME: Time stamp for console
Oct 16 22:25:01 lola-10 TIME: Time stamp for console
Oct 16 22:30:01 lola-10 TIME: Time stamp for console
Oct 16 22:35:01 lola-10 TIME: Time stamp for console
Oct 16 22:40:02 lola-10 TIME: Time stamp for console
Oct 16 22:45:01 lola-10 TIME: Time stamp for console
Oct 16 22:50:01 lola-10 TIME: Time stamp for console
Oct 16 22:55:01 lola-10 TIME: Time stamp for console
Oct 16 23:00:01 lola-10 TIME: Time stamp for console
Oct 16 23:05:01 lola-10 TIME: Time stamp for console
Oct 16 23:10:01 lola-10 TIME: Time stamp for console
Oct 16 23:15:01 lola-10 TIME: Time stamp for console
Oct 16 23:20:01 lola-10 TIME: Time stamp for console
Oct 16 23:25:01 lola-10 TIME: Time stamp for console
Oct 16 23:30:01 lola-10 TIME: Time stamp for console
Oct 16 23:35:01 lola-10 TIME: Time stamp for console
Oct 16 23:40:01 lola-10 TIME: Time stamp for console
Oct 16 23:45:01 lola-10 TIME: Time stamp for console
Oct 16 23:50:01 lola-10 TIME: Time stamp for console
Oct 16 23:55:01 lola-10 TIME: Time stamp for console
Oct 17 00:00:01 lola-10 TIME: Time stamp for console
Oct 17 00:05:01 lola-10 TIME: Time stamp for console
Oct 17 00:10:01 lola-10 TIME: Time stamp for console
Oct 17 00:15:01 lola-10 TIME: Time stamp for console
Oct 17 00:20:01 lola-10 TIME: Time stamp for console
Oct 17 00:25:01 lola-10 TIME: Time stamp for console
Oct 17 00:30:01 lola-10 TIME: Time stamp for console
Oct 17 00:35:01 lola-10 TIME: Time stamp for console
Oct 17 00:40:01 lola-10 TIME: Time stamp for console
Oct 17 00:45:01 lola-10 TIME: Time stamp for console
Oct 17 00:50:02 lola-10 TIME: Time stamp for console
Oct 17 00:55:01 lola-10 TIME: Time stamp for console
Oct 17 01:00:01 lola-10 TIME: Time stamp for console
Oct 17 01:05:01 lola-10 TIME: Time stamp for console
Oct 17 01:10:01 lola-10 TIME: Time stamp for console
Oct 17 01:15:01 lola-10 TIME: Time stamp for console
Oct 17 01:20:01 lola-10 TIME: Time stamp for console
Oct 17 01:25:01 lola-10 TIME: Time stamp for console
Oct 17 01:30:01 lola-10 TIME: Time stamp for console
Oct 17 01:35:01 lola-10 TIME: Time stamp for console
Oct 17 01:40:01 lola-10 TIME: Time stamp for console
Oct 17 01:45:01 lola-10 TIME: Time stamp for console
Oct 17 01:50:01 lola-10 TIME: Time stamp for console
Oct 17 01:55:01 lola-10 TIME: Time stamp for console
Oct 17 02:00:01 lola-10 TIME: Time stamp for console
Oct 17 02:05:01 lola-10 TIME: Time stamp for console
Oct 17 02:10:01 lola-10 TIME: Time stamp for console
Oct 17 02:15:01 lola-10 TIME: Time stamp for console
Oct 17 02:20:01 lola-10 TIME: Time stamp for console
Oct 17 02:25:01 lola-10 TIME: Time stamp for console
Oct 17 02:30:01 lola-10 TIME: Time stamp for console
Oct 17 02:35:01 lola-10 TIME: Time stamp for console
Oct 17 02:40:01 lola-10 TIME: Time stamp for console
Oct 17 02:45:01 lola-10 TIME: Time stamp for console
Oct 17 02:50:01 lola-10 TIME: Time stamp for console
Oct 17 02:55:01 lola-10 TIME: Time stamp for console
Oct 17 03:00:01 lola-10 TIME: Time stamp for console
Oct 17 03:05:01 lola-10 TIME: Time stamp for console
Oct 17 03:10:01 lola-10 TIME: Time stamp for console
Oct 17 03:15:01 lola-10 TIME: Time stamp for console
Oct 17 03:20:01 lola-10 TIME: Time stamp for console
Oct 17 03:25:01 lola-10 TIME: Time stamp for console
Oct 17 03:30:02 lola-10 TIME: Time stamp for console
Oct 17 03:35:01 lola-10 TIME: Time stamp for console
Oct 17 03:40:01 lola-10 TIME: Time stamp for console
Oct 17 03:45:01 lola-10 TIME: Time stamp for console
Oct 17 03:50:01 lola-10 TIME: Time stamp for console
Oct 17 03:55:01 lola-10 TIME: Time stamp for console
Oct 17 04:00:01 lola-10 TIME: Time stamp for console
Oct 17 04:05:01 lola-10 TIME: Time stamp for console
Oct 17 04:10:01 lola-10 TIME: Time stamp for console
Oct 17 04:15:01 lola-10 TIME: Time stamp for console
Oct 17 04:20:01 lola-10 TIME: Time stamp for console
Oct 17 04:25:01 lola-10 TIME: Time stamp for console
Oct 17 04:30:01 lola-10 TIME: Time stamp for console
Oct 17 04:35:01 lola-10 TIME: Time stamp for console
Oct 17 04:40:01 lola-10 TIME: Time stamp for console
Oct 17 04:45:01 lola-10 TIME: Time stamp for console
Oct 17 04:50:02 lola-10 TIME: Time stamp for console
Oct 17 04:55:01 lola-10 TIME: Time stamp for console
Oct 17 05:00:01 lola-10 TIME: Time stamp for console
Oct 17 05:05:01 lola-10 TIME: Time stamp for console
Oct 17 05:10:01 lola-10 TIME: Time stamp for console
Oct 17 05:15:01 lola-10 TIME: Time stamp for console
Oct 17 05:20:01 lola-10 TIME: Time stamp for console
Oct 17 05:25:01 lola-10 TIME: Time stamp for console
Oct 17 05:30:01 lola-10 TIME: Time stamp for console
Oct 17 05:35:01 lola-10 TIME: Time stamp for console
Oct 17 05:40:01 lola-10 TIME: Time stamp for console
Oct 17 05:45:01 lola-10 TIME: Time stamp for console
Oct 17 05:50:01 lola-10 TIME: Time stamp for console
Oct 17 05:55:01 lola-10 TIME: Time stamp for console
Oct 17 06:00:01 lola-10 TIME: Time stamp for console
Oct 17 06:05:01 lola-10 TIME: Time stamp for console
Oct 17 06:10:01 lola-10 TIME: Time stamp for console
Oct 17 06:15:01 lola-10 TIME: Time stamp for console
Oct 17 06:20:01 lola-10 TIME: Time stamp for console
Oct 17 06:25:01 lola-10 TIME: Time stamp for console
Oct 17 06:30:01 lola-10 TIME: Time stamp for console
Oct 17 06:35:01 lola-10 TIME: Time stamp for console
Oct 17 06:40:01 lola-10 TIME: Time stamp for console
Oct 17 06:45:01 lola-10 TIME: Time stamp for console
Oct 17 06:50:01 lola-10 TIME: Time stamp for console
Oct 17 06:55:01 lola-10 TIME: Time stamp for console
Oct 17 07:00:01 lola-10 TIME: Time stamp for console
Oct 17 07:05:01 lola-10 TIME: Time stamp for console
Oct 17 07:10:01 lola-10 TIME: Time stamp for console
Oct 17 07:15:01 lola-10 TIME: Time stamp for console
Oct 17 07:20:01 lola-10 TIME: Time stamp for console
Oct 17 07:25:01 lola-10 TIME: Time stamp for console
Oct 17 07:30:01 lola-10 TIME: Time stamp for console
Oct 17 07:35:01 lola-10 TIME: Time stamp for console
Oct 17 07:40:01 lola-10 TIME: Time stamp for console
Oct 17 07:45:01 lola-10 TIME: Time stamp for console
Oct 17 07:50:01 lola-10 TIME: Time stamp for console
Oct 17 07:55:01 lola-10 TIME: Time stamp for console
Oct 17 08:00:01 lola-10 TIME: Time stamp for console
Oct 17 08:05:01 lola-10 TIME: Time stamp for console
Oct 17 08:10:01 lola-10 TIME: Time stamp for console
Oct 17 08:15:01 lola-10 TIME: Time stamp for console
Oct 17 08:20:01 lola-10 TIME: Time stamp for console
Oct 17 08:25:01 lola-10 TIME: Time stamp for console
Oct 17 08:30:01 lola-10 TIME: Time stamp for console
Oct 17 08:35:01 lola-10 TIME: Time stamp for console
Oct 17 08:40:02 lola-10 TIME: Time stamp for console
Oct 17 08:45:01 lola-10 TIME: Time stamp for console
Oct 17 08:50:01 lola-10 TIME: Time stamp for console
Oct 17 08:55:01 lola-10 TIME: Time stamp for console
Oct 17 09:00:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476596231/real 1476596231]  req@ffff8808329006c0 x1548322423451248/t0(0) o400->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 224/224 e 4956 to 1 dl 1476720142 ref 1 fl Rpc:X/c0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476720149/real 1476720149]  req@ffff880803ac63c0 x1548322433419216/t0(0) o400->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 224/224 e 0 to 1 dl 1476720156 ref 1 fl Rpc:X/c0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476720170/real 1476720170]  req@ffff880803ac63c0 x1548322433420912/t0(0) o400->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 224/224 e 0 to 1 dl 1476720177 ref 1 fl Rpc:X/c0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476720205/real 1476720205]  req@ffff880803ac63c0 x1548322433423824/t0(0) o400->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 224/224 e 0 to 1 dl 1476720212 ref 1 fl Rpc:X/c0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail
Lustre: Skipped 1 previous similar message
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476720288/real 0]  req@ffff880837e089c0 x1548322433430736/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476720299 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 12 previous similar messages
Oct 17 09:05:01 lola-10 TIME: Time stamp for console
LNetError: 4545:0:(o2iblnd_cb.c:3135:kiblnd_check_txs_locked()) Timed out tx: tx_queue, 6 seconds
LNetError: 4545:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out RDMA with 192.168.1.108@o2ib10 (106): c: 0, oc: 0, rc: 8
Lustre: soaked-MDT0002: haven't heard from client soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib10) in 229 seconds. I think it's dead, and I am evicting it. exp ffff880800278c00, cur 1476720430 expire 1476720280 last 1476720201
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476720463/real 1476720463]  req@ffff880831e21cc0 x1548322433444480/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476720479 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
Oct 17 09:10:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476720738/real 1476720738]  req@ffff880831e029c0 x1548322433466192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476720774 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 27 previous similar messages
Oct 17 09:15:01 lola-10 TIME: Time stamp for console
Oct 17 09:20:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476721263/real 1476721263]  req@ffff880802c88080 x1548322433508192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476721318 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 83 previous similar messages
Oct 17 09:25:01 lola-10 TIME: Time stamp for console
Oct 17 09:30:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476721888/real 1476721888]  req@ffff8808025279c0 x1548322433558192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476721943 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 09:35:01 lola-10 TIME: Time stamp for console
Oct 17 09:40:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476722513/real 1476722513]  req@ffff880832285380 x1548322433608192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476722568 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 09:45:01 lola-10 TIME: Time stamp for console
Oct 17 09:50:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476723138/real 1476723138]  req@ffff880802c9a380 x1548322433658192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476723193 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 09:55:02 lola-10 TIME: Time stamp for console
Oct 17 10:00:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476723763/real 1476723763]  req@ffff880802604680 x1548322433708192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476723818 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 10:05:01 lola-10 TIME: Time stamp for console
Oct 17 10:10:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476724388/real 1476724388]  req@ffff880831c6a0c0 x1548322433758192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476724443 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 10:15:01 lola-10 TIME: Time stamp for console
Oct 17 10:20:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476725013/real 1476725013]  req@ffff880833b720c0 x1548322433808192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476725068 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 10:25:01 lola-10 TIME: Time stamp for console
Oct 17 10:30:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476725638/real 1476725638]  req@ffff88082c0529c0 x1548322433858192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476725693 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 10:35:01 lola-10 TIME: Time stamp for console
Oct 17 10:40:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476726263/real 1476726263]  req@ffff88080372c680 x1548322433908192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476726318 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 10:45:01 lola-10 TIME: Time stamp for console
Oct 17 10:50:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476726888/real 1476726888]  req@ffff880802b95980 x1548322433958160/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476726943 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 10:55:01 lola-10 TIME: Time stamp for console
Oct 17 11:00:01 lola-10 TIME: Time stamp for console
Oct 17 11:05:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476727513/real 1476727513]  req@ffff880802b8c6c0 x1548322434008160/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476727568 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 11:10:01 lola-10 TIME: Time stamp for console
Oct 17 11:15:02 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476728138/real 1476728138]  req@ffff880802bd6080 x1548322434058160/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476728193 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 11:20:01 lola-10 TIME: Time stamp for console
Oct 17 11:25:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476728763/real 1476728763]  req@ffff880802b9fc80 x1548322434108192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476728818 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 11:30:01 lola-10 TIME: Time stamp for console
Oct 17 11:35:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476729363/real 1476729363]  req@ffff880802c5a9c0 x1548322434156192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476729418 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 95 previous similar messages
Oct 17 11:40:01 lola-10 TIME: Time stamp for console
Oct 17 11:45:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476729988/real 1476729988]  req@ffff880802d1c0c0 x1548322434206192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476730043 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 11:50:01 lola-10 TIME: Time stamp for console
Oct 17 11:55:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476730588/real 1476730588]  req@ffff880838156680 x1548322434254192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476730643 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 95 previous similar messages
Oct 17 12:00:01 lola-10 TIME: Time stamp for console
Oct 17 12:05:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476731213/real 1476731213]  req@ffff88082a85f6c0 x1548322434304160/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476731268 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 12:10:01 lola-10 TIME: Time stamp for console
Oct 17 12:15:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476731838/real 1476731838]  req@ffff880833b729c0 x1548322434354192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476731893 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 12:20:01 lola-10 TIME: Time stamp for console
Oct 17 12:25:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476732463/real 1476732463]  req@ffff880802c1f9c0 x1548322434404224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476732518 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 12:30:01 lola-10 TIME: Time stamp for console
Oct 17 12:35:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476733088/real 1476733088]  req@ffff880802b97380 x1548322434454224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476733143 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 12:40:01 lola-10 TIME: Time stamp for console
Oct 17 12:45:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476733713/real 1476733713]  req@ffff880832978cc0 x1548322434504224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476733768 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 12:50:01 lola-10 TIME: Time stamp for console
Oct 17 12:55:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476734338/real 1476734338]  req@ffff880802f38cc0 x1548322434554192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476734393 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 13:00:01 lola-10 TIME: Time stamp for console
Oct 17 13:05:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476734963/real 1476734963]  req@ffff880802b97c80 x1548322434604160/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476735018 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 13:10:01 lola-10 TIME: Time stamp for console
Oct 17 13:15:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476735588/real 1476735588]  req@ffff88082b8df3c0 x1548322434654224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476735643 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 13:20:01 lola-10 TIME: Time stamp for console
Oct 17 13:25:01 lola-10 TIME: Time stamp for console
Oct 17 13:30:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476736213/real 1476736213]  req@ffff880803f9e380 x1548322434704224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476736268 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 13:35:01 lola-10 TIME: Time stamp for console
Oct 17 13:40:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476736838/real 1476736838]  req@ffff880803f683c0 x1548322434754192/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476736893 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 13:45:01 lola-10 TIME: Time stamp for console
Oct 17 13:50:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476737463/real 1476737463]  req@ffff88082afa4cc0 x1548322434804224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476737518 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 13:55:01 lola-10 TIME: Time stamp for console
Oct 17 14:00:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476738088/real 1476738088]  req@ffff8807ca8d8380 x1548322434854224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476738143 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 14:05:01 lola-10 TIME: Time stamp for console
Oct 17 14:10:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476738713/real 1476738713]  req@ffff8807ca8563c0 x1548322434904224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476738768 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 14:15:01 lola-10 TIME: Time stamp for console
Oct 17 14:20:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476739338/real 1476739338]  req@ffff8807ca879380 x1548322434954224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476739393 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 14:25:01 lola-10 TIME: Time stamp for console
Oct 17 14:30:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476739963/real 1476739963]  req@ffff880802604c80 x1548322435004224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476740018 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 14:35:01 lola-10 TIME: Time stamp for console
Oct 17 14:40:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476740588/real 1476740588]  req@ffff880803ee89c0 x1548322435054224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476740643 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 14:45:01 lola-10 TIME: Time stamp for console
Oct 17 14:50:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476741213/real 1476741213]  req@ffff880802b5ccc0 x1548322435104224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476741268 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Lustre: soaked-MDT0002: haven't heard from client 67e07261-9095-cc21-4db3-c4ce4fbb2d6d (at 192.168.1.116@o2ib100) in 268 seconds. I think it's dead, and I am evicting it. exp ffff880800278400, cur 1476741248 expire 1476741098 last 1476740980
Oct 17 14:55:01 lola-10 TIME: Time stamp for console
Oct 17 15:00:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476741838/real 1476741838]  req@ffff8807c8862380 x1548322435154224/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476741893 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 15:05:01 lola-10 TIME: Time stamp for console
Oct 17 15:10:01 lola-10 TIME: Time stamp for console
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476742463/real 1476742463]  req@ffff8807c8bbfcc0 x1548322435204160/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476742518 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4555:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 99 previous similar messages
Oct 17 15:15:01 lola-10 TIME: Time stamp for console
Lustre: soaked-OST0012-osc-MDT0002: Connection to soaked-OST0012 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0007-osc-MDT0002: Connection to soaked-OST0007 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 3 previous similar messages
Lustre: soaked-OST0008-osc-MDT0002: Connection to soaked-OST0008 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 3 previous similar messages
Lustre: soaked-OST0015-osc-MDT0002: Connection to soaked-OST0015 (at 192.168.1.105@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 4 previous similar messages
Lustre: soaked-OST000a-osc-MDT0002: Connection to soaked-OST000a (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               Version 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.                                                                                                                                                                          MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           LSI Corporation MPT SAS2 BIOS                                                   Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                 Initializing../                                                                 Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                                                                                                 Press Ctrl-C to start LSI Corp Configuration Utility...                         Searching for devices at HBA 0...                                               LSI Corporation MPT SAS2 BIOS                                                   MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                            PCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    SLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    ---- ---- --- -------- ---------------- ----------- ----------                    3           LSI      SAS2308-IT       15.00.00.00  0F:00:00:03                  3    4   7  LSI      Universal Xport  0786         20.00 MiB                    3    4   41  LSI      INF-01-00        0786         14.55 TiB                   3    4   42  LSI      INF-01-00        0786         14.55 TiB                   3    4   43  LSI      INF-01-00        0786         14.55 TiB                   3    4   44  LSI      INF-01-00        0786         14.55 TiB                   3    4   45  LSI      INF-01-00        0786         14.55 TiB                   3    4   46  LSI      INF-01-00        0786         14.55 TiB                   3    0   7  LSI      Universal Xport  0786         20.00 MiB                    3    0   41  LSI      INF-01-00        0786         14.55 TiB                   3    0   42  LSI      INF-01-00        0786         14.55 TiB                   3    0   43  LSI      INF-01-00        0786         14.55 TiB                   3    0   44  LSI      INF-01-00        0786         14.55 TiB                   3    0   45  LSI      INF-01-00        0786         14.55 TiB                   3    0   46  LSI      INF-01-00        0786         14.55 TiB                 Copyright 2000-2012 LSI Corporation.                                                                                                                              RAID Volumes:                                                                   None defined.                                                                   Physical Devices:                                                             �  ID   Device Model     Serial #                     Size Type/Status(Vol ID)     0    ST500NM0011      Z1M0X1F9                  465.7GB Non-RAID Disk           1    ST500NM0011      Z1M0X1GG                  465.7GB Non-RAID Disk         Press <CTRL-I> to enter Configuration Utility..                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Copyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                     RAID Volumes:                                                                 Press <CTRL-I> to enter Configuration Utility...                                Initializing Intel(R) Boot Agent GE v1.4.04                                     PXE 2.1 Build 091 (WfM 2.0)                                                     Press Ctrl+S to enter the Setup Menu.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                          Bios Version: SE5C600.86B.01.08.0003.022620131521                               BMC Firmware Version: 1.17.4207                                                 SDR Version: SDR Package 1.09                                                   ME Firmware Version: 2.1.7.112                                                  Platform ID: S2600GZ                                                            System memory detected: 32768 MB                                                Current memory speed: 1333 MT/s                                                 Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        Number of physical processors identified: 2                                     ********************************************************************************AHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          SAS/SATA Capable Controller configured with 4 ports in SATA mode                ********************************************************************************USB Keyboard detected                                                           USB Mouse detected                                                                                                                                              Press <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                                     
Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

    GNU GRUB  version 0.97  (571K lower / 3066652K upper memory)

+-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+
      Use the ^ and v keys to select which entry is highlighted.
      Press enter to boot the selected OS, 'e' to edit the
      commands before booting, 'a' to modify the kernel arguments
      before booting, or 'c' for a command-line.  CentOS (2.6.32-573.26.1.el6_lustre.x86_64)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  The highlighted entry will be booted automatically in 5 seconds.    The highlighted entry will be booted automatically in 4 seconds.    The highlighted entry will be booted automatically in 3 seconds.    The highlighted entry will be booted automatically in 2 seconds.    The highlighted entry will be booted automatically in 1 seconds.    Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-573.26.1.el6_lustre.x86_64 (soakbuilder@lola-16.lola.whamcloud.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-16) (GCC) ) #1 SMP Mon Oct 17 13:07:39 PDT 2016
Command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=auto SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000008ec00 (usable)
 BIOS-e820: 000000000008ec00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bb3c7000 (usable)
 BIOS-e820: 00000000bb3c7000 - 00000000bdd2f000 (reserved)
 BIOS-e820: 00000000bdd2f000 - 00000000bddcd000 (ACPI NVS)
 BIOS-e820: 00000000bddcd000 - 00000000bdea1000 (ACPI data)
 BIOS-e820: 00000000bdea1000 - 00000000bdf2f000 (ACPI NVS)
 BIOS-e820: 00000000bdf2f000 - 00000000bdfac000 (ACPI data)
 BIOS-e820: 00000000bdfac000 - 00000000be000000 (usable)
 BIOS-e820: 00000000be000000 - 00000000d0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
 BIOS-e820: 00000000fed19000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ffa20000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000840000000 (usable)
DMI 2.6 present.
SMBIOS version 2.6 @ 0xF0440
No AGP bridge found
last_pfn = 0x840000 max_arch_pfn = 0x400000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xbe000 max_arch_pfn = 0x400000000
Using GB pages for direct mapping
init_memory_mapping: 0000000000000000-00000000be000000
init_memory_mapping: 0000000100000000-0000000840000000
RAMDISK: 3601e000 - 37fef30d
ACPI: Deleted _OSI()
ACPI: Deleted _OSI()
ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20090903/tbfadt-611)
ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
ACPI: FACS 00000000bdfa9f40 00040
ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
Setting APIC routing to flat.
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: PXM 0 -> APIC 2 -> Node 0
SRAT: PXM 0 -> APIC 3 -> Node 0
SRAT: PXM 0 -> APIC 4 -> Node 0
SRAT: PXM 0 -> APIC 5 -> Node 0
SRAT: PXM 0 -> APIC 6 -> Node 0
SRAT: PXM 0 -> APIC 7 -> Node 0
SRAT: PXM 0 -> APIC 8 -> Node 0
SRAT: PXM 0 -> APIC 9 -> Node 0
SRAT: PXM 0 -> APIC 10 -> Node 0
SRAT: PXM 0 -> APIC 11 -> Node 0
SRAT: PXM 0 -> APIC 12 -> Node 0
SRAT: PXM 0 -> APIC 13 -> Node 0
SRAT: PXM 0 -> APIC 14 -> Node 0
SRAT: PXM 0 -> APIC 15 -> Node 0
SRAT: PXM 1 -> APIC 32 -> Node 1
SRAT: PXM 1 -> APIC 33 -> Node 1
SRAT: PXM 1 -> APIC 34 -> Node 1
SRAT: PXM 1 -> APIC 35 -> Node 1
SRAT: PXM 1 -> APIC 36 -> Node 1
SRAT: PXM 1 -> APIC 37 -> Node 1
SRAT: PXM 1 -> APIC 38 -> Node 1
SRAT: PXM 1 -> APIC 39 -> Node 1
SRAT: PXM 1 -> APIC 40 -> Node 1
SRAT: PXM 1 -> APIC 41 -> Node 1
SRAT: PXM 1 -> APIC 42 -> Node 1
SRAT: PXM 1 -> APIC 43 -> Node 1
SRAT: PXM 1 -> APIC 44 -> Node 1
SRAT: PXM 1 -> APIC 45 -> Node 1
SRAT: PXM 1 -> APIC 46 -> Node 1
SRAT: PXM 1 -> APIC 47 -> Node 1
SRAT: Node 0 PXM 0 0-c0000000
SRAT: Node 0 PXM 0 100000000-440000000
SRAT: Node 1 PXM 1 440000000-840000000
Bootmem setup node 0 0000000000000000-0000000440000000
  NODE_DATA [0000000000009000 - 000000000003cfff]
  bootmap [0000000000100000 -  0000000000187fff] pages 88
(8 early reservations) ==> bootmem [0000000000 - 0440000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS ==> [0001000000 - 000203eb64]
  #3 [003601e000 - 0037fef30d]          RAMDISK ==> [003601e000 - 0037fef30d]
  #4 [000008ec00 - 0000100000]    BIOS reserved ==> [000008ec00 - 0000100000]
  #5 [000203f000 - 000203f9b8]              BRK ==> [000203f000 - 000203f9b8]
  #6 [0000008000 - 0000009000]          PGTABLE ==> [0000008000 - 0000009000]
  #7 [0000001000 - 0000001030]        ACPI SLIT ==> [0000001000 - 0000001030]
Bootmem setup node 1 0000000440000000-0000000840000000
  NODE_DATA [0000000440000040 - 000000044003403f]
  bootmap [0000000440035000 -  00000004400b4fff] pages 80
(8 early reservations) ==> bootmem [0440000000 - 0840000000]
  #0 [0000000000 - 0000001000]   BIOS data page
  #1 [0000006000 - 0000008000]       TRAMPOLINE
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS
  #3 [003601e000 - 0037fef30d]          RAMDISK
  #4 [000008ec00 - 0000100000]    BIOS reserved
  #5 [000203f000 - 000203f9b8]              BRK
  #6 [0000008000 - 0000009000]          PGTABLE
  #7 [0000001000 - 0000001030]        ACPI SLIT
found SMP MP-table at [ffff8800000fcd70] fcd70
Reserving 131MB of memory at 48MB for crashkernel (System RAM: 33792MB)
Zone PFN ranges:
  DMA      0x00000001 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   0x00100000 -> 0x00840000
Movable zone start PFN for each node
early_node_map[5] active PFN ranges
    0: 0x00000001 -> 0x0000008e
    0: 0x00000100 -> 0x000bb3c7
    0: 0x000bdfac -> 0x000be000
    0: 0x00100000 -> 0x00440000
    1: 0x00440000 -> 0x00840000
ACPI: PM-Timer IO Port: 0x408
Setting APIC routing to flat.
ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a701 base: 0xfed00000
SMP: Allowing 240 CPUs, 208 hotplug CPUs
PM: Registered nosave memory: 000000000008e000 - 000000000008f000
PM: Registered nosave memory: 000000000008f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
PM: Registered nosave memory: 00000000bb3c7000 - 00000000bdd2f000
PM: Registered nosave memory: 00000000bdd2f000 - 00000000bddcd000
PM: Registered nosave memory: 00000000bddcd000 - 00000000bdea1000
PM: Registered nosave memory: 00000000bdea1000 - 00000000bdf2f000
PM: Registered nosave memory: 00000000bdf2f000 - 00000000bdfac000
PM: Registered nosave memory: 00000000be000000 - 00000000d0000000
PM: Registered nosave memory: 00000000d0000000 - 00000000fec00000
PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
PM: Registered nosave memory: 00000000fec01000 - 00000000fed19000
PM: Registered nosave memory: 00000000fed19000 - 00000000fed1a000
PM: Registered nosave memory: 00000000fed1a000 - 00000000fed1c000
PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
PM: Registered nosave memory: 00000000fed20000 - 00000000fee00000
PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
PM: Registered nosave memory: 00000000fee01000 - 00000000ffa20000
PM: Registered nosave memory: 00000000ffa20000 - 0000000100000000
Allocating PCI resources starting at d0000000 (gap: d0000000:2ec00000)
Booting paravirtualized kernel on bare hardware
NR_CPUS:4096 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
PERCPU: Embedded 30 pages/cpu @ffff880038600000 s91288 r8192 d23400 u131072
pcpu-alloc: s91288 r8192 d23400 u131072 alloc=1*2097152
pcpu-alloc: [0] 000 001 002 003 004 005 006 007 016 017 018 019 020 021 022 023 
pcpu-alloc: [0] 032 034 036 038 040 042 044 046 048 050 052 054 056 058 060 062 
pcpu-alloc: [0] 064 066 068 070 072 074 076 078 080 082 084 086 088 090 092 094 
pcpu-alloc: [0] 096 098 100 102 104 106 108 110 112 114 116 118 120 122 124 126 
pcpu-alloc: [0] 128 130 132 134 136 138 140 142 144 146 148 150 152 154 156 158 
pcpu-alloc: [0] 160 162 164 166 168 170 172 174 176 178 180 182 184 186 188 190 
pcpu-alloc: [0] 192 194 196 198 200 202 204 206 208 210 212 214 216 218 220 222 
pcpu-alloc: [0] 224 226 228 230 232 234 236 238 --- --- --- --- --- --- --- --- 
pcpu-alloc: [1] 008 009 010 011 012 013 014 015 024 025 026 027 028 029 030 031 
pcpu-alloc: [1] 033 035 037 039 041 043 045 047 049 051 053 055 057 059 061 063 
pcpu-alloc: [1] 065 067 069 071 073 075 077 079 081 083 085 087 089 091 093 095 
pcpu-alloc: [1] 097 099 101 103 105 107 109 111 113 115 117 119 121 123 125 127 
pcpu-alloc: [1] 129 131 133 135 137 139 141 143 145 147 149 151 153 155 157 159 
pcpu-alloc: [1] 161 163 165 167 169 171 173 175 177 179 181 183 185 187 189 191 
pcpu-alloc: [1] 193 195 197 199 201 203 205 207 209 211 213 215 217 219 221 223 
pcpu-alloc: [1] 225 227 229 231 233 235 237 239 --- --- --- --- --- --- --- --- 
Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8250675
Policy zone: Normal
Kernel command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=131M@0M SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
PID hash table entries: 4096 (order: 3, 32768 bytes)
xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
Checking aperture...
No AGP bridge found
Memory: 32738448k/34603008k available (5400k kernel code, 1126752k absent, 737808k reserved, 7008k data, 1304k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:3144
Extended CMOS year: 2000
Console: colour VGA+ 80x25
console [ttyS0] enabled
allocated 134217728 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
TSC: cpu family 6 model 45, tsc initial value = 75c6c42057
Fast TSC calibration using PIT
Detected 2693.610 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5387.22 BogoMIPS (lpj=2693610)
pid_max: default: 245760 minimum: 1920
Security Framework initialized
SELinux:  Initializing.
Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 20 MCE banks
CPU0: Thermal monitoring enabled (TM1)
using mwait in idle threads.
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 22144 entries in 87 pages
x2apic not enabled, IRQ remapping init failed
APIC routing finalized to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz stepping 07
Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
... version:                3
... bit width:              48
... generic registers:      4
... value mask:             0000ffffffffffff
... max period:             0000ffffffffffff
... fixed-purpose events:   3
... event mask:             000000070000000f
NMI watchdog enabled, takes one hw-pmu counter.
Booting Node   0, Processors  #1 #2 #3 #4 #5 #6 #7 Ok.
Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 Ok.
Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 Ok.
Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
Brought up 32 CPUs
Total of 32 processors activated (172375.84 BogoMIPS).
devtmpfs: initialized
PM: Registering ACPI NVS region at bdd2f000 (647168 bytes)
PM: Registering ACPI NVS region at bdea1000 (581632 bytes)
regulator: core version 0.5
NET: Registered protocol family 16
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MCFG configuration 0: base c0000000 segment 0 buses 0 - 255
PCI: MCFG area at c0000000 reserved in E820
PCI: Using MMCONFIG at c0000000 - cfffffff
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: Executed 1 blocks of module-level executable AML code
ACPI: BIOS _OSI(Linux) query ignored
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
HEST: Table parsing has been initialized.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
pci_root PNP0A08:00: host bridge window [io  0x0000-0xbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:00: host bridge window [mem 0x000c0000-0x000c3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c4000-0x000c7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c8000-0x000cbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000cc000-0x000cffff]
pci_root PNP0A08:00: host bridge window [mem 0x000d0000-0x000d3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d4000-0x000d7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d8000-0x000dbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000dc000-0x000dffff]
pci_root PNP0A08:00: host bridge window [mem 0x000e0000-0x000e3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e4000-0x000e7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e8000-0x000ebfff]
pci_root PNP0A08:00: host bridge window [mem 0x000ec000-0x000effff]
pci_root PNP0A08:00: host bridge window [mem 0x000f0000-0x000fffff]
pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xebffffff]
pci_root PNP0A08:00: host bridge window [mem 0x380000000000-0x38007fffffff]
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdfff])
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff]
pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff]
pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff]
pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff]
pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff]
pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff]
pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff]
pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff]
pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff]
pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff]
pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff]
pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff]
pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff]
pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
pci 0000:00:00.0: PME# disabled
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
pci 0000:00:01.1: PME# disabled
pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
pci 0000:00:02.0: PME# disabled
pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
pci 0000:00:02.2: PME# disabled
pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
pci 0000:00:03.0: PME# disabled
pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
pci 0000:00:11.0: PME# disabled
pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.0: PME# disabled
pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
pci 0000:00:16.1: PME# disabled
pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.7: PME# disabled
pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.0: PME# disabled
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:00.0: PME# disabled
pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
pci 0000:02:00.1: PME# disabled
pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
pci 0000:02:00.2: PME# disabled
pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
pci 0000:02:00.3: PME# disabled
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:07:00.3: PME# supported from D0 D3hot D3cold
pci 0000:07:00.3: PME# disabled
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a] (subtractive decode)
 pci0000:00: Requesting ACPI _OSC control (0x1d)
 pci0000:00: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
pci_root PNP0A08:01: host bridge window [io  0x03b0-0x03df]
pci_root PNP0A08:01: host bridge window [io  0xc000-0xffff]
pci_root PNP0A08:01: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:01: host bridge window [mem 0xec000000-0xfbffffff]
pci_root PNP0A08:01: host bridge window [mem 0x380080000000-0x3800ffffffff]
PCI host bridge to bus 0000:80
pci_bus 0000:80: root bus resource [io  0x03b0-0x03df]
pci_bus 0000:80: root bus resource [io  0xc000-0xffff]
pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff]
pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff]
pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
pci 0000:80:01.0: PME# disabled
pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
pci 0000:80:02.0: PME# disabled
pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
pci 0000:80:03.0: PME# disabled
pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
pci 0000:80:03.2: PME# disabled
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
 pci0000:80: Requesting ACPI _OSC control (0x1d)
 pci0000:80: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
PCI host bridge to bus 0000:7f
 pci0000:7f: Requesting ACPI _OSC control (0x1d)
 pci0000:7f: ACPI _OSC control (0x10) granted
ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
PCI host bridge to bus 0000:ff
 pci0000:ff: Requesting ACPI _OSC control (0x1d)
 pci0000:ff: ACPI _OSC control (0x10) granted
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:09:00.0
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
HPET: 8 timers in total, 5 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 72, 73, 74, 75, 76, 0
hpet0: 8 comparators, 64-bit 14.318180 MHz counter
Switching to clocksource hpet
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 15 devices
ACPI: ACPI bus type pnp unregistered
system 00:05: [io  0x0680-0x069f] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0x0400-0x0453] has been reserved
system 00:05: [io  0x0458-0x047f] has been reserved
system 00:05: [io  0x0500-0x057f] has been reserved
system 00:05: [io  0x0600-0x061f] has been reserved
system 00:05: [io  0x0ca2-0x0ca5] has been reserved
system 00:05: [io  0x0cf9] could not be reserved
system 00:07: [io  0x0454-0x0457] has been reserved
system 00:0a: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:0a: [mem 0xebfff000-0xebffffff] has been reserved
system 00:0a: [mem 0xc0000000-0xcfffffff] has been reserved
system 00:0a: [mem 0xfed20000-0xfed3ffff] has been reserved
system 00:0a: [mem 0xfed45000-0xfed8ffff] has been reserved
system 00:0a: [mem 0xff000000-0xffffffff] could not be reserved
system 00:0a: [mem 0xfee00000-0xfeefffff] could not be reserved
system 00:0a: [mem 0xfec00000-0xfecfffff] could not be reserved
system 00:0a: [mem 0xd0f70000-0xd0f70fff] has been reserved
system 00:0c: [mem 0x00000000-0x0009cfff] could not be reserved
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
pci 0000:00:02.0:   bridge window [mem 0xeb000000-0xeb7fffff 64bit pref]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
pci 0000:00:11.0:   bridge window [mem 0xeb800000-0xebcfffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a]
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
pci 0000:00:01.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:01.1: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.2: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:03.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:11.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
pci 0000:80:01.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:02.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.2: PCI INT A -> GSI 71 (level, low) -> IRQ 71
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1a.0: PCI INT B disabled
pci 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1d.0: PCI I�NT A disabled
mage as initramfs...
Freeing initrd memory: 32580k freed
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
futex hash table entries: 65536 (order: 10, 4194304 bytes)
audit: initializing netlink socket (disabled)
type=2000 audit(1476742819.770:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 32768
ksign: Installing public key data
Loading keyring
- Added public key 3B396075E393847B
- User ID: Red Hat, Inc. (Kernel Module GPG key)
- Added public key D4A26C9CCD09BEDA
- User ID: Red Hat Enterprise Linux Driver Update Program <secalert@redhat.com>
- Added public key CB445E0DA3EA1F65
- User ID: Red Hat Enterprise Linux Driver Update Program (key 4) <secalert@redhat.com>
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
acpiphp: Slot [2] registered
acpiphp: Slot [2-1] registered
acpiphp: Slot [2-2] registered
acpiphp: Slot [2-3] registered
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
[Firmware Bug]: No valid trip found
ERST: Error Record Serialization Table (ERST) support is initialized.
GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
�serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input1
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
ehci_hcd 0000:00:1a.0: EHCI Host Controller
ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.0: debug port 2
ehci_hcd 0000:00:1a.0: irq 22, io mem 0xd0f20000
ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb1: SerialNumber: 0000:00:1a.0
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
ehci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
ehci_hcd 0000:00:1d.0: EHCI Host Controller
ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
Refined TSC clocksource calibration: 2693.505 MHz.
Switching to clocksource tsc
ehci_hcd 0000:00:1d.0: debug port 2
ehci_hcd 0000:00:1d.0: irq 20, io mem 0xd0f10000
ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: EHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
PNP: No PS/2 controller found. Probing ports directly.
mice: PS/2 mouse device common for all mice
rtc_cmos 00:06: RTC can wake from S4
rtc_cmos 00:06: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
cpuidle: using governor ladder
cpuidle: using governor menu
EFI Variables Facility v0.08 2004-May-17
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
GRE over IPv4 demultiplexor driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
rtc_cmos 00:06: setting system clock to 2016-10-17 22:20:25 UTC (1476742825)
Initalizing network drop monitor service
Freeing unused kernel memory: 1304k freed
Write protecting the kernel read-only data: 10240k
Freeing unused kernel memory: 724k freed
Freeing unused kernel memory: 1572k freed
rdac: device handler registered
dracut: dracut-004-388.el6
dracut: rd_NO_LUKS: removing cryptoluks activation
dracut: rd_NO_LVM: removing LVM activation
usb 1-1: new high speed USB device number 2 using ehci_hcd
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: dm-devel@redhat.com
udev: starting version 147
usb 1-1: New USB device found, idVendor=8087, idProduct=0024
usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 1-1: configuration #1 chosen from 1 choice
hub 1-1:1.0: USB hub found
hub 1-1:1.0: 6 ports detected
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
usb 2-1: new high speed USB device number 2 using ehci_hcd
ACPI: WMI: Mapper loaded
usb 2-1: New USB device found, idVendor=8087, idProduct=0024
usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 2-1: configuration #1 chosen from 1 choice
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 8 ports detected
mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)
mlx4_core: Initializing 0000:04:00.0
mlx4_core 0000:04:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
usb 2-1.4: new full speed USB device number 3 using ehci_hcd
usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.4: Product: Virtual Keyboard and Mouse
usb 2-1.4: Manufacturer: American Megatrends Inc.
usb 2-1.4: SerialNumber: serial
usb 2-1.4: configuration #1 chosen from 1 choice
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input2
generic-usb 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input3
generic-usb 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)
mlx4_en 0000:04:00.0: registered PHC clock
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
<mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014)
mpt2sas version 20.101.00.00 loaded
mpt2sas 0000:06:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32774632 kB)
mpt2sas0: MSI-X vectors supported: 8, no of cores: 32, max_msix_vectors: 8
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 127
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 128
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 129
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 130
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 131
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 132
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 133
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 134
mpt2sas0: iomem(0x00000000d0a40000), mapped(0xffffc900147c0000), size(65536)
mpt2sas0: ioport(0x0000000000002000), size(256)
mpt2sas0: sending message unit reset !!
mpt2sas0: message unit reset: SUCCESS
mpt2sas0: Allocated physical memory: size(17329 kB)
mpt2sas0: Current Controller Queue Depth(9979), Max Controller Queue Depth(10240)
mpt2sas0: Scatter Gather Elements per IO(128)
mpt2sas0: LSISAS2308: FWVersion(15.00.00.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
mpt2sas0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi0 : Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas0: host_add: handle(0x0001), sas_addr(0x500605b005d6d910), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:41: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:42: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:43: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:44: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:45: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:46: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:41: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:42: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:43: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:44: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:45: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:46: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:0:41: rdac: LUN 41 (RDAC) (owned)
scsi 0:0:0:42: rdac: LUN 42 (RDAC) (unowned)
scsi 0:0:0:43: rdac: LUN 43 (RDAC) (owned)
scsi 0:0:0:44: rdac: LUN 44 (RDAC) (unowned)
scsi 0:0:0:45: rdac: LUN 45 (RDAC) (owned)
scsi 0:0:0:46: rdac: LUN 46 (RDAC) (unowned)
scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:1:41: rdac: LUN 41 (RDAC) (unowned)
scsi 0:0:1:42: rdac: LUN 42 (RDAC) (owned)
scsi 0:0:1:43: rdac: LUN 43 (RDAC) (unowned)
scsi 0:0:1:44: rdac: LUN 44 (RDAC) (owned)
scsi 0:0:1:45: rdac: LUN 45 (RDAC) (unowned)
scsi 0:0:1:46: rdac: LUN 46 (RDAC) (owned)
isci: Intel(R) C600 SAS Controller Driver - version 1.1.0-rh
isci 0000:07:00.0: driver configured for rev: 6 silicon
isci 0000:07:00.0: OEM parameter table found in OROM
isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
isci 0000:07:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
scsi1 : isci
ata1.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata1.00: configured for UDMA/133
scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ata2.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata2.00: configured for UDMA/133
scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ahci 0000:00:1f.2: PCI INT B -> GSI 21 (level, low) -> IRQ 21
ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
scsi2 : ahci
scsi3 : ahci
scsi4 : ahci
scsi5 : ahci
scsi6 : ahci
scsi7 : ahci
ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 137
ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 137
ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 137
ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 137
ata7: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 137
ata8: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 137
ata3: SATA link down (SStatus 0 SControl 300)
ata4: SATA link down (SStatus 0 SControl 300)
ata6: SATA link down (SStatus 0 SControl 300)
ata8: SATA link down (SStatus 0 SControl 300)
ata5: SATA link down (SStatus 0 SControl 300)
ata7: SATA link down (SStatus 0 SControl 300)
%Gsd 0:0:0:7: [sda] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 1:0:0:0: [sdo] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:0:0: [sdo] Write Protect is off
sd 1:0:0:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 1:0:1:0: [sdp] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:1:0: [sdp] Write Protect is off
sd 1:0:1:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sdo:
 sdp:
sd 0:0:0:41: [sdb] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
 sdo1 sdo2
sd 0:0:1:41: [sdi] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:1:45: [sdm] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:43: [sdd] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:42: [sdj] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:42: [sdc] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:43: [sdk] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:44: [sdl] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:46: [sdg] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:46: [sdn] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:41: [sdi] Write Protect is off
sd 0:0:0:7: [sda] Write Protect is off
sd 0:0:0:42: [sdc] Write Protect is off
sd 0:0:1:46: [sdn] Write Protect is off
sd 0:0:1:45: [sdm] Write Protect is off
sd 0:0:0:44: [sde] Write Protect is off
sd 0:0:1:41: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write Protect is off
sd 0:0:0:45: [sdf] Write Protect is off
sd 0:0:0:7: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:42: [sdj] Write Protect is off
sd 0:0:1:44: [sdl] Write Protect is off
sd 0:0:1:46: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:43: [sdk] Write Protect is off
sd 0:0:0:45: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:42: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:44: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:45: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:42: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:43: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:44: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:43: [sdd] Write Protect is off
sd 0:0:0:46: [sdg] Write Protect is off
sd 0:0:0:43: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdn:
 sdf:
 sdh:
 sdj: unknown partition table
 sdc:
sd 1:0:0:0: [sdo] Attached SCSI disk
sd 0:0:0:41: [sdb] Write Protect is off
sd 0:0:0:41: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdi:
sd 0:0:0:45: [sdf] Attached SCSI disk
 unknown partition table
 sdl:
sd 0:0:1:42: [sdj] Attached SCSI disk
 sdk:
 sdd: unknown partition table
 sdm:
sd 0:0:1:44: [sdl] Attached SCSI disk
 unknown partition table
 sde:Dev sdi: unable to read RDB block 0
sd 0:0:0:43: [sdd] Attached SCSI disk
 sda:Dev sdk: unable to read RDB block 0
 unable to read partition table
Dev sde: unable to read RDB block 0
sd 0:0:1:43: [sdk] Attached SCSI disk
 unable to read partition table
 unknown partition table
sd 0:0:1:41: [sdi] Attached SCSI disk
 unable to read partition table
sd 0:0:1:46: [sdn] Attached SCSI disk
Dev sdm: unable to read RDB block 0
sd 0:0:0:44: [sde] Attached SCSI disk
 sdg: sdp1 sdp9
Dev sdc: unable to read RDB block 0
 sdb:
sd 1:0:1:0: [sdp] Attached SCSI disk
 unable to read partition table
 unable to read partition table
sd 0:0:1:45: [sdm] Attached SCSI disk
 unknown partition table
Dev sdg: unable to read RDB block 0
sd 0:0:0:41: [sdb] Attached SCSI disk
sd 0:0:0:42: [sdc] Attached SCSI disk
 unable to read partition table
sd 0:0:0:46: [sdg] Attached SCSI disk
 unknown partition table
sd 0:0:1:7: [sdh] Attached SCSI disk
 unknown partition table
sd 0:0:0:7: [sda] Attached SCSI disk
EXT3-fs (sdo1): recovery required on readonly filesystem
EXT3-fs (sdo1): write access will be enabled during recovery
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sdo1): orphan cleanup on readonly fs
EXT3-fs (sdo1): 7 orphan inodes deleted
EXT3-fs (sdo1): recovery complete
EXT3-fs (sdo1): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/sdo1
SELinux:  Disabled at runtime.
type=1404 audit(1476742843.438:2): selinux=0 auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
cat: /proc/self/attr/current: Invalid argument

		Welcome to CentOS 

Starting udev: udev: starting version 147
dca service started, version 1.12.1
igb: Intel(R) Gigabit Ethernet Network Driver - version 5.2.15-k
igb: Copyright (c) 2007-2014 Intel Corporation.
igb 0000:02:00.0: PCI INT A -> GSI 27 (level, low) -> IRQ 27
igb 0000:02:00.0: added PHC on eth0
igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b3
igb 0000:02:00.0: eth0: PBA No: 100000-000
igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.1: PCI INT B -> GSI 30 (level, low) -> IRQ 30
igb 0000:02:00.1: added PHC on eth1
igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b4
igb 0000:02:00.1: eth1: PBA No: 100000-000
igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.2: PCI INT C -> GSI 28 (level, low) -> IRQ 28
igb 0000:02:00.2: added PHC on eth2
igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b5
igb 0000:02:00.2: eth2: PBA No: 100000-000
igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.3: PCI INT D -> GSI 29 (level, low) -> IRQ 29
igb 0000:02:00.3: added PHC on eth3
igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b6
igb 0000:02:00.3: eth3: PBA No: 100000-000
igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
scsi 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:0:7: Attached scsi generic sg1 type 0
sd 0:0:0:41: Attached scsi generic sg2 type 0
sd 0:0:0:42: Attached scsi generic sg3 type 0
sd 0:0:0:43: Attached scsi generic sg4 type 0
sd 0:0:0:44: Attached scsi generic sg5 type 0
sd 0:0:0:45: Attached scsi generic sg6 type 0
sd 0:0:0:46: Attached scsi generic sg7 type 0
scsi 0:0:1:0: Attached scsi generic sg8 type 0
sd 0:0:1:7: Attached scsi generic sg9 type 0
sd 0:0:1:41: Attached scsi generic sg10 type 0
sd 0:0:1:42: Attached scsi generic sg11 type 0
sd 0:0:1:43: Attached scsi generic sg12 type 0
sd 0:0:1:44: Attached scsi generic sg13 type 0
sd 0:0:1:45: Attached scsi generic sg14 type 0
sd 0:0:1:46: Attached scsi generic sg15 type 0
sd 1:0:0:0: Attached scsi generic sg16 type 0
sd 1:0:1:0: Attached scsi generic sg17 type 0
ioatdma: Intel(R) QuickData Technology Driver 4.00
ioatdma 0000:00:04.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
igb 0000:02:00.0: DCA enabled
igb 0000:02:00.1: DCA enabled
ioatdma 0000:00:04.1: PCI INT B -> GSI 39 (level, low) -> IRQ 39
igb 0000:02:00.2: DCA enabled
igb 0000:02:00.3: DCA enabled
ioatdma 0000:00:04.2: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.3: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.4: PCI INT A -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.5: PCI INT B -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.6: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.7: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:80:04.0: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.1: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.2: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.3: PCI INT D -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.4: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.5: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.6: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.7: PCI INT D -> GSI 63 (level, low) -> IRQ 63
i801_smbus 0000:00:1f.3: PCI INT C -> GSI 23 (level, low) -> IRQ 23
ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
i801_smbus 0000:07:00.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
i801_smbus 0000:07:00.3: Enabling SMBus device
ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042f conflicts with OpRegion 0x0000000000000400-0x000000000000047f (\PMIO) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000053f (\FBPC) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000052f (\_SI_.SIOR) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
lpc_ich: Resource conflict(s) found affecting gpio_ich
EDAC MC: Ver: 2.1.0 Oct 17 2016
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0
EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0
EDAC sbridge: Driver loaded.
%Gzunicode: module license 'CDDL' taints kernel.
Disabling lock debugging due to kernel taint
SPL: Loaded module v0.6.5.7-1
ZFS: Loaded module v0.6.5.7-1, ZFS pool version 5000, ZFS filesystem version 5
iTCO_vendor_support: vendor-support=0
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.07rh
iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
microcode: CPU0 updated to revision 0x710, date = 2013-06-17 
microcode: CPU1 updated to revision 0x710, date = 2013-06-17 
microcode: CPU2 updated to revision 0x710, date = 2013-06-17 
microcode: CPU3 updated to revision 0x710, date = 2013-06-17 
microcode: CPU4 updated to revision 0x710, date = 2013-06-17 
microcode: CPU5 updated to revision 0x710, date = 2013-06-17 
microcode: CPU6 updated to revision 0x710, date = 2013-06-17 
microcode: CPU7 updated to revision 0x710, date = 2013-06-17 
microcode: CPU8 updated to revision 0x710, date = 2013-06-17 
microcode: CPU9 updated to revision 0x710, date = 2013-06-17 
microcode: CPU10 updated to revision 0x710, date = 2013-06-17 
microcode: CPU11 updated to revision 0x710, date = 2013-06-17 
microcode: CPU12 updated to revision 0x710, date = 2013-06-17 
microcode: CPU13 updated to revision 0x710, date = 2013-06-17 
microcode: CPU14 updated to revision 0x710, date = 2013-06-17 
microcode: CPU15 updated to revision 0x710, date = 2013-06-17 
microcode: CPU16 updated to revision 0x710, date = 2013-06-17 
microcode: CPU17 updated to revision 0x710, date = 2013-06-17 
microcode: CPU18 updated to revision 0x710, date = 2013-06-17 
microcode: CPU19 updated to revision 0x710, date = 2013-06-17 
microcode: CPU20 updated to revision 0x710, date = 2013-06-17 
microcode: CPU21 updated to revision 0x710, date = 2013-06-17 
microcode: CPU22 updated to revision 0x710, date = 2013-06-17 
microcode: CPU23 updated to revision 0x710, date = 2013-06-17 
microcode: CPU24 updated to revision 0x710, date = 2013-06-17 
microcode: CPU25 updated to revision 0x710, date = 2013-06-17 
microcode: CPU26 updated to revision 0x710, date = 2013-06-17 
microcode: CPU27 updated to revision 0x710, date = 2013-06-17 
microcode: CPU28 updated to revision 0x710, date = 2013-06-17 
microcode: CPU29 updated to revision 0x710, date = 2013-06-17 
microcode: CPU30 updated to revision 0x710, date = 2013-06-17 
microcode: CPU31 updated to revision 0x710, date = 2013-06-17 
[  OK  ]


Setting hostname lola-10.lola.whamcloud.com:  [  OK  ]


device-mapper: multipath: version 1.6.0 loaded
Oct 17 15:20:49 | ignoring extra data starting with 'udev_dir' on line 2 of /etc/multipath.conf

device-mapper: multipath round-robin: version 1.0.0 loaded
device-mapper: table: 253:0: multipath: error getting device
device-mapper: ioctl: error adding target to table
Add partition mappings:  [  OK  ]


ERROR: asr: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: hpt37x: reading /dev/sdg[Input/output error]

ERROR: hpt45x: reading /dev/sdg[Input/output error]

ERROR: isw: reading /dev/sdg[Input/output error]

ERROR: jmicron: reading /dev/sdg[Input/output error]

ERROR: lsi: reading /dev/sdg[Input/output error]

ERROR: nvidia: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: sil: reading /dev/sdg[Input/output error]

ERROR: via: reading /dev/sdg[Input/output error]

ERROR: asr: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: hpt37x: reading /dev/sde[Input/output error]

ERROR: hpt45x: reading /dev/sde[Input/output error]

ERROR: isw: reading /dev/sde[Input/output error]

ERROR: jmicron: reading /dev/sde[Input/output error]

ERROR: lsi: reading /dev/sde[Input/output error]

ERROR: nvidia: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: sil: reading /dev/sde[Input/output error]

ERROR: via: reading /dev/sde[Input/output error]

ERROR: asr: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: hpt37x: reading /dev/sdk[Input/output error]

ERROR: hpt45x: reading /dev/sdk[Input/output error]

ERROR: isw: reading /dev/sdk[Input/output error]

ERROR: jmicron: reading /dev/sdk[Input/output error]

ERROR: lsi: reading /dev/sdk[Input/output error]

ERROR: nvidia: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: sil: reading /dev/sdk[Input/output error]

ERROR: via: reading /dev/sdk[Input/output error]

ERROR: asr: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: hpt37x: reading /dev/sdm[Input/output error]

ERROR: hpt45x: reading /dev/sdm[Input/output error]

ERROR: isw: reading /dev/sdm[Input/output error]

ERROR: jmicron: reading /dev/sdm[Input/output error]

ERROR: lsi: reading /dev/sdm[Input/output error]

ERROR: nvidia: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: sil: reading /dev/sdm[Input/output error]

ERROR: via: reading /dev/sdm[Input/output error]

ERROR: asr: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: hpt37x: reading /dev/sdc[Input/output error]

ERROR: hpt45x: reading /dev/sdc[Input/output error]

ERROR: isw: reading /dev/sdc[Input/output error]

ERROR: jmicron: reading /dev/sdc[Input/output error]

ERROR: lsi: reading /dev/sdc[Input/output error]

ERROR: nvidia: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: sil: reading /dev/sdc[Input/output error]

ERROR: via: reading /dev/sdc[Input/output error]

ERROR: asr: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: hpt37x: reading /dev/sdi[Input/output error]

ERROR: hpt45x: reading /dev/sdi[Input/output error]

ERROR: isw: reading /dev/sdi[Input/output error]

ERROR: jmicron: reading /dev/sdi[Input/output error]

ERROR: lsi: reading /dev/sdi[Input/output error]

ERROR: nvidia: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: sil: reading /dev/sdi[Input/output error]

ERROR: via: reading /dev/sdi[Input/output error]

Setting up Logical Volume Management: [  OK  ]


Checking filesystems

Checking all file systems.

[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/sdo1 

/dev/sdo1: clean, 131813/1310720 files, 3385011/5242880 blocks

[  OK  ]


RemEXT3-fs (sdo1): using internal journal
ounting root filesystem in read-write mode:  [  OK  ]


Mounting local filesystems:  [  OK  ]


Enabling local filesystem quotas:  [  OK  ]


Enabling /etc/fstab swaps:  Adding 16457724k swap on /dev/sdo2.  Priority:-1 extents:1 across:16457724k 
[  OK  ]


Entering non-interactive startup

Calling the system activity data collector (sadc)... 

Loading OpenIB kernel modules:[  OK  ]


Mounting ZFS filesystem(s)  [  OK  ]


ip6tables: No config file.[WARNING]


iptables: No config file.[WARNING]


Bringing up loopback interface:  [  OK  ]


Bringing up interface eth0:  ADDRCONF(NETDEV_UP): eth0: link is not ready
Determining if ip address 10.4.0.110 is already in use for device eth0...

[  OK  ]


Bringing up interface ib0:  ADDRCONF(NETDEV_UP): ib0: link is not ready
ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
igb 0000:02:00.0: eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
[  OK  ]


Bringing up interface ipmi:  ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Device ipmi does not seem to be present, delaying initialization.

[FAILED]


Starting auditd: type=1305 audit(1476742871.686:3): audit_pid=4479 old=0 auid=4294967295 ses=4294967295 res=1
[  OK  ]


Loading Lustre module stack...LNet: HW CPU cores: 32, npartitions: 2
alg: No test for adler32 (adler32-zlib)
alg: No test for crc32 (crc32-table)
alg: No test for crc32 (crc32-pclmul)
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
Lustre: Lustre: Build Version: 2.8.59_25_g401d7fc
LNet: Added LNI 192.168.1.110@o2ib10 [8/256/0/180]


Starting system logger: [  OK  ]


Enabling ondemand cpu frequency scaling: [  OK  ]


Starting irqbalance: [  OK  ]


Starting rpcbind: [  OK  ]


ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Starting NFS statd: [  OK  ]


Starting system message bus: [  OK  ]


Setting NIS domain: domain is 'lola.whamcloud.com'  [  OK  ]


Starting NIS service: [  OK  ]


Binding NIS service: [  OK  ]


Starting ibacm daemon:[  OK  ]


NFS filesystems queued to be mounted

Mounting filesystems:  RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Slow work thread pool: Starting up
Slow work thread pool: Ready
FS-Cache: Loaded
NFS: Registering the id_resolver key type
FS-Cache: Netfs 'nfs' registered for caching
[  OK  ]


Starting acpi daemon: [  OK  ]


Starting HAL daemon: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
[  OK  ]


Retrigger failed udev events[  OK  ]


Starting ZFS Event Daemon  [  OK  ]
[  OK  ]


Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Starting NFS services:  [  OK  ]


Starting NFS quotas: [  OK  ]


Starting NFS mountd: [  OK  ]


Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
[  OK  ]


Starting RPC idmapd: [  OK  ]


Sharing ZFS filesystems  [  OK  ]


Starting MUNGE: mungedib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
[  OK  ]


Detected change(s) the following file(s):

  

  /boot/vmlinuz-2.6.32-573.26.1.el6_lustre.x86_64

Rebuilding /boot/initrd-2.6.32-573.26.1.el6_lustre.x86_64kdump.img

ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Warning: There might not be enough space to save a vmcore.

         The size of UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 should be greater than 32774632 kilo bytes.

Starting kdump:[  OK  ]


Starting sshd: [  OK  ]


Starting xinetd: [  OK  ]


Starting ntpd: [  OK  ]


Starting GANGLIA gmond: [  OK  ]


Starting sendmail: [  OK  ]


Starting sm-client: [  OK  ]


Starting crond: [  OK  ]


802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
8021q: adding VLAN 0 to HW filter on device eth0
starting slurmd: [  OK  ]


Starting atd: [  OK  ]


Starting collectl: [  OK  ]



CentOS release 6.7 (Final)
Kernel 2.6.32-573.26.1.el6_lustre.x86_64 on an x86_64

lola-10.lola.whamcloud.com login: Oct 17 15:25:01 lola-10 TIME: Time stamp for console
Oct 17 15:30:02 lola-10 TIME: Time stamp for console
LDISKFS-fs warning (device dm-4): ldiskfs_multi_mount_protect: MMP interval 42 higher than expected, please wait.

LDISKFS-fs (dm-4): recovery complete
LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. quota=on. Opts: 
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. quota=on. Opts: 
Oct 17 15:35:01 lola-10 TIME: Time stamp for console
LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. quota=on. Opts: 
LustreError: 11-0: soaked-MDT0000-osp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476743914/real 1476743914]  req@ffff88081f828380 x1548477142139152/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476743919 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476743914/real 1476743914]  req@ffff8808182abc80 x1548477142139264/t0(0) o8->soaked-OST0006-osc-MDT0002@192.168.1.102@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476743919 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 8 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.108@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.109@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: soaked-MDT0002: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10)
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476743939/real 1476743939]  req@ffff880835b57cc0 x1548477142140368/t0(0) o8->soaked-OST0010-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476743944 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 15 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0001_UUID (at 192.168.1.103@o2ib10)
Lustre: soaked-OST0001-osc-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476743939/real 1476743939]  req@ffff88082c1b6c80 x1548477142140448/t0(0) o8->soaked-OST0015-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476743944 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10)
Lustre: soaked-MDT0002: Will be in recovery for at least 5:00, or until 2 clients reconnect
Lustre: soaked-MDT0002: Connection restored to 192.168.1.105@o2ib10 (at 192.168.1.105@o2ib10)
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476743964/real 1476743964]  req@ffff88082f0b7c80 x1548477142141152/t0(0) o8->soaked-OST0016-osc-MDT0002@192.168.1.106@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476743974 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 10 previous similar messages
Lustre: soaked-MDT0002: Recovery over after 0:28, of 3 clients 3 recovered and 0 were evicted.
Lustre: soaked-OST0004-osc-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: Skipped 2 previous similar messages
Oct 17 15:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-OST0009-osc-MDT0002: Connection restored to 192.168.1.105@o2ib10 (at 192.168.1.105@o2ib10)
Lustre: Skipped 8 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0004_UUID (at 192.168.1.106@o2ib10)
Lustre: Skipped 24 previous similar messages
Lustre: soaked-MDT0000-osp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Lustre: Skipped 5 previous similar messages
Oct 17 15:45:01 lola-10 TIME: Time stamp for console
Oct 17 15:50:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_disconnect to node 192.168.1.108@o2ib10 failed: rc = -19
LustreError: Skipped 1 previous similar message
Lustre: 17684:0:(lwp_dev.c:185:lwp_disconnect()) soaked-MDT0000-lwp-MDT0002: can't disconnect: rc = -19
LustreError: 17684:0:(obd_mount_server.c:953:lustre_disconnect_lwp()) soaked-MDT0000-lwp-MDT0002: fail to disconnect LWP: rc = -19
Lustre: 17684:0:(obd_mount_server.c:1524:server_put_super()) soaked-MDT0002: failed to disconnect lwp: rc= -19
Lustre: Failing over soaked-MDT0002
LustreError: 4556:0:(import.c:662:ptlrpc_connect_import()) can't connect to a closed import
LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 1 previous similar message
Lustre: 17684:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476744714/real 1476744714]  req@ffff8804152700c0 x1548477142309216/t0(0) o251->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 224/224 e 0 to 1 dl 1476744720 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 17684:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: server umount soaked-MDT0002 complete
Oct 17 15:55:01 lola-10 TIME: Time stamp for console
LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. quota=on. Opts: 
LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. quota=on. Opts: 
LustreError: 11-0: soaked-MDT0000-osp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: Skipped 2 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476745098/real 1476745098]  req@ffff880818ed6980 x1548477142309872/t0(0) o8->soaked-OST0017-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476745103 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib10)
Lustre: Skipped 18 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.108@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
Oct 17 16:00:01 lola-10 TIME: Time stamp for console
Oct 17 16:05:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-MDT0001-osp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -19
Oct 17 16:10:01 lola-10 TIME: Time stamp for console
Oct 17 16:15:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-MDT0001-osp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -19
Oct 17 16:20:01 lola-10 TIME: Time stamp for console
Oct 17 16:25:01 lola-10 TIME: Time stamp for console
Oct 17 16:30:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-MDT0001-osp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -19
Oct 17 16:35:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476747298/real 1476747298]  req@ffff880820bc7380 x1548477142483056/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476747314 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 24 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476747348/real 0]  req@ffff880834422c80 x1548477142486992/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476747369 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476747398/real 1476747398]  req@ffff88081705d980 x1548477142490928/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476747424 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476747448/real 1476747448]  req@ffff8808330cac80 x1548477142494864/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476747479 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476747498/real 0]  req@ffff88081ead3980 x1548477142498800/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476747534 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Oct 17 16:40:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476747623/real 1476747623]  req@ffff880838014c80 x1548477142508592/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476747664 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476747673/real 1476747673]  req@ffff88082de98cc0 x1548477142512528/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476747719 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476747723/real 1476747723]  req@ffff880833638c80 x1548477142516464/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476747774 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476747823/real 1476747823]  req@ffff880817fee9c0 x1548477142524336/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476747879 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
LustreError: 11-0: soaked-MDT0001-osp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -19
Oct 17 16:45:01 lola-10 TIME: Time stamp for console
Lustre: 4582:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476747948/real 0]  req@ffff88082d5073c0 x1548477142534192/t0(0) o400->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1476747955 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4582:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.102@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 3 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 3 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 3 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.106@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 7 previous similar messages
Oct 17 16:50:01 lola-10 TIME: Time stamp for console
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 5 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.102@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.102@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 1 previous similar message
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476748180/real 0]  req@ffff880817cdb680 x1548477142552496/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476748236 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 31 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 19 previous similar messages
Lustre: Failing over soaked-MDT0002
LustreError: 17915:0:(llog_osd.c:2022:llog_osd_get_cat_list()) soaked-MDT0000-osp-MDT0002: error reading CATALOGS: rc = -5
LustreError: 17916:0:(osp_object.c:527:osp_attr_get()) soaked-MDT0001-osp-MDT0002:osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5
LustreError: 17916:0:(lod_sub_object.c:959:lod_sub_prep_llog()) soaked-MDT0002-mdtlov: can't get id from catalogs: rc = -5
LustreError: 17916:0:(lod_dev.c:419:lod_sub_recovery_thread()) soaked-MDT0001-osp-MDT0002 getting update log failed: rc = -5
LustreError: 17915:0:(llog_osd.c:2022:llog_osd_get_cat_list()) Skipped 1 previous similar message
LustreError: 4566:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff88041461d980 x1548477142560464/t0(0) o13->soaked-OST000e-osc-MDT0002@192.168.1.104@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4563:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff8804357019c0 x1548477142560448/t0(0) o13->soaked-OST0013-osc-MDT0002@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4563:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 1 previous similar message
LustreError: 4566:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 2 previous similar messages
Lustre: server umount soaked-MDT0002 complete
LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. quota=on. Opts: 
Oct 17 16:55:01 lola-10 TIME: Time stamp for console
Oct 17 17:00:01 lola-10 TIME: Time stamp for console
Oct 17 17:05:01 lola-10 TIME: Time stamp for console
LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. quota=on. Opts: 
LustreError: 11-0: soaked-MDT0000-osp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476749237/real 1476749237]  req@ffff8808230563c0 x1548477142560800/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476749242 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: soaked-MDT0002: Will be in recovery for at least 5:00, or until 1 client reconnects
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib10)
Lustre: Skipped 25 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.108@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 23 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: soaked-MDT0002: Denying connection for new client 8def2455-4284-8b62-26e8-f9e60ca767e5(at 192.168.1.113@o2ib100), waiting for 2 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 4:40
LustreError: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Denying connection for new client f8dc1698-672d-e295-5801-379aa47bf342(at 192.168.1.113@o2ib100), waiting for 2 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 4:35
Lustre: soaked-MDT0002: Recovery over after 0:45, of 3 clients 3 recovered and 0 were evicted.
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0004_UUID (at 192.168.1.106@o2ib10)
Lustre: Skipped 23 previous similar messages
Oct 17 17:10:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0001-osp-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Lustre: Skipped 23 previous similar messages
Oct 17 17:15:01 lola-10 TIME: Time stamp for console
Oct 17 17:20:01 lola-10 TIME: Time stamp for console
Oct 17 17:25:01 lola-10 TIME: Time stamp for console
Oct 17 17:30:01 lola-10 TIME: Time stamp for console
Oct 17 17:35:01 lola-10 TIME: Time stamp for console
Oct 17 17:40:01 lola-10 TIME: Time stamp for console
Oct 17 17:45:01 lola-10 TIME: Time stamp for console
Oct 17 17:50:01 lola-10 TIME: Time stamp for console
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476751812/real 0]  req@ffff8803efd49380 x1548477164904368/t0(0) o400->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 224/224 e 0 to 1 dl 1476751819 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail
Lustre: soaked-MDT0000-osp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476751900/real 1476751900]  req@ffff8807f8649cc0 x1548477164911440/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476751911 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 54 previous similar messages
Lustre: soaked-MDT0002: haven't heard from client soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib10) in 227 seconds. I think it's dead, and I am evicting it. exp ffff88081f37b800, cur 1476752012 expire 1476751862 last 1476751785
LustreError: 19173:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476751794, 300s ago), entering recovery for soaked-MDT0000_UUID@192.168.1.108@o2ib10 ns: soaked-MDT0000-osp-MDT0002 lock: ffff8803f387e540/0x8dd5124751534a0d lrc: 4/0,1 mode: --/EX res: [0x200007162:0x6727:0x0].0x0 bits 0x2 rrc: 1 type: IBT flags: 0x1000001000000 nid: local remote: 0xece6db58fc4af9c5 expref: -99 pid: 19173 timeout: 0 lvb_type: 0
LustreError: 19097:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476751796, 300s ago), entering recovery for soaked-MDT0000_UUID@192.168.1.108@o2ib10 ns: soaked-MDT0000-osp-MDT0002 lock: ffff8803f0294dc0/0x8dd5124751537223 lrc: 4/0,1 mode: --/EX res: [0x200007162:0x6730:0x0].0x0 bits 0x2 rrc: 1 type: IBT flags: 0x1000001000000 nid: local remote: 0xece6db58fc4afaf2 expref: -99 pid: 19097 timeout: 0 lvb_type: 0
LustreError: 19097:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) Skipped 1 previous similar message
Oct 17 17:55:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476752125/real 1476752125]  req@ffff8803f31f99c0 x1548477164929296/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476752151 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
Lustre: soaked-MDT0002: Connection restored to MGC192.168.1.108@o2ib10_1 (at 192.168.1.109@o2ib10)
LustreError: 167-0: soaked-MDT0000-lwp-MDT0002: This client was evicted by soaked-MDT0000; in progress operations using this service will fail.
Lustre: Evicted from MGS (at MGC192.168.1.108@o2ib10_1) after server handle changed from 0xece6db58fbeda043 to 0xbc8394251a7d8827
Lustre: soaked-MDT0000-osp-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Lustre: Skipped 2 previous similar messages
LNet: Service thread pid 19199 completed after 533.33s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 1 previous similar message
LustreError: 11-0: soaked-MDT0000-osp-MDT0002: operation out_update to node 192.168.1.109@o2ib10 failed: rc = -19
LustreError: Skipped 1 previous similar message
Lustre: soaked-MDT0000-osp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation obd_ping to node 192.168.1.109@o2ib10 failed: rc = -107
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will fail
Lustre: Evicted from MGS (at MGC192.168.1.108@o2ib10_0) after server handle changed from 0xbc8394251a7d8827 to 0xfaadc3f7177d604
LustreError: 167-0: soaked-MDT0000-lwp-MDT0002: This client was evicted by soaked-MDT0000; in progress operations using this service will fail.
Oct 17 18:00:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0000-osp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Lustre: Skipped 3 previous similar messages
Oct 17 18:05:01 lola-10 TIME: Time stamp for console
Oct 17 18:10:01 lola-10 TIME: Time stamp for console
Oct 17 18:15:01 lola-10 TIME: Time stamp for console
Oct 17 18:20:01 lola-10 TIME: Time stamp for console
Oct 17 18:25:01 lola-10 TIME: Time stamp for console
Oct 17 18:30:01 lola-10 TIME: Time stamp for console
Lustre: 4569:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476754233/real 0]  req@ffff8803f1d2d080 x1548477182144384/t0(0) o400->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 224/224 e 0 to 1 dl 1476754240 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4569:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.109@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.130@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 6 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 3 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.116@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 4 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476754290/real 1476754290]  req@ffff8803f312c680 x1548477182303104/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476754301 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.127@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 17 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.117@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 8 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.126@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 41 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476754390/real 1476754390]  req@ffff88040b35b9c0 x1548477182571728/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476754411 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.117@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 49 previous similar messages
LDISKFS-fs warning (device dm-5): ldiskfs_multi_mount_protect: MMP interval 42 higher than expected, please wait.

Oct 17 18:35:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476754540/real 1476754540]  req@ffff880413789980 x1548477183171024/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476754576 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
LDISKFS-fs (dm-5): recovery complete
LDISKFS-fs (dm-5): mounted filesystem with ordered data mode. quota=on. Opts: 
Lustre: soaked-MDT0002: Received LWP connection from 0@lo, removing former export from 192.168.1.111@o2ib10
Lustre: soaked-MDT0002: Connection restored to  (at 0@lo)
Lustre: soaked-MDT0003: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-450
Lustre: soaked-MDT0003: Will be in recovery for at least 2:30, or until 22 clients reconnect
Lustre: soaked-MDT0003: Connection restored to 01cae752-0caa-1cb3-98fd-0d64e17eaaf8 (at 192.168.1.123@o2ib100)
Lustre: Skipped 8 previous similar messages
Lustre: soaked-MDT0003: Recovery over after 0:34, of 22 clients 22 recovered and 0 were evicted.
Lustre: Failing over soaked-MDT0003
LustreError: 19902:0:(osp_precreate.c:615:osp_precreate_send()) soaked-OST000c-osc-MDT0003: can't precreate: rc = -5
LustreError: 19902:0:(osp_precreate.c:1225:osp_precreate_thread()) soaked-OST000c-osc-MDT0003: cannot precreate objects: rc = -5
Lustre: soaked-MDT0003: Not available for connect from 192.168.1.127@o2ib100 (stopping)
LustreError: 4586:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff8807fb57a9c0 x1548477183467856/t0(0) o13->soaked-OST000e-osc-MDT0003@192.168.1.104@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4586:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 1 previous similar message
LustreError: 4574:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff8807f5c38680 x1548477183469328/t0(0) o13->soaked-OST0010-osc-MDT0003@192.168.1.106@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4574:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 3 previous similar messages
Lustre: soaked-MDT0003: Not available for connect from 192.168.1.107@o2ib10 (stopping)
Lustre: Skipped 13 previous similar messages
Lustre: soaked-MDT0003: Not available for connect from 192.168.1.131@o2ib100 (stopping)
Lustre: Skipped 1 previous similar message
LustreError: 4562:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff880413789980 x1548477183486192/t0(0) o13->soaked-OST0013-osc-MDT0003@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4562:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 5 previous similar messages
LustreError: 11-0: soaked-MDT0003-osp-MDT0002: operation obd_ping to node 0@lo failed: rc = -107
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 4587:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff8807f4a8d380 x1548477183491280/t0(0) o13->soaked-OST0011-osc-MDT0003@192.168.1.107@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4587:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 9 previous similar messages
Lustre: server umount soaked-MDT0003 complete
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.113@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 119 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib10)
Lustre: Skipped 38 previous similar messages
Lustre: soaked-MDT0003-osp-MDT0002: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10)
Oct 17 18:40:01 lola-10 TIME: Time stamp for console
Lustre: 4582:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476754985/real 0]  req@ffff8807f4e4a6c0 x1548477185485568/t0(0) o13->soaked-OST000a-osc-MDT0002@192.168.1.106@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476754992 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST0016-osc-MDT0002: Connection to soaked-OST0016 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4582:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
LustreError: 18805:0:(osp_precreate.c:615:osp_precreate_send()) soaked-OST000a-osc-MDT0002: can't precreate: rc = -5
LustreError: 18817:0:(osp_precreate.c:1225:osp_precreate_thread()) soaked-OST0010-osc-MDT0002: cannot precreate objects: rc = -5
LustreError: 18805:0:(osp_precreate.c:615:osp_precreate_send()) Skipped 2 previous similar messages
Oct 17 18:45:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.107@o2ib10, removing former export from 192.168.1.106@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10)
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.107@o2ib10, removing former export from 192.168.1.106@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.107@o2ib10, removing former export from 192.168.1.106@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.107@o2ib10, removing former export from 192.168.1.106@o2ib10
LustreError: 11-0: soaked-OST0016-osc-MDT0002: operation ost_destroy to node 192.168.1.107@o2ib10 failed: rc = -107
Lustre: soaked-OST0016-osc-MDT0002: Connection to soaked-OST0016 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 3 previous similar messages
LustreError: Skipped 6 previous similar messages
LustreError: 11-0: soaked-OST0004-osc-MDT0002: operation ost_destroy to node 192.168.1.107@o2ib10 failed: rc = -107
LustreError: Skipped 1 previous similar message
Lustre: soaked-OST0004-osc-MDT0002: Connection to soaked-OST0004 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST000a-osc-MDT0002: operation ost_statfs to node 192.168.1.107@o2ib10 failed: rc = -107
Lustre: soaked-OST000a-osc-MDT0002: Connection to soaked-OST000a (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST0010-osc-MDT0002: operation ost_destroy to node 192.168.1.107@o2ib10 failed: rc = -107
Oct 17 18:50:01 lola-10 TIME: Time stamp for console
Oct 17 18:55:01 lola-10 TIME: Time stamp for console
Oct 17 19:00:01 lola-10 TIME: Time stamp for console
Oct 17 19:05:01 lola-10 TIME: Time stamp for console
Oct 17 19:10:01 lola-10 TIME: Time stamp for console
Oct 17 19:15:01 lola-10 TIME: Time stamp for console
Oct 17 19:20:01 lola-10 TIME: Time stamp for console
Oct 17 19:25:01 lola-10 TIME: Time stamp for console
Oct 17 19:30:01 lola-10 TIME: Time stamp for console
Lustre: 4566:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476757871/real 0]  req@ffff8803f02b90c0 x1548477222901440/t0(0) o103->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:17/18 lens 328/224 e 0 to 1 dl 1476757878 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4566:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 60 previous similar messages
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 24 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 26 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476757978/real 1476757978]  req@ffff8807f32286c0 x1548477223416160/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476757994 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 50 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 54 previous similar messages
Oct 17 19:35:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476758128/real 1476758128]  req@ffff8807ede606c0 x1548477227089488/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476758159 ref 2 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.102@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 115 previous similar messages
LDISKFS-fs warning (device dm-5): ldiskfs_multi_mount_protect: MMP interval 42 higher than expected, please wait.

LustreError: 19173:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476757871, 300s ago), entering recovery for soaked-MDT0003_UUID@192.168.1.110@o2ib10 ns: soaked-MDT0003-osp-MDT0002 lock: ffff8803beb5e140/0x8dd51247557d50d1 lrc: 4/0,1 mode: --/EX res: [0x2c00059f1:0x10aa9:0x0].0x0 bits 0x2 rrc: 4 type: IBT flags: 0x1000001000000 nid: local remote: 0x841f54db7a18b95b expref: -99 pid: 19173 timeout: 0 lvb_type: 0
LustreError: 19173:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) Skipped 2 previous similar messages
LDISKFS-fs (dm-5): recovery complete
LDISKFS-fs (dm-5): mounted filesystem with ordered data mode. quota=on. Opts: 
Lustre: soaked-MDT0002: Received LWP connection from 0@lo, removing former export from 192.168.1.111@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.110@o2ib10 (at 0@lo)
Lustre: Skipped 15 previous similar messages
Lustre: soaked-MDT0003: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-450
Lustre: soaked-MDT0003: Will be in recovery for at least 2:30, or until 22 clients reconnect
Lustre: soaked-MDT0003: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10)
Lustre: Skipped 42 previous similar messages
Lustre: soaked-MDT0003: Recovery over after 0:46, of 22 clients 22 recovered and 0 were evicted.
LNet: Service thread pid 19170 completed after 379.35s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 12 previous similar messages
Lustre: Failing over soaked-MDT0003
LustreError: 11-0: soaked-MDT0003-osp-MDT0002: operation ldlm_cancel to node 0@lo failed: rc = -19
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
LustreError: Skipped 1 previous similar message
LustreError: 4575:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff88079e45f080 x1548477232734560/t0(0) o13->soaked-OST0009-osc-MDT0003@192.168.1.105@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4575:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 3 previous similar messages
Lustre: soaked-MDT0003: Not available for connect from 192.168.1.116@o2ib100 (stopping)
Lustre: Skipped 1 previous similar message
LustreError: 4571:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff8803c5f06080 x1548477232838416/t0(0) o13->soaked-OST000f-osc-MDT0003@192.168.1.105@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4571:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 2 previous similar messages
LustreError: 4557:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff8803c25af380 x1548477232893952/t0(0) o13->soaked-OST0011-osc-MDT0003@192.168.1.107@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4557:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 7 previous similar messages
Lustre: soaked-MDT0003: Not available for connect from 192.168.1.107@o2ib10 (stopping)
Lustre: Skipped 2 previous similar messages
sd 0:0:1:44: attempting task abort! scmd(ffff8803cd6580c0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 0f b8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803cd6580c0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c9a18480)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 0f c8 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c9a18480)
sd 0:0:1:44: attempting task abort! scmd(ffff8803a920d380)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 0f f0 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803a920d380)
sd 0:0:1:44: attempting task abort! scmd(ffff8803a9223980)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 15 78 00 00 28 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803a9223980)
sd 0:0:1:44: attempting task abort! scmd(ffff8803a9223b80)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 15 b0 00 00 40 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803a9223b80)
sd 0:0:1:44: attempting task abort! scmd(ffff8803a9223e80)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 16 08 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803a9223e80)
sd 0:0:1:44: attempting task abort! scmd(ffff8803a9226ac0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 16 10 00 00 38 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803a9226ac0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803a9223a80)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 16 50 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803a9223a80)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c9a18d80)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 16 88 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c9a18d80)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c9a18580)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 16 a0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c9a18580)
sd 0:0:1:44: attempting task abort! scmd(ffff8803a9226dc0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 16 a8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803a9226dc0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803a9226ec0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 16 c0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803a9226ec0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803a934bdc0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 16 d8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803a934bdc0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c9a2a080)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 16 f0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c9a2a080)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c9a2d4c0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 16 f8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c9a2d4c0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c9a267c0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 17 08 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c9a267c0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803b0facb80)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 17 20 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803b0facb80)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c9a21a80)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 17 38 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c9a21a80)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c9a264c0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 17 48 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c9a264c0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c9a263c0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 17 60 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c9a263c0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c9a266c0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 17 88 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c9a266c0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803eed1c0c0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 17 b0 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803eed1c0c0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803a93664c0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 17 d0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803a93664c0)
sd 0:0:1:44: attempting task abort! scmd(ffff8803c6e16bc0)
sd 0:0:1:44: [sdl] CDB: Write(10): 2a 00 00 00 17 e8 00 00 38 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:44: task abort: SUCCESS scmd(ffff8803c6e16bc0)
Lustre: server umount soaked-MDT0003 complete
Lustre: soaked-MDT0002: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10)
Lustre: Skipped 4 previous similar messages
Oct 17 19:40:01 lola-10 TIME: Time stamp for console
Oct 17 19:45:01 lola-10 TIME: Time stamp for console
Oct 17 19:50:01 lola-10 TIME: Time stamp for console
Oct 17 19:55:01 lola-10 TIME: Time stamp for console
Oct 17 20:00:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8807a7543cc0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0e c8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a7543cc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a7c596c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0e e0 00 00 00 18 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a7c596c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ee1710c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 28 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ee1710c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f49fbcc0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 38 00 00 00 18 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f49fbcc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807edd9cd80)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 70 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807edd9cd80)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a7c594c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 90 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a7c594c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807edd9c280)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f d0 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807edd9c280)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a7e5e580)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f e0 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a7e5e580)
sd 0:0:1:42: attempting task abort! scmd(ffff8807cdcd41c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f f8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807cdcd41c0)
Oct 17 20:05:01 lola-10 TIME: Time stamp for console
Oct 17 20:10:01 lola-10 TIME: Time stamp for console
Oct 17 20:15:01 lola-10 TIME: Time stamp for console
Lustre: 4581:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476760687/real 0]  req@ffff88082781c9c0 x1548477271301776/t0(0) o13->soaked-OST000d-osc-MDT0002@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476760694 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4581:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
Lustre: soaked-OST000d-osc-MDT0002: Connection to soaked-OST000d (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0013-osc-MDT0002: Connection to soaked-OST0013 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 2 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476760745/real 1476760745]  req@ffff88041446f6c0 x1548477272136944/t0(0) o8->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476760756 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 24 previous similar messages
Oct 17 20:20:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476760845/real 1476760845]  req@ffff8803f1e93380 x1548477272435072/t0(0) o8->soaked-OST0001-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476760866 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476761020/real 1476761020]  req@ffff8803f043e080 x1548477272483952/t0(0) o8->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476761056 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
Oct 17 20:25:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0013_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0001_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0007_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST000d_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 119 previous similar messages
Lustre: soaked-OST0001-osc-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 2 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 4 previous similar messages
Oct 17 20:30:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 5 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 10 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 10 previous similar messages
Oct 17 20:35:01 lola-10 TIME: Time stamp for console
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 20 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0013_UUID (at 192.168.1.103@o2ib10)
Lustre: Skipped 4 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0013_UUID (at 192.168.1.103@o2ib10)
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 17 previous similar messages
Lustre: soaked-MDT0002: Client fba24f35-5625-e003-a958-29928c5e620b (at 192.168.1.120@o2ib100) reconnecting
Oct 17 20:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 4236c3da-7f64-f6f1-4440-63ec2a6974d3 (at 192.168.1.132@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 4236c3da-7f64-f6f1-4440-63ec2a6974d3 (at 192.168.1.132@o2ib100)
Lustre: Skipped 2 previous similar messages
Oct 17 20:45:01 lola-10 TIME: Time stamp for console
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 38 previous similar messages
Lustre: soaked-MDT0002: Client a3d948b8-7745-adee-d8bc-8f3f12a2cff5 (at 192.168.1.126@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to a3d948b8-7745-adee-d8bc-8f3f12a2cff5 (at 192.168.1.126@o2ib100)
Oct 17 20:50:01 lola-10 TIME: Time stamp for console
Oct 17 20:55:01 lola-10 TIME: Time stamp for console
Oct 17 21:00:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8803c75377c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e e8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c75377c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c75376c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e f8 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c75376c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c75375c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 20 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c75375c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c75374c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 38 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c75374c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c75373c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 40 00 00 30 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c75373c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c75372c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 80 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c75372c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c75371c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 98 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c75371c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c75370c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f c8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c75370c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880384414e80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f d0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880384414e80)
sd 0:0:1:42: attempting task abort! scmd(ffff880384414d80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e8 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880384414d80)
Lustre: soaked-MDT0002: Client a88bbb17-2144-f5a0-f288-6259da2e8aff (at 192.168.1.129@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to a88bbb17-2144-f5a0-f288-6259da2e8aff (at 192.168.1.129@o2ib100)
Oct 17 21:05:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client fba24f35-5625-e003-a958-29928c5e620b (at 192.168.1.120@o2ib100) reconnecting
Oct 17 21:10:01 lola-10 TIME: Time stamp for console
Lustre: 19174:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476763947/real 1476763947]  req@ffff8803f0afb980 x1548477333215296/t0(0) o104->soaked-MDT0002@192.168.1.125@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476763954 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 19174:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
Oct 17 21:15:01 lola-10 TIME: Time stamp for console
Lustre: 19173:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476764314/real 1476764314]  req@ffff8803bea9d0c0 x1548477339807600/t0(0) o104->soaked-MDT0002@192.168.1.123@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476764321 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Oct 17 21:20:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client a88bbb17-2144-f5a0-f288-6259da2e8aff (at 192.168.1.129@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to a88bbb17-2144-f5a0-f288-6259da2e8aff (at 192.168.1.129@o2ib100)
Lustre: Skipped 1 previous similar message
Oct 17 21:25:01 lola-10 TIME: Time stamp for console
Oct 17 21:30:01 lola-10 TIME: Time stamp for console
Oct 17 21:35:01 lola-10 TIME: Time stamp for console
Oct 17 21:40:01 lola-10 TIME: Time stamp for console
Oct 17 21:45:01 lola-10 TIME: Time stamp for console
Oct 17 21:50:01 lola-10 TIME: Time stamp for console
Oct 17 21:55:01 lola-10 TIME: Time stamp for console
Oct 17 22:00:01 lola-10 TIME: Time stamp for console
Oct 17 22:05:01 lola-10 TIME: Time stamp for console
Oct 17 22:10:01 lola-10 TIME: Time stamp for console
Oct 17 22:15:01 lola-10 TIME: Time stamp for console
Oct 17 22:20:01 lola-10 TIME: Time stamp for console
Lustre: 18783:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476768140/real 1476768140]  req@ffff8807f3aaa6c0 x1548477394744704/t0(0) o1000->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 2640/4320 e 0 to 1 dl 1476768184 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-MDT0001-osp-MDT0002: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476768170/real 1476768194]  req@ffff8803cdd293c0 x1548477394747696/t0(0) o400->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 224/224 e 0 to 1 dl 1476768214 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476768234/real 1476768234]  req@ffff8803ca9c2380 x1548477394752768/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476768245 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476768284/real 1476768284]  req@ffff8803efded6c0 x1548477394756768/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476768300 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Oct 17 22:25:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476768459/real 1476768478]  req@ffff8803caae46c0 x1548477394770720/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476768485 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.108@o2ib10, removing former export from 192.168.1.109@o2ib10
LustreError: 18752:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff8807cf37f080 x1548477394779088/t0(0) o105->soaked-MDT0002@192.168.1.109@o2ib10:15/16 lens 304/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
Lustre: soaked-MDT0002: Connection restored to MGC192.168.1.108@o2ib10_0 (at 192.168.1.108@o2ib10)
LustreError: 18752:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 11 previous similar messages
LustreError: 18752:0:(ldlm_lockd.c:687:ldlm_handle_ast_error()) ### client (nid 192.168.1.109@o2ib10) failed to reply to completion AST (req@ffff8807cf37f080 x1548477394779088 status 0 rc -5), evict it ns: mdt-soaked-MDT0002_UUID lock: ffff8807a64d3a80/0x8dd512475bba2e7e lrc: 3/0,0 mode: EX/EX res: [0x2800069a9:0x7269:0x0].0x0 bits 0x2 rrc: 3 type: IBT flags: 0x40000001000000 nid: 192.168.1.109@o2ib10 remote: 0xbc8394252162c725 expref: 80 pid: 19143 timeout: 0 lvb_type: 0
LustreError: 138-a: soaked-MDT0002: A client on nid 192.168.1.109@o2ib10 was evicted due to a lock completion callback time out: rc -5
Oct 17 22:30:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0001-osp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
LNet: Service thread pid 19199 completed after 476.02s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 4 previous similar messages
LustreError: 11-0: soaked-MDT0001-osp-MDT0002: operation ldlm_cancel to node 192.168.1.108@o2ib10 failed: rc = -19
Lustre: soaked-MDT0001-osp-MDT0002: Connection to soaked-MDT0001 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Lustre: soaked-MDT0001-osp-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Oct 17 22:35:01 lola-10 TIME: Time stamp for console
Oct 17 22:40:01 lola-10 TIME: Time stamp for console
Oct 17 22:45:01 lola-10 TIME: Time stamp for console
Oct 17 22:50:01 lola-10 TIME: Time stamp for console
Oct 17 22:55:01 lola-10 TIME: Time stamp for console
Oct 17 23:00:01 lola-10 TIME: Time stamp for console
Oct 17 23:05:01 lola-10 TIME: Time stamp for console
Lustre: 4585:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476770930/real 0]  req@ffff88077cff2c80 x1548477411598624/t0(0) o13->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476770937 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST0001-osc-MDT0002: Connection to soaked-OST0001 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4585:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-OST000d-osc-MDT0002: Connection to soaked-OST000d (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: soaked-OST0013-osc-MDT0002: Connection to soaked-OST0013 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0002: Client f8dc1698-672d-e295-5801-379aa47bf342 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to fba24f35-5625-e003-a958-29928c5e620b (at 192.168.1.120@o2ib100)
Lustre: Skipped 1 previous similar message
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.121@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 33 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476770990/real 1476770990]  req@ffff8807f4faecc0 x1548477411698960/t0(0) o8->soaked-OST0001-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476771001 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 38 previous similar messages
Lustre: soaked-MDT0002: Client fba24f35-5625-e003-a958-29928c5e620b (at 192.168.1.120@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to fba24f35-5625-e003-a958-29928c5e620b (at 192.168.1.120@o2ib100)
Lustre: Skipped 1 previous similar message
Oct 17 23:10:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476771040/real 1476771040]  req@ffff8803f33cc080 x1548477412363328/t0(0) o8->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476771056 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476771165/real 1476771165]  req@ffff8803bd3dc680 x1548477414165392/t0(0) o8->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476771191 ref 2 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Oct 17 23:15:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476771290/real 1476771290]  req@ffff8803cd1f63c0 x1548477414956544/t0(0) o8->soaked-OST0013-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476771326 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0013_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0001_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0007_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST000d_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
Lustre: soaked-OST0013-osc-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 5 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 10 previous similar messages
Oct 17 23:20:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 9 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 22 previous similar messages
Oct 17 23:25:01 lola-10 TIME: Time stamp for console
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476771896/real 0]  req@ffff8803b275d0c0 x1548477422557424/t0(0) o13->soaked-OST000e-osc-MDT0002@192.168.1.104@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476771903 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: soaked-OST000e-osc-MDT0002: Connection to soaked-OST000e (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0014-osc-MDT0002: Connection to soaked-OST0014 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0002-osc-MDT0002: Connection to soaked-OST0002 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 21 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0013_UUID (at 192.168.1.103@o2ib10)
Lustre: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0013_UUID (at 192.168.1.103@o2ib10)
Lustre: Skipped 1 previous similar message
Oct 17 23:30:01 lola-10 TIME: Time stamp for console
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0008_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0014_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0002_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST000e_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
Lustre: soaked-OST0014-osc-MDT0002: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
Lustre: Skipped 31 previous similar messages
Oct 17 23:35:01 lola-10 TIME: Time stamp for console
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 65 previous similar messages
Oct 17 23:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0008_UUID (at 192.168.1.104@o2ib10)
Lustre: Skipped 4 previous similar messages
Oct 17 23:45:01 lola-10 TIME: Time stamp for console
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 89 previous similar messages
Oct 17 23:50:01 lola-10 TIME: Time stamp for console
Lustre: 4567:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476773589/real 1476773614]  req@ffff8803a1c9e680 x1548477449390768/t0(0) o103->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:17/18 lens 328/224 e 0 to 1 dl 1476773645 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
Lustre: 18784:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476773588/real 1476773614]  req@ffff8803cbe29680 x1548477449390464/t0(0) o1000->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 1424/4320 e 0 to 1 dl 1476773654 ref 2 fl Rpc:eX/0/ffffffff rc 0/-1
Lustre: 18784:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 43 previous similar messages
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4567:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 42 previous similar messages
Oct 17 23:55:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476773714/real 1476773714]  req@ffff8803f0e5a680 x1548477449403488/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476773730 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.109@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 114 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476773864/real 1476773864]  req@ffff8803f0074380 x1548477449415488/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476773895 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
LustreError: 18759:0:(ldlm_request.c:129:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476773587, 300s ago); not entering recovery in server code, just going back to sleep ns: mdt-soaked-MDT0002_UUID lock: ffff8806fd38e3c0/0x8dd512475d6d19ad lrc: 3/0,1 mode: --/PW res: [0x280006992:0x1d596:0x0].0x87c148a6 bits 0x2 rrc: 8 type: IBT flags: 0x40210401000020 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0
LustreError: 18759:0:(ldlm_request.c:129:ldlm_expired_completion_wait()) Skipped 5 previous similar messages
LustreError: dumping log to /tmp/lustre-log.1476773888.19199
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.111@o2ib10, removing former export from same NID
Lustre: Skipped 37 previous similar messages
Oct 18 00:00:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib10)
Lustre: Skipped 2 previous similar messages
LNet: Service thread pid 21074 completed after 427.67s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
Oct 18 00:05:01 lola-10 TIME: Time stamp for console
Oct 18 00:10:01 lola-10 TIME: Time stamp for console
Oct 18 00:15:01 lola-10 TIME: Time stamp for console
Oct 18 00:20:01 lola-10 TIME: Time stamp for console
Oct 18 00:25:01 lola-10 TIME: Time stamp for console
Oct 18 00:30:01 lola-10 TIME: Time stamp for console
Oct 18 00:35:01 lola-10 TIME: Time stamp for console
Lustre: 4576:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476776221/real 0]  req@ffff8806fd8e19c0 x1548477485233120/t0(0) o13->soaked-OST0002-osc-MDT0002@192.168.1.104@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476776228 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4576:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: soaked-OST0002-osc-MDT0002: Connection to soaked-OST0002 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST000e-osc-MDT0002: Connection to soaked-OST000e (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0008-osc-MDT0002: Connection to soaked-OST0008 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476776282/real 1476776282]  req@ffff8807777c3cc0 x1548477485373472/t0(0) o8->soaked-OST0008-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476776293 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476776382/real 1476776382]  req@ffff8807fc4dc980 x1548477485534848/t0(0) o8->soaked-OST0008-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476776403 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Oct 18 00:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.105@o2ib10, removing former export from 192.168.1.104@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.105@o2ib10 (at 192.168.1.105@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.105@o2ib10, removing former export from 192.168.1.104@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.105@o2ib10, removing former export from 192.168.1.104@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.105@o2ib10 (at 192.168.1.105@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.105@o2ib10, removing former export from 192.168.1.104@o2ib10
Lustre: soaked-OST0014-osc-MDT0002: Connection restored to 192.168.1.105@o2ib10 (at 192.168.1.105@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10)
Lustre: Skipped 3 previous similar messages
LustreError: 11-0: soaked-OST0014-osc-MDT0002: operation ost_statfs to node 192.168.1.105@o2ib10 failed: rc = -107
Lustre: soaked-OST0014-osc-MDT0002: Connection to soaked-OST0014 (at 192.168.1.105@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST0008-osc-MDT0002: operation obd_ping to node 192.168.1.105@o2ib10 failed: rc = -107
LustreError: 11-0: soaked-OST000e-osc-MDT0002: operation ost_statfs to node 192.168.1.105@o2ib10 failed: rc = -107
Lustre: soaked-OST000e-osc-MDT0002: Connection to soaked-OST000e (at 192.168.1.105@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
LustreError: 11-0: soaked-OST0002-osc-MDT0002: operation obd_ping to node 192.168.1.105@o2ib10 failed: rc = -107
Oct 18 00:45:01 lola-10 TIME: Time stamp for console
Oct 18 00:50:01 lola-10 TIME: Time stamp for console
Oct 18 00:55:01 lola-10 TIME: Time stamp for console
Oct 18 01:00:01 lola-10 TIME: Time stamp for console
Oct 18 01:05:01 lola-10 TIME: Time stamp for console
Oct 18 01:10:01 lola-10 TIME: Time stamp for console
Oct 18 01:15:01 lola-10 TIME: Time stamp for console
Oct 18 01:20:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100)
Lustre: Skipped 7 previous similar messages
Oct 18 01:25:01 lola-10 TIME: Time stamp for console
Oct 18 01:30:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 01cae752-0caa-1cb3-98fd-0d64e17eaaf8 (at 192.168.1.123@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 01cae752-0caa-1cb3-98fd-0d64e17eaaf8 (at 192.168.1.123@o2ib100)
Oct 18 01:35:01 lola-10 TIME: Time stamp for console
Oct 18 01:40:01 lola-10 TIME: Time stamp for console
Oct 18 01:45:01 lola-10 TIME: Time stamp for console
Oct 18 01:50:01 lola-10 TIME: Time stamp for console
Lustre: 23122:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476780605/real 0]  req@ffff880341fdb6c0 x1548477503172288/t0(0) o1000->soaked-MDT0000-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 328/4320 e 0 to 1 dl 1476780612 ref 3 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 23122:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
Lustre: soaked-MDT0000-osp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476780637/real 1476780637]  req@ffff880341ce8080 x1548477503365120/t0(0) o400->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 224/224 e 0 to 1 dl 1476780644 ref 2 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476780687/real 1476780687]  req@ffff880384b63080 x1548477503715744/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476780698 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476780762/real 1476780762]  req@ffff8803425bf380 x1548477504265648/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476780778 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 6 previous similar messages
LNet: Service thread pid 19198 completed after 227.75s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 16 previous similar messages
Oct 18 01:55:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.109@o2ib10, removing former export from same NID
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib10)
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476780937/real 1476780937]  req@ffff8803844009c0 x1548477505178112/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476780963 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.109@o2ib10, removing former export from 192.168.1.108@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
LustreError: 167-0: soaked-MDT0000-lwp-MDT0002: This client was evicted by soaked-MDT0000; in progress operations using this service will fail.
Lustre: soaked-MDT0000-lwp-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Lustre: Evicted from MGS (at MGC192.168.1.108@o2ib10_1) after server handle changed from 0xfaadc3f7177d604 to 0x929ff5f28c5c0c78
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0000-osp-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
LNet: Service thread pid 23122 completed after 588.68s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 2 previous similar messages
LustreError: 11-0: soaked-MDT0000-osp-MDT0002: operation out_update to node 192.168.1.109@o2ib10 failed: rc = -107
Lustre: soaked-MDT0000-osp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Oct 18 02:00:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation obd_ping to node 192.168.1.109@o2ib10 failed: rc = -107
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will fail
Lustre: soaked-MDT0002: Connection restored to MGC192.168.1.108@o2ib10_0 (at 192.168.1.108@o2ib10)
Lustre: Evicted from MGS (at MGC192.168.1.108@o2ib10_0) after server handle changed from 0x929ff5f28c5c0c78 to 0x71982d716c0f2ada
LustreError: 167-0: soaked-MDT0000-lwp-MDT0002: This client was evicted by soaked-MDT0000; in progress operations using this service will fail.
Lustre: MGC192.168.1.108@o2ib10: Connection restored to MGC192.168.1.108@o2ib10_0 (at 192.168.1.108@o2ib10)
Lustre: soaked-MDT0000-osp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Lustre: Skipped 1 previous similar message
Oct 18 02:05:01 lola-10 TIME: Time stamp for console
Oct 18 02:10:01 lola-10 TIME: Time stamp for console
Oct 18 02:15:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 8def2455-4284-8b62-26e8-f9e60ca767e5 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to f8dc1698-672d-e295-5801-379aa47bf342 (at 192.168.1.113@o2ib100)
Oct 18 02:20:01 lola-10 TIME: Time stamp for console
Oct 18 02:25:01 lola-10 TIME: Time stamp for console
Oct 18 02:30:01 lola-10 TIME: Time stamp for console
Oct 18 02:35:01 lola-10 TIME: Time stamp for console
Oct 18 02:40:01 lola-10 TIME: Time stamp for console
Oct 18 02:45:01 lola-10 TIME: Time stamp for console
Oct 18 02:50:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff88079f9df580)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 00 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88079f9df580)
sd 0:0:1:42: attempting task abort! scmd(ffff88079f9df880)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 10 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88079f9df880)
sd 0:0:1:42: attempting task abort! scmd(ffff88079f9df680)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 28 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88079f9df680)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f4da7ec0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 30 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f4da7ec0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f4da7dc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 50 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f4da7dc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f4da7cc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 70 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f4da7cc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f4da7bc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 98 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f4da7bc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f4da7ac0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 a0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f4da7ac0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f4da79c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 b8 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f4da79c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f4da78c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 e0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f4da78c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a4e709c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 88 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a4e709c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a4e708c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e b8 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a4e708c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a4e707c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e d8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a4e707c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a4e706c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e f0 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a4e706c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a4e705c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 10 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a4e705c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a4e704c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 28 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a4e704c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a4e703c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 50 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a4e703c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a4e702c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 58 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a4e702c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a4e701c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 68 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a4e701c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807a4e700c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 80 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a4e700c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880703ec8e80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 90 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880703ec8e80)
sd 0:0:1:42: attempting task abort! scmd(ffff880703ec8d80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f a0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880703ec8d80)
sd 0:0:1:42: attempting task abort! scmd(ffff880703ec8c80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f d0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880703ec8c80)
sd 0:0:1:42: attempting task abort! scmd(ffff880703ec8b80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e8 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880703ec8b80)
Lustre: 4580:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476784397/real 0]  req@ffff8807a77c8380 x1548477544319824/t0(0) o13->soaked-OST000e-osc-MDT0002@192.168.1.104@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476784404 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4580:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 15 previous similar messages
Lustre: soaked-OST000e-osc-MDT0002: Connection to soaked-OST000e (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0008-osc-MDT0002: Connection to soaked-OST0008 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476784458/real 1476784458]  req@ffff88041453d0c0 x1548477544799968/t0(0) o8->soaked-OST0002-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476784469 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Oct 18 02:55:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476784558/real 1476784558]  req@ffff880342cea980 x1548477546349392/t0(0) o8->soaked-OST0008-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476784579 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
INFO: task mdt00_009:19091 blocked for more than 120 seconds.
      Tainted: P           -- ------------    2.6.32-573.26.1.el6_lustre.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mdt00_009     D 0000000000000007     0 19091      2 0x00000080
 ffff880410f7b5e0 0000000000000046 0000000000000000 ffff880410f7b5b0
 ffff880410f7b550 ffffffff810608c0 000025da7e7832b4 ffffffff8100969d
 0000000000000000 000000010276ca65 ffff88040daf7068 ffff880410f7bfd8
Call Trace:
 [<ffffffff810608c0>] ? __dequeue_entity+0x30/0x50
 [<ffffffff8100969d>] ? __switch_to+0x7d/0x340
 [<ffffffffa0e47f80>] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand]
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11fbda2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa067c181>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
 [<ffffffffa11f3ea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11f47c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1254586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa124e8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa06789b8>] ? libcfs_log_return+0x28/0x40 [libcfs]
 [<ffffffffa124f96b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa1131518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa113a11f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa112308d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa110dd9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa110e3b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa110c91e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa096d7c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0998feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a1ee91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a2003c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09cc791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffffa09cba60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20
INFO: task mdt00_001:18757 blocked for more than 120 seconds.
      Tainted: P           -- ------------    2.6.32-573.26.1.el6_lustre.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mdt00_001     D 0000000000000007     0 18757      2 0x00000080
 ffff88041577b5e0 0000000000000046 ffff88041577b5a8 ffff88041577b5a4
 ffffffffa12162c0 ffff88043fe82c00 000025e53e7a0d78 ffff880038695a00
 0000000000000400 0000000102777ef8 ffff8804337efad8 ffff88041577bfd8
Call Trace:
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11fbda2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa067c181>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
 [<ffffffffa11f3ea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11f47c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1254586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa124e8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa06789b8>] ? libcfs_log_return+0x28/0x40 [libcfs]
 [<ffffffffa124f96b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa1131518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa113a11f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa112308d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa110dd9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa110e3b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa110c91e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa096d7c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0998feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a1ee91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a2003c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09cc791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffffa09cba60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20
INFO: task mdt01_002:18761 blocked for more than 120 seconds.
      Tainted: P           -- ------------    2.6.32-573.26.1.el6_lustre.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mdt01_002     D 000000000000001a     0 18761      2 0x00000080
 ffff880414cf75e0 0000000000000046 0000000000000000 ffff880414cf75b0
 ffffffffa12162c0 000000000000004f 000025e53e7948c5 ffff8804358b2040
 ffffffffa121eee0 0000000102777efa ffff8804358b25f8 ffff880414cf7fd8
Call Trace:
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11fbda2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa067c181>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
 [<ffffffffa11f3ea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11f47c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1254586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa124e8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa06789b8>] ? libcfs_log_return+0x28/0x40 [libcfs]
 [<ffffffffa124f96b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa1131518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa113a11f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa112308d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa110dd9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa110e3b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa110c91e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa096d7c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0998feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a1ee91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a2003c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09cc791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffffa09cba60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20
INFO: task mdt01_003:18857 blocked for more than 120 seconds.
      Tainted: P           -- ------------    2.6.32-573.26.1.el6_lustre.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mdt01_003     D 000000000000000b     0 18857      2 0x00000080
 ffff88040d4d35e0 0000000000000046 0000000000000000 ffff88040d4d35b0
 ffffffffa12162c0 000000000000004f 000025efe7b889b3 ffff880412f0f520
 ffffffffa121eee0 00000001027831c1 ffff880412f0fad8 ffff88040d4d3fd8
Call Trace:
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11fbda2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa067c181>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
 [<ffffffffa11f3ea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11f47c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1254586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa124e8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa06789b8>] ? libcfs_log_return+0x28/0x40 [libcfs]
 [<ffffffffa124f96b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa1131518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa113a11f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa112308d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa110dd9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa110e3b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa110c91e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa096d7c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0998feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a1ee91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a2003c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09cc791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffffa09cba60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20
INFO: task mdt01_005:18891 blocked for more than 120 seconds.
      Tainted: P           -- ------------    2.6.32-573.26.1.el6_lustre.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mdt01_005     D 000000000000000b     0 18891      2 0x00000080
 ffff88041133b5e0 0000000000000046 ffff88041133b5a8 ffff88041133b5a4
 ffffffffa12162c0 ffff88043fe83400 000025e53e7c1791 ffff88044e535a00
 0000000000000400 0000000102777ef8 ffff880412f0f068 ffff88041133bfd8
Call Trace:
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11fbda2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa067c181>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
 [<ffffffffa11f3ea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11f47c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1254586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa124e8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa06789b8>] ? libcfs_log_return+0x28/0x40 [libcfs]
 [<ffffffffa124f96b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa1131518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa113a11f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa112308d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa110dd9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa110e3b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa110c91e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa096d7c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0998feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a1ee91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a2003c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09cc791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffffa09cba60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20
INFO: task mdt00_009:19091 blocked for more than 120 seconds.
      Tainted: P           -- ------------    2.6.32-573.26.1.el6_lustre.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mdt00_009     D 0000000000000007     0 19091      2 0x00000080
 ffff880410f7b5e0 0000000000000046 0000000000000000 ffff880410f7b5b0
 ffff880410f7b550 ffffffff810608c0 000025da7e7832b4 ffffffff8100969d
 0000000000000000 000000010276ca65 ffff88040daf7068 ffff880410f7bfd8
Call Trace:
 [<ffffffff810608c0>] ? __dequeue_entity+0x30/0x50
 [<ffffffff8100969d>] ? __switch_to+0x7d/0x340
 [<ffffffffa0e47f80>] ? do_dbs_timer+0x0/0x3bc [cpufreq_ondemand]
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11fbda2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa067c181>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
 [<ffffffffa11f3ea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11f47c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1254586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa124e8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa06789b8>] ? libcfs_log_return+0x28/0x40 [libcfs]
 [<ffffffffa124f96b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa1131518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa113a11f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa112308d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa110dd9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa110e3b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa110c91e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa096d7c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0998feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a1ee91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a2003c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09cc791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffffa09cba60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20
INFO: task mdt01_006:19092 blocked for more than 120 seconds.
      Tainted: P           -- ------------    2.6.32-573.26.1.el6_lustre.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mdt01_006     D 0000000000000008     0 19092      2 0x00000080
 ffff880410dff5e0 0000000000000046 ffff880410dfffd8 ffff880410dff5b0
 ffffffffa12162c0 000000000000004f ffff880410dfffd8 ffff88040f8ecab0
 ffffffffa121eee0 0000000000000050 ffff88040f8ed068 ffff880410dfffd8
Call Trace:
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11fbda2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa067c181>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
 [<ffffffffa11f3ea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11f47c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1254586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa124e8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa06789b8>] ? libcfs_log_return+0x28/0x40 [libcfs]
 [<ffffffffa124f96b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa1131518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa113a11f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa112308d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa110dd9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa110e3b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa110c91e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa096d7c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0998feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a1ee91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a2003c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09cc791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffffa09cba60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20
INFO: task mdt01_011:19099 blocked for more than 120 seconds.
      Tainted: P           -- ------------    2.6.32-573.26.1.el6_lustre.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mdt01_011     D 000000000000001c     0 19099      2 0x00000080
 ffff88041617f5e0 0000000000000046 0000000000000000 ffff88041617f5b0
 ffffffffa12162c0 000000000000004f 000025e53e85df0a ffff880410d58040
 ffffffffa121eee0 0000000102777ef8 ffff880410d585f8 ffff88041617ffd8
Call Trace:
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11fbda2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa067c181>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
 [<ffffffffa11f3ea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11f47c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1254586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa124e8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa06789b8>] ? libcfs_log_return+0x28/0x40 [libcfs]
 [<ffffffffa124f96b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa1131518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa113a11f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa112308d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa110dd9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa110e3b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa110c91e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa096d7c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0998feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a1ee91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a2003c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09cc791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffffa09cba60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20
INFO: task mdt00_014:19127 blocked for more than 120 seconds.
      Tainted: P           -- ------------    2.6.32-573.26.1.el6_lustre.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mdt00_014     D 0000000000000004     0 19127      2 0x00000080
 ffff8808154275e0 0000000000000046 0000000000000000 ffff8808154275b0
 ffffffffa12162c0 000000000000004f 000025e53e83eb0b ffff880833ef0040
 ffffffffa121eee0 0000000102777ef8 ffff880833ef05f8 ffff880815427fd8
Call Trace:
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11fbda2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa067c181>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
 [<ffffffffa11f3ea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11f47c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1254586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa124e8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa06789b8>] ? libcfs_log_return+0x28/0x40 [libcfs]
 [<ffffffffa124f96b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa1131518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa113a11f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa112308d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa110dd9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa110e3b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa110c91e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa096d7c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0998feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a1ee91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a2003c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09cc791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffffa09cba60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20
INFO: task mdt00_015:19157 blocked for more than 120 seconds.
      Tainted: P           -- ------------    2.6.32-573.26.1.el6_lustre.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
mdt00_015     D 0000000000000014     0 19157      2 0x00000080
 ffff88080c5f35e0 0000000000000046 0000000000000000 ffff88080c5f35a4
 ffffffff00000000 ffff88043fe84600 000025e53e7b43d7 ffff88044e595a00
 00000000000005fe 0000000102777ef5 ffff88082f243ad8 ffff88080c5f3fd8
Call Trace:
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11fbda2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa067c181>] ? libcfs_debug_msg+0x41/0x50 [libcfs]
 [<ffffffffa11f3ea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11f47c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1254586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa124e8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa06789b8>] ? libcfs_log_return+0x28/0x40 [libcfs]
 [<ffffffffa124f96b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa1131518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa113a11f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa112308d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa110dd9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa110e3b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa110c91e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa096d7c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0998feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a1ee91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a2003c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09cc791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffffa09cba60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20
LNet: Service thread pid 19092 completed after 244.46s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 10 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476784733/real 1476784733]  req@ffff88040d0c2980 x1548477548433088/t0(0) o8->soaked-OST0014-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476784769 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
Oct 18 03:00:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0008_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0014_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0002_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST000e_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
Lustre: soaked-OST0014-osc-MDT0002: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10)
Lustre: soaked-OST000e-osc-MDT0002: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10)
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 196 previous similar messages
Lustre: soaked-OST0002-osc-MDT0002: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10)
Lustre: Skipped 1 previous similar message
LNet: Service thread pid 23122 completed after 395.73s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0008_UUID (at 192.168.1.104@o2ib10)
Lustre: Skipped 3 previous similar messages
LNet: Service thread pid 18857 completed after 398.65s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
Oct 18 03:05:01 lola-10 TIME: Time stamp for console
Oct 18 03:10:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 8def2455-4284-8b62-26e8-f9e60ca767e5 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to f8dc1698-672d-e295-5801-379aa47bf342 (at 192.168.1.113@o2ib100)
Lustre: Skipped 3 previous similar messages
Oct 18 03:15:02 lola-10 TIME: Time stamp for console
Oct 18 03:20:01 lola-10 TIME: Time stamp for console
Oct 18 03:25:01 lola-10 TIME: Time stamp for console
Oct 18 03:30:01 lola-10 TIME: Time stamp for console
Oct 18 03:35:01 lola-10 TIME: Time stamp for console
Oct 18 03:40:01 lola-10 TIME: Time stamp for console
Oct 18 03:45:01 lola-10 TIME: Time stamp for console
Oct 18 03:50:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e9c84114-fa24-d181-aaaf-64cb793239ab (at 192.168.1.134@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to e9c84114-fa24-d181-aaaf-64cb793239ab (at 192.168.1.134@o2ib100)
Oct 18 03:55:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 8def2455-4284-8b62-26e8-f9e60ca767e5 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to f8dc1698-672d-e295-5801-379aa47bf342 (at 192.168.1.113@o2ib100)
Oct 18 04:00:01 lola-10 TIME: Time stamp for console
Oct 18 04:05:01 lola-10 TIME: Time stamp for console
Oct 18 04:10:01 lola-10 TIME: Time stamp for console
Oct 18 04:15:01 lola-10 TIME: Time stamp for console
Oct 18 04:20:01 lola-10 TIME: Time stamp for console
Oct 18 04:25:01 lola-10 TIME: Time stamp for console
Oct 18 04:30:01 lola-10 TIME: Time stamp for console
Oct 18 04:35:01 lola-10 TIME: Time stamp for console
Oct 18 04:40:01 lola-10 TIME: Time stamp for console
Oct 18 04:45:01 lola-10 TIME: Time stamp for console
Oct 18 04:50:01 lola-10 TIME: Time stamp for console
Oct 18 04:55:01 lola-10 TIME: Time stamp for console
Oct 18 05:00:01 lola-10 TIME: Time stamp for console
Oct 18 05:05:01 lola-10 TIME: Time stamp for console
Oct 18 05:10:01 lola-10 TIME: Time stamp for console
Oct 18 05:15:01 lola-10 TIME: Time stamp for console
Oct 18 05:20:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8803cd744ec0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 18 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803cd744ec0)
sd 0:0:1:42: attempting task abort! scmd(ffff880382d12780)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 28 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880382d12780)
sd 0:0:1:42: attempting task abort! scmd(ffff8803cd7448c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 40 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803cd7448c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880412de2480)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 50 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880412de2480)
sd 0:0:1:42: attempting task abort! scmd(ffff880382d12880)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 68 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880382d12880)
sd 0:0:1:42: attempting task abort! scmd(ffff880382d12980)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 80 00 00 50 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880382d12980)
sd 0:0:1:42: attempting task abort! scmd(ffff8803cd7443c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 d8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803cd7443c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880382d12a80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 f8 00 00 38 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880382d12a80)
Oct 18 05:25:01 lola-10 TIME: Time stamp for console
Oct 18 05:30:01 lola-10 TIME: Time stamp for console
Oct 18 05:35:01 lola-10 TIME: Time stamp for console
Oct 18 05:40:01 lola-10 TIME: Time stamp for console
Oct 18 05:45:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 8def2455-4284-8b62-26e8-f9e60ca767e5 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to f8dc1698-672d-e295-5801-379aa47bf342 (at 192.168.1.113@o2ib100)
Oct 18 05:50:01 lola-10 TIME: Time stamp for console
Oct 18 05:55:01 lola-10 TIME: Time stamp for console
Oct 18 06:00:01 lola-10 TIME: Time stamp for console
Oct 18 06:05:01 lola-10 TIME: Time stamp for console
Oct 18 06:10:01 lola-10 TIME: Time stamp for console
Oct 18 06:15:01 lola-10 TIME: Time stamp for console
Oct 18 06:20:01 lola-10 TIME: Time stamp for console
Oct 18 06:25:01 lola-10 TIME: Time stamp for console
Oct 18 06:30:01 lola-10 TIME: Time stamp for console
Oct 18 06:35:01 lola-10 TIME: Time stamp for console
Oct 18 06:40:01 lola-10 TIME: Time stamp for console
Oct 18 06:45:01 lola-10 TIME: Time stamp for console
Oct 18 06:50:01 lola-10 TIME: Time stamp for console
Oct 18 06:55:01 lola-10 TIME: Time stamp for console
Oct 18 07:00:01 lola-10 TIME: Time stamp for console
Oct 18 07:05:01 lola-10 TIME: Time stamp for console
Oct 18 07:10:02 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476800093/real 0]  req@ffff880383da7080 x1548477729068384/t0(0) o13->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476800100 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: soaked-OST0007-osc-MDT0002: Connection to soaked-OST0007 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Oct 18 07:15:01 lola-10 TIME: Time stamp for console
Lustre: soaked-OST000d-osc-MDT0002: Connection to soaked-OST000d (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Client fba24f35-5625-e003-a958-29928c5e620b (at 192.168.1.120@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to a3d948b8-7745-adee-d8bc-8f3f12a2cff5 (at 192.168.1.126@o2ib100)
Lustre: Skipped 1 previous similar message
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.113@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476800151/real 1476800151]  req@ffff88079f0cbcc0 x1548477729354544/t0(0) o8->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476800162 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 39 previous similar messages
Lustre: soaked-MDT0002: Client fba24f35-5625-e003-a958-29928c5e620b (at 192.168.1.120@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to fba24f35-5625-e003-a958-29928c5e620b (at 192.168.1.120@o2ib100)
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Client 8def2455-4284-8b62-26e8-f9e60ca767e5 (at 192.168.1.113@o2ib100) reconnecting
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to f8dc1698-672d-e295-5801-379aa47bf342 (at 192.168.1.113@o2ib100)
Lustre: Skipped 1 previous similar message
sd 0:0:1:42: attempting task abort! scmd(ffff8807a658e680)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f f8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807a658e680)
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476800251/real 1476800251]  req@ffff88079ee196c0 x1548477729763760/t0(0) o8->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476800272 ref 2 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10)
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10)
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10)
Lustre: Skipped 1 previous similar message
Oct 18 07:20:01 lola-10 TIME: Time stamp for console
Lustre: soaked-OST0007-osc-MDT0002: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10)
Lustre: Skipped 1 previous similar message
LustreError: 11-0: soaked-OST0013-osc-MDT0002: operation ost_destroy to node 192.168.1.102@o2ib10 failed: rc = -107
Lustre: soaked-OST0013-osc-MDT0002: Connection to soaked-OST0013 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: Skipped 2 previous similar messages
LustreError: 11-0: soaked-OST0001-osc-MDT0002: operation ost_statfs to node 192.168.1.102@o2ib10 failed: rc = -107
LustreError: Skipped 1 previous similar message
Lustre: soaked-OST0001-osc-MDT0002: Connection to soaked-OST0001 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST0007-osc-MDT0002: operation ost_statfs to node 192.168.1.102@o2ib10 failed: rc = -107
Lustre: soaked-OST0007-osc-MDT0002: Connection to soaked-OST0007 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST000d-osc-MDT0002: operation ost_statfs to node 192.168.1.102@o2ib10 failed: rc = -107
Lustre: soaked-OST000d-osc-MDT0002: Connection to soaked-OST000d (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Oct 18 07:25:01 lola-10 TIME: Time stamp for console
Oct 18 07:30:01 lola-10 TIME: Time stamp for console
Oct 18 07:35:01 lola-10 TIME: Time stamp for console
Oct 18 07:40:01 lola-10 TIME: Time stamp for console
Oct 18 07:45:01 lola-10 TIME: Time stamp for console
Oct 18 07:50:01 lola-10 TIME: Time stamp for console
Oct 18 07:55:01 lola-10 TIME: Time stamp for console
Oct 18 08:00:01 lola-10 TIME: Time stamp for console
Oct 18 08:05:01 lola-10 TIME: Time stamp for console
Oct 18 08:10:01 lola-10 TIME: Time stamp for console
Oct 18 08:15:01 lola-10 TIME: Time stamp for console
Oct 18 08:20:01 lola-10 TIME: Time stamp for console
Oct 18 08:25:01 lola-10 TIME: Time stamp for console
Oct 18 08:30:02 lola-10 TIME: Time stamp for console
Oct 18 08:35:01 lola-10 TIME: Time stamp for console
Oct 18 08:40:01 lola-10 TIME: Time stamp for console
Oct 18 08:45:01 lola-10 TIME: Time stamp for console
Oct 18 08:50:01 lola-10 TIME: Time stamp for console
Oct 18 08:55:01 lola-10 TIME: Time stamp for console
Oct 18 09:00:01 lola-10 TIME: Time stamp for console
Oct 18 09:05:01 lola-10 TIME: Time stamp for console
Oct 18 09:10:01 lola-10 TIME: Time stamp for console
Oct 18 09:15:01 lola-10 TIME: Time stamp for console
Oct 18 09:20:01 lola-10 TIME: Time stamp for console
Oct 18 09:25:01 lola-10 TIME: Time stamp for console
Lustre: 4582:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476808101/real 0]  req@ffff8805c80776c0 x1548477790687088/t0(0) o400->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 224/224 e 0 to 1 dl 1476808108 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4582:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 11 previous similar messages
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0000-osp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476808141/real 1476808141]  req@ffff8805c82d93c0 x1548477791982192/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476808147 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
Oct 18 09:30:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476808191/real 1476808191]  req@ffff880640669380 x1548477793607616/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476808202 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476808291/real 1476808291]  req@ffff880776b3f980 x1548477797053552/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476808312 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476808466/real 1476808466]  req@ffff8806ff7fc0c0 x1548477803275472/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476808497 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 6 previous similar messages
Oct 18 09:35:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.108@o2ib10, removing former export from same NID
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.108@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 1 previous similar message
LustreError: 167-0: soaked-MDT0000-lwp-MDT0002: This client was evicted by soaked-MDT0000; in progress operations using this service will fail.
Lustre: soaked-MDT0000-lwp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Lustre: Skipped 7 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.108@o2ib10, removing former export from same NID
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib10)
Lustre: Evicted from MGS (at MGC192.168.1.108@o2ib10_0) after server handle changed from 0x71982d716c0f2ada to 0x6d1e7c2a2d5ad165
Lustre: soaked-MDT0000-osp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Lustre: Skipped 1 previous similar message
Oct 18 09:40:01 lola-10 TIME: Time stamp for console
Oct 18 09:45:01 lola-10 TIME: Time stamp for console
Oct 18 09:50:02 lola-10 TIME: Time stamp for console
Oct 18 09:55:01 lola-10 TIME: Time stamp for console
Oct 18 10:00:01 lola-10 TIME: Time stamp for console
Oct 18 10:05:01 lola-10 TIME: Time stamp for console
Oct 18 10:10:01 lola-10 TIME: Time stamp for console
Oct 18 10:15:01 lola-10 TIME: Time stamp for console
Oct 18 10:20:01 lola-10 TIME: Time stamp for console
Oct 18 10:25:01 lola-10 TIME: Time stamp for console
Oct 18 10:30:01 lola-10 TIME: Time stamp for console
Oct 18 10:35:01 lola-10 TIME: Time stamp for console
Oct 18 10:40:01 lola-10 TIME: Time stamp for console
Oct 18 10:45:01 lola-10 TIME: Time stamp for console
Lustre: 18858:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476812717/real 1476812717]  req@ffff88077ada4cc0 x1548477847534640/t0(0) o104->soaked-MDT0002@192.168.1.121@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476812724 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 18858:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Oct 18 10:50:01 lola-10 TIME: Time stamp for console
Oct 18 10:55:01 lola-10 TIME: Time stamp for console
Oct 18 11:00:01 lola-10 TIME: Time stamp for console
Oct 18 11:05:01 lola-10 TIME: Time stamp for console
Oct 18 11:10:01 lola-10 TIME: Time stamp for console
Oct 18 11:15:01 lola-10 TIME: Time stamp for console
Oct 18 11:20:01 lola-10 TIME: Time stamp for console
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
SOL session closed by BMC

<ConMan> Console [lola-10] disconnected from "ipmitool.exp" (pid 2355) after 1w3d21h54m43s at 10-18 14:32.

<ConMan> Console [lola-10] connected to "ipmitool.exp" (pid 7806) at 10-18 14:32.
Connection established via ipmitool (pid 7810).
Copyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               Version 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.                                                                                                                                                                          MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           LSI Corporation MPT SAS2 BIOS                                                   Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                 Initializing../                                                                 Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                                                                                                 Press Ctrl-C to start LSI Corp Configuration Utility...                         Searching for devices at HBA 0...                                               LSI Corporation MPT SAS2 BIOS                                                   MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                            PCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    SLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    ---- ---- --- -------- ---------------- ----------- ----------                    3           LSI      SAS2308-IT       15.00.00.00  0F:00:00:03                  3    4   7  LSI      Universal Xport  0786         20.00 MiB                    3    4   41  LSI      INF-01-00        0786         14.55 TiB                   3    4   42  LSI      INF-01-00        0786         14.55 TiB                   3    4   43  LSI      INF-01-00        0786         14.55 TiB                   3    4   44  LSI      INF-01-00        0786         14.55 TiB                   3    4   45  LSI      INF-01-00        0786         14.55 TiB                   3    4   46  LSI      INF-01-00        0786         14.55 TiB                   3    0   7  LSI      Universal Xport  0786         20.00 MiB                    3    0   41  LSI      INF-01-00        0786         14.55 TiB                   3    0   42  LSI      INF-01-00        0786         14.55 TiB                   3    0   43  LSI      INF-01-00        0786         14.55 TiB                   3    0   44  LSI      INF-01-00        0786         14.55 TiB                   3    0   45  LSI      INF-01-00        0786         14.55 TiB                   3    0   46  LSI      INF-01-00        0786         14.55 TiB                 Copyright 2000-2012 LSI Corporation.                                                                                                                              RAID Volumes:                                                                   None defined.                                                                   Physical Devices:                                                             �  ID   Device Model     Serial #                     Size Type/Status(Vol ID)     0    ST500NM0011      Z1M0X1F9                  465.7GB Non-RAID Disk           1    ST500NM0011      Z1M0X1GG                  465.7GB Non-RAID Disk         Press <CTRL-I> to enter Configuration Utility..                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Copyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                     RAID Volumes:                                                                 Press <CTRL-I> to enter Configuration Utility...                                                                                                                PXE 2.1 Build 091 (WfM 2.0)                                                     Press Ctrl+S to enter the Setup Menu.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                          Bios Version: SE5C600.86B.01.08.0003.022620131521                               BMC Firmware Version: 1.17.4207                                                 SDR Version: SDR Package 1.09                                                   ME Firmware Version: 2.1.7.112                                                  Platform ID: S2600GZ                                                            System memory detected: 32768 MB                                                Current memory speed: 1333 MT/s                                                 Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        Number of physical processors identified: 2                                     ********************************************************************************AHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          SAS/SATA Capable Controller configured with 4 ports in SATA mode                ********************************************************************************USB Keyboard detected                                                           USB Mouse detected                                                                                                                                              Press <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                                     
Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

    GNU GRUB  version 0.97  (571K lower / 3066652K upper memory)

+-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+
      Use the ^ and v keys to select which entry is highlighted.
      Press enter to boot the selected OS, 'e' to edit the
      commands before booting, 'a' to modify the kernel arguments
      before booting, or 'c' for a command-line.  CentOS (2.6.32-573.26.1.el6_lustre.x86_64)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  The highlighted entry will be booted automatically in 5 seconds.    The highlighted entry will be booted automatically in 4 seconds.    The highlighted entry will be booted automatically in 3 seconds.    The highlighted entry will be booted automatically in 2 seconds.    The highlighted entry will be booted automatically in 1 seconds.    Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-573.26.1.el6_lustre.x86_64 (soakbuilder@lola-16.lola.whamcloud.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-16) (GCC) ) #1 SMP Mon Oct 17 13:07:39 PDT 2016
Command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=auto SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000008ec00 (usable)
 BIOS-e820: 000000000008ec00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bb3c7000 (usable)
 BIOS-e820: 00000000bb3c7000 - 00000000bdd2f000 (reserved)
 BIOS-e820: 00000000bdd2f000 - 00000000bddcd000 (ACPI NVS)
 BIOS-e820: 00000000bddcd000 - 00000000bdea1000 (ACPI data)
 BIOS-e820: 00000000bdea1000 - 00000000bdf2f000 (ACPI NVS)
 BIOS-e820: 00000000bdf2f000 - 00000000bdfac000 (ACPI data)
 BIOS-e820: 00000000bdfac000 - 00000000be000000 (usable)
 BIOS-e820: 00000000be000000 - 00000000d0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
 BIOS-e820: 00000000fed19000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ffa20000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000840000000 (usable)
DMI 2.6 present.
SMBIOS version 2.6 @ 0xF0440
No AGP bridge found
last_pfn = 0x840000 max_arch_pfn = 0x400000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xbe000 max_arch_pfn = 0x400000000
Using GB pages for direct mapping
init_memory_mapping: 0000000000000000-00000000be000000
init_memory_mapping: 0000000100000000-0000000840000000
RAMDISK: 3601e000 - 37fef30d
ACPI: Deleted _OSI()
ACPI: Deleted _OSI()
ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20090903/tbfadt-611)
ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
ACPI: FACS 00000000bdfa9f40 00040
ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
Setting APIC routing to flat.
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: PXM 0 -> APIC 2 -> Node 0
SRAT: PXM 0 -> APIC 3 -> Node 0
SRAT: PXM 0 -> APIC 4 -> Node 0
SRAT: PXM 0 -> APIC 5 -> Node 0
SRAT: PXM 0 -> APIC 6 -> Node 0
SRAT: PXM 0 -> APIC 7 -> Node 0
SRAT: PXM 0 -> APIC 8 -> Node 0
SRAT: PXM 0 -> APIC 9 -> Node 0
SRAT: PXM 0 -> APIC 10 -> Node 0
SRAT: PXM 0 -> APIC 11 -> Node 0
SRAT: PXM 0 -> APIC 12 -> Node 0
SRAT: PXM 0 -> APIC 13 -> Node 0
SRAT: PXM 0 -> APIC 14 -> Node 0
SRAT: PXM 0 -> APIC 15 -> Node 0
SRAT: PXM 1 -> APIC 32 -> Node 1
SRAT: PXM 1 -> APIC 33 -> Node 1
SRAT: PXM 1 -> APIC 34 -> Node 1
SRAT: PXM 1 -> APIC 35 -> Node 1
SRAT: PXM 1 -> APIC 36 -> Node 1
SRAT: PXM 1 -> APIC 37 -> Node 1
SRAT: PXM 1 -> APIC 38 -> Node 1
SRAT: PXM 1 -> APIC 39 -> Node 1
SRAT: PXM 1 -> APIC 40 -> Node 1
SRAT: PXM 1 -> APIC 41 -> Node 1
SRAT: PXM 1 -> APIC 42 -> Node 1
SRAT: PXM 1 -> APIC 43 -> Node 1
SRAT: PXM 1 -> APIC 44 -> Node 1
SRAT: PXM 1 -> APIC 45 -> Node 1
SRAT: PXM 1 -> APIC 46 -> Node 1
SRAT: PXM 1 -> APIC 47 -> Node 1
SRAT: Node 0 PXM 0 0-c0000000
SRAT: Node 0 PXM 0 100000000-440000000
SRAT: Node 1 PXM 1 440000000-840000000
Bootmem setup node 0 0000000000000000-0000000440000000
  NODE_DATA [0000000000009000 - 000000000003cfff]
  bootmap [0000000000100000 -  0000000000187fff] pages 88
(8 early reservations) ==> bootmem [0000000000 - 0440000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS ==> [0001000000 - 000203eb64]
  #3 [003601e000 - 0037fef30d]          RAMDISK ==> [003601e000 - 0037fef30d]
  #4 [000008ec00 - 0000100000]    BIOS reserved ==> [000008ec00 - 0000100000]
  #5 [000203f000 - 000203f9b8]              BRK ==> [000203f000 - 000203f9b8]
  #6 [0000008000 - 0000009000]          PGTABLE ==> [0000008000 - 0000009000]
  #7 [0000001000 - 0000001030]        ACPI SLIT ==> [0000001000 - 0000001030]
Bootmem setup node 1 0000000440000000-0000000840000000
  NODE_DATA [0000000440000040 - 000000044003403f]
  bootmap [0000000440035000 -  00000004400b4fff] pages 80
(8 early reservations) ==> bootmem [0440000000 - 0840000000]
  #0 [0000000000 - 0000001000]   BIOS data page
  #1 [0000006000 - 0000008000]       TRAMPOLINE
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS
  #3 [003601e000 - 0037fef30d]          RAMDISK
  #4 [000008ec00 - 0000100000]    BIOS reserved
  #5 [000203f000 - 000203f9b8]              BRK
  #6 [0000008000 - 0000009000]          PGTABLE
  #7 [0000001000 - 0000001030]        ACPI SLIT
found SMP MP-table at [ffff8800000fcd70] fcd70
Reserving 131MB of memory at 48MB for crashkernel (System RAM: 33792MB)
Zone PFN ranges:
  DMA      0x00000001 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   0x00100000 -> 0x00840000
Movable zone start PFN for each node
early_node_map[5] active PFN ranges
    0: 0x00000001 -> 0x0000008e
    0: 0x00000100 -> 0x000bb3c7
    0: 0x000bdfac -> 0x000be000
    0: 0x00100000 -> 0x00440000
    1: 0x00440000 -> 0x00840000
ACPI: PM-Timer IO Port: 0x408
Setting APIC routing to flat.
ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a701 base: 0xfed00000
SMP: Allowing 240 CPUs, 208 hotplug CPUs
PM: Registered nosave memory: 000000000008e000 - 000000000008f000
PM: Registered nosave memory: 000000000008f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
PM: Registered nosave memory: 00000000bb3c7000 - 00000000bdd2f000
PM: Registered nosave memory: 00000000bdd2f000 - 00000000bddcd000
PM: Registered nosave memory: 00000000bddcd000 - 00000000bdea1000
PM: Registered nosave memory: 00000000bdea1000 - 00000000bdf2f000
PM: Registered nosave memory: 00000000bdf2f000 - 00000000bdfac000
PM: Registered nosave memory: 00000000be000000 - 00000000d0000000
PM: Registered nosave memory: 00000000d0000000 - 00000000fec00000
PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
PM: Registered nosave memory: 00000000fec01000 - 00000000fed19000
PM: Registered nosave memory: 00000000fed19000 - 00000000fed1a000
PM: Registered nosave memory: 00000000fed1a000 - 00000000fed1c000
PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
PM: Registered nosave memory: 00000000fed20000 - 00000000fee00000
PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
PM: Registered nosave memory: 00000000fee01000 - 00000000ffa20000
PM: Registered nosave memory: 00000000ffa20000 - 0000000100000000
Allocating PCI resources starting at d0000000 (gap: d0000000:2ec00000)
Booting paravirtualized kernel on bare hardware
NR_CPUS:4096 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
PERCPU: Embedded 30 pages/cpu @ffff880038600000 s91288 r8192 d23400 u131072
pcpu-alloc: s91288 r8192 d23400 u131072 alloc=1*2097152
pcpu-alloc: [0] 000 001 002 003 004 005 006 007 016 017 018 019 020 021 022 023 
pcpu-alloc: [0] 032 034 036 038 040 042 044 046 048 050 052 054 056 058 060 062 
pcpu-alloc: [0] 064 066 068 070 072 074 076 078 080 082 084 086 088 090 092 094 
pcpu-alloc: [0] 096 098 100 102 104 106 108 110 112 114 116 118 120 122 124 126 
pcpu-alloc: [0] 128 130 132 134 136 138 140 142 144 146 148 150 152 154 156 158 
pcpu-alloc: [0] 160 162 164 166 168 170 172 174 176 178 180 182 184 186 188 190 
pcpu-alloc: [0] 192 194 196 198 200 202 204 206 208 210 212 214 216 218 220 222 
pcpu-alloc: [0] 224 226 228 230 232 234 236 238 --- --- --- --- --- --- --- --- 
pcpu-alloc: [1] 008 009 010 011 012 013 014 015 024 025 026 027 028 029 030 031 
pcpu-alloc: [1] 033 035 037 039 041 043 045 047 049 051 053 055 057 059 061 063 
pcpu-alloc: [1] 065 067 069 071 073 075 077 079 081 083 085 087 089 091 093 095 
pcpu-alloc: [1] 097 099 101 103 105 107 109 111 113 115 117 119 121 123 125 127 
pcpu-alloc: [1] 129 131 133 135 137 139 141 143 145 147 149 151 153 155 157 159 
pcpu-alloc: [1] 161 163 165 167 169 171 173 175 177 179 181 183 185 187 189 191 
pcpu-alloc: [1] 193 195 197 199 201 203 205 207 209 211 213 215 217 219 221 223 
pcpu-alloc: [1] 225 227 229 231 233 235 237 239 --- --- --- --- --- --- --- --- 
Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8250675
Policy zone: Normal
Kernel command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=131M@0M SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
PID hash table entries: 4096 (order: 3, 32768 bytes)
xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
Checking aperture...
No AGP bridge found
Memory: 32738448k/34603008k available (5400k kernel code, 1126752k absent, 737808k reserved, 7008k data, 1304k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:3144
Extended CMOS year: 2000
Console: colour VGA+ 80x25
console [ttyS0] enabled
allocated 134217728 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
TSC: cpu family 6 model 45, tsc initial value = 76769d08dc
Fast TSC calibration using PIT
Detected 2693.514 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5387.02 BogoMIPS (lpj=2693514)
pid_max: default: 245760 minimum: 1920
Security Framework initialized
SELinux:  Initializing.
Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 20 MCE banks
CPU0: Thermal monitoring enabled (TM1)
using mwait in idle threads.
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 22144 entries in 87 pages
x2apic not enabled, IRQ remapping init failed
APIC routing finalized to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz stepping 07
Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
... version:                3
... bit width:              48
... generic registers:      4
... value mask:             0000ffffffffffff
... max period:             0000ffffffffffff
... fixed-purpose events:   3
... event mask:             000000070000000f
NMI watchdog enabled, takes one hw-pmu counter.
Booting Node   0, Processors  #1 #2 #3 #4 #5 #6 #7 Ok.
Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 Ok.
Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 Ok.
Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
Brought up 32 CPUs
Total of 32 processors activated (172372.80 BogoMIPS).
devtmpfs: initialized
PM: Registering ACPI NVS region at bdd2f000 (647168 bytes)
PM: Registering ACPI NVS region at bdea1000 (581632 bytes)
regulator: core version 0.5
NET: Registered protocol family 16
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MCFG configuration 0: base c0000000 segment 0 buses 0 - 255
PCI: MCFG area at c0000000 reserved in E820
PCI: Using MMCONFIG at c0000000 - cfffffff
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: Executed 1 blocks of module-level executable AML code
ACPI: BIOS _OSI(Linux) query ignored
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
HEST: Table parsing has been initialized.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
pci_root PNP0A08:00: host bridge window [io  0x0000-0xbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:00: host bridge window [mem 0x000c0000-0x000c3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c4000-0x000c7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c8000-0x000cbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000cc000-0x000cffff]
pci_root PNP0A08:00: host bridge window [mem 0x000d0000-0x000d3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d4000-0x000d7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d8000-0x000dbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000dc000-0x000dffff]
pci_root PNP0A08:00: host bridge window [mem 0x000e0000-0x000e3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e4000-0x000e7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e8000-0x000ebfff]
pci_root PNP0A08:00: host bridge window [mem 0x000ec000-0x000effff]
pci_root PNP0A08:00: host bridge window [mem 0x000f0000-0x000fffff]
pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xebffffff]
pci_root PNP0A08:00: host bridge window [mem 0x380000000000-0x38007fffffff]
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdfff])
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff]
pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff]
pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff]
pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff]
pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff]
pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff]
pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff]
pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff]
pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff]
pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff]
pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff]
pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff]
pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff]
pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
pci 0000:00:00.0: PME# disabled
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
pci 0000:00:01.1: PME# disabled
pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
pci 0000:00:02.0: PME# disabled
pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
pci 0000:00:02.2: PME# disabled
pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
pci 0000:00:03.0: PME# disabled
pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
pci 0000:00:11.0: PME# disabled
pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.0: PME# disabled
pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
pci 0000:00:16.1: PME# disabled
pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.7: PME# disabled
pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.0: PME# disabled
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:00.0: PME# disabled
pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
pci 0000:02:00.1: PME# disabled
pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
pci 0000:02:00.2: PME# disabled
pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
pci 0000:02:00.3: PME# disabled
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:07:00.3: PME# supported from D0 D3hot D3cold
pci 0000:07:00.3: PME# disabled
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a] (subtractive decode)
 pci0000:00: Requesting ACPI _OSC control (0x1d)
 pci0000:00: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
pci_root PNP0A08:01: host bridge window [io  0x03b0-0x03df]
pci_root PNP0A08:01: host bridge window [io  0xc000-0xffff]
pci_root PNP0A08:01: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:01: host bridge window [mem 0xec000000-0xfbffffff]
pci_root PNP0A08:01: host bridge window [mem 0x380080000000-0x3800ffffffff]
PCI host bridge to bus 0000:80
pci_bus 0000:80: root bus resource [io  0x03b0-0x03df]
pci_bus 0000:80: root bus resource [io  0xc000-0xffff]
pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff]
pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff]
pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
pci 0000:80:01.0: PME# disabled
pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
pci 0000:80:02.0: PME# disabled
pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
pci 0000:80:03.0: PME# disabled
pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
pci 0000:80:03.2: PME# disabled
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
 pci0000:80: Requesting ACPI _OSC control (0x1d)
 pci0000:80: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
PCI host bridge to bus 0000:7f
 pci0000:7f: Requesting ACPI _OSC control (0x1d)
 pci0000:7f: ACPI _OSC control (0x10) granted
ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
PCI host bridge to bus 0000:ff
 pci0000:ff: Requesting ACPI _OSC control (0x1d)
 pci0000:ff: ACPI _OSC control (0x10) granted
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:09:00.0
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
HPET: 8 timers in total, 5 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 72, 73, 74, 75, 76, 0
hpet0: 8 comparators, 64-bit 14.318180 MHz counter
Switching to clocksource hpet
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 15 devices
ACPI: ACPI bus type pnp unregistered
system 00:05: [io  0x0680-0x069f] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0x0400-0x0453] has been reserved
system 00:05: [io  0x0458-0x047f] has been reserved
system 00:05: [io  0x0500-0x057f] has been reserved
system 00:05: [io  0x0600-0x061f] has been reserved
system 00:05: [io  0x0ca2-0x0ca5] has been reserved
system 00:05: [io  0x0cf9] could not be reserved
system 00:07: [io  0x0454-0x0457] has been reserved
system 00:0a: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:0a: [mem 0xebfff000-0xebffffff] has been reserved
system 00:0a: [mem 0xc0000000-0xcfffffff] has been reserved
system 00:0a: [mem 0xfed20000-0xfed3ffff] has been reserved
system 00:0a: [mem 0xfed45000-0xfed8ffff] has been reserved
system 00:0a: [mem 0xff000000-0xffffffff] could not be reserved
system 00:0a: [mem 0xfee00000-0xfeefffff] could not be reserved
system 00:0a: [mem 0xfec00000-0xfecfffff] could not be reserved
system 00:0a: [mem 0xd0f70000-0xd0f70fff] has been reserved
system 00:0c: [mem 0x00000000-0x0009cfff] could not be reserved
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
pci 0000:00:02.0:   bridge window [mem 0xeb000000-0xeb7fffff 64bit pref]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
pci 0000:00:11.0:   bridge window [mem 0xeb800000-0xebcfffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a]
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
pci 0000:00:01.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:01.1: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.2: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:03.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:11.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
pci 0000:80:01.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:02.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.2: PCI INT A -> GSI 71 (level, low) -> IRQ 71
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1a.0: PCI INT B disabled
pci 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1d.0: PCI I�NT A disabled
s initramfs...
Freeing initrd memory: 32580k freed
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
futex hash table entries: 65536 (order: 10, 4194304 bytes)
audit: initializing netlink socket (disabled)
type=2000 audit(1476815136.103:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 32768
ksign: Installing public key data
Loading keyring
- Added public key 3B396075E393847B
- User ID: Red Hat, Inc. (Kernel Module GPG key)
- Added public key D4A26C9CCD09BEDA
- User ID: Red Hat Enterprise Linux Driver Update Program <secalert@redhat.com>
- Added public key CB445E0DA3EA1F65
- User ID: Red Hat Enterprise Linux Driver Update Program (key 4) <secalert@redhat.com>
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
acpiphp: Slot [2] registered
acpiphp: Slot [2-1] registered
acpiphp: Slot [2-2] registered
acpiphp: Slot [2-3] registered
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
[Firmware Bug]: No valid trip found
ERST: Error Record Serialization Table (ERST) support is initialized.
GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
�serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input1
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
ehci_hcd 0000:00:1a.0: EHCI Host Controller
ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.0: debug port 2
ehci_hcd 0000:00:1a.0: irq 22, io mem 0xd0f20000
ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb1: SerialNumber: 0000:00:1a.0
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
ehci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
ehci_hcd 0000:00:1d.0: EHCI Host Controller
ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
ehci_hcd 0000:00:1d.0: debug port 2
ehci_hcd 0000:00:1d.0: irq 20, io mem 0xd0f10000
Refined TSC clocksource calibration: 2693.509 MHz.
Switching to clocksource tsc
ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: EHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
PNP: No PS/2 controller found. Probing ports directly.
mice: PS/2 mouse device common for all mice
rtc_cmos 00:06: RTC can wake from S4
rtc_cmos 00:06: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
cpuidle: using governor ladder
cpuidle: using governor menu
EFI Variables Facility v0.08 2004-May-17
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
GRE over IPv4 demultiplexor driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
rtc_cmos 00:06: setting system clock to 2016-10-18 18:25:41 UTC (1476815141)
Initalizing network drop monitor service
Freeing unused kernel memory: 1304k freed
Write protecting the kernel read-only data: 10240k
Freeing unused kernel memory: 724k freed
Freeing unused kernel memory: 1572k freed
rdac: device handler registered
dracut: dracut-004-388.el6
dracut: rd_NO_LUKS: removing cryptoluks activation
dracut: rd_NO_LVM: removing LVM activation
usb 1-1: new high speed USB device number 2 using ehci_hcd
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: dm-devel@redhat.com
udev: starting version 147
usb 1-1: New USB device found, idVendor=8087, idProduct=0024
usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 1-1: configuration #1 chosen from 1 choice
hub 1-1:1.0: USB hub found
hub 1-1:1.0: 6 ports detected
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
usb 2-1: new high speed USB device number 2 using ehci_hcd
mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)
mlx4_core: Initializing 0000:04:00.0
mlx4_core 0000:04:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
usb 2-1: New USB device found, idVendor=8087, idProduct=0024
usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 2-1: configuration #1 chosen from 1 choice
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 8 ports detected
usb 2-1.4: new full speed USB device number 3 using ehci_hcd
usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.4: Product: Virtual Keyboard and Mouse
usb 2-1.4: Manufacturer: American Megatrends Inc.
usb 2-1.4: SerialNumber: serial
usb 2-1.4: configuration #1 chosen from 1 choice
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input2
generic-usb 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input3
generic-usb 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)
mlx4_en 0000:04:00.0: registered PHC clock
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
<mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014)
mpt2sas version 20.101.00.00 loaded
mpt2sas 0000:06:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32774632 kB)
mpt2sas0: MSI-X vectors supported: 8, no of cores: 32, max_msix_vectors: 8
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 127
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 128
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 129
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 130
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 131
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 132
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 133
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 134
mpt2sas0: iomem(0x00000000d0a40000), mapped(0xffffc900147c0000), size(65536)
mpt2sas0: ioport(0x0000000000002000), size(256)
mpt2sas0: sending message unit reset !!
mpt2sas0: message unit reset: SUCCESS
mpt2sas0: Allocated physical memory: size(17329 kB)
mpt2sas0: Current Controller Queue Depth(9979), Max Controller Queue Depth(10240)
mpt2sas0: Scatter Gather Elements per IO(128)
mpt2sas0: LSISAS2308: FWVersion(15.00.00.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
mpt2sas0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi0 : Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas0: host_add: handle(0x0001), sas_addr(0x500605b005d6d910), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:41: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:42: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:43: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:44: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:45: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:46: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:41: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:42: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:43: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:44: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:45: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:46: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:0:41: rdac: LUN 41 (RDAC) (owned)
scsi 0:0:0:42: rdac: LUN 42 (RDAC) (unowned)
scsi 0:0:0:43: rdac: LUN 43 (RDAC) (owned)
scsi 0:0:0:44: rdac: LUN 44 (RDAC) (unowned)
scsi 0:0:0:45: rdac: LUN 45 (RDAC) (owned)
scsi 0:0:0:46: rdac: LUN 46 (RDAC) (unowned)
scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:1:41: rdac: LUN 41 (RDAC) (unowned)
scsi 0:0:1:42: rdac: LUN 42 (RDAC) (owned)
scsi 0:0:1:43: rdac: LUN 43 (RDAC) (unowned)
scsi 0:0:1:44: rdac: LUN 44 (RDAC) (owned)
scsi 0:0:1:45: rdac: LUN 45 (RDAC) (unowned)
scsi 0:0:1:46: rdac: LUN 46 (RDAC) (owned)
isci: Intel(R) C600 SAS Controller Driver - version 1.1.0-rh
isci 0000:07:00.0: driver configured for rev: 6 silicon
isci 0000:07:00.0: OEM parameter table found in OROM
isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
isci 0000:07:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
scsi1 : isci
ata1.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata1.00: configured for UDMA/133
scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ata2.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata2.00: configured for UDMA/133
scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ACPI: WMI: Mapper loaded
ahci 0000:00:1f.2: PCI INT B -> GSI 21 (level, low) -> IRQ 21
ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
scsi2 : ahci
scsi3 : ahci
scsi4 : ahci
scsi5 : ahci
scsi6 : ahci
scsi7 : ahci
ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 137
ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 137
ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 137
ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 137
ata7: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 137
ata8: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 137
ata3: SATA link down (SStatus 0 SControl 300)
ata4: SATA link down (SStatus 0 SControl 300)
ata5: SATA link down (SStatus 0 SControl 300)
ata8: SATA link down (SStatus 0 SControl 300)
ata7: SATA link down (SStatus 0 SControl 300)
ata6: SATA link down (SStatus 0 SControl 300)
%Gsd 0:0:0:7: [sda] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:0:42: [sdc] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:41: [sdb] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:43: [sdd] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:42: [sdc] Write Protect is off
sd 0:0:0:42: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:41: [sdb] Write Protect is off
sd 0:0:0:46: [sdg] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] Write Protect is off
sd 0:0:1:42: [sdj] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:41: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:1:41: [sdi] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:43: [sdd] Write Protect is off
sd 0:0:0:44: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:43: [sdk] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] Write Protect is off
sd 0:0:1:44: [sdl] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:43: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:45: [sdm] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 1:0:0:0: [sdo] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:0:0: [sdo] Write Protect is off
sd 0:0:0:45: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 1:0:0:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 0:0:1:46: [sdn] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 1:0:1:0: [sdp] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 0:0:1:7: [sdh] Write Protect is off
sd 1:0:1:0: [sdp] Write Protect is off
sd 0:0:0:46: [sdg] Write Protect is off
sd 1:0:1:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 0:0:1:42: [sdj] Write Protect is off
 sdo:
sd 0:0:1:41: [sdi] Write Protect is off
sd 0:0:1:44: [sdl] Write Protect is off
sd 0:0:0:46: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:43: [sdk] Write Protect is off
 sdp:
sd 0:0:1:41: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:44: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:46: [sdn] Write Protect is off
sd 0:0:1:42: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:45: [sdm] Write Protect is off
sd 0:0:1:46: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:43: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdb:
sd 0:0:1:45: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sde: unknown partition table
 sdc:
sd 0:0:0:7: [sda] Write Protect is off
sd 0:0:0:7: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:41: [sdb] Attached SCSI disk
 sdo1 sdo2
Dev sdc: unable to read RDB block 0
 sdh:Dev sde: unable to read RDB block 0
 unable to read partition table
 unable to read partition table
sd 1:0:0:0: [sdo] Attached SCSI disk
sd 0:0:0:42: [sdc] Attached SCSI disk
 sdd:
sd 0:0:0:44: [sde] Attached SCSI disk
 sdj: unknown partition table
 unknown partition table
 sda:
 sdf:
sd 0:0:1:42: [sdj] Attached SCSI disk
sd 0:0:0:43: [sdd] Attached SCSI disk
 sdg:
 sdi:
 sdl: unknown partition table
 sdk: unknown partition table
sd 0:0:0:45: [sdf] Attached SCSI disk
Dev sdi: unable to read RDB block 0
sd 0:0:1:44: [sdl] Attached SCSI disk
Dev sdk: unable to read RDB block 0
 unable to read partition table
Dev sdg: unable to read RDB block 0
sd 0:0:1:41: [sdi] Attached SCSI disk
 unable to read partition table
 unable to read partition table
sd 0:0:1:43: [sdk] Attached SCSI disk
 sdm:Dev sdm: unable to read RDB block 0
 sdp1
sd 0:0:0:46: [sdg] Attached SCSI disk
 sdp9
 unable to read partition table
sd 1:0:1:0: [sdp] Attached SCSI disk
 sdn:
sd 0:0:1:45: [sdm] Attached SCSI disk
 unknown partition table
sd 0:0:1:46: [sdn] Attached SCSI disk
 unknown partition table
sd 0:0:1:7: [sdh] Attached SCSI disk
 unknown partition table
sd 0:0:0:7: [sda] Attached SCSI disk
EXT3-fs (sdo1): recovery required on readonly filesystem
EXT3-fs (sdo1): write access will be enabled during recovery
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sdo1): orphan cleanup on readonly fs
EXT3-fs (sdo1): 7 orphan inodes deleted
EXT3-fs (sdo1): recovery complete
EXT3-fs (sdo1): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/sdo1
SELinux:  Disabled at runtime.
type=1404 audit(1476815158.353:2): selinux=0 auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
cat: /proc/self/attr/current: Invalid argument

		Welcome to CentOS 

Starting udev: udev: starting version 147
dca service started, version 1.12.1
igb: Intel(R) Gigabit Ethernet Network Driver - version 5.2.15-k
igb: Copyright (c) 2007-2014 Intel Corporation.
igb 0000:02:00.0: PCI INT A -> GSI 27 (level, low) -> IRQ 27
igb 0000:02:00.0: added PHC on eth0
igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b3
igb 0000:02:00.0: eth0: PBA No: 100000-000
igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.1: PCI INT B -> GSI 30 (level, low) -> IRQ 30
igb 0000:02:00.1: added PHC on eth1
igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b4
igb 0000:02:00.1: eth1: PBA No: 100000-000
igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.2: PCI INT C -> GSI 28 (level, low) -> IRQ 28
igb 0000:02:00.2: added PHC on eth2
igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b5
igb 0000:02:00.2: eth2: PBA No: 100000-000
igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.3: PCI INT D -> GSI 29 (level, low) -> IRQ 29
igb 0000:02:00.3: added PHC on eth3
igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b6
igb 0000:02:00.3: eth3: PBA No: 100000-000
igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
scsi 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:0:7: Attached scsi generic sg1 type 0
sd 0:0:0:41: Attached scsi generic sg2 type 0
sd 0:0:0:42: Attached scsi generic sg3 type 0
sd 0:0:0:43: Attached scsi generic sg4 type 0
sd 0:0:0:44: Attached scsi generic sg5 type 0
sd 0:0:0:45: Attached scsi generic sg6 type 0
sd 0:0:0:46: Attached scsi generic sg7 type 0
scsi 0:0:1:0: Attached scsi generic sg8 type 0
sd 0:0:1:7: Attached scsi generic sg9 type 0
sd 0:0:1:41: Attached scsi generic sg10 type 0
sd 0:0:1:42: Attached scsi generic sg11 type 0
sd 0:0:1:43: Attached scsi generic sg12 type 0
sd 0:0:1:44: Attached scsi generic sg13 type 0
sd 0:0:1:45: Attached scsi generic sg14 type 0
sd 0:0:1:46: Attached scsi generic sg15 type 0
sd 1:0:0:0: Attached scsi generic sg16 type 0
sd 1:0:1:0: Attached scsi generic sg17 type 0
ioatdma: Intel(R) QuickData Technology Driver 4.00
ioatdma 0000:00:04.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
igb 0000:02:00.0: DCA enabled
igb 0000:02:00.1: DCA enabled
ioatdma 0000:00:04.1: PCI INT B -> GSI 39 (level, low) -> IRQ 39
igb 0000:02:00.2: DCA enabled
igb 0000:02:00.3: DCA enabled
ioatdma 0000:00:04.2: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.3: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.4: PCI INT A -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.5: PCI INT B -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.6: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.7: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:80:04.0: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.1: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.2: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.3: PCI INT D -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.4: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.5: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.6: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.7: PCI INT D -> GSI 63 (level, low) -> IRQ 63
i801_smbus 0000:00:1f.3: PCI INT C -> GSI 23 (level, low) -> IRQ 23
ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
i801_smbus 0000:07:00.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
i801_smbus 0000:07:00.3: Enabling SMBus device
ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042f conflicts with OpRegion 0x0000000000000400-0x000000000000047f (\PMIO) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000053f (\FBPC) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000052f (\_SI_.SIOR) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
lpc_ich: Resource conflict(s) found affecting gpio_ich
EDAC MC: Ver: 2.1.0 Oct 17 2016
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0
EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0
EDAC sbridge: Driver loaded.
%Gzunicode: module license 'CDDL' taints kernel.
Disabling lock debugging due to kernel taint
SPL: Loaded module v0.6.5.7-1
ZFS: Loaded module v0.6.5.7-1, ZFS pool version 5000, ZFS filesystem version 5
iTCO_vendor_support: vendor-support=0
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.07rh
iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
microcode: CPU0 updated to revision 0x710, date = 2013-06-17 
microcode: CPU1 updated to revision 0x710, date = 2013-06-17 
microcode: CPU2 updated to revision 0x710, date = 2013-06-17 
microcode: CPU3 updated to revision 0x710, date = 2013-06-17 
microcode: CPU4 updated to revision 0x710, date = 2013-06-17 
microcode: CPU5 updated to revision 0x710, date = 2013-06-17 
microcode: CPU6 updated to revision 0x710, date = 2013-06-17 
microcode: CPU7 updated to revision 0x710, date = 2013-06-17 
microcode: CPU8 updated to revision 0x710, date = 2013-06-17 
microcode: CPU9 updated to revision 0x710, date = 2013-06-17 
microcode: CPU10 updated to revision 0x710, date = 2013-06-17 
microcode: CPU11 updated to revision 0x710, date = 2013-06-17 
microcode: CPU12 updated to revision 0x710, date = 2013-06-17 
microcode: CPU13 updated to revision 0x710, date = 2013-06-17 
microcode: CPU14 updated to revision 0x710, date = 2013-06-17 
microcode: CPU15 updated to revision 0x710, date = 2013-06-17 
microcode: CPU16 updated to revision 0x710, date = 2013-06-17 
microcode: CPU17 updated to revision 0x710, date = 2013-06-17 
microcode: CPU18 updated to revision 0x710, date = 2013-06-17 
microcode: CPU19 updated to revision 0x710, date = 2013-06-17 
microcode: CPU20 updated to revision 0x710, date = 2013-06-17 
microcode: CPU21 updated to revision 0x710, date = 2013-06-17 
microcode: CPU22 updated to revision 0x710, date = 2013-06-17 
microcode: CPU23 updated to revision 0x710, date = 2013-06-17 
microcode: CPU24 updated to revision 0x710, date = 2013-06-17 
microcode: CPU25 updated to revision 0x710, date = 2013-06-17 
microcode: CPU26 updated to revision 0x710, date = 2013-06-17 
microcode: CPU27 updated to revision 0x710, date = 2013-06-17 
microcode: CPU28 updated to revision 0x710, date = 2013-06-17 
microcode: CPU29 updated to revision 0x710, date = 2013-06-17 
microcode: CPU30 updated to revision 0x710, date = 2013-06-17 
microcode: CPU31 updated to revision 0x710, date = 2013-06-17 
[  OK  ]


Setting hostname lola-10.lola.whamcloud.com:  [  OK  ]


device-mapper: multipath: version 1.6.0 loaded
Oct 18 11:26:03 | ignoring extra data starting with 'udev_dir' on line 2 of /etc/multipath.conf

device-mapper: multipath round-robin: version 1.0.0 loaded
device-mapper: table: 253:4: multipath: error getting device
device-mapper: ioctl: error adding target to table
Add partition mappings:  [  OK  ]


ERROR: asr: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: hpt37x: reading /dev/sdm[Input/output error]

ERROR: hpt45x: reading /dev/sdm[Input/output error]

ERROR: isw: reading /dev/sdm[Input/output error]

ERROR: jmicron: reading /dev/sdm[Input/output error]

ERROR: lsi: reading /dev/sdm[Input/output error]

ERROR: nvidia: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: sil: reading /dev/sdm[Input/output error]

ERROR: via: reading /dev/sdm[Input/output error]

ERROR: asr: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: hpt37x: reading /dev/sdk[Input/output error]

ERROR: hpt45x: reading /dev/sdk[Input/output error]

ERROR: isw: reading /dev/sdk[Input/output error]

ERROR: jmicron: reading /dev/sdk[Input/output error]

ERROR: lsi: reading /dev/sdk[Input/output error]

ERROR: nvidia: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: sil: reading /dev/sdk[Input/output error]

ERROR: via: reading /dev/sdk[Input/output error]

ERROR: asr: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: hpt37x: reading /dev/sdi[Input/output error]

ERROR: hpt45x: reading /dev/sdi[Input/output error]

ERROR: isw: reading /dev/sdi[Input/output error]

ERROR: jmicron: reading /dev/sdi[Input/output error]

ERROR: lsi: reading /dev/sdi[Input/output error]

ERROR: nvidia: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: sil: reading /dev/sdi[Input/output error]

ERROR: via: reading /dev/sdi[Input/output error]

ERROR: asr: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: hpt37x: reading /dev/sdg[Input/output error]

ERROR: hpt45x: reading /dev/sdg[Input/output error]

ERROR: isw: reading /dev/sdg[Input/output error]

ERROR: jmicron: reading /dev/sdg[Input/output error]

ERROR: lsi: reading /dev/sdg[Input/output error]

ERROR: nvidia: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: sil: reading /dev/sdg[Input/output error]

ERROR: via: reading /dev/sdg[Input/output error]

ERROR: asr: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: hpt37x: reading /dev/sde[Input/output error]

ERROR: hpt45x: reading /dev/sde[Input/output error]

ERROR: isw: reading /dev/sde[Input/output error]

ERROR: jmicron: reading /dev/sde[Input/output error]

ERROR: lsi: reading /dev/sde[Input/output error]

ERROR: nvidia: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: sil: reading /dev/sde[Input/output error]

ERROR: via: reading /dev/sde[Input/output error]

ERROR: asr: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: hpt37x: reading /dev/sdc[Input/output error]

ERROR: hpt45x: reading /dev/sdc[Input/output error]

ERROR: isw: reading /dev/sdc[Input/output error]

ERROR: jmicron: reading /dev/sdc[Input/output error]

ERROR: lsi: reading /dev/sdc[Input/output error]

ERROR: nvidia: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: sil: reading /dev/sdc[Input/output error]

ERROR: via: reading /dev/sdc[Input/output error]

Setting up Logical Volume Management: [  OK  ]


Checking filesystems

Checking all file systems.

[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/sdo1 

/dev/sdo1: clean, 131812/1310720 files, 3402725/5242880 blocks

[  OK  ]


RemEXT3-fs (sdo1): using internal journal
ounting root filesystem in read-write mode:  [  OK  ]


Mounting local filesystems:  [  OK  ]


Enabling local filesystem quotas:  [  OK  ]


Enabling /etc/fstab swaps:  Adding 16457724k swap on /dev/sdo2.  Priority:-1 extents:1 across:16457724k 
[  OK  ]


Entering non-interactive startup

Calling the system activity data collector (sadc)... 

Loading OpenIB kernel modules:[  OK  ]


Mounting ZFS filesystem(s)  [  OK  ]


ip6tables: No config file.[WARNING]


iptables: No config file.[WARNING]


Bringing up loopback interface:  [  OK  ]


Bringing up interface eth0:  ADDRCONF(NETDEV_UP): eth0: link is not ready
Determining if ip address 10.4.0.110 is already in use for device eth0...

igb 0000:02:00.0: eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  OK  ]


Bringing up interface ib0:  ADDRCONF(NETDEV_UP): ib0: link is not ready
ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
[  OK  ]


Bringing up interface ipmi:  Device ipmi does not seem to be present, delaying initialization.

[FAILED]


Starting auditd: type=1305 audit(1476815183.286:3): audit_pid=4481 old=0 auid=4294967295 ses=4294967295 res=1
[  OK  ]


Loading Lustre module stack...LNet: HW CPU cores: 32, npartitions: 2
alg: No test for adler32 (adler32-zlib)
alg: No test for crc32 (crc32-table)
alg: No test for crc32 (crc32-pclmul)
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
Lustre: Lustre: Build Version: 2.8.59_25_g401d7fc
LNet: Added LNI 192.168.1.110@o2ib10 [8/256/0/180]


Starting system logger: [  OK  ]


Enabling ondemand cpu frequency scaling: [  OK  ]


Starting irqbalance: [  OK  ]


Starting rpcbind: [  OK  ]


ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Starting NFS statd: [  OK  ]


Starting system message bus: [  OK  ]


Setting NIS domain: domain is 'lola.whamcloud.com'  [  OK  ]


Starting NIS service: [  OK  ]


Binding NIS service: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
.[  OK  ]


Starting ibacm daemon:[  OK  ]


NFS filesystems queued to be mounted

Mounting filesystems:  RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Slow work thread pool: Starting up
Slow work thread pool: Ready
FS-Cache: Loaded
NFS: Registering the id_resolver key type
FS-Cache: Netfs 'nfs' registered for caching
[  OK  ]


Starting acpi daemon: [  OK  ]


Starting HAL daemon: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
[  OK  ]


Retrigger failed udev events[  OK  ]


Starting ZFS Event Daemon  [  OK  ]
[  OK  ]


Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Starting NFS services:  [  OK  ]


Starting NFS quotas: [  OK  ]


Starting NFS mountd: [  OK  ]


Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
[  OK  ]


Starting RPC idmapd: [  OK  ]


Sharing ZFS filesystems  [  OK  ]


Starting MUNGE: munged[  OK  ]


Starting kdump:[  OK  ]


Starting sshd: [  OK  ]


Starting xinetd: [  OK  ]


Starting ntpd: [  OK  ]


Starting GANGLIA gmond: [  OK  ]


Starting sendmail: [  OK  ]


Starting sm-client: [  OK  ]


Starting crond: [  OK  ]


starting slurmd: [  OK  ]


802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
8021q: adding VLAN 0 to HW filter on device eth0
Starting atd: [  OK  ]


Starting collectl: [  OK  ]



CentOS release 6.7 (Final)
Kernel 2.6.32-573.26.1.el6_lustre.x86_64 on an x86_64

lola-10.lola.whamcloud.com login: Oct 18 11:30:01 lola-10 TIME: Time stamp for console
LDISKFS-fs warning (device dm-0): ldiskfs_multi_mount_protect: MMP interval 42 higher than expected, please wait.

LDISKFS-fs (dm-0): recovery complete
LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. quota=on. Opts: 
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
Lustre: soaked-MDT0002: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-450
Lustre: soaked-MDT0002: Will be in recovery for at least 2:30, or until 22 clients reconnect
Lustre: soaked-MDT0002: Connection restored to 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100)
Lustre: soaked-MDT0002: Connection restored to 01cae752-0caa-1cb3-98fd-0d64e17eaaf8 (at 192.168.1.123@o2ib100)
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0000_UUID (at 192.168.1.102@o2ib10)
Lustre: Skipped 5 previous similar messages
Lustre: soaked-MDT0002: Connection restored to fba24f35-5625-e003-a958-29928c5e620b (at 192.168.1.120@o2ib100)
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Connection restored to a7f7fe73-573a-8138-deac-4dd672b42eef (at 192.168.1.133@o2ib100)
Lustre: Skipped 11 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 4236c3da-7f64-f6f1-4440-63ec2a6974d3 (at 192.168.1.132@o2ib100)
Lustre: Skipped 5 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0008_UUID (at 192.168.1.104@o2ib10)
Lustre: Skipped 9 previous similar messages
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
Oct 18 11:35:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: Skipped 1 previous similar message
Oct 18 11:40:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: Skipped 3 previous similar messages
Oct 18 11:45:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: Skipped 5 previous similar messages
Oct 18 11:50:01 lola-10 TIME: Time stamp for console
Oct 18 11:55:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: recovery is timed out, evict stale exports
Lustre: soaked-MDT0002: disconnecting 4 stale clients
Lustre: 6047:0:(ldlm_lib.c:1625:abort_req_replay_queue()) @@@ aborted:  req@ffff880822fbdc50 x1548504850797840/t0(60144986627) o1000->soaked-MDT0001-mdtlov_UUID@192.168.1.109@o2ib10:-1/-1 lens 360/0 e 56 to 0 dl 1476816932 ref 1 fl Complete:/4/ffffffff rc 0/-1
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.109@o2ib10, removing former export from same NID
Lustre: soaked-MDT0002: Denying connection for new client fba24f35-5625-e003-a958-29928c5e620b(at 192.168.1.120@o2ib100), waiting for 22 known clients (17 recovered, 1 in progress, and 4 evicted) to recover in 21188489:29
Lustre: soaked-MDT0002: Denying connection for new client 8def2455-4284-8b62-26e8-f9e60ca767e5(at 192.168.1.113@o2ib100), waiting for 22 known clients (17 recovered, 1 in progress, and 4 evicted) to recover in 21188489:29
Lustre: soaked-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Lustre: Skipped 7 previous similar messages
Lustre: 6047:0:(ldlm_lib.c:2036:target_recovery_overseer()) soaked-MDT0002 recovery is aborted by hard timeout
Lustre: 6047:0:(ldlm_lib.c:2046:target_recovery_overseer()) recovery is aborted, evict exports in recovery
Lustre: soaked-MDT0002: Recovery over after 23:20, of 22 clients 17 recovered and 5 were evicted.
Lustre: soaked-MDT0002: Connection restored to 63007e90-8efe-e065-1584-1ca6a775384c (at 192.168.1.119@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to fba24f35-5625-e003-a958-29928c5e620b (at 192.168.1.120@o2ib100)
Oct 18 12:00:01 lola-10 TIME: Time stamp for console
Oct 18 12:05:01 lola-10 TIME: Time stamp for console
Oct 18 12:10:01 lola-10 TIME: Time stamp for console
Lustre: 4573:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476817877/real 0]  req@ffff8803fdbb8080 x1548564481768320/t0(0) o13->soaked-OST0014-osc-MDT0002@192.168.1.104@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476817884 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST0014-osc-MDT0002: Connection to soaked-OST0014 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4586:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476817877/real 0]  req@ffff88082697c3c0 x1548564481768288/t0(0) o13->soaked-OST000e-osc-MDT0002@192.168.1.104@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476817884 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4586:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
Lustre: soaked-OST000e-osc-MDT0002: Connection to soaked-OST000e (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 2 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476817884/real 0]  req@ffff880803692680 x1548564481771584/t0(0) o8->soaked-OST000e-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476817890 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4564:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476817875/real 1476817899]  req@ffff8803ffd739c0 x1548564481767040/t0(0) o6->soaked-OST000e-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 664/432 e 0 to 1 dl 1476817919 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
Lustre: 4564:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
sd 0:0:1:42: attempting task abort! scmd(ffff880800a950c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 e8 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880800a950c0)
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476817984/real 0]  req@ffff880824252cc0 x1548564481874720/t0(0) o8->soaked-OST000e-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476817995 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476818084/real 0]  req@ffff8808134f6c80 x1548564482153088/t0(0) o8->soaked-OST0008-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476818100 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Oct 18 12:15:01 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476818159/real 1476818159]  req@ffff88082980d3c0 x1548564482330736/t0(0) o8->soaked-OST000e-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476818180 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476818209/real 1476818209]  req@ffff88080123c3c0 x1548564482548784/t0(0) o8->soaked-OST0014-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476818235 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476818284/real 1476818284]  req@ffff88081496c980 x1548564482816912/t0(0) o8->soaked-OST0014-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476818315 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
LNet: Service thread pid 6274 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
LNet: Service thread pid 6274 completed after 200.00s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
Pid: 6274, comm: mdt01_014

Call Trace:
 [<ffffffff8153cc55>] rwsem_down_failed_common+0x95/0x1d0
 [<ffffffff8153cdb3>] rwsem_down_write_failed+0x23/0x30
 [<ffffffff8129e923>] call_rwsem_down_write_failed+0x13/0x20
 [<ffffffff8153c2b2>] ? down_write+0x32/0x40
 [<ffffffffa11d5da2>] lod_qos_prep_create+0xe12/0x15b0 [lod]
 [<ffffffffa0f7949f>] ? osd_declare_object_create+0x25f/0x330 [osd_ldiskfs]
 [<ffffffffa11cdea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11ce7c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1245586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa123f8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa124096b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa110b518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa111411f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa07ce7cc>] ? upcall_cache_get_entry+0x29c/0x880 [obdclass]
 [<ffffffffa07d38d0>] ? lu_ucred+0x20/0x30 [obdclass]
 [<ffffffffa10df795>] ? mdt_ucred+0x15/0x20 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e83b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa10e691e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa09687c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0993feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a088e1>] ? tgt_lookup_reply+0x31/0x190 [ptlrpc]
 [<ffffffffa0a19e91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476818347.6274
LNet: Service thread pid 6319 was inactive for 202.56s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6319, comm: mdt01_017

Call Trace:
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa12a2f36>] osp_precreate_reserve+0x3f6/0x890 [osp]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa129c62d>] osp_declare_object_create+0x19d/0x6a0 [osp]
 [<ffffffffa11d9025>] lod_sub_object_declare_create+0xd5/0x260 [lod]
 [<ffffffffa11d116e>] lod_qos_declare_object_on+0xce/0x3e0 [lod]
 [<ffffffffa11d4942>] lod_alloc_rr.clone.1+0x852/0xea0 [lod]
 [<ffffffffa0fa73a9>] ? osd_declare_qid+0x299/0x4d0 [osd_ldiskfs]
 [<ffffffffa11d5d82>] lod_qos_prep_create+0xdf2/0x15b0 [lod]
 [<ffffffffa11cdea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11ce7c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1245586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa123f8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa124096b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa110b518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa111411f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa07ce7cc>] ? upcall_cache_get_entry+0x29c/0x880 [obdclass]
 [<ffffffffa07d38d0>] ? lu_ucred+0x20/0x30 [obdclass]
 [<ffffffffa10df795>] ? mdt_ucred+0x15/0x20 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e83b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa10e691e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa09687c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0993feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a088e1>] ? tgt_lookup_reply+0x31/0x190 [ptlrpc]
 [<ffffffffa0a19e91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 6266, comm: mdt01_011

Call Trace:
 [<ffffffff8105e9b6>] ? enqueue_task+0x66/0x80
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa12a2f36>] osp_precreate_reserve+0x3f6/0x890 [osp]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa129c62d>] osp_declare_object_create+0x19d/0x6a0 [osp]
 [<ffffffffa11d9025>] lod_sub_object_declare_create+0xd5/0x260 [lod]
 [<ffffffffa11d116e>] lod_qos_declare_object_on+0xce/0x3e0 [lod]
 [<ffffffffa11d4942>] lod_alloc_rr.clone.1+0x852/0xea0 [lod]
 [<ffffffffa11d5d82>] lod_qos_prep_create+0xdf2/0x15b0 [lod]
 [<ffffffffa11cdea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11ce7c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1245586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa123f8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa124096b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa110b518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa111411f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa07ce7cc>] ? upcall_cache_get_entry+0x29c/0x880 [obdclass]
 [<ffffffffa07d38d0>] ? lu_ucred+0x20/0x30 [obdclass]
 [<ffffffffa10df795>] ? mdt_ucred+0x15/0x20 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e83b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa10e691e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa09687c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0993feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a088e1>] ? tgt_lookup_reply+0x31/0x190 [ptlrpc]
 [<ffffffffa0a19e91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Oct 18 12:20:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
Lustre: Skipped 1 previous similar message
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0008_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
LNet: Service thread pid 6319 completed after 300.00s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0014_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0002_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST000e_UUID (at 192.168.1.104@o2ib10) because it is indicating it is a new client
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476818434/real 1476818434]  req@ffff8804048a50c0 x1548564483804768/t0(0) o8->soaked-OST0014-osc-MDT0002@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476818475 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 2 previous similar messages
LNet: Service thread pid 5954 was inactive for 240.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
LNet: Skipped 1 previous similar message
Pid: 5954, comm: mdt00_000

Call Trace:
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa12a2f36>] osp_precreate_reserve+0x3f6/0x890 [osp]
 [<ffffffff81539896>] ? schedule+0x176/0x3a0
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa129c62d>] osp_declare_object_create+0x19d/0x6a0 [osp]
 [<ffffffffa11d9025>] lod_sub_object_declare_create+0xd5/0x260 [lod]
 [<ffffffffa11d116e>] lod_qos_declare_object_on+0xce/0x3e0 [lod]
 [<ffffffffa11d4942>] lod_alloc_rr.clone.1+0x852/0xea0 [lod]
 [<ffffffffa11d5d82>] lod_qos_prep_create+0xdf2/0x15b0 [lod]
 [<ffffffffa11cdea2>] lod_declare_striped_object+0x162/0x820 [lod]
 [<ffffffffa11ce7c1>] lod_declare_object_create+0x261/0x570 [lod]
 [<ffffffffa1245586>] mdd_declare_object_create_internal+0x116/0x340 [mdd]
 [<ffffffffa123f8b6>] mdd_declare_create+0x56/0x930 [mdd]
 [<ffffffffa124096b>] mdd_create+0x7db/0x1770 [mdd]
 [<ffffffffa110b518>] mdo_create+0x18/0x50 [mdt]
 [<ffffffffa111411f>] mdt_reint_open+0x226f/0x3230 [mdt]
 [<ffffffffa07ce7cc>] ? upcall_cache_get_entry+0x29c/0x880 [obdclass]
 [<ffffffffa07d38d0>] ? lu_ucred+0x20/0x30 [obdclass]
 [<ffffffffa10df795>] ? mdt_ucred+0x15/0x20 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e83b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa10e691e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa09687c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0993feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a088e1>] ? tgt_lookup_reply+0x31/0x190 [ptlrpc]
 [<ffffffffa0a19e91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476818502.5954
Lustre: soaked-OST0002-osc-MDT0002: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10)
Lustre: Skipped 3 previous similar messages
LNet: Service thread pid 5954 completed after 244.75s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
Lustre: soaked-OST0014-osc-MDT0002: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
Lustre: Skipped 2 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
Lustre: Skipped 2 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
Lustre: Skipped 3 previous similar messages
Oct 18 12:25:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
Lustre: Skipped 2 previous similar messages
sd 0:0:1:42: attempting task abort! scmd(ffff880801ba6780)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 60 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880801ba6780)
sd 0:0:1:42: attempting task abort! scmd(ffff88080c830180)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 88 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88080c830180)
sd 0:0:1:42: attempting task abort! scmd(ffff88080c830a80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 98 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88080c830a80)
sd 0:0:1:42: attempting task abort! scmd(ffff88080de25580)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 a8 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88080de25580)
sd 0:0:1:42: attempting task abort! scmd(ffff88080de25480)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 c8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88080de25480)
sd 0:0:1:42: attempting task abort! scmd(ffff88080de25380)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 e8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88080de25380)
sd 0:0:1:42: attempting task abort! scmd(ffff88080de25280)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 f8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88080de25280)
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0008_UUID (at 192.168.1.104@o2ib10)
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0008_UUID (at 192.168.1.104@o2ib10)
Oct 18 12:30:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.104@o2ib10, removing former export from same NID
Lustre: Skipped 17 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0008_UUID (at 192.168.1.104@o2ib10)
Oct 18 12:35:01 lola-10 TIME: Time stamp for console
Oct 18 12:40:01 lola-10 TIME: Time stamp for console
Oct 18 12:45:01 lola-10 TIME: Time stamp for console
Oct 18 12:50:01 lola-10 TIME: Time stamp for console
Oct 18 12:55:01 lola-10 TIME: Time stamp for console
Oct 18 13:00:01 lola-10 TIME: Time stamp for console
Oct 18 13:05:01 lola-10 TIME: Time stamp for console
Oct 18 13:10:01 lola-10 TIME: Time stamp for console
Oct 18 13:15:01 lola-10 TIME: Time stamp for console
Oct 18 13:20:01 lola-10 TIME: Time stamp for console
Oct 18 13:25:01 lola-10 TIME: Time stamp for console
Oct 18 13:30:01 lola-10 TIME: Time stamp for console
Oct 18 13:35:01 lola-10 TIME: Time stamp for console
Oct 18 13:40:01 lola-10 TIME: Time stamp for console
Oct 18 13:45:01 lola-10 TIME: Time stamp for console
Oct 18 13:50:01 lola-10 TIME: Time stamp for console
Oct 18 13:55:01 lola-10 TIME: Time stamp for console
Oct 18 14:00:01 lola-10 TIME: Time stamp for console
Oct 18 14:05:01 lola-10 TIME: Time stamp for console
Oct 18 14:10:01 lola-10 TIME: Time stamp for console
Oct 18 14:15:01 lola-10 TIME: Time stamp for console
Oct 18 14:20:01 lola-10 TIME: Time stamp for console
Lustre: 4563:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476825689/real 0]  req@ffff8803b1add0c0 x1548564558393920/t0(0) o13->soaked-OST0011-osc-MDT0002@192.168.1.107@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476825696 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4563:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-OST0011-osc-MDT0002: Connection to soaked-OST0011 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0017-osc-MDT0002: Connection to soaked-OST0017 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: soaked-OST0005-osc-MDT0002: Connection to soaked-OST0005 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0002: Client 485b43bc-eca4-2baf-34d1-3fd59bf57cbe (at 192.168.1.131@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 485b43bc-eca4-2baf-34d1-3fd59bf57cbe (at 192.168.1.131@o2ib100)
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.127@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: soaked-MDT0002: Client 485b43bc-eca4-2baf-34d1-3fd59bf57cbe (at 192.168.1.131@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 485b43bc-eca4-2baf-34d1-3fd59bf57cbe (at 192.168.1.131@o2ib100)
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476825748/real 0]  req@ffff8807cd929380 x1548564558399184/t0(0) o8->soaked-OST000b-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476825759 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476825823/real 0]  req@ffff8807c67139c0 x1548564559538416/t0(0) o8->soaked-OST0011-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476825839 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Oct 18 14:25:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0017_UUID (at 192.168.1.106@o2ib10)
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476825973/real 1476825973]  req@ffff880829d27c80 x1548564561455392/t0(0) o8->soaked-OST0011-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476825999 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: Skipped 2 previous similar messages
Lustre: soaked-OST000b-osc-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: Skipped 2 previous similar messages
LustreError: 11-0: soaked-OST0017-osc-MDT0002: operation ost_statfs to node 192.168.1.106@o2ib10 failed: rc = -107
LustreError: Skipped 10 previous similar messages
Lustre: soaked-OST0017-osc-MDT0002: Connection to soaked-OST0017 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0005-osc-MDT0002: Connection to soaked-OST0005 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0017-osc-MDT0002: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10)
Lustre: Skipped 2 previous similar messages
Lustre: soaked-OST000b-osc-MDT0002: Connection to soaked-OST000b (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Oct 18 14:30:01 lola-10 TIME: Time stamp for console
Oct 18 14:35:01 lola-10 TIME: Time stamp for console
Oct 18 14:40:01 lola-10 TIME: Time stamp for console
Oct 18 14:45:01 lola-10 TIME: Time stamp for console
Oct 18 14:50:01 lola-10 TIME: Time stamp for console
Oct 18 14:55:02 lola-10 TIME: Time stamp for console
Oct 18 15:00:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8803c91985c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 e8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c91985c0)
Oct 18 15:05:01 lola-10 TIME: Time stamp for console
Oct 18 15:10:01 lola-10 TIME: Time stamp for console
Oct 18 15:15:01 lola-10 TIME: Time stamp for console
Oct 18 15:20:01 lola-10 TIME: Time stamp for console
Oct 18 15:25:01 lola-10 TIME: Time stamp for console
Oct 18 15:30:01 lola-10 TIME: Time stamp for console
Oct 18 15:35:01 lola-10 TIME: Time stamp for console
Oct 18 15:40:01 lola-10 TIME: Time stamp for console
Oct 18 15:45:01 lola-10 TIME: Time stamp for console
Oct 18 15:50:01 lola-10 TIME: Time stamp for console
Oct 18 15:55:01 lola-10 TIME: Time stamp for console
Oct 18 16:00:01 lola-10 TIME: Time stamp for console
Oct 18 16:05:01 lola-10 TIME: Time stamp for console
Lustre: 4584:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476832073/real 0]  req@ffff88077b658cc0 x1548564689305760/t0(0) o400->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 224/224 e 0 to 1 dl 1476832087 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4584:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
Lustre: soaked-MDT0001-osp-MDT0002: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476832137/real 0]  req@ffff880777d34680 x1548564689310864/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476832148 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Oct 18 16:10:01 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476832237/real 0]  req@ffff8807cda09cc0 x1548564689318832/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476832253 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476832437/real 1476832437]  req@ffff8807ba87bc80 x1548564689335376/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476832463 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.108@o2ib10, removing former export from 192.168.1.109@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Lustre: Skipped 6 previous similar messages
Oct 18 16:15:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0001-osp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
LustreError: 11-0: soaked-MDT0001-osp-MDT0002: operation obd_ping to node 192.168.1.108@o2ib10 failed: rc = -107
LustreError: Skipped 3 previous similar messages
Lustre: soaked-MDT0001-osp-MDT0002: Connection to soaked-MDT0001 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0001-osp-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Lustre: Skipped 1 previous similar message
Oct 18 16:20:01 lola-10 TIME: Time stamp for console
Oct 18 16:25:01 lola-10 TIME: Time stamp for console
Oct 18 16:30:01 lola-10 TIME: Time stamp for console
Oct 18 16:35:01 lola-10 TIME: Time stamp for console
Oct 18 16:40:01 lola-10 TIME: Time stamp for console
Oct 18 16:45:01 lola-10 TIME: Time stamp for console
Oct 18 16:50:01 lola-10 TIME: Time stamp for console
Oct 18 16:55:01 lola-10 TIME: Time stamp for console
Lustre: 4586:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476835026/real 0]  req@ffff8807ca24a380 x1548564707287744/t0(0) o13->soaked-OST0006-osc-MDT0002@192.168.1.102@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476835033 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4586:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: soaked-OST0006-osc-MDT0002: Connection to soaked-OST0006 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0000-osc-MDT0002: Connection to soaked-OST0000 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0002: Client 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100)
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.117@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: soaked-MDT0002: Client 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100)
Oct 18 17:00:01 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476835284/real 1476835284]  req@ffff88077c8603c0 x1548564707825488/t0(0) o8->soaked-OST0006-osc-MDT0002@192.168.1.102@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476835295 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 39 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.103@o2ib10, removing former export from 192.168.1.102@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0012_UUID (at 192.168.1.103@o2ib10)
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.103@o2ib10, removing former export from 192.168.1.102@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.103@o2ib10, removing former export from 192.168.1.102@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.103@o2ib10, removing former export from 192.168.1.102@o2ib10
Lustre: soaked-OST0012-osc-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: Skipped 3 previous similar messages
LustreError: 11-0: soaked-OST0012-osc-MDT0002: operation ost_statfs to node 192.168.1.103@o2ib10 failed: rc = -107
Lustre: soaked-OST0012-osc-MDT0002: Connection to soaked-OST0012 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 2 previous similar messages
LustreError: 11-0: soaked-OST0000-osc-MDT0002: operation ost_statfs to node 192.168.1.103@o2ib10 failed: rc = -107
Lustre: soaked-OST0000-osc-MDT0002: Connection to soaked-OST0000 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST0006-osc-MDT0002: operation ost_statfs to node 192.168.1.103@o2ib10 failed: rc = -107
Lustre: soaked-OST0006-osc-MDT0002: Connection to soaked-OST0006 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST000c-osc-MDT0002: operation ost_statfs to node 192.168.1.103@o2ib10 failed: rc = -107
Lustre: soaked-OST000c-osc-MDT0002: Connection to soaked-OST000c (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0006-osc-MDT0002: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10)
Lustre: Skipped 8 previous similar messages
Oct 18 17:05:01 lola-10 TIME: Time stamp for console
Oct 18 17:10:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8807fb1af5c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 17 00 00 00 00 10 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807fb1af5c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ca77ca80)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 17 18 00 00 00 18 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ca77ca80)
sd 0:0:1:42: attempting task abort! scmd(ffff8807fed5fcc0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 17 40 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807fed5fcc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807dd49cec0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 17 68 00 00 00 10 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807dd49cec0)
Oct 18 17:15:01 lola-10 TIME: Time stamp for console
Oct 18 17:20:01 lola-10 TIME: Time stamp for console
Oct 18 17:25:01 lola-10 TIME: Time stamp for console
Oct 18 17:30:02 lola-10 TIME: Time stamp for console
Oct 18 17:35:01 lola-10 TIME: Time stamp for console
Oct 18 17:40:01 lola-10 TIME: Time stamp for console
Oct 18 17:45:01 lola-10 TIME: Time stamp for console
Oct 18 17:50:01 lola-10 TIME: Time stamp for console
Oct 18 17:55:01 lola-10 TIME: Time stamp for console
Oct 18 18:00:01 lola-10 TIME: Time stamp for console
Oct 18 18:05:01 lola-10 TIME: Time stamp for console
Oct 18 18:10:01 lola-10 TIME: Time stamp for console
Oct 18 18:15:01 lola-10 TIME: Time stamp for console
Oct 18 18:20:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8803772c4e80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 80 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803772c4e80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803772c4d80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 98 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803772c4d80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803772c4c80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 c0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803772c4c80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803772c4b80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 c8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803772c4b80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803772c4a80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 07 f8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803772c4a80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803297c50c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d f8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803297c50c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263e80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 10 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263e80)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263d80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 30 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263d80)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263c80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 50 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263c80)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263b80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 68 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263b80)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263a80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 80 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263a80)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263980)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e a0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263980)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263880)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e c8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263880)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263780)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e f0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263780)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263680)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 00 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263680)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263580)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 30 00 00 28 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263580)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263480)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 60 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263480)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263380)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 78 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263380)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263280)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 88 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263280)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263180)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f a0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263180)
sd 0:0:1:42: attempting task abort! scmd(ffff880334263080)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f b8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880334263080)
sd 0:0:1:42: attempting task abort! scmd(ffff8803cbca3ec0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f c0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803cbca3ec0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803cbca3dc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803cbca3dc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803cbca3cc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f f0 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803cbca3cc0)
Oct 18 18:25:01 lola-10 TIME: Time stamp for console
Oct 18 18:30:01 lola-10 TIME: Time stamp for console
Oct 18 18:35:01 lola-10 TIME: Time stamp for console
Oct 18 18:40:01 lola-10 TIME: Time stamp for console
Oct 18 18:45:01 lola-10 TIME: Time stamp for console
Oct 18 18:50:01 lola-10 TIME: Time stamp for console
Oct 18 18:55:01 lola-10 TIME: Time stamp for console
Oct 18 19:00:01 lola-10 TIME: Time stamp for console
Oct 18 19:05:01 lola-10 TIME: Time stamp for console
Oct 18 19:10:01 lola-10 TIME: Time stamp for console
Oct 18 19:15:01 lola-10 TIME: Time stamp for console
Lustre: 4582:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476843517/real 0]  req@ffff8807be0e7980 x1548564839444208/t0(0) o13->soaked-OST0017-osc-MDT0002@192.168.1.107@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476843524 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4582:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-OST0017-osc-MDT0002: Connection to soaked-OST0017 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0005-osc-MDT0002: Connection to soaked-OST0005 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 2 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476843527/real 0]  req@ffff8807b9d520c0 x1548564839445376/t0(0) o8->soaked-OST0005-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476843533 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 6 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476843577/real 1476843577]  req@ffff88033f6b3080 x1548564839448848/t0(0) o8->soaked-OST0017-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476843588 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
Oct 18 19:20:01 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476843627/real 1476843627]  req@ffff8803cc2063c0 x1548564839452336/t0(0) o8->soaked-OST0017-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476843643 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476843727/real 1476843727]  req@ffff8803a9558380 x1548564839459296/t0(0) o8->soaked-OST0011-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476843753 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: Skipped 2 previous similar messages
Lustre: soaked-OST0011-osc-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: Skipped 2 previous similar messages
LustreError: 11-0: soaked-OST0017-osc-MDT0002: operation ost_statfs to node 192.168.1.106@o2ib10 failed: rc = -107
Lustre: soaked-OST0017-osc-MDT0002: Connection to soaked-OST0017 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST0005-osc-MDT0002: operation ost_statfs to node 192.168.1.106@o2ib10 failed: rc = -107
Lustre: soaked-OST0005-osc-MDT0002: Connection to soaked-OST0005 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST000b-osc-MDT0002: operation ost_statfs to node 192.168.1.106@o2ib10 failed: rc = -107
Oct 18 19:25:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-OST0011-osc-MDT0002: operation ost_statfs to node 192.168.1.106@o2ib10 failed: rc = -107
Lustre: soaked-OST0011-osc-MDT0002: Connection to soaked-OST0011 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0005_UUID (at 192.168.1.107@o2ib10)
Lustre: Skipped 6 previous similar messages
Oct 18 19:30:01 lola-10 TIME: Time stamp for console
Oct 18 19:35:01 lola-10 TIME: Time stamp for console
Lustre: 4561:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476844602/real 0]  req@ffff8803b5143680 x1548564839529024/t0(0) o400->soaked-MDT0000-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 224/224 e 0 to 1 dl 1476844609 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4561:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: soaked-MDT0000-osp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476844639/real 1476844639]  req@ffff8803babf6c80 x1548564839532000/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476844645 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476844739/real 1476844739]  req@ffff8803bab0e980 x1548564839539920/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476844750 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Oct 18 19:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: haven't heard from client soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib10) in 230 seconds. I think it's dead, and I am evicting it. exp ffff8804316cf800, cur 1476844806 expire 1476844656 last 1476844576
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476844814/real 0]  req@ffff880374c640c0 x1548564839546400/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476844835 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476844989/real 1476844989]  req@ffff88040c4653c0 x1548564839560240/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476845020 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 6 previous similar messages
Oct 18 19:45:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib10)
Lustre: Skipped 2 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.108@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: Evicted from MGS (at 192.168.1.108@o2ib10) after server handle changed from 0x6d1e7c2a30666001 to 0x78c91f23fdf24b27
Lustre: MGC192.168.1.108@o2ib10: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.108@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 167-0: soaked-MDT0000-lwp-MDT0002: This client was evicted by soaked-MDT0000; in progress operations using this service will fail.
Lustre: soaked-MDT0000-lwp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Oct 18 19:50:01 lola-10 TIME: Time stamp for console
Oct 18 19:55:01 lola-10 TIME: Time stamp for console
Oct 18 20:00:01 lola-10 TIME: Time stamp for console
Oct 18 20:05:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8807b9cac5c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 17 10 00 00 00 20 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807b9cac5c0)
sd 0:0:1:42: attempting task abort! scmd(ffff88077abdfa80)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 17 40 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88077abdfa80)
sd 0:0:1:42: attempting task abort! scmd(ffff88077abdf180)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 17 50 00 00 00 30 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88077abdf180)
Oct 18 20:10:01 lola-10 TIME: Time stamp for console
Oct 18 20:15:01 lola-10 TIME: Time stamp for console
Oct 18 20:20:01 lola-10 TIME: Time stamp for console
Oct 18 20:25:01 lola-10 TIME: Time stamp for console
Oct 18 20:30:01 lola-10 TIME: Time stamp for console
Oct 18 20:35:01 lola-10 TIME: Time stamp for console
Oct 18 20:40:01 lola-10 TIME: Time stamp for console
Oct 18 20:45:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 8db29874-6318-cdd7-bb00-649f341345d7 (at 192.168.1.125@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 8db29874-6318-cdd7-bb00-649f341345d7 (at 192.168.1.125@o2ib100)
Lustre: Skipped 1 previous similar message
Oct 18 20:50:01 lola-10 TIME: Time stamp for console
Oct 18 20:55:01 lola-10 TIME: Time stamp for console
Oct 18 21:00:01 lola-10 TIME: Time stamp for console
LNet: 4553:0:(o2iblnd_cb.c:393:kiblnd_handle_rx()) PUT_NACK from 192.168.1.114@o2ib10
LustreError: 6286:0:(ldlm_lib.c:3224:target_bulk_io()) @@@ timeout on bulk READ after 100+0s  req@ffff8807ca127680 x1548484992164288/t0(0) o37->413d103e-c18d-9dc1-7b46-3410cee37444@192.168.1.117@o2ib100:-1/-1 lens 568/440 e 3 to 0 dl 1476849805 ref 1 fl Interpret:/0/0 rc 0/0
Oct 18 21:05:01 lola-10 TIME: Time stamp for console
Oct 18 21:10:01 lola-10 TIME: Time stamp for console
Oct 18 21:15:01 lola-10 TIME: Time stamp for console
Oct 18 21:20:01 lola-10 TIME: Time stamp for console
Oct 18 21:25:01 lola-10 TIME: Time stamp for console
Oct 18 21:30:01 lola-10 TIME: Time stamp for console
Oct 18 21:35:01 lola-10 TIME: Time stamp for console
Oct 18 21:40:01 lola-10 TIME: Time stamp for console
Oct 18 21:45:01 lola-10 TIME: Time stamp for console
Oct 18 21:50:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client a7f7fe73-573a-8138-deac-4dd672b42eef (at 192.168.1.133@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to a7f7fe73-573a-8138-deac-4dd672b42eef (at 192.168.1.133@o2ib100)
Lustre: 6266:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476852853/real 1476852853]  req@ffff8807c71466c0 x1548564979419616/t0(0) o104->soaked-MDT0002@192.168.1.131@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476852860 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 6266:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 16 previous similar messages
Oct 18 21:55:01 lola-10 TIME: Time stamp for console
Lustre: 6835:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476853027/real 1476853027]  req@ffff8803339d73c0 x1548564981857104/t0(0) o104->soaked-MDT0002@192.168.1.121@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476853034 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Oct 18 22:00:01 lola-10 TIME: Time stamp for console
Lustre: 6244:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476853445/real 1476853445]  req@ffff8803756b16c0 x1548564989816464/t0(0) o104->soaked-MDT0002@192.168.1.127@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476853452 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 6244:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Oct 18 22:05:01 lola-10 TIME: Time stamp for console
Oct 18 22:10:01 lola-10 TIME: Time stamp for console
Oct 18 22:15:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff880778fb66c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 30 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880778fb66c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880778fb6dc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 50 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880778fb6dc0)
sd 0:0:1:42: attempting task abort! scmd(ffff880778fb6cc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 70 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880778fb6cc0)
sd 0:0:1:42: attempting task abort! scmd(ffff880778fb64c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 80 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880778fb64c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880778fb69c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f a8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880778fb69c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880778d1aec0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f c0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880778d1aec0)
sd 0:0:1:42: attempting task abort! scmd(ffff880778d1aac0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f d8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880778d1aac0)
sd 0:0:1:42: attempting task abort! scmd(ffff880778d1a6c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880778d1a6c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807242ce9c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 88 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807242ce9c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807242ce6c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 98 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807242ce6c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807242ce5c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 a0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807242ce5c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807242cebc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 c8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807242cebc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8808012dc680)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 e8 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8808012dc680)
Lustre: soaked-MDT0002: Client 8def2455-4284-8b62-26e8-f9e60ca767e5 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 8def2455-4284-8b62-26e8-f9e60ca767e5 (at 192.168.1.113@o2ib100)
Oct 18 22:20:01 lola-10 TIME: Time stamp for console
Oct 18 22:25:01 lola-10 TIME: Time stamp for console
Oct 18 22:30:01 lola-10 TIME: Time stamp for console
Oct 18 22:35:01 lola-10 TIME: Time stamp for console
Oct 18 22:40:01 lola-10 TIME: Time stamp for console
Oct 18 22:45:01 lola-10 TIME: Time stamp for console
Oct 18 22:50:01 lola-10 TIME: Time stamp for console
Oct 18 22:55:01 lola-10 TIME: Time stamp for console
Oct 18 23:00:02 lola-10 TIME: Time stamp for console
Oct 18 23:05:01 lola-10 TIME: Time stamp for console
Oct 18 23:10:01 lola-10 TIME: Time stamp for console
Oct 18 23:15:01 lola-10 TIME: Time stamp for console
Oct 18 23:20:01 lola-10 TIME: Time stamp for console
Lustre: 4563:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476858154/real 0]  req@ffff88032b293c80 x1548565024187696/t0(0) o13->soaked-OST000d-osc-MDT0002@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476858161 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST000d-osc-MDT0002: Connection to soaked-OST000d (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: soaked-OST0001-osc-MDT0002: Connection to soaked-OST0001 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0002: Client 77b115f7-b156-bea0-a757-c841364e6d1b (at 192.168.1.127@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to a7f7fe73-573a-8138-deac-4dd672b42eef (at 192.168.1.133@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Client 485b43bc-eca4-2baf-34d1-3fd59bf57cbe (at 192.168.1.131@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 485b43bc-eca4-2baf-34d1-3fd59bf57cbe (at 192.168.1.131@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: 4584:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476858154/real 1476858179]  req@ffff880814f343c0 x1548565024187824/t0(0) o6->soaked-OST000d-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 664/432 e 0 to 1 dl 1476858198 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
Lustre: 4584:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 12 previous similar messages
Lustre: soaked-MDT0002: Client 485b43bc-eca4-2baf-34d1-3fd59bf57cbe (at 192.168.1.131@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 485b43bc-eca4-2baf-34d1-3fd59bf57cbe (at 192.168.1.131@o2ib100)
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476858265/real 0]  req@ffff8808332923c0 x1548565024410032/t0(0) o8->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476858276 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Oct 18 23:25:01 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476858365/real 0]  req@ffff8807fa76fcc0 x1548565024726544/t0(0) o8->soaked-OST000d-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476858381 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0013_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0001_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0007_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST000d_UUID (at 192.168.1.103@o2ib10) because it is indicating it is a new client
Lustre: soaked-OST0013-osc-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: soaked-OST0001-osc-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 5 previous similar messages
Oct 18 23:30:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 8 previous similar messages
Oct 18 23:35:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.103@o2ib10, removing former export from same NID
Lustre: Skipped 20 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: soaked-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Oct 18 23:40:01 lola-10 TIME: Time stamp for console
Oct 18 23:45:01 lola-10 TIME: Time stamp for console
Oct 18 23:50:01 lola-10 TIME: Time stamp for console
Oct 18 23:55:01 lola-10 TIME: Time stamp for console
Oct 19 00:00:01 lola-10 TIME: Time stamp for console
Oct 19 00:05:01 lola-10 TIME: Time stamp for console
Oct 19 00:10:01 lola-10 TIME: Time stamp for console
Oct 19 00:15:01 lola-10 TIME: Time stamp for console
Oct 19 00:20:01 lola-10 TIME: Time stamp for console
Oct 19 00:25:01 lola-10 TIME: Time stamp for console
Oct 19 00:30:01 lola-10 TIME: Time stamp for console
Oct 19 00:35:01 lola-10 TIME: Time stamp for console
Oct 19 00:40:01 lola-10 TIME: Time stamp for console
Oct 19 00:45:01 lola-10 TIME: Time stamp for console
Oct 19 00:50:01 lola-10 TIME: Time stamp for console
Oct 19 00:55:01 lola-10 TIME: Time stamp for console
Oct 19 01:00:01 lola-10 TIME: Time stamp for console
Oct 19 01:05:01 lola-10 TIME: Time stamp for console
Oct 19 01:10:01 lola-10 TIME: Time stamp for console
Oct 19 01:15:01 lola-10 TIME: Time stamp for console
Oct 19 01:20:01 lola-10 TIME: Time stamp for console
Oct 19 01:25:01 lola-10 TIME: Time stamp for console
Oct 19 01:30:01 lola-10 TIME: Time stamp for console
Oct 19 01:35:01 lola-10 TIME: Time stamp for console
Oct 19 01:40:01 lola-10 TIME: Time stamp for console
Oct 19 01:45:01 lola-10 TIME: Time stamp for console
Oct 19 01:50:01 lola-10 TIME: Time stamp for console
Oct 19 01:55:01 lola-10 TIME: Time stamp for console
Lustre: 4568:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476867527/real 1476867552]  req@ffff880376248980 x1548565176730432/t0(0) o103->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:17/18 lens 328/224 e 0 to 1 dl 1476867578 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: 4568:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 13 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.117@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.127@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.122@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.107@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 4 previous similar messages
Lustre: 4574:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476867533/real 0]  req@ffff8803403bd0c0 x1548565176751328/t0(0) o103->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:17/18 lens 328/224 e 0 to 1 dl 1476867584 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4574:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.106@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.106@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 4 previous similar messages
Oct 19 02:00:01 lola-10 TIME: Time stamp for console
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.103@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 8 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 10 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.131@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 28 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476867652/real 0]  req@ffff8803797a96c0 x1548565176761616/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476867663 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.120@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 48 previous similar messages
LNet: Service thread pid 6265 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6265, comm: mdt01_010

Call Trace:
 [<ffffffff8100bc0e>] ? apic_timer_interrupt+0xe/0x20
 [<ffffffff81089e8c>] ? lock_timer_base+0x3c/0x70
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa09ab781>] ptlrpc_set_wait+0x321/0x960 [ptlrpc]
 [<ffffffffa09a08d0>] ? ptlrpc_interrupted_set+0x0/0x120 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa09b7c65>] ? lustre_msg_set_jobid+0xf5/0x130 [ptlrpc]
 [<ffffffffa09abe41>] ptlrpc_queue_wait+0x81/0x220 [ptlrpc]
 [<ffffffffa12b7bc2>] osp_remote_sync+0xf2/0x1e0 [osp]
 [<ffffffffa129c1c7>] osp_attr_get+0x447/0x710 [osp]
 [<ffffffff811791ea>] ? kmem_cache_alloc+0x18a/0x190
 [<ffffffffa129cd25>] osp_object_init+0x1f5/0x360 [osp]
 [<ffffffffa07bb508>] lu_object_alloc+0xd8/0x320 [obdclass]
 [<ffffffffa07bc8f1>] lu_object_find_try+0x151/0x260 [obdclass]
 [<ffffffffa07bcab1>] lu_object_find_at+0xb1/0xe0 [obdclass]
 [<ffffffffa11c1b85>] ? lod_index_lookup+0x25/0x30 [lod]
 [<ffffffffa122ffbc>] ? __mdd_lookup+0x28c/0x450 [mdd]
 [<ffffffffa07bcaf6>] lu_object_find+0x16/0x20 [obdclass]
 [<ffffffffa10e0ad6>] mdt_object_find+0x56/0x170 [mdt]
 [<ffffffffa10f50df>] mdt_getattr_name_lock+0xb1f/0x1910 [mdt]
 [<ffffffffa10f63f2>] mdt_intent_getattr+0x292/0x470 [mdt]
 [<ffffffffa10e691e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa09687c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0993feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a088e1>] ? tgt_lookup_reply+0x31/0x190 [ptlrpc]
 [<ffffffffa0a19e91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff8106ee50>] ? pick_next_task_fair+0xd0/0x130
 [<ffffffff81539896>] ? schedule+0x176/0x3a0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476867724.6265
LNet: Service thread pid 6066 was inactive for 201.17s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6066, comm: mdt01_005

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa12414ef>] mdd_create+0x135f/0x1770 [mdd]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa1107e2c>] mdt_reint_create+0xbdc/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 6048, comm: mdt00_003

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa11cdc2c>] ? lod_attr_get+0x9c/0x1b0 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa1237b12>] mdd_unlink+0x532/0x1020 [mdd]
 [<ffffffffa10fcff8>] mdo_unlink+0x18/0x50 [mdt]
 [<ffffffffa11060ff>] mdt_reint_unlink+0xcaf/0x10c0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff8106ee50>] ? pick_next_task_fair+0xd0/0x130
 [<ffffffff81539896>] ? schedule+0x176/0x3a0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LNet: Service thread pid 6244 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
LNet: Skipped 1 previous similar message
Pid: 6244, comm: mdt00_011

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa12414ef>] mdd_create+0x135f/0x1770 [mdd]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa1107e2c>] mdt_reint_create+0xbdc/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476867732.6244
Pid: 6280, comm: mdt00_016

Call Trace:
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa098935e>] ldlm_cli_enqueue_local+0x21e/0x810 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e07a0>] ? mdt_blocking_ast+0x0/0x2e0 [mdt]
 [<ffffffffa10ed4e4>] mdt_object_local_lock+0x3a4/0xb00 [mdt]
 [<ffffffffa10e07a0>] ? mdt_blocking_ast+0x0/0x2e0 [mdt]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10ee143>] mdt_object_lock_internal+0x63/0x320 [mdt]
 [<ffffffffa10ee614>] mdt_object_lock+0x14/0x20 [mdt]
 [<ffffffffa111278b>] mdt_reint_open+0x8db/0x3230 [mdt]
 [<ffffffffa07ce7cc>] ? upcall_cache_get_entry+0x29c/0x880 [obdclass]
 [<ffffffffa07d38d0>] ? lu_ucred+0x20/0x30 [obdclass]
 [<ffffffffa10df795>] ? mdt_ucred+0x15/0x20 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e83b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa10e691e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa09687c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0993feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a088e1>] ? tgt_lookup_reply+0x31/0x190 [ptlrpc]
 [<ffffffffa0a19e91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff8106ee50>] ? pick_next_task_fair+0xd0/0x130
 [<ffffffff81539896>] ? schedule+0x176/0x3a0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476867733.6280
Lustre: soaked-MDT0002: haven't heard from client soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib10) in 227 seconds. I think it's dead, and I am evicting it. exp ffff8804316cfc00, cur 1476867750 expire 1476867600 last 1476867523
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476867752/real 0]  req@ffff880376466380 x1548565176769584/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476867768 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
LustreError: 6280:0:(ldlm_request.c:129:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476867532, 300s ago); not entering recovery in server code, just going back to sleep ns: mdt-soaked-MDT0002_UUID lock: ffff8803739751c0/0xed0a3470a922081 lrc: 3/0,1 mode: --/PW res: [0x280007183:0x3d55:0x0].0xdbe54640 bits 0x2 rrc: 2 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6280 timeout: 0 lvb_type: 0
LustreError: dumping log to /tmp/lustre-log.1476867832.6280
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.116@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 107 previous similar messages
Oct 19 02:05:01 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476867902/real 1476867902]  req@ffff8803297bc680 x1548565176781584/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476867933 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib10)
Lustre: 6241:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff8803cbe656c0 x1548481544943552/t64438421163(0) o36->8def2455-4284-8b62-26e8-f9e60ca767e5@192.168.1.113@o2ib100:-1/-1 lens 624/3128 e 22 to 0 dl 1476868124 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: soaked-MDT0002: Client 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100)
Lustre: soaked-MDT0002: Client 8def2455-4284-8b62-26e8-f9e60ca767e5 (at 192.168.1.113@o2ib100) reconnecting
Lustre: 10699:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff880621f2d6c0 x1548481544990160/t0(0) o101->8def2455-4284-8b62-26e8-f9e60ca767e5@192.168.1.113@o2ib100:-1/-1 lens 1376/3512 e 22 to 0 dl 1476868132 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: 10699:0:(service.c:1331:ptlrpc_at_send_early_reply()) Skipped 2 previous similar messages
Oct 19 02:10:01 lola-10 TIME: Time stamp for console
Oct 19 02:15:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100)
Lustre: Skipped 1 previous similar message
Oct 19 02:20:01 lola-10 TIME: Time stamp for console
Oct 19 02:25:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100) reconnecting
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 413d103e-c18d-9dc1-7b46-3410cee37444 (at 192.168.1.117@o2ib100)
Lustre: Skipped 1 previous similar message
LustreError: 11-0: soaked-MDT0003-osp-MDT0002: operation out_update to node 192.168.1.111@o2ib10 failed: rc = -107
LustreError: 167-0: soaked-MDT0003-osp-MDT0002: This client was evicted by soaked-MDT0003; in progress operations using this service will fail.
LustreError: 6265:0:(osp_object.c:527:osp_attr_get()) soaked-MDT0003-osp-MDT0002:osp_attr_get update error [0x2c000813b:0x1c191:0x0]: rc = -5
Lustre: 6048:0:(service.c:2099:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (600:1228s); client may timeout.  req@ffff8803cbe656c0 x1548481544943552/t64438421163(0) o36->8def2455-4284-8b62-26e8-f9e60ca767e5@192.168.1.113@o2ib100:-1/-1 lens 624/424 e 22 to 0 dl 1476868124 ref 1 fl Complete:/0/0 rc -5/-5
LNet: Service thread pid 6048 completed after 1827.84s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LustreError: 6265:0:(osp_object.c:527:osp_attr_get()) Skipped 1 previous similar message
LustreError: 6042:0:(llog_cat.c:745:llog_cat_cancel_records()) soaked-MDT0003-osp-MDT0002: fail to cancel 1 of 1 llog-records: rc = -116
Oct 19 02:30:01 lola-10 TIME: Time stamp for console
Lustre: 6242:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476869458/real 0]  req@ffff8803760a90c0 x1548565181565584/t0(0) o1000->soaked-MDT0000-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 328/4320 e 0 to 1 dl 1476869465 ref 3 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 6242:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: soaked-MDT0000-osp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476869515/real 1476869515]  req@ffff8803775dac80 x1548565181658192/t0(0) o38->soaked-MDT0000-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476869526 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476869590/real 1476869590]  req@ffff8803ab7990c0 x1548565181664240/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476869606 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
Oct 19 02:35:01 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476869715/real 0]  req@ffff88040e7efcc0 x1548565181674176/t0(0) o38->soaked-MDT0000-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476869746 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 9 previous similar messages
Oct 19 02:40:01 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476870015/real 1476870015]  req@ffff880376da2080 x1548565181698064/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476870066 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 14 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.108@o2ib10, removing former export from same NID
Lustre: Skipped 1 previous similar message
LustreError: 167-0: soaked-MDT0000-lwp-MDT0002: This client was evicted by soaked-MDT0000; in progress operations using this service will fail.
Lustre: Evicted from MGS (at 192.168.1.108@o2ib10) after server handle changed from 0x78c91f23fdf24b27 to 0xc233574bca009185
Lustre: soaked-MDT0000-lwp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: 6048:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-150), not sending early reply
  req@ffff8808013d2cc0 x1548481545587168/t0(0) o101->8def2455-4284-8b62-26e8-f9e60ca767e5@192.168.1.113@o2ib100:-1/-1 lens 1360/3512 e 0 to 0 dl 1476870213 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: 6048:0:(service.c:1331:ptlrpc_at_send_early_reply()) Skipped 1 previous similar message
Oct 19 02:45:01 lola-10 TIME: Time stamp for console
Oct 19 02:50:01 lola-10 TIME: Time stamp for console
Oct 19 02:55:01 lola-10 TIME: Time stamp for console
Oct 19 03:00:01 lola-10 TIME: Time stamp for console
Oct 19 03:05:01 lola-10 TIME: Time stamp for console
Oct 19 03:10:01 lola-10 TIME: Time stamp for console
Oct 19 03:15:01 lola-10 TIME: Time stamp for console
Oct 19 03:20:01 lola-10 TIME: Time stamp for console
Oct 19 03:25:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 63007e90-8efe-e065-1584-1ca6a775384c (at 192.168.1.119@o2ib100) reconnecting
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 63007e90-8efe-e065-1584-1ca6a775384c (at 192.168.1.119@o2ib100)
Lustre: Skipped 1 previous similar message
Oct 19 03:30:01 lola-10 TIME: Time stamp for console
Oct 19 03:35:01 lola-10 TIME: Time stamp for console
Oct 19 03:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client a3d948b8-7745-adee-d8bc-8f3f12a2cff5 (at 192.168.1.126@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to a3d948b8-7745-adee-d8bc-8f3f12a2cff5 (at 192.168.1.126@o2ib100)
Oct 19 03:45:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client a7f7fe73-573a-8138-deac-4dd672b42eef (at 192.168.1.133@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to a7f7fe73-573a-8138-deac-4dd672b42eef (at 192.168.1.133@o2ib100)
Oct 19 03:50:01 lola-10 TIME: Time stamp for console
Oct 19 03:55:01 lola-10 TIME: Time stamp for console
Oct 19 04:00:01 lola-10 TIME: Time stamp for console
Oct 19 04:05:01 lola-10 TIME: Time stamp for console
Oct 19 04:10:01 lola-10 TIME: Time stamp for console
Oct 19 04:15:01 lola-10 TIME: Time stamp for console
Oct 19 04:20:01 lola-10 TIME: Time stamp for console
Oct 19 04:25:01 lola-10 TIME: Time stamp for console
Oct 19 04:30:01 lola-10 TIME: Time stamp for console
Lustre: 4572:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476876765/real 0]  req@ffff88033fc576c0 x1548565362306048/t0(0) o400->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 224/224 e 0 to 1 dl 1476876772 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4572:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 6 previous similar messages
Lustre: soaked-MDT0001-osp-MDT0002: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476876872/real 1476876872]  req@ffff8803fb8070c0 x1548565374199984/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476876888 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
Oct 19 04:35:01 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476877047/real 0]  req@ffff88032caccc80 x1548565374887248/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476877073 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.108@o2ib10, removing former export from 192.168.1.109@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib10)
Oct 19 04:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0001-osp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib10)
LustreError: 11-0: soaked-MDT0001-osp-MDT0002: operation obd_ping to node 192.168.1.108@o2ib10 failed: rc = -107
LustreError: Skipped 2 previous similar messages
Lustre: soaked-MDT0001-osp-MDT0002: Connection to soaked-MDT0001 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0001-osp-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Oct 19 04:45:01 lola-10 TIME: Time stamp for console
Oct 19 04:50:01 lola-10 TIME: Time stamp for console
Oct 19 04:55:01 lola-10 TIME: Time stamp for console
Oct 19 05:00:01 lola-10 TIME: Time stamp for console
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
SOL session closed by BMC

<ConMan> Console [lola-10] disconnected from "ipmitool.exp" (pid 7806) after 17h39m47s at 10-19 08:12.

<ConMan> Console [lola-10] connected to "ipmitool.exp" (pid 10187) at 10-19 08:12.
Connection established via ipmitool (pid 10191).
                                                                                                                                                                MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           LSI Corporation MPT SAS2 BIOS                                                   Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                 Initializing../                                                                 Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                                                                                                 Press Ctrl-C to start LSI Corp Configuration Utility...                         Searching for devices at HBA 0...                                               LSI Corporation MPT SAS2 BIOS                                                   MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                            PCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    SLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    ---- ---- --- -------- ---------------- ----------- ----------                    3           LSI      SAS2308-IT       15.00.00.00  0F:00:00:03                  3    4   7  LSI      Universal Xport  0786         20.00 MiB                    3    4   41  LSI      INF-01-00        0786         14.55 TiB                   3    4   42  LSI      INF-01-00        0786         14.55 TiB                   3    4   43  LSI      INF-01-00        0786         14.55 TiB                   3    4   44  LSI      INF-01-00        0786         14.55 TiB                   3    4   45  LSI      INF-01-00        0786         14.55 TiB                   3    4   46  LSI      INF-01-00        0786         14.55 TiB                   3    0   7  LSI      Universal Xport  0786         20.00 MiB                    3    0   41  LSI      INF-01-00        0786         14.55 TiB                   3    0   42  LSI      INF-01-00        0786         14.55 TiB                   3    0   43  LSI      INF-01-00        0786         14.55 TiB                   3    0   44  LSI      INF-01-00        0786         14.55 TiB                   3    0   45  LSI      INF-01-00        0786         14.55 TiB                   3    0   46  LSI      INF-01-00        0786         14.55 TiB                 Copyright 2000-2012 LSI Corporation.                                                                                                                              RAID Volumes:                                                                   None defined.                                                                   Physical Devices:                                                             �  ID   Device Model     Serial #                     Size Type/Status(Vol ID)     0    ST500NM0011      Z1M0X1F9                  465.7GB Non-RAID Disk           1    ST500NM0011      Z1M0X1GG                  465.7GB Non-RAID Disk         Press <CTRL-I> to enter Configuration Utility..                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Copyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                     RAID Volumes:                                                                 Press <CTRL-I> to enter Configuration Utility...                                                                                                                PXE 2.1 Build 091 (WfM 2.0)                                                     Press Ctrl+S to enter the Setup Menu.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                          Bios Version: SE5C600.86B.01.08.0003.022620131521                               BMC Firmware Version: 1.17.4207                                                 SDR Version: SDR Package 1.09                                                   ME Firmware Version: 2.1.7.112                                                  Platform ID: S2600GZ                                                            System memory detected: 32768 MB                                                Current memory speed: 1333 MT/s                                                 Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        Number of physical processors identified: 2                                     ********************************************************************************AHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          SAS/SATA Capable Controller configured with 4 ports in SATA mode                ********************************************************************************USB Keyboard detected                                                           USB Mouse detected                                                                                                                                              Press <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                                     
Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

    GNU GRUB  version 0.97  (571K lower / 3066652K upper memory)

+-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+
      Use the ^ and v keys to select which entry is highlighted.
      Press enter to boot the selected OS, 'e' to edit the
      commands before booting, 'a' to modify the kernel arguments
      before booting, or 'c' for a command-line.  CentOS (2.6.32-573.26.1.el6_lustre.x86_64)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  The highlighted entry will be booted automatically in 5 seconds.    The highlighted entry will be booted automatically in 4 seconds.    The highlighted entry will be booted automatically in 3 seconds.    The highlighted entry will be booted automatically in 2 seconds.    The highlighted entry will be booted automatically in 1 seconds.    Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-573.26.1.el6_lustre.x86_64 (soakbuilder@lola-16.lola.whamcloud.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-16) (GCC) ) #1 SMP Mon Oct 17 13:07:39 PDT 2016
Command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=auto SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000008ec00 (usable)
 BIOS-e820: 000000000008ec00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bb3c7000 (usable)
 BIOS-e820: 00000000bb3c7000 - 00000000bdd2f000 (reserved)
 BIOS-e820: 00000000bdd2f000 - 00000000bddcd000 (ACPI NVS)
 BIOS-e820: 00000000bddcd000 - 00000000bdea1000 (ACPI data)
 BIOS-e820: 00000000bdea1000 - 00000000bdf2f000 (ACPI NVS)
 BIOS-e820: 00000000bdf2f000 - 00000000bdfac000 (ACPI data)
 BIOS-e820: 00000000bdfac000 - 00000000be000000 (usable)
 BIOS-e820: 00000000be000000 - 00000000d0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
 BIOS-e820: 00000000fed19000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ffa20000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000840000000 (usable)
DMI 2.6 present.
SMBIOS version 2.6 @ 0xF0440
No AGP bridge found
last_pfn = 0x840000 max_arch_pfn = 0x400000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xbe000 max_arch_pfn = 0x400000000
Using GB pages for direct mapping
init_memory_mapping: 0000000000000000-00000000be000000
init_memory_mapping: 0000000100000000-0000000840000000
RAMDISK: 3601e000 - 37fef30d
ACPI: Deleted _OSI()
ACPI: Deleted _OSI()
ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20090903/tbfadt-611)
ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
ACPI: FACS 00000000bdfa9f40 00040
ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
Setting APIC routing to flat.
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: PXM 0 -> APIC 2 -> Node 0
SRAT: PXM 0 -> APIC 3 -> Node 0
SRAT: PXM 0 -> APIC 4 -> Node 0
SRAT: PXM 0 -> APIC 5 -> Node 0
SRAT: PXM 0 -> APIC 6 -> Node 0
SRAT: PXM 0 -> APIC 7 -> Node 0
SRAT: PXM 0 -> APIC 8 -> Node 0
SRAT: PXM 0 -> APIC 9 -> Node 0
SRAT: PXM 0 -> APIC 10 -> Node 0
SRAT: PXM 0 -> APIC 11 -> Node 0
SRAT: PXM 0 -> APIC 12 -> Node 0
SRAT: PXM 0 -> APIC 13 -> Node 0
SRAT: PXM 0 -> APIC 14 -> Node 0
SRAT: PXM 0 -> APIC 15 -> Node 0
SRAT: PXM 1 -> APIC 32 -> Node 1
SRAT: PXM 1 -> APIC 33 -> Node 1
SRAT: PXM 1 -> APIC 34 -> Node 1
SRAT: PXM 1 -> APIC 35 -> Node 1
SRAT: PXM 1 -> APIC 36 -> Node 1
SRAT: PXM 1 -> APIC 37 -> Node 1
SRAT: PXM 1 -> APIC 38 -> Node 1
SRAT: PXM 1 -> APIC 39 -> Node 1
SRAT: PXM 1 -> APIC 40 -> Node 1
SRAT: PXM 1 -> APIC 41 -> Node 1
SRAT: PXM 1 -> APIC 42 -> Node 1
SRAT: PXM 1 -> APIC 43 -> Node 1
SRAT: PXM 1 -> APIC 44 -> Node 1
SRAT: PXM 1 -> APIC 45 -> Node 1
SRAT: PXM 1 -> APIC 46 -> Node 1
SRAT: PXM 1 -> APIC 47 -> Node 1
SRAT: Node 0 PXM 0 0-c0000000
SRAT: Node 0 PXM 0 100000000-440000000
SRAT: Node 1 PXM 1 440000000-840000000
Bootmem setup node 0 0000000000000000-0000000440000000
  NODE_DATA [0000000000009000 - 000000000003cfff]
  bootmap [0000000000100000 -  0000000000187fff] pages 88
(8 early reservations) ==> bootmem [0000000000 - 0440000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS ==> [0001000000 - 000203eb64]
  #3 [003601e000 - 0037fef30d]          RAMDISK ==> [003601e000 - 0037fef30d]
  #4 [000008ec00 - 0000100000]    BIOS reserved ==> [000008ec00 - 0000100000]
  #5 [000203f000 - 000203f9b8]              BRK ==> [000203f000 - 000203f9b8]
  #6 [0000008000 - 0000009000]          PGTABLE ==> [0000008000 - 0000009000]
  #7 [0000001000 - 0000001030]        ACPI SLIT ==> [0000001000 - 0000001030]
Bootmem setup node 1 0000000440000000-0000000840000000
  NODE_DATA [0000000440000040 - 000000044003403f]
  bootmap [0000000440035000 -  00000004400b4fff] pages 80
(8 early reservations) ==> bootmem [0440000000 - 0840000000]
  #0 [0000000000 - 0000001000]   BIOS data page
  #1 [0000006000 - 0000008000]       TRAMPOLINE
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS
  #3 [003601e000 - 0037fef30d]          RAMDISK
  #4 [000008ec00 - 0000100000]    BIOS reserved
  #5 [000203f000 - 000203f9b8]              BRK
  #6 [0000008000 - 0000009000]          PGTABLE
  #7 [0000001000 - 0000001030]        ACPI SLIT
found SMP MP-table at [ffff8800000fcd70] fcd70
Reserving 131MB of memory at 48MB for crashkernel (System RAM: 33792MB)
Zone PFN ranges:
  DMA      0x00000001 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   0x00100000 -> 0x00840000
Movable zone start PFN for each node
early_node_map[5] active PFN ranges
    0: 0x00000001 -> 0x0000008e
    0: 0x00000100 -> 0x000bb3c7
    0: 0x000bdfac -> 0x000be000
    0: 0x00100000 -> 0x00440000
    1: 0x00440000 -> 0x00840000
ACPI: PM-Timer IO Port: 0x408
Setting APIC routing to flat.
ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a701 base: 0xfed00000
SMP: Allowing 240 CPUs, 208 hotplug CPUs
PM: Registered nosave memory: 000000000008e000 - 000000000008f000
PM: Registered nosave memory: 000000000008f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
PM: Registered nosave memory: 00000000bb3c7000 - 00000000bdd2f000
PM: Registered nosave memory: 00000000bdd2f000 - 00000000bddcd000
PM: Registered nosave memory: 00000000bddcd000 - 00000000bdea1000
PM: Registered nosave memory: 00000000bdea1000 - 00000000bdf2f000
PM: Registered nosave memory: 00000000bdf2f000 - 00000000bdfac000
PM: Registered nosave memory: 00000000be000000 - 00000000d0000000
PM: Registered nosave memory: 00000000d0000000 - 00000000fec00000
PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
PM: Registered nosave memory: 00000000fec01000 - 00000000fed19000
PM: Registered nosave memory: 00000000fed19000 - 00000000fed1a000
PM: Registered nosave memory: 00000000fed1a000 - 00000000fed1c000
PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
PM: Registered nosave memory: 00000000fed20000 - 00000000fee00000
PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
PM: Registered nosave memory: 00000000fee01000 - 00000000ffa20000
PM: Registered nosave memory: 00000000ffa20000 - 0000000100000000
Allocating PCI resources starting at d0000000 (gap: d0000000:2ec00000)
Booting paravirtualized kernel on bare hardware
NR_CPUS:4096 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
PERCPU: Embedded 30 pages/cpu @ffff880038600000 s91288 r8192 d23400 u131072
pcpu-alloc: s91288 r8192 d23400 u131072 alloc=1*2097152
pcpu-alloc: [0] 000 001 002 003 004 005 006 007 016 017 018 019 020 021 022 023 
pcpu-alloc: [0] 032 034 036 038 040 042 044 046 048 050 052 054 056 058 060 062 
pcpu-alloc: [0] 064 066 068 070 072 074 076 078 080 082 084 086 088 090 092 094 
pcpu-alloc: [0] 096 098 100 102 104 106 108 110 112 114 116 118 120 122 124 126 
pcpu-alloc: [0] 128 130 132 134 136 138 140 142 144 146 148 150 152 154 156 158 
pcpu-alloc: [0] 160 162 164 166 168 170 172 174 176 178 180 182 184 186 188 190 
pcpu-alloc: [0] 192 194 196 198 200 202 204 206 208 210 212 214 216 218 220 222 
pcpu-alloc: [0] 224 226 228 230 232 234 236 238 --- --- --- --- --- --- --- --- 
pcpu-alloc: [1] 008 009 010 011 012 013 014 015 024 025 026 027 028 029 030 031 
pcpu-alloc: [1] 033 035 037 039 041 043 045 047 049 051 053 055 057 059 061 063 
pcpu-alloc: [1] 065 067 069 071 073 075 077 079 081 083 085 087 089 091 093 095 
pcpu-alloc: [1] 097 099 101 103 105 107 109 111 113 115 117 119 121 123 125 127 
pcpu-alloc: [1] 129 131 133 135 137 139 141 143 145 147 149 151 153 155 157 159 
pcpu-alloc: [1] 161 163 165 167 169 171 173 175 177 179 181 183 185 187 189 191 
pcpu-alloc: [1] 193 195 197 199 201 203 205 207 209 211 213 215 217 219 221 223 
pcpu-alloc: [1] 225 227 229 231 233 235 237 239 --- --- --- --- --- --- --- --- 
Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8250675
Policy zone: Normal
Kernel command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=131M@0M SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
PID hash table entries: 4096 (order: 3, 32768 bytes)
xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
Checking aperture...
No AGP bridge found
Memory: 32738448k/34603008k available (5400k kernel code, 1126752k absent, 737808k reserved, 7008k data, 1304k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:3144
Extended CMOS year: 2000
Console: colour VGA+ 80x25
console [ttyS0] enabled
allocated 134217728 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
TSC: cpu family 6 model 45, tsc initial value = 760f3dba1f
Fast TSC calibration using PIT
Detected 2693.411 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.82 BogoMIPS (lpj=2693411)
pid_max: default: 245760 minimum: 1920
Security Framework initialized
SELinux:  Initializing.
Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 20 MCE banks
CPU0: Thermal monitoring enabled (TM1)
using mwait in idle threads.
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 22144 entries in 87 pages
x2apic not enabled, IRQ remapping init failed
APIC routing finalized to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz stepping 07
Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
... version:                3
... bit width:              48
... generic registers:      4
... value mask:             0000ffffffffffff
... max period:             0000ffffffffffff
... fixed-purpose events:   3
... event mask:             000000070000000f
NMI watchdog enabled, takes one hw-pmu counter.
Booting Node   0, Processors  #1 #2 #3 #4 #5 #6 #7 Ok.
Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 Ok.
Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 Ok.
Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
Brought up 32 CPUs
Total of 32 processors activated (172369.47 BogoMIPS).
devtmpfs: initialized
PM: Registering ACPI NVS region at bdd2f000 (647168 bytes)
PM: Registering ACPI NVS region at bdea1000 (581632 bytes)
regulator: core version 0.5
NET: Registered protocol family 16
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MCFG configuration 0: base c0000000 segment 0 buses 0 - 255
PCI: MCFG area at c0000000 reserved in E820
PCI: Using MMCONFIG at c0000000 - cfffffff
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: Executed 1 blocks of module-level executable AML code
ACPI: BIOS _OSI(Linux) query ignored
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
HEST: Table parsing has been initialized.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
pci_root PNP0A08:00: host bridge window [io  0x0000-0xbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:00: host bridge window [mem 0x000c0000-0x000c3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c4000-0x000c7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c8000-0x000cbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000cc000-0x000cffff]
pci_root PNP0A08:00: host bridge window [mem 0x000d0000-0x000d3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d4000-0x000d7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d8000-0x000dbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000dc000-0x000dffff]
pci_root PNP0A08:00: host bridge window [mem 0x000e0000-0x000e3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e4000-0x000e7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e8000-0x000ebfff]
pci_root PNP0A08:00: host bridge window [mem 0x000ec000-0x000effff]
pci_root PNP0A08:00: host bridge window [mem 0x000f0000-0x000fffff]
pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xebffffff]
pci_root PNP0A08:00: host bridge window [mem 0x380000000000-0x38007fffffff]
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdfff])
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff]
pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff]
pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff]
pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff]
pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff]
pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff]
pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff]
pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff]
pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff]
pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff]
pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff]
pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff]
pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff]
pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
pci 0000:00:00.0: PME# disabled
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
pci 0000:00:01.1: PME# disabled
pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
pci 0000:00:02.0: PME# disabled
pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
pci 0000:00:02.2: PME# disabled
pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
pci 0000:00:03.0: PME# disabled
pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
pci 0000:00:11.0: PME# disabled
pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.0: PME# disabled
pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
pci 0000:00:16.1: PME# disabled
pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.7: PME# disabled
pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.0: PME# disabled
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:00.0: PME# disabled
pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
pci 0000:02:00.1: PME# disabled
pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
pci 0000:02:00.2: PME# disabled
pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
pci 0000:02:00.3: PME# disabled
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:07:00.3: PME# supported from D0 D3hot D3cold
pci 0000:07:00.3: PME# disabled
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a] (subtractive decode)
 pci0000:00: Requesting ACPI _OSC control (0x1d)
 pci0000:00: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
pci_root PNP0A08:01: host bridge window [io  0x03b0-0x03df]
pci_root PNP0A08:01: host bridge window [io  0xc000-0xffff]
pci_root PNP0A08:01: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:01: host bridge window [mem 0xec000000-0xfbffffff]
pci_root PNP0A08:01: host bridge window [mem 0x380080000000-0x3800ffffffff]
PCI host bridge to bus 0000:80
pci_bus 0000:80: root bus resource [io  0x03b0-0x03df]
pci_bus 0000:80: root bus resource [io  0xc000-0xffff]
pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff]
pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff]
pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
pci 0000:80:01.0: PME# disabled
pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
pci 0000:80:02.0: PME# disabled
pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
pci 0000:80:03.0: PME# disabled
pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
pci 0000:80:03.2: PME# disabled
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
 pci0000:80: Requesting ACPI _OSC control (0x1d)
 pci0000:80: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
PCI host bridge to bus 0000:7f
 pci0000:7f: Requesting ACPI _OSC control (0x1d)
 pci0000:7f: ACPI _OSC control (0x10) granted
ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
PCI host bridge to bus 0000:ff
 pci0000:ff: Requesting ACPI _OSC control (0x1d)
 pci0000:ff: ACPI _OSC control (0x10) granted
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:09:00.0
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
HPET: 8 timers in total, 5 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 72, 73, 74, 75, 76, 0
hpet0: 8 comparators, 64-bit 14.318180 MHz counter
Switching to clocksource hpet
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 15 devices
ACPI: ACPI bus type pnp unregistered
system 00:05: [io  0x0680-0x069f] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0x0400-0x0453] has been reserved
system 00:05: [io  0x0458-0x047f] has been reserved
system 00:05: [io  0x0500-0x057f] has been reserved
system 00:05: [io  0x0600-0x061f] has been reserved
system 00:05: [io  0x0ca2-0x0ca5] has been reserved
system 00:05: [io  0x0cf9] could not be reserved
system 00:07: [io  0x0454-0x0457] has been reserved
system 00:0a: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:0a: [mem 0xebfff000-0xebffffff] has been reserved
system 00:0a: [mem 0xc0000000-0xcfffffff] has been reserved
system 00:0a: [mem 0xfed20000-0xfed3ffff] has been reserved
system 00:0a: [mem 0xfed45000-0xfed8ffff] has been reserved
system 00:0a: [mem 0xff000000-0xffffffff] could not be reserved
system 00:0a: [mem 0xfee00000-0xfeefffff] could not be reserved
system 00:0a: [mem 0xfec00000-0xfecfffff] could not be reserved
system 00:0a: [mem 0xd0f70000-0xd0f70fff] has been reserved
system 00:0c: [mem 0x00000000-0x0009cfff] could not be reserved
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
pci 0000:00:02.0:   bridge window [mem 0xeb000000-0xeb7fffff 64bit pref]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
pci 0000:00:11.0:   bridge window [mem 0xeb800000-0xebcfffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a]
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
pci 0000:00:01.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:01.1: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.2: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:03.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:11.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
pci 0000:80:01.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:02.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.2: PCI INT A -> GSI 71 (level, low) -> IRQ 71
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1a.0: PCI INT B disabled
pci 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1d.0: PCI INT A dis�abled
Trying tinitramfs...
Freeing initrd memory: 32580k freed
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
futex hash table entries: 65536 (order: 10, 4194304 bytes)
audit: initializing netlink socket (disabled)
type=2000 audit(1476878718.096:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 32768
ksign: Installing public key data
Loading keyring
- Added public key 3B396075E393847B
- User ID: Red Hat, Inc. (Kernel Module GPG key)
- Added public key D4A26C9CCD09BEDA
- User ID: Red Hat Enterprise Linux Driver Update Program <secalert@redhat.com>
- Added public key CB445E0DA3EA1F65
- User ID: Red Hat Enterprise Linux Driver Update Program (key 4) <secalert@redhat.com>
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
acpiphp: Slot [2] registered
acpiphp: Slot [2-1] registered
acpiphp: Slot [2-2] registered
acpiphp: Slot [2-3] registered
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
[Firmware Bug]: No valid trip found
ERST: Error Record Serialization Table (ERST) support is initialized.
GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
�serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input1
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
ehci_hcd 0000:00:1a.0: EHCI Host Controller
ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.0: debug port 2
ehci_hcd 0000:00:1a.0: irq 22, io mem 0xd0f20000
ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb1: SerialNumber: 0000:00:1a.0
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
ehci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
ehci_hcd 0000:00:1d.0: EHCI Host Controller
ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
ehci_hcd 0000:00:1d.0: debug port 2
ehci_hcd 0000:00:1d.0: irq 20, io mem 0xd0f10000
Refined TSC clocksource calibration: 2693.509 MHz.
Switching to clocksource tsc
ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: EHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
PNP: No PS/2 controller found. Probing ports directly.
mice: PS/2 mouse device common for all mice
rtc_cmos 00:06: RTC can wake from S4
rtc_cmos 00:06: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
cpuidle: using governor ladder
cpuidle: using governor menu
EFI Variables Facility v0.08 2004-May-17
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
GRE over IPv4 demultiplexor driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
rtc_cmos 00:06: setting system clock to 2016-10-19 12:05:23 UTC (1476878723)
Initalizing network drop monitor service
Freeing unused kernel memory: 1304k freed
Write protecting the kernel read-only data: 10240k
Freeing unused kernel memory: 724k freed
Freeing unused kernel memory: 1572k freed
rdac: device handler registered
dracut: dracut-004-388.el6
dracut: rd_NO_LUKS: removing cryptoluks activation
dracut: rd_NO_LVM: removing LVM activation
usb 1-1: new high speed USB device number 2 using ehci_hcd
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: dm-devel@redhat.com
udev: starting version 147
usb 1-1: New USB device found, idVendor=8087, idProduct=0024
usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 1-1: configuration #1 chosen from 1 choice
hub 1-1:1.0: USB hub found
hub 1-1:1.0: 6 ports detected
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
usb 2-1: new high speed USB device number 2 using ehci_hcd
mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)
mlx4_core: Initializing 0000:04:00.0
mlx4_core 0000:04:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
usb 2-1: New USB device found, idVendor=8087, idProduct=0024
usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 2-1: configuration #1 chosen from 1 choice
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 8 ports detected
usb 2-1.4: new full speed USB device number 3 using ehci_hcd
usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.4: Product: Virtual Keyboard and Mouse
usb 2-1.4: Manufacturer: American Megatrends Inc.
usb 2-1.4: SerialNumber: serial
usb 2-1.4: configuration #1 chosen from 1 choice
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input2
generic-usb 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input3
generic-usb 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)
mlx4_en 0000:04:00.0: registered PHC clock
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
<mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014)
mpt2sas version 20.101.00.00 loaded
mpt2sas 0000:06:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32774632 kB)
mpt2sas0: MSI-X vectors supported: 8, no of cores: 32, max_msix_vectors: 8
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 127
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 128
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 129
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 130
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 131
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 132
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 133
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 134
mpt2sas0: iomem(0x00000000d0a40000), mapped(0xffffc900147c0000), size(65536)
mpt2sas0: ioport(0x0000000000002000), size(256)
mpt2sas0: sending message unit reset !!
mpt2sas0: message unit reset: SUCCESS
mpt2sas0: Allocated physical memory: size(17329 kB)
mpt2sas0: Current Controller Queue Depth(9979), Max Controller Queue Depth(10240)
mpt2sas0: Scatter Gather Elements per IO(128)
mpt2sas0: LSISAS2308: FWVersion(15.00.00.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
mpt2sas0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi0 : Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas0: host_add: handle(0x0001), sas_addr(0x500605b005d6d910), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:41: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:42: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:43: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:44: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:45: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:46: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:41: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:42: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:43: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:44: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:45: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:46: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:0:41: rdac: LUN 41 (RDAC) (owned)
scsi 0:0:0:42: rdac: LUN 42 (RDAC) (unowned)
scsi 0:0:0:43: rdac: LUN 43 (RDAC) (owned)
scsi 0:0:0:44: rdac: LUN 44 (RDAC) (unowned)
scsi 0:0:0:45: rdac: LUN 45 (RDAC) (owned)
scsi 0:0:0:46: rdac: LUN 46 (RDAC) (unowned)
scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:1:41: rdac: LUN 41 (RDAC) (unowned)
scsi 0:0:1:42: rdac: LUN 42 (RDAC) (owned)
scsi 0:0:1:43: rdac: LUN 43 (RDAC) (unowned)
scsi 0:0:1:44: rdac: LUN 44 (RDAC) (owned)
scsi 0:0:1:45: rdac: LUN 45 (RDAC) (unowned)
scsi 0:0:1:46: rdac: LUN 46 (RDAC) (owned)
isci: Intel(R) C600 SAS Controller Driver - version 1.1.0-rh
isci 0000:07:00.0: driver configured for rev: 6 silicon
isci 0000:07:00.0: OEM parameter table found in OROM
isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
isci 0000:07:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
scsi1 : isci
ata1.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata1.00: configured for UDMA/133
scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ata2.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata2.00: configured for UDMA/133
scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ACPI: WMI: Mapper loaded
ahci 0000:00:1f.2: PCI INT B -> GSI 21 (level, low) -> IRQ 21
ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
scsi2 : ahci
scsi3 : ahci
scsi4 : ahci
scsi5 : ahci
scsi6 : ahci
scsi7 : ahci
ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 137
ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 137
ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 137
ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 137
ata7: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 137
ata8: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 137
ata6: SATA link down (SStatus 0 SControl 300)
ata5: SATA link down (SStatus 0 SControl 300)
ata3: SATA link down (SStatus 0 SControl 300)
ata8: SATA link down (SStatus 0 SControl 300)
ata7: SATA link down (SStatus 0 SControl 300)
ata4: SATA link down (SStatus 0 SControl 300)
%Gsd 0:0:0:7: [sda] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 1:0:0:0: [sdo] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:0:0: [sdo] Write Protect is off
sd 1:0:0:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 1:0:1:0: [sdp] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:1:0: [sdp] Write Protect is off
sd 1:0:1:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sdo:
 sdp:
sd 0:0:0:41: [sdb] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
 sdo1 sdo2
sd 0:0:0:42: [sdc] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:45: [sdm] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:46: [sdn] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:44: [sdl] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:43: [sdd] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:1:42: [sdj] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:43: [sdk] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:46: [sdg] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:41: [sdi] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:44: [sdl] Write Protect is off
sd 0:0:1:43: [sdk] Write Protect is off
sd 0:0:0:46: [sdg] Write Protect is off
sd 0:0:1:45: [sdm] Write Protect is off
sd 0:0:0:44: [sde] Write Protect is off
sd 0:0:1:42: [sdj] Write Protect is off
sd 0:0:1:41: [sdi] Write Protect is off
sd 0:0:0:45: [sdf] Write Protect is off
sd 0:0:1:7: [sdh] Write Protect is off
sd 0:0:1:44: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:46: [sdn] Write Protect is off
sd 0:0:1:43: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:44: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:42: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:46: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:45: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:41: [sdb] Write Protect is off
sd 0:0:0:7: [sda] Write Protect is off
sd 0:0:1:41: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:41: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:43: [sdd] Write Protect is off
sd 0:0:0:43: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:45: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:7: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 1:0:0:0: [sdo] Attached SCSI disk
sd 0:0:0:42: [sdc] Write Protect is off
sd 0:0:0:42: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdk:
 sdi:Dev sdk: unable to read RDB block 0
 unable to read partition table
 sdd:
sd 0:0:1:43: [sdk] Attached SCSI disk
 sdl:
 sdg: unknown partition table
 unknown partition table
sd 0:0:0:43: [sdd] Attached SCSI disk
Dev sdi: unable to read RDB block 0
 sdb: unable to read partition table
Dev sdg: unable to read RDB block 0
sd 0:0:1:44: [sdl] Attached SCSI disk
sd 0:0:1:41: [sdi] Attached SCSI disk
 sdc:
 sdn: unknown partition table
 unable to read partition table
sd 0:0:0:41: [sdb] Attached SCSI disk
 sde:
sd 0:0:0:46: [sdg] Attached SCSI disk
Dev sdc: unable to read RDB block 0
 sdp1 sdp9
 sda:
sd 1:0:1:0: [sdp] Attached SCSI disk
 sdm:
 sdf:
 sdj:Dev sde: unable to read RDB block 0
 unknown partition table
 unable to read partition table
sd 0:0:0:45: [sdf] Attached SCSI disk
 unknown partition table
sd 0:0:0:44: [sde] Attached SCSI disk
 unknown partition table
sd 0:0:1:42: [sdj] Attached SCSI disk
 unable to read partition table
sd 0:0:1:46: [sdn] Attached SCSI disk
Dev sdm: unable to read RDB block 0
sd 0:0:0:42: [sdc] Attached SCSI disk
 unable to read partition table
 sdh:
sd 0:0:1:45: [sdm] Attached SCSI disk
 unknown partition table
sd 0:0:0:7: [sda] Attached SCSI disk
 unknown partition table
sd 0:0:1:7: [sdh] Attached SCSI disk
EXT3-fs (sdo1): recovery required on readonly filesystem
EXT3-fs (sdo1): write access will be enabled during recovery
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sdo1): orphan cleanup on readonly fs
EXT3-fs (sdo1): 1 orphan inode deleted
EXT3-fs (sdo1): recovery complete
EXT3-fs (sdo1): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/sdo1
SELinux:  Disabled at runtime.
type=1404 audit(1476878741.314:2): selinux=0 auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
cat: /proc/self/attr/current: Invalid argument

		Welcome to CentOS 

Starting udev: udev: starting version 147
dca service started, version 1.12.1
igb: Intel(R) Gigabit Ethernet Network Driver - version 5.2.15-k
igb: Copyright (c) 2007-2014 Intel Corporation.
igb 0000:02:00.0: PCI INT A -> GSI 27 (level, low) -> IRQ 27
igb 0000:02:00.0: added PHC on eth0
igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b3
igb 0000:02:00.0: eth0: PBA No: 100000-000
igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.1: PCI INT B -> GSI 30 (level, low) -> IRQ 30
igb 0000:02:00.1: added PHC on eth1
igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b4
igb 0000:02:00.1: eth1: PBA No: 100000-000
igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.2: PCI INT C -> GSI 28 (level, low) -> IRQ 28
igb 0000:02:00.2: added PHC on eth2
igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b5
igb 0000:02:00.2: eth2: PBA No: 100000-000
igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.3: PCI INT D -> GSI 29 (level, low) -> IRQ 29
igb 0000:02:00.3: added PHC on eth3
igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b6
igb 0000:02:00.3: eth3: PBA No: 100000-000
igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
scsi 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:0:7: Attached scsi generic sg1 type 0
sd 0:0:0:41: Attached scsi generic sg2 type 0
sd 0:0:0:42: Attached scsi generic sg3 type 0
sd 0:0:0:43: Attached scsi generic sg4 type 0
sd 0:0:0:44: Attached scsi generic sg5 type 0
sd 0:0:0:45: Attached scsi generic sg6 type 0
sd 0:0:0:46: Attached scsi generic sg7 type 0
scsi 0:0:1:0: Attached scsi generic sg8 type 0
sd 0:0:1:7: Attached scsi generic sg9 type 0
sd 0:0:1:41: Attached scsi generic sg10 type 0
sd 0:0:1:42: Attached scsi generic sg11 type 0
sd 0:0:1:43: Attached scsi generic sg12 type 0
sd 0:0:1:44: Attached scsi generic sg13 type 0
sd 0:0:1:45: Attached scsi generic sg14 type 0
sd 0:0:1:46: Attached scsi generic sg15 type 0
sd 1:0:0:0: Attached scsi generic sg16 type 0
sd 1:0:1:0: Attached scsi generic sg17 type 0
ioatdma: Intel(R) QuickData Technology Driver 4.00
ioatdma 0000:00:04.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
igb 0000:02:00.0: DCA enabled
igb 0000:02:00.1: DCA enabled
ioatdma 0000:00:04.1: PCI INT B -> GSI 39 (level, low) -> IRQ 39
igb 0000:02:00.2: DCA enabled
igb 0000:02:00.3: DCA enabled
ioatdma 0000:00:04.2: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.3: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.4: PCI INT A -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.5: PCI INT B -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.6: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.7: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:80:04.0: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.1: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.2: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.3: PCI INT D -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.4: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.5: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.6: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.7: PCI INT D -> GSI 63 (level, low) -> IRQ 63
i801_smbus 0000:00:1f.3: PCI INT C -> GSI 23 (level, low) -> IRQ 23
ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
i801_smbus 0000:07:00.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
i801_smbus 0000:07:00.3: Enabling SMBus device
ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042f conflicts with OpRegion 0x0000000000000400-0x000000000000047f (\PMIO) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000053f (\FBPC) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000052f (\_SI_.SIOR) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
lpc_ich: Resource conflict(s) found affecting gpio_ich
EDAC MC: Ver: 2.1.0 Oct 17 2016
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0
EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0
EDAC sbridge: Driver loaded.
%Gzunicode: module license 'CDDL' taints kernel.
Disabling lock debugging due to kernel taint
SPL: Loaded module v0.6.5.7-1
ZFS: Loaded module v0.6.5.7-1, ZFS pool version 5000, ZFS filesystem version 5
iTCO_vendor_support: vendor-support=0
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.07rh
iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
microcode: CPU0 updated to revision 0x710, date = 2013-06-17 
microcode: CPU1 updated to revision 0x710, date = 2013-06-17 
microcode: CPU2 updated to revision 0x710, date = 2013-06-17 
microcode: CPU3 updated to revision 0x710, date = 2013-06-17 
microcode: CPU4 updated to revision 0x710, date = 2013-06-17 
microcode: CPU5 updated to revision 0x710, date = 2013-06-17 
microcode: CPU6 updated to revision 0x710, date = 2013-06-17 
microcode: CPU7 updated to revision 0x710, date = 2013-06-17 
microcode: CPU8 updated to revision 0x710, date = 2013-06-17 
microcode: CPU9 updated to revision 0x710, date = 2013-06-17 
microcode: CPU10 updated to revision 0x710, date = 2013-06-17 
microcode: CPU11 updated to revision 0x710, date = 2013-06-17 
microcode: CPU12 updated to revision 0x710, date = 2013-06-17 
microcode: CPU13 updated to revision 0x710, date = 2013-06-17 
microcode: CPU14 updated to revision 0x710, date = 2013-06-17 
microcode: CPU15 updated to revision 0x710, date = 2013-06-17 
microcode: CPU16 updated to revision 0x710, date = 2013-06-17 
microcode: CPU17 updated to revision 0x710, date = 2013-06-17 
microcode: CPU18 updated to revision 0x710, date = 2013-06-17 
microcode: CPU19 updated to revision 0x710, date = 2013-06-17 
microcode: CPU20 updated to revision 0x710, date = 2013-06-17 
microcode: CPU21 updated to revision 0x710, date = 2013-06-17 
microcode: CPU22 updated to revision 0x710, date = 2013-06-17 
microcode: CPU23 updated to revision 0x710, date = 2013-06-17 
microcode: CPU24 updated to revision 0x710, date = 2013-06-17 
microcode: CPU25 updated to revision 0x710, date = 2013-06-17 
microcode: CPU26 updated to revision 0x710, date = 2013-06-17 
microcode: CPU27 updated to revision 0x710, date = 2013-06-17 
microcode: CPU28 updated to revision 0x710, date = 2013-06-17 
microcode: CPU29 updated to revision 0x710, date = 2013-06-17 
microcode: CPU30 updated to revision 0x710, date = 2013-06-17 
microcode: CPU31 updated to revision 0x710, date = 2013-06-17 
[  OK  ]


Setting hostname lola-10.lola.whamcloud.com:  [  OK  ]


device-mapper: multipath: version 1.6.0 loaded
Oct 19 05:05:46 | ignoring extra data starting with 'udev_dir' on line 2 of /etc/multipath.conf

device-mapper: multipath round-robin: version 1.0.0 loaded
device-mapper: table: 253:0: multipath: error getting device
device-mapper: ioctl: error adding target to table
Add partition mappings:  [  OK  ]


ERROR: asr: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: hpt37x: reading /dev/sdc[Input/output error]

ERROR: hpt45x: reading /dev/sdc[Input/output error]

ERROR: isw: reading /dev/sdc[Input/output error]

ERROR: jmicron: reading /dev/sdc[Input/output error]

ERROR: lsi: reading /dev/sdc[Input/output error]

ERROR: nvidia: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: sil: reading /dev/sdc[Input/output error]

ERROR: via: reading /dev/sdc[Input/output error]

ERROR: asr: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: hpt37x: reading /dev/sdm[Input/output error]

ERROR: hpt45x: reading /dev/sdm[Input/output error]

ERROR: isw: reading /dev/sdm[Input/output error]

ERROR: jmicron: reading /dev/sdm[Input/output error]

ERROR: lsi: reading /dev/sdm[Input/output error]

ERROR: nvidia: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: sil: reading /dev/sdm[Input/output error]

ERROR: via: reading /dev/sdm[Input/output error]

ERROR: asr: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: hpt37x: reading /dev/sdg[Input/output error]

ERROR: hpt45x: reading /dev/sdg[Input/output error]

ERROR: isw: reading /dev/sdg[Input/output error]

ERROR: jmicron: reading /dev/sdg[Input/output error]

ERROR: lsi: reading /dev/sdg[Input/output error]

ERROR: nvidia: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: sil: reading /dev/sdg[Input/output error]

ERROR: via: reading /dev/sdg[Input/output error]

ERROR: asr: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: hpt37x: reading /dev/sdi[Input/output error]

ERROR: hpt45x: reading /dev/sdi[Input/output error]

ERROR: isw: reading /dev/sdi[Input/output error]

ERROR: jmicron: reading /dev/sdi[Input/output error]

ERROR: lsi: reading /dev/sdi[Input/output error]

ERROR: nvidia: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: sil: reading /dev/sdi[Input/output error]

ERROR: via: reading /dev/sdi[Input/output error]

ERROR: asr: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: hpt37x: reading /dev/sde[Input/output error]

ERROR: hpt45x: reading /dev/sde[Input/output error]

ERROR: isw: reading /dev/sde[Input/output error]

ERROR: jmicron: reading /dev/sde[Input/output error]

ERROR: lsi: reading /dev/sde[Input/output error]

ERROR: nvidia: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: sil: reading /dev/sde[Input/output error]

ERROR: via: reading /dev/sde[Input/output error]

ERROR: asr: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: hpt37x: reading /dev/sdk[Input/output error]

ERROR: hpt45x: reading /dev/sdk[Input/output error]

ERROR: isw: reading /dev/sdk[Input/output error]

ERROR: jmicron: reading /dev/sdk[Input/output error]

ERROR: lsi: reading /dev/sdk[Input/output error]

ERROR: nvidia: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: sil: reading /dev/sdk[Input/output error]

ERROR: via: reading /dev/sdk[Input/output error]

Setting up Logical Volume Management: [  OK  ]


Checking filesystems

Checking all file systems.

[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/sdo1 

/dev/sdo1: clean, 131820/1310720 files, 3459844/5242880 blocks

[  OK  ]


RemEXT3-fs (sdo1): using internal journal
ounting root filesystem in read-write mode:  [  OK  ]


Mounting local filesystems:  [  OK  ]


Enabling local filesystem quotas:  [  OK  ]


Enabling /etc/fstab swaps:  Adding 16457724k swap on /dev/sdo2.  Priority:-1 extents:1 across:16457724k 
[  OK  ]


Entering non-interactive startup

Calling the system activity data collector (sadc)... 

Loading OpenIB kernel modules:[  OK  ]


Mounting ZFS filesystem(s)  [  OK  ]


ip6tables: No config file.[WARNING]


iptables: No config file.[WARNING]


Bringing up loopback interface:  [  OK  ]


Bringing up interface eth0:  ADDRCONF(NETDEV_UP): eth0: link is not ready
Determining if ip address 10.4.0.110 is already in use for device eth0...

igb 0000:02:00.0: eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  OK  ]


Bringing up interface ib0:  ADDRCONF(NETDEV_UP): ib0: link is not ready
ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
[  OK  ]


Bringing up interface ipmi:  Device ipmi does not seem to be present, delaying initialization.

[FAILED]


Starting auditd: type=1305 audit(1476878766.047:3): audit_pid=4478 old=0 auid=4294967295 ses=4294967295 res=1
[  OK  ]


Loading Lustre module stack...LNet: HW CPU cores: 32, npartitions: 2
alg: No test for adler32 (adler32-zlib)
alg: No test for crc32 (crc32-table)
alg: No test for crc32 (crc32-pclmul)
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
Lustre: Lustre: Build Version: 2.8.59_25_g401d7fc
LNet: Added LNI 192.168.1.110@o2ib10 [8/256/0/180]


Starting system logger: [  OK  ]


Enabling ondemand cpu frequency scaling: [  OK  ]


Starting irqbalance: [  OK  ]


Starting rpcbind: [  OK  ]


ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Starting NFS statd: [  OK  ]


Starting system message bus: [  OK  ]


Setting NIS domain: domain is 'lola.whamcloud.com'  [  OK  ]


Starting NIS service: [  OK  ]


Binding NIS service: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
.[  OK  ]


Starting ibacm daemon:[  OK  ]


NFS filesystems queued to be mounted

Mounting filesystems:  RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Slow work thread pool: Starting up
Slow work thread pool: Ready
FS-Cache: Loaded
NFS: Registering the id_resolver key type
FS-Cache: Netfs 'nfs' registered for caching
[  OK  ]


Starting acpi daemon: [  OK  ]


Starting HAL daemon: [  OK  ]


Retrigger failed udev events[  OK  ]


Starting ZFS Event Daemon  [  OK  ]
[  OK  ]


Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Starting NFS services:  [  OK  ]


Starting NFS quotas: [  OK  ]


Starting NFS mountd: [  OK  ]


Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
[  OK  ]


Starting RPC idmapd: [  OK  ]


Sharing ZFS filesystems  [  OK  ]


Starting MUNGE: munged[  OK  ]


Starting kdump:[  OK  ]


Starting sshd: [  OK  ]


Starting xinetd: [  OK  ]


Starting ntpd: [  OK  ]


Starting GANGLIA gmond: [  OK  ]


Starting sendmail: [  OK  ]


Starting sm-client: [  OK  ]


Starting crond: [  OK  ]


starting slurmd: 802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
8021q: adding VLAN 0 to HW filter on device eth0
[  OK  ]


Starting atd: [  OK  ]


Starting collectl: [  OK  ]



CentOS release 6.7 (Final)
Kernel 2.6.32-573.26.1.el6_lustre.x86_64 on an x86_64

lola-10.lola.whamcloud.com login: Oct 19 05:10:01 lola-10 TIME: Time stamp for console
Oct 19 05:15:01 lola-10 TIME: Time stamp for console
Oct 19 05:20:01 lola-10 TIME: Time stamp for console
Oct 19 05:25:01 lola-10 TIME: Time stamp for console
Oct 19 05:30:01 lola-10 TIME: Time stamp for console
Oct 19 05:35:01 lola-10 TIME: Time stamp for console
Oct 19 05:40:01 lola-10 TIME: Time stamp for console
Oct 19 05:45:01 lola-10 TIME: Time stamp for console
Oct 19 05:50:01 lola-10 TIME: Time stamp for console
Oct 19 05:55:01 lola-10 TIME: Time stamp for console
Oct 19 06:00:01 lola-10 TIME: Time stamp for console
Oct 19 06:05:01 lola-10 TIME: Time stamp for console
Oct 19 06:10:01 lola-10 TIME: Time stamp for console
Oct 19 06:15:01 lola-10 TIME: Time stamp for console
Oct 19 06:20:02 lola-10 TIME: Time stamp for console
Oct 19 06:25:01 lola-10 TIME: Time stamp for console
Oct 19 06:30:01 lola-10 TIME: Time stamp for console
Oct 19 06:35:01 lola-10 TIME: Time stamp for console
Oct 19 06:40:01 lola-10 TIME: Time stamp for console
Oct 19 06:45:01 lola-10 TIME: Time stamp for console
Oct 19 06:50:01 lola-10 TIME: Time stamp for console
Oct 19 06:55:01 lola-10 TIME: Time stamp for console
Oct 19 07:00:01 lola-10 TIME: Time stamp for console
Oct 19 07:05:01 lola-10 TIME: Time stamp for console
Oct 19 07:10:01 lola-10 TIME: Time stamp for console
Oct 19 07:15:01 lola-10 TIME: Time stamp for console
Oct 19 07:20:01 lola-10 TIME: Time stamp for console
Oct 19 07:25:01 lola-10 TIME: Time stamp for console
Oct 19 07:30:01 lola-10 TIME: Time stamp for console
Oct 19 07:35:01 lola-10 TIME: Time stamp for console
Oct 19 07:40:01 lola-10 TIME: Time stamp for console
Oct 19 07:45:02 lola-10 TIME: Time stamp for console
Oct 19 07:50:01 lola-10 TIME: Time stamp for console
Oct 19 07:55:01 lola-10 TIME: Time stamp for console
Oct 19 08:00:01 lola-10 TIME: Time stamp for console
Oct 19 08:05:01 lola-10 TIME: Time stamp for console
Oct 19 08:10:01 lola-10 TIME: Time stamp for console
Oct 19 08:15:01 lola-10 TIME: Time stamp for console
Oct 19 08:20:01 lola-10 TIME: Time stamp for console
Oct 19 08:25:01 lola-10 TIME: Time stamp for console
Oct 19 08:30:01 lola-10 TIME: Time stamp for console
Oct 19 08:35:01 lola-10 TIME: Time stamp for console
Oct 19 08:40:01 lola-10 TIME: Time stamp for console
Oct 19 08:45:01 lola-10 TIME: Time stamp for console
Oct 19 08:50:01 lola-10 TIME: Time stamp for console
Oct 19 08:55:01 lola-10 TIME: Time stamp for console
Oct 19 09:00:01 lola-10 TIME: Time stamp for console
Oct 19 09:05:02 lola-10 TIME: Time stamp for console
Oct 19 09:10:01 lola-10 TIME: Time stamp for console
Oct 19 09:15:01 lola-10 TIME: Time stamp for console
Oct 19 09:20:01 lola-10 TIME: Time stamp for console
Oct 19 09:25:01 lola-10 TIME: Time stamp for console
Oct 19 09:30:01 lola-10 TIME: Time stamp for console
Oct 19 09:35:01 lola-10 TIME: Time stamp for console
Oct 19 09:40:01 lola-10 TIME: Time stamp for console
Oct 19 09:45:01 lola-10 TIME: Time stamp for console
Oct 19 09:50:01 lola-10 TIME: Time stamp for console
Oct 19 09:55:01 lola-10 TIME: Time stamp for console
Oct 19 10:00:01 lola-10 TIME: Time stamp for console
Oct 19 10:05:01 lola-10 TIME: Time stamp for console
Oct 19 10:10:01 lola-10 TIME: Time stamp for console
Oct 19 10:15:01 lola-10 TIME: Time stamp for console
Oct 19 10:20:01 lola-10 TIME: Time stamp for console
Oct 19 10:25:01 lola-10 TIME: Time stamp for console
Oct 19 10:30:02 lola-10 TIME: Time stamp for console
Oct 19 10:35:01 lola-10 TIME: Time stamp for console
Oct 19 10:40:01 lola-10 TIME: Time stamp for console
Oct 19 10:45:01 lola-10 TIME: Time stamp for console
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               Version 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.                                                                                                                                                                          MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           LSI Corporation MPT SAS2 BIOS                                                   Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                 Initializing../                                                                 Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                                                                                                 Press Ctrl-C to start LSI Corp Configuration Utility...                         Searching for devices at HBA 0...                                               LSI Corporation MPT SAS2 BIOS                                                   MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                            PCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    SLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    ---- ---- --- -------- ---------------- ----------- ----------                    3           LSI      SAS2308-IT       15.00.00.00  0F:00:00:03                  3    4   7  LSI      Universal Xport  0786         20.00 MiB                    3    4   41  LSI      INF-01-00        0786         14.55 TiB                   3    4   42  LSI      INF-01-00        0786         14.55 TiB                   3    4   43  LSI      INF-01-00        0786         14.55 TiB                   3    4   44  LSI      INF-01-00        0786         14.55 TiB                   3    4   45  LSI      INF-01-00        0786         14.55 TiB                   3    4   46  LSI      INF-01-00        0786         14.55 TiB                   3    0   7  LSI      Universal Xport  0786         20.00 MiB                    3    0   41  LSI      INF-01-00        0786         14.55 TiB                   3    0   42  LSI      INF-01-00        0786         14.55 TiB                   3    0   43  LSI      INF-01-00        0786         14.55 TiB                   3    0   44  LSI      INF-01-00        0786         14.55 TiB                   3    0   45  LSI      INF-01-00        0786         14.55 TiB                   3    0   46  LSI      INF-01-00        0786         14.55 TiB                 Copyright 2000-2012 LSI Corporation.                                                                                                                              RAID Volumes:                                                                   None defined.                                                                   Physical Devices:                                                             �  ID   Device Model     Serial #                     Size Type/Status(Vol ID)     0    ST500NM0011      Z1M0X1F9                  465.7GB Non-RAID Disk           1    ST500NM0011      Z1M0X1GG                  465.7GB Non-RAID Disk         Press <CTRL-I> to enter Configuration Utility..                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Copyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   Press <CTRL-I> to enter Configuration Utility...                                Initializing Intel(R) Boot Agent GE v1.4.04                                     PXE 2.1 Build 091 (WfM 2.0)                                                     Press Ctrl+S to enter the Setup Menu.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                          Bios Version: SE5C600.86B.01.08.0003.022620131521                               BMC Firmware Version: 1.17.4207                                                 SDR Version: SDR Package 1.09                                                   ME Firmware Version: 2.1.7.112                                                  Platform ID: S2600GZ                                                            System memory detected: 32768 MB                                                Current memory speed: 1333 MT/s                                                 Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        Number of physical processors identified: 2                                     ********************************************************************************AHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          SAS/SATA Capable Controller configured with 4 ports in SATA mode                ********************************************************************************USB Keyboard detected                                                           USB Mouse detected                                                                                                                                              Press <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                                     
Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

    GNU GRUB  version 0.97  (571K lower / 3066652K upper memory)

+-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+
      Use the ^ and v keys to select which entry is highlighted.
      Press enter to boot the selected OS, 'e' to edit the
      commands before booting, 'a' to modify the kernel arguments
      before booting, or 'c' for a command-line.  CentOS (2.6.32-573.26.1.el6_lustre.x86_64)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  The highlighted entry will be booted automatically in 5 seconds.    The highlighted entry will be booted automatically in 4 seconds.    The highlighted entry will be booted automatically in 3 seconds.    The highlighted entry will be booted automatically in 2 seconds.    The highlighted entry will be booted automatically in 1 seconds.    Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-573.26.1.el6_lustre.x86_64 (soakbuilder@lola-16.lola.whamcloud.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-16) (GCC) ) #1 SMP Mon Oct 17 13:07:39 PDT 2016
Command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=auto SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000008ec00 (usable)
 BIOS-e820: 000000000008ec00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bb3c7000 (usable)
 BIOS-e820: 00000000bb3c7000 - 00000000bdd2f000 (reserved)
 BIOS-e820: 00000000bdd2f000 - 00000000bddcd000 (ACPI NVS)
 BIOS-e820: 00000000bddcd000 - 00000000bdea1000 (ACPI data)
 BIOS-e820: 00000000bdea1000 - 00000000bdf2f000 (ACPI NVS)
 BIOS-e820: 00000000bdf2f000 - 00000000bdfac000 (ACPI data)
 BIOS-e820: 00000000bdfac000 - 00000000be000000 (usable)
 BIOS-e820: 00000000be000000 - 00000000d0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
 BIOS-e820: 00000000fed19000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ffa20000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000840000000 (usable)
DMI 2.6 present.
SMBIOS version 2.6 @ 0xF0440
No AGP bridge found
last_pfn = 0x840000 max_arch_pfn = 0x400000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xbe000 max_arch_pfn = 0x400000000
Using GB pages for direct mapping
init_memory_mapping: 0000000000000000-00000000be000000
init_memory_mapping: 0000000100000000-0000000840000000
RAMDISK: 3601e000 - 37fef30d
ACPI: Deleted _OSI()
ACPI: Deleted _OSI()
ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20090903/tbfadt-611)
ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
ACPI: FACS 00000000bdfa9f40 00040
ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
Setting APIC routing to flat.
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: PXM 0 -> APIC 2 -> Node 0
SRAT: PXM 0 -> APIC 3 -> Node 0
SRAT: PXM 0 -> APIC 4 -> Node 0
SRAT: PXM 0 -> APIC 5 -> Node 0
SRAT: PXM 0 -> APIC 6 -> Node 0
SRAT: PXM 0 -> APIC 7 -> Node 0
SRAT: PXM 0 -> APIC 8 -> Node 0
SRAT: PXM 0 -> APIC 9 -> Node 0
SRAT: PXM 0 -> APIC 10 -> Node 0
SRAT: PXM 0 -> APIC 11 -> Node 0
SRAT: PXM 0 -> APIC 12 -> Node 0
SRAT: PXM 0 -> APIC 13 -> Node 0
SRAT: PXM 0 -> APIC 14 -> Node 0
SRAT: PXM 0 -> APIC 15 -> Node 0
SRAT: PXM 1 -> APIC 32 -> Node 1
SRAT: PXM 1 -> APIC 33 -> Node 1
SRAT: PXM 1 -> APIC 34 -> Node 1
SRAT: PXM 1 -> APIC 35 -> Node 1
SRAT: PXM 1 -> APIC 36 -> Node 1
SRAT: PXM 1 -> APIC 37 -> Node 1
SRAT: PXM 1 -> APIC 38 -> Node 1
SRAT: PXM 1 -> APIC 39 -> Node 1
SRAT: PXM 1 -> APIC 40 -> Node 1
SRAT: PXM 1 -> APIC 41 -> Node 1
SRAT: PXM 1 -> APIC 42 -> Node 1
SRAT: PXM 1 -> APIC 43 -> Node 1
SRAT: PXM 1 -> APIC 44 -> Node 1
SRAT: PXM 1 -> APIC 45 -> Node 1
SRAT: PXM 1 -> APIC 46 -> Node 1
SRAT: PXM 1 -> APIC 47 -> Node 1
SRAT: Node 0 PXM 0 0-c0000000
SRAT: Node 0 PXM 0 100000000-440000000
SRAT: Node 1 PXM 1 440000000-840000000
Bootmem setup node 0 0000000000000000-0000000440000000
  NODE_DATA [0000000000009000 - 000000000003cfff]
  bootmap [0000000000100000 -  0000000000187fff] pages 88
(8 early reservations) ==> bootmem [0000000000 - 0440000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS ==> [0001000000 - 000203eb64]
  #3 [003601e000 - 0037fef30d]          RAMDISK ==> [003601e000 - 0037fef30d]
  #4 [000008ec00 - 0000100000]    BIOS reserved ==> [000008ec00 - 0000100000]
  #5 [000203f000 - 000203f9b8]              BRK ==> [000203f000 - 000203f9b8]
  #6 [0000008000 - 0000009000]          PGTABLE ==> [0000008000 - 0000009000]
  #7 [0000001000 - 0000001030]        ACPI SLIT ==> [0000001000 - 0000001030]
Bootmem setup node 1 0000000440000000-0000000840000000
  NODE_DATA [0000000440000040 - 000000044003403f]
  bootmap [0000000440035000 -  00000004400b4fff] pages 80
(8 early reservations) ==> bootmem [0440000000 - 0840000000]
  #0 [0000000000 - 0000001000]   BIOS data page
  #1 [0000006000 - 0000008000]       TRAMPOLINE
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS
  #3 [003601e000 - 0037fef30d]          RAMDISK
  #4 [000008ec00 - 0000100000]    BIOS reserved
  #5 [000203f000 - 000203f9b8]              BRK
  #6 [0000008000 - 0000009000]          PGTABLE
  #7 [0000001000 - 0000001030]        ACPI SLIT
found SMP MP-table at [ffff8800000fcd70] fcd70
Reserving 131MB of memory at 48MB for crashkernel (System RAM: 33792MB)
Zone PFN ranges:
  DMA      0x00000001 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   0x00100000 -> 0x00840000
Movable zone start PFN for each node
early_node_map[5] active PFN ranges
    0: 0x00000001 -> 0x0000008e
    0: 0x00000100 -> 0x000bb3c7
    0: 0x000bdfac -> 0x000be000
    0: 0x00100000 -> 0x00440000
    1: 0x00440000 -> 0x00840000
ACPI: PM-Timer IO Port: 0x408
Setting APIC routing to flat.
ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a701 base: 0xfed00000
SMP: Allowing 240 CPUs, 208 hotplug CPUs
PM: Registered nosave memory: 000000000008e000 - 000000000008f000
PM: Registered nosave memory: 000000000008f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
PM: Registered nosave memory: 00000000bb3c7000 - 00000000bdd2f000
PM: Registered nosave memory: 00000000bdd2f000 - 00000000bddcd000
PM: Registered nosave memory: 00000000bddcd000 - 00000000bdea1000
PM: Registered nosave memory: 00000000bdea1000 - 00000000bdf2f000
PM: Registered nosave memory: 00000000bdf2f000 - 00000000bdfac000
PM: Registered nosave memory: 00000000be000000 - 00000000d0000000
PM: Registered nosave memory: 00000000d0000000 - 00000000fec00000
PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
PM: Registered nosave memory: 00000000fec01000 - 00000000fed19000
PM: Registered nosave memory: 00000000fed19000 - 00000000fed1a000
PM: Registered nosave memory: 00000000fed1a000 - 00000000fed1c000
PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
PM: Registered nosave memory: 00000000fed20000 - 00000000fee00000
PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
PM: Registered nosave memory: 00000000fee01000 - 00000000ffa20000
PM: Registered nosave memory: 00000000ffa20000 - 0000000100000000
Allocating PCI resources starting at d0000000 (gap: d0000000:2ec00000)
Booting paravirtualized kernel on bare hardware
NR_CPUS:4096 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
PERCPU: Embedded 30 pages/cpu @ffff880038600000 s91288 r8192 d23400 u131072
pcpu-alloc: s91288 r8192 d23400 u131072 alloc=1*2097152
pcpu-alloc: [0] 000 001 002 003 004 005 006 007 016 017 018 019 020 021 022 023 
pcpu-alloc: [0] 032 034 036 038 040 042 044 046 048 050 052 054 056 058 060 062 
pcpu-alloc: [0] 064 066 068 070 072 074 076 078 080 082 084 086 088 090 092 094 
pcpu-alloc: [0] 096 098 100 102 104 106 108 110 112 114 116 118 120 122 124 126 
pcpu-alloc: [0] 128 130 132 134 136 138 140 142 144 146 148 150 152 154 156 158 
pcpu-alloc: [0] 160 162 164 166 168 170 172 174 176 178 180 182 184 186 188 190 
pcpu-alloc: [0] 192 194 196 198 200 202 204 206 208 210 212 214 216 218 220 222 
pcpu-alloc: [0] 224 226 228 230 232 234 236 238 --- --- --- --- --- --- --- --- 
pcpu-alloc: [1] 008 009 010 011 012 013 014 015 024 025 026 027 028 029 030 031 
pcpu-alloc: [1] 033 035 037 039 041 043 045 047 049 051 053 055 057 059 061 063 
pcpu-alloc: [1] 065 067 069 071 073 075 077 079 081 083 085 087 089 091 093 095 
pcpu-alloc: [1] 097 099 101 103 105 107 109 111 113 115 117 119 121 123 125 127 
pcpu-alloc: [1] 129 131 133 135 137 139 141 143 145 147 149 151 153 155 157 159 
pcpu-alloc: [1] 161 163 165 167 169 171 173 175 177 179 181 183 185 187 189 191 
pcpu-alloc: [1] 193 195 197 199 201 203 205 207 209 211 213 215 217 219 221 223 
pcpu-alloc: [1] 225 227 229 231 233 235 237 239 --- --- --- --- --- --- --- --- 
Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8250675
Policy zone: Normal
Kernel command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=131M@0M SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
PID hash table entries: 4096 (order: 3, 32768 bytes)
xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
Checking aperture...
No AGP bridge found
Memory: 32738448k/34603008k available (5400k kernel code, 1126752k absent, 737808k reserved, 7008k data, 1304k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:3144
Extended CMOS year: 2000
Console: colour VGA+ 80x25
console [ttyS0] enabled
allocated 134217728 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
TSC: cpu family 6 model 45, tsc initial value = 75f4d86a41
Fast TSC calibration using PIT
Detected 2693.510 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5387.02 BogoMIPS (lpj=2693510)
pid_max: default: 245760 minimum: 1920
Security Framework initialized
SELinux:  Initializing.
Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 20 MCE banks
CPU0: Thermal monitoring enabled (TM1)
using mwait in idle threads.
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 22144 entries in 87 pages
x2apic not enabled, IRQ remapping init failed
APIC routing finalized to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz stepping 07
Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
... version:                3
... bit width:              48
... generic registers:      4
... value mask:             0000ffffffffffff
... max period:             0000ffffffffffff
... fixed-purpose events:   3
... event mask:             000000070000000f
NMI watchdog enabled, takes one hw-pmu counter.
Booting Node   0, Processors  #1 #2 #3 #4 #5 #6 #7 Ok.
Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 Ok.
Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 Ok.
Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
Brought up 32 CPUs
Total of 32 processors activated (172372.64 BogoMIPS).
devtmpfs: initialized
PM: Registering ACPI NVS region at bdd2f000 (647168 bytes)
PM: Registering ACPI NVS region at bdea1000 (581632 bytes)
regulator: core version 0.5
NET: Registered protocol family 16
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MCFG configuration 0: base c0000000 segment 0 buses 0 - 255
PCI: MCFG area at c0000000 reserved in E820
PCI: Using MMCONFIG at c0000000 - cfffffff
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: Executed 1 blocks of module-level executable AML code
ACPI: BIOS _OSI(Linux) query ignored
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
HEST: Table parsing has been initialized.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
pci_root PNP0A08:00: host bridge window [io  0x0000-0xbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:00: host bridge window [mem 0x000c0000-0x000c3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c4000-0x000c7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c8000-0x000cbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000cc000-0x000cffff]
pci_root PNP0A08:00: host bridge window [mem 0x000d0000-0x000d3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d4000-0x000d7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d8000-0x000dbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000dc000-0x000dffff]
pci_root PNP0A08:00: host bridge window [mem 0x000e0000-0x000e3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e4000-0x000e7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e8000-0x000ebfff]
pci_root PNP0A08:00: host bridge window [mem 0x000ec000-0x000effff]
pci_root PNP0A08:00: host bridge window [mem 0x000f0000-0x000fffff]
pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xebffffff]
pci_root PNP0A08:00: host bridge window [mem 0x380000000000-0x38007fffffff]
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdfff])
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff]
pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff]
pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff]
pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff]
pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff]
pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff]
pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff]
pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff]
pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff]
pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff]
pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff]
pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff]
pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff]
pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
pci 0000:00:00.0: PME# disabled
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
pci 0000:00:01.1: PME# disabled
pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
pci 0000:00:02.0: PME# disabled
pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
pci 0000:00:02.2: PME# disabled
pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
pci 0000:00:03.0: PME# disabled
pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
pci 0000:00:11.0: PME# disabled
pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.0: PME# disabled
pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
pci 0000:00:16.1: PME# disabled
pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.7: PME# disabled
pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.0: PME# disabled
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:00.0: PME# disabled
pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
pci 0000:02:00.1: PME# disabled
pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
pci 0000:02:00.2: PME# disabled
pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
pci 0000:02:00.3: PME# disabled
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:07:00.3: PME# supported from D0 D3hot D3cold
pci 0000:07:00.3: PME# disabled
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a] (subtractive decode)
 pci0000:00: Requesting ACPI _OSC control (0x1d)
 pci0000:00: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
pci_root PNP0A08:01: host bridge window [io  0x03b0-0x03df]
pci_root PNP0A08:01: host bridge window [io  0xc000-0xffff]
pci_root PNP0A08:01: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:01: host bridge window [mem 0xec000000-0xfbffffff]
pci_root PNP0A08:01: host bridge window [mem 0x380080000000-0x3800ffffffff]
PCI host bridge to bus 0000:80
pci_bus 0000:80: root bus resource [io  0x03b0-0x03df]
pci_bus 0000:80: root bus resource [io  0xc000-0xffff]
pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff]
pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff]
pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
pci 0000:80:01.0: PME# disabled
pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
pci 0000:80:02.0: PME# disabled
pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
pci 0000:80:03.0: PME# disabled
pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
pci 0000:80:03.2: PME# disabled
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
 pci0000:80: Requesting ACPI _OSC control (0x1d)
 pci0000:80: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
PCI host bridge to bus 0000:7f
 pci0000:7f: Requesting ACPI _OSC control (0x1d)
 pci0000:7f: ACPI _OSC control (0x10) granted
ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
PCI host bridge to bus 0000:ff
 pci0000:ff: Requesting ACPI _OSC control (0x1d)
 pci0000:ff: ACPI _OSC control (0x10) granted
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:09:00.0
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
HPET: 8 timers in total, 5 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 72, 73, 74, 75, 76, 0
hpet0: 8 comparators, 64-bit 14.318180 MHz counter
Switching to clocksource hpet
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 15 devices
ACPI: ACPI bus type pnp unregistered
system 00:05: [io  0x0680-0x069f] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0x0400-0x0453] has been reserved
system 00:05: [io  0x0458-0x047f] has been reserved
system 00:05: [io  0x0500-0x057f] has been reserved
system 00:05: [io  0x0600-0x061f] has been reserved
system 00:05: [io  0x0ca2-0x0ca5] has been reserved
system 00:05: [io  0x0cf9] could not be reserved
system 00:07: [io  0x0454-0x0457] has been reserved
system 00:0a: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:0a: [mem 0xebfff000-0xebffffff] has been reserved
system 00:0a: [mem 0xc0000000-0xcfffffff] has been reserved
system 00:0a: [mem 0xfed20000-0xfed3ffff] has been reserved
system 00:0a: [mem 0xfed45000-0xfed8ffff] has been reserved
system 00:0a: [mem 0xff000000-0xffffffff] could not be reserved
system 00:0a: [mem 0xfee00000-0xfeefffff] could not be reserved
system 00:0a: [mem 0xfec00000-0xfecfffff] could not be reserved
system 00:0a: [mem 0xd0f70000-0xd0f70fff] has been reserved
system 00:0c: [mem 0x00000000-0x0009cfff] could not be reserved
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
pci 0000:00:02.0:   bridge window [mem 0xeb000000-0xeb7fffff 64bit pref]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
pci 0000:00:11.0:   bridge window [mem 0xeb800000-0xebcfffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a]
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
pci 0000:00:01.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:01.1: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.2: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:03.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:11.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
pci 0000:80:01.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:02.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.2: PCI INT A -> GSI 71 (level, low) -> IRQ 71
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1a.0: PCI INT B disabled
pci 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1d.0: PCI I�NT A disabled
e as initramfs...
Freeing initrd memory: 32580k freed
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
futex hash table entries: 65536 (order: 10, 4194304 bytes)
audit: initializing netlink socket (disabled)
type=2000 audit(1476899363.106:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 32768
ksign: Installing public key data
Loading keyring
- Added public key 3B396075E393847B
- User ID: Red Hat, Inc. (Kernel Module GPG key)
- Added public key D4A26C9CCD09BEDA
- User ID: Red Hat Enterprise Linux Driver Update Program <secalert@redhat.com>
- Added public key CB445E0DA3EA1F65
- User ID: Red Hat Enterprise Linux Driver Update Program (key 4) <secalert@redhat.com>
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
acpiphp: Slot [2] registered
acpiphp: Slot [2-1] registered
acpiphp: Slot [2-2] registered
acpiphp: Slot [2-3] registered
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
[Firmware Bug]: No valid trip found
ERST: Error Record Serialization Table (ERST) support is initialized.
GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
�serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input1
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
ehci_hcd 0000:00:1a.0: EHCI Host Controller
ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.0: debug port 2
ehci_hcd 0000:00:1a.0: irq 22, io mem 0xd0f20000
ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb1: SerialNumber: 0000:00:1a.0
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
ehci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
ehci_hcd 0000:00:1d.0: EHCI Host Controller
ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
ehci_hcd 0000:00:1d.0: debug port 2
ehci_hcd 0000:00:1d.0: irq 20, io mem 0xd0f10000
Refined TSC clocksource calibration: 2693.509 MHz.
Switching to clocksource tsc
ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: EHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
PNP: No PS/2 controller found. Probing ports directly.
mice: PS/2 mouse device common for all mice
rtc_cmos 00:06: RTC can wake from S4
rtc_cmos 00:06: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
cpuidle: using governor ladder
cpuidle: using governor menu
EFI Variables Facility v0.08 2004-May-17
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
GRE over IPv4 demultiplexor driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
rtc_cmos 00:06: setting system clock to 2016-10-19 17:49:28 UTC (1476899368)
Initalizing network drop monitor service
Freeing unused kernel memory: 1304k freed
Write protecting the kernel read-only data: 10240k
Freeing unused kernel memory: 724k freed
Freeing unused kernel memory: 1572k freed
rdac: device handler registered
dracut: dracut-004-388.el6
dracut: rd_NO_LUKS: removing cryptoluks activation
dracut: rd_NO_LVM: removing LVM activation
usb 1-1: new high speed USB device number 2 using ehci_hcd
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: dm-devel@redhat.com
udev: starting version 147
usb 1-1: New USB device found, idVendor=8087, idProduct=0024
usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 1-1: configuration #1 chosen from 1 choice
hub 1-1:1.0: USB hub found
hub 1-1:1.0: 6 ports detected
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
usb 2-1: new high speed USB device number 2 using ehci_hcd
mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)
mlx4_core: Initializing 0000:04:00.0
mlx4_core 0000:04:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
usb 2-1: New USB device found, idVendor=8087, idProduct=0024
usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 2-1: configuration #1 chosen from 1 choice
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 8 ports detected
usb 2-1.4: new full speed USB device number 3 using ehci_hcd
usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.4: Product: Virtual Keyboard and Mouse
usb 2-1.4: Manufacturer: American Megatrends Inc.
usb 2-1.4: SerialNumber: serial
usb 2-1.4: configuration #1 chosen from 1 choice
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input2
generic-usb 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input3
generic-usb 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)
mlx4_en 0000:04:00.0: registered PHC clock
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
<mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014)
mpt2sas version 20.101.00.00 loaded
mpt2sas 0000:06:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32774632 kB)
mpt2sas0: MSI-X vectors supported: 8, no of cores: 32, max_msix_vectors: 8
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 127
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 128
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 129
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 130
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 131
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 132
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 133
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 134
mpt2sas0: iomem(0x00000000d0a40000), mapped(0xffffc900147c0000), size(65536)
mpt2sas0: ioport(0x0000000000002000), size(256)
mpt2sas0: sending message unit reset !!
mpt2sas0: message unit reset: SUCCESS
mpt2sas0: Allocated physical memory: size(17329 kB)
mpt2sas0: Current Controller Queue Depth(9979), Max Controller Queue Depth(10240)
mpt2sas0: Scatter Gather Elements per IO(128)
mpt2sas0: LSISAS2308: FWVersion(15.00.00.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
mpt2sas0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi0 : Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas0: host_add: handle(0x0001), sas_addr(0x500605b005d6d910), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:41: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:42: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:43: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:44: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:45: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:46: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:41: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:42: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:43: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:44: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:45: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:46: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:0:41: rdac: LUN 41 (RDAC) (owned)
scsi 0:0:0:42: rdac: LUN 42 (RDAC) (unowned)
scsi 0:0:0:43: rdac: LUN 43 (RDAC) (owned)
scsi 0:0:0:44: rdac: LUN 44 (RDAC) (unowned)
scsi 0:0:0:45: rdac: LUN 45 (RDAC) (owned)
scsi 0:0:0:46: rdac: LUN 46 (RDAC) (unowned)
scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:1:41: rdac: LUN 41 (RDAC) (unowned)
scsi 0:0:1:42: rdac: LUN 42 (RDAC) (owned)
scsi 0:0:1:43: rdac: LUN 43 (RDAC) (unowned)
scsi 0:0:1:44: rdac: LUN 44 (RDAC) (owned)
scsi 0:0:1:45: rdac: LUN 45 (RDAC) (unowned)
scsi 0:0:1:46: rdac: LUN 46 (RDAC) (owned)
isci: Intel(R) C600 SAS Controller Driver - version 1.1.0-rh
isci 0000:07:00.0: driver configured for rev: 6 silicon
isci 0000:07:00.0: OEM parameter table found in OROM
isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
isci 0000:07:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
scsi1 : isci
ata1.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata1.00: configured for UDMA/133
scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ata2.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata2.00: configured for UDMA/133
scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ACPI: WMI: Mapper loaded
ahci 0000:00:1f.2: PCI INT B -> GSI 21 (level, low) -> IRQ 21
ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
scsi2 : ahci
scsi3 : ahci
scsi4 : ahci
scsi5 : ahci
scsi6 : ahci
scsi7 : ahci
ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 137
ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 137
ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 137
ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 137
ata7: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 137
ata8: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 137
ata6: SATA link down (SStatus 0 SControl 300)
ata5: SATA link down (SStatus 0 SControl 300)
ata7: SATA link down (SStatus 0 SControl 300)
ata4: SATA link down (SStatus 0 SControl 300)
ata3: SATA link down (SStatus 0 SControl 300)
ata8: SATA link down (SStatus 0 SControl 300)
%Gsd 0:0:0:7: [sda] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:0:41: [sdb] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 1:0:0:0: [sdo] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:1:0: [sdp] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:0:0: [sdo] Write Protect is off
sd 1:0:1:0: [sdp] Write Protect is off
sd 1:0:0:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 1:0:1:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sdp:
 sdo:
sd 0:0:0:42: [sdc] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:43: [sdd] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:44: [sdl] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:46: [sdg] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:46: [sdn] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:41: [sdi] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
 sdo1 sdo2
sd 0:0:1:43: [sdk] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:1:45: [sdm] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:42: [sdj] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:44: [sdl] Write Protect is off
sd 0:0:0:7: [sda] Write Protect is off
sd 0:0:0:46: [sdg] Write Protect is off
sd 0:0:0:43: [sdd] Write Protect is off
sd 0:0:0:44: [sde] Write Protect is off
sd 0:0:1:46: [sdn] Write Protect is off
sd 0:0:0:41: [sdb] Write Protect is off
sd 0:0:1:41: [sdi] Write Protect is off
sd 0:0:1:44: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:7: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:45: [sdf] Write Protect is off
sd 0:0:0:44: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:43: [sdk] Write Protect is off
sd 0:0:1:46: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:41: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:43: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write Protect is off
sd 0:0:1:42: [sdj] Write Protect is off
sd 0:0:1:45: [sdm] Write Protect is off
sd 0:0:1:43: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:42: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:45: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:41: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:45: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdl:
 sde:Dev sde: unable to read RDB block 0
 unable to read partition table
sd 0:0:0:42: [sdc] Write Protect is off
sd 1:0:0:0: [sdo] Attached SCSI disk
 sda:
 sdi:
 sdn:
 sdd:
sd 0:0:0:44: [sde] Attached SCSI disk
 sdk:
 sdg:Dev sdg: unable to read RDB block 0
Dev sdk: unable to read RDB block 0
 unknown partition table
 unknown partition table
sd 0:0:0:42: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
 unable to read partition table
sd 0:0:0:43: [sdd] Attached SCSI disk
sd 0:0:1:44: [sdl] Attached SCSI disk
 sdb: unable to read partition table
sd 0:0:1:43: [sdk] Attached SCSI disk
Dev sdi: unable to read RDB block 0
sd 0:0:0:46: [sdg] Attached SCSI disk
 unknown partition table
 unable to read partition table
sd 0:0:1:46: [sdn] Attached SCSI disk
 unknown partition table
sd 0:0:1:41: [sdi] Attached SCSI disk
 sdh:
sd 0:0:0:41: [sdb] Attached SCSI disk
 sdp1 sdp9
 sdf:
sd 1:0:1:0: [sdp] Attached SCSI disk
 sdm:
 sdj:Dev sdm: unable to read RDB block 0
 unknown partition table
 unknown partition table
sd 0:0:0:45: [sdf] Attached SCSI disk
 unable to read partition table
sd 0:0:1:42: [sdj] Attached SCSI disk
 sdc:
sd 0:0:1:45: [sdm] Attached SCSI disk
Dev sdc: unable to read RDB block 0
 unable to read partition table
sd 0:0:0:42: [sdc] Attached SCSI disk
 unknown partition table
sd 0:0:0:7: [sda] Attached SCSI disk
 unknown partition table
sd 0:0:1:7: [sdh] Attached SCSI disk
EXT3-fs (sdo1): recovery required on readonly filesystem
EXT3-fs (sdo1): write access will be enabled during recovery
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sdo1): orphan cleanup on readonly fs
EXT3-fs (sdo1): 1 orphan inode deleted
EXT3-fs (sdo1): recovery complete
EXT3-fs (sdo1): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/sdo1
SELinux:  Disabled at runtime.
type=1404 audit(1476899386.319:2): selinux=0 auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
cat: /proc/self/attr/current: Invalid argument

		Welcome to CentOS 

Starting udev: udev: starting version 147
dca service started, version 1.12.1
igb: Intel(R) Gigabit Ethernet Network Driver - version 5.2.15-k
igb: Copyright (c) 2007-2014 Intel Corporation.
igb 0000:02:00.0: PCI INT A -> GSI 27 (level, low) -> IRQ 27
igb 0000:02:00.0: added PHC on eth0
igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b3
igb 0000:02:00.0: eth0: PBA No: 100000-000
igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.1: PCI INT B -> GSI 30 (level, low) -> IRQ 30
igb 0000:02:00.1: added PHC on eth1
igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b4
igb 0000:02:00.1: eth1: PBA No: 100000-000
igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.2: PCI INT C -> GSI 28 (level, low) -> IRQ 28
igb 0000:02:00.2: added PHC on eth2
igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b5
igb 0000:02:00.2: eth2: PBA No: 100000-000
igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.3: PCI INT D -> GSI 29 (level, low) -> IRQ 29
igb 0000:02:00.3: added PHC on eth3
igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b6
igb 0000:02:00.3: eth3: PBA No: 100000-000
igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
scsi 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:0:7: Attached scsi generic sg1 type 0
sd 0:0:0:41: Attached scsi generic sg2 type 0
sd 0:0:0:42: Attached scsi generic sg3 type 0
sd 0:0:0:43: Attached scsi generic sg4 type 0
sd 0:0:0:44: Attached scsi generic sg5 type 0
sd 0:0:0:45: Attached scsi generic sg6 type 0
sd 0:0:0:46: Attached scsi generic sg7 type 0
scsi 0:0:1:0: Attached scsi generic sg8 type 0
sd 0:0:1:7: Attached scsi generic sg9 type 0
sd 0:0:1:41: Attached scsi generic sg10 type 0
sd 0:0:1:42: Attached scsi generic sg11 type 0
sd 0:0:1:43: Attached scsi generic sg12 type 0
sd 0:0:1:44: Attached scsi generic sg13 type 0
sd 0:0:1:45: Attached scsi generic sg14 type 0
sd 0:0:1:46: Attached scsi generic sg15 type 0
sd 1:0:0:0: Attached scsi generic sg16 type 0
sd 1:0:1:0: Attached scsi generic sg17 type 0
ioatdma: Intel(R) QuickData Technology Driver 4.00
ioatdma 0000:00:04.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
igb 0000:02:00.0: DCA enabled
igb 0000:02:00.1: DCA enabled
ioatdma 0000:00:04.1: PCI INT B -> GSI 39 (level, low) -> IRQ 39
igb 0000:02:00.2: DCA enabled
igb 0000:02:00.3: DCA enabled
ioatdma 0000:00:04.2: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.3: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.4: PCI INT A -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.5: PCI INT B -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.6: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.7: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:80:04.0: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.1: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.2: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.3: PCI INT D -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.4: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.5: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.6: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.7: PCI INT D -> GSI 63 (level, low) -> IRQ 63
i801_smbus 0000:00:1f.3: PCI INT C -> GSI 23 (level, low) -> IRQ 23
ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
i801_smbus 0000:07:00.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
i801_smbus 0000:07:00.3: Enabling SMBus device
ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042f conflicts with OpRegion 0x0000000000000400-0x000000000000047f (\PMIO) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000053f (\FBPC) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000052f (\_SI_.SIOR) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
lpc_ich: Resource conflict(s) found affecting gpio_ich
EDAC MC: Ver: 2.1.0 Oct 17 2016
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0
EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0
EDAC sbridge: Driver loaded.
%Gzunicode: module license 'CDDL' taints kernel.
Disabling lock debugging due to kernel taint
SPL: Loaded module v0.6.5.7-1
ZFS: Loaded module v0.6.5.7-1, ZFS pool version 5000, ZFS filesystem version 5
iTCO_vendor_support: vendor-support=0
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.07rh
iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
microcode: CPU0 updated to revision 0x710, date = 2013-06-17 
microcode: CPU1 updated to revision 0x710, date = 2013-06-17 
microcode: CPU2 updated to revision 0x710, date = 2013-06-17 
microcode: CPU3 updated to revision 0x710, date = 2013-06-17 
microcode: CPU4 updated to revision 0x710, date = 2013-06-17 
microcode: CPU5 updated to revision 0x710, date = 2013-06-17 
microcode: CPU6 updated to revision 0x710, date = 2013-06-17 
microcode: CPU7 updated to revision 0x710, date = 2013-06-17 
microcode: CPU8 updated to revision 0x710, date = 2013-06-17 
microcode: CPU9 updated to revision 0x710, date = 2013-06-17 
microcode: CPU10 updated to revision 0x710, date = 2013-06-17 
microcode: CPU11 updated to revision 0x710, date = 2013-06-17 
microcode: CPU12 updated to revision 0x710, date = 2013-06-17 
microcode: CPU13 updated to revision 0x710, date = 2013-06-17 
microcode: CPU14 updated to revision 0x710, date = 2013-06-17 
microcode: CPU15 updated to revision 0x710, date = 2013-06-17 
microcode: CPU16 updated to revision 0x710, date = 2013-06-17 
microcode: CPU17 updated to revision 0x710, date = 2013-06-17 
microcode: CPU18 updated to revision 0x710, date = 2013-06-17 
microcode: CPU19 updated to revision 0x710, date = 2013-06-17 
microcode: CPU20 updated to revision 0x710, date = 2013-06-17 
microcode: CPU21 updated to revision 0x710, date = 2013-06-17 
microcode: CPU22 updated to revision 0x710, date = 2013-06-17 
microcode: CPU23 updated to revision 0x710, date = 2013-06-17 
microcode: CPU24 updated to revision 0x710, date = 2013-06-17 
microcode: CPU25 updated to revision 0x710, date = 2013-06-17 
microcode: CPU26 updated to revision 0x710, date = 2013-06-17 
microcode: CPU27 updated to revision 0x710, date = 2013-06-17 
microcode: CPU28 updated to revision 0x710, date = 2013-06-17 
microcode: CPU29 updated to revision 0x710, date = 2013-06-17 
microcode: CPU30 updated to revision 0x710, date = 2013-06-17 
microcode: CPU31 updated to revision 0x710, date = 2013-06-17 
[  OK  ]


Setting hostname lola-10.lola.whamcloud.com:  [  OK  ]


device-mapper: multipath: version 1.6.0 loaded
Oct 19 10:49:52 | ignoring extra data starting with 'udev_dir' on line 2 of /etc/multipath.conf

device-mapper: multipath round-robin: version 1.0.0 loaded
device-mapper: table: 253:1: multipath: error getting device
device-mapper: ioctl: error adding target to table
Add partition mappings:  [  OK  ]


ERROR: asr: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: hpt37x: reading /dev/sdc[Input/output error]

ERROR: hpt45x: reading /dev/sdc[Input/output error]

ERROR: isw: reading /dev/sdc[Input/output error]

ERROR: jmicron: reading /dev/sdc[Input/output error]

ERROR: lsi: reading /dev/sdc[Input/output error]

ERROR: nvidia: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: sil: reading /dev/sdc[Input/output error]

ERROR: via: reading /dev/sdc[Input/output error]

ERROR: asr: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: hpt37x: reading /dev/sdm[Input/output error]

ERROR: hpt45x: reading /dev/sdm[Input/output error]

ERROR: isw: reading /dev/sdm[Input/output error]

ERROR: jmicron: reading /dev/sdm[Input/output error]

ERROR: lsi: reading /dev/sdm[Input/output error]

ERROR: nvidia: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: sil: reading /dev/sdm[Input/output error]

ERROR: via: reading /dev/sdm[Input/output error]

ERROR: asr: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: hpt37x: reading /dev/sdk[Input/output error]

ERROR: hpt45x: reading /dev/sdk[Input/output error]

ERROR: isw: reading /dev/sdk[Input/output error]

ERROR: jmicron: reading /dev/sdk[Input/output error]

ERROR: lsi: reading /dev/sdk[Input/output error]

ERROR: nvidia: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: sil: reading /dev/sdk[Input/output error]

ERROR: via: reading /dev/sdk[Input/output error]

ERROR: asr: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: hpt37x: reading /dev/sdi[Input/output error]

ERROR: hpt45x: reading /dev/sdi[Input/output error]

ERROR: isw: reading /dev/sdi[Input/output error]

ERROR: jmicron: reading /dev/sdi[Input/output error]

ERROR: lsi: reading /dev/sdi[Input/output error]

ERROR: nvidia: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: sil: reading /dev/sdi[Input/output error]

ERROR: via: reading /dev/sdi[Input/output error]

ERROR: asr: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: hpt37x: reading /dev/sdg[Input/output error]

ERROR: hpt45x: reading /dev/sdg[Input/output error]

ERROR: isw: reading /dev/sdg[Input/output error]

ERROR: jmicron: reading /dev/sdg[Input/output error]

ERROR: lsi: reading /dev/sdg[Input/output error]

ERROR: nvidia: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: sil: reading /dev/sdg[Input/output error]

ERROR: via: reading /dev/sdg[Input/output error]

ERROR: asr: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: hpt37x: reading /dev/sde[Input/output error]

ERROR: hpt45x: reading /dev/sde[Input/output error]

ERROR: isw: reading /dev/sde[Input/output error]

ERROR: jmicron: reading /dev/sde[Input/output error]

ERROR: lsi: reading /dev/sde[Input/output error]

ERROR: nvidia: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: sil: reading /dev/sde[Input/output error]

ERROR: via: reading /dev/sde[Input/output error]

Setting up Logical Volume Management: [  OK  ]


Checking filesystems

Checking all file systems.

[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/sdo1 

/dev/sdo1: clean, 131821/1310720 files, 3477786/5242880 blocks

[  OK  ]


RemEXT3-fs (sdo1): ounting root filusing internal journalesystem in read-
write mode:  [  OK  ]


Mounting local filesystems:  [  OK  ]


Enabling local filesystem quotas:  [  OK  ]


Enabling /etc/fstab swaps:  Adding 16457724k swap on /dev/sdo2.  Priority:-1 extents:1 across:16457724k 
[  OK  ]


Entering non-interactive startup

Calling the system activity data collector (sadc)... 

Loading OpenIB kernel modules:[  OK  ]


Mounting ZFS filesystem(s)  [  OK  ]


ip6tables: No config file.[WARNING]


iptables: No config file.[WARNING]


Bringing up loopback interface:  [  OK  ]


Bringing up interface eth0:  ADDRCONF(NETDEV_UP): eth0: link is not ready
Determining if ip address 10.4.0.110 is already in use for device eth0...

igb 0000:02:00.0: eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  OK  ]


Bringing up interface ib0:  ADDRCONF(NETDEV_UP): ib0: link is not ready
ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
[  OK  ]


Bringing up interface ipmi:  Device ipmi does not seem to be present, delaying initialization.

[FAILED]


Starting auditd: type=1305 audit(1476899414.660:3): audit_pid=4482 old=0 auid=4294967295 ses=4294967295 res=1
[  OK  ]


Loading Lustre module stack...LNet: HW CPU cores: 32, npartitions: 2
alg: No test for adler32 (adler32-zlib)
alg: No test for crc32 (crc32-table)
alg: No test for crc32 (crc32-pclmul)
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
Lustre: Lustre: Build Version: 2.8.59_25_g401d7fc
LNet: Added LNI 192.168.1.110@o2ib10 [8/256/0/180]


Starting system logger: [  OK  ]


Enabling ondemand cpu frequency scaling: [  OK  ]


Starting irqbalance: [  OK  ]


Starting rpcbind: [  OK  ]


ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Starting NFS statd: [  OK  ]


Starting system message bus: [  OK  ]


Setting NIS domain: domain is 'lola.whamcloud.com'  [  OK  ]


Starting NIS service: [  OK  ]


Binding NIS service: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
.[  OK  ]


Starting ibacm daemon:[  OK  ]


NFS filesystems queued to be mounted

Mounting filesystems:  RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Slow work thread pool: Starting up
Slow work thread pool: Ready
FS-Cache: Loaded
NFS: Registering the id_resolver key type
FS-Cache: Netfs 'nfs' registered for caching
[  OK  ]


Starting acpi daemon: [  OK  ]


Starting HAL daemon: [  OK  ]


Retrigger failed udev events[  OK  ]


Starting ZFS Event Daemon  [  OK  ]
[  OK  ]


Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Starting NFS services:  [  OK  ]


Starting NFS quotas: [  OK  ]


Starting NFS mountd: [  OK  ]


Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
[  OK  ]


Starting RPC idmapd: [  OK  ]


Sharing ZFS filesystems  [  OK  ]


Starting MUNGE: munged[  OK  ]


ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Starting kdump:[  OK  ]


Starting sshd: [  OK  ]


Starting xinetd: [  OK  ]


Starting ntpd: [  OK  ]


Starting GANGLIA gmond: [  OK  ]


Starting sendmail: [  OK  ]


Starting sm-client: [  OK  ]


Starting crond: [  OK  ]


starting slurmd: 802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
8021q: adding VLAN 0 to HW filter on device eth0
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
[  OK  ]


Starting atd: [  OK  ]


Starting collectl: [  OK  ]



CentOS release 6.7 (Final)
Kernel 2.6.32-573.26.1.el6_lustre.x86_64 on an x86_64

lola-10.lola.whamcloud.com login: Oct 19 10:55:01 lola-10 TIME: Time stamp for console
LDISKFS-fs warning (device dm-6): ldiskfs_multi_mount_protect: MMP interval 42 higher than expected, please wait.

LDISKFS-fs (dm-6): recovery complete
LDISKFS-fs (dm-6): mounted filesystem with ordered data mode. quota=on. Opts: 
Oct 19 11:00:01 lola-10 TIME: Time stamp for console
Oct 19 11:05:01 lola-10 TIME: Time stamp for console
Oct 19 11:10:01 lola-10 TIME: Time stamp for console
Oct 19 11:15:01 lola-10 TIME: Time stamp for console
LDISKFS-fs (dm-6): mounted filesystem with ordered data mode. quota=on. Opts: 
LustreError: 11-0: soaked-MDT0001-osp-MDT0002: operation mds_connect to node 192.168.1.109@o2ib10 failed: rc = -114
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476901029/real 1476901029]  req@ffff880403707380 x1548641289372320/t0(0) o8->soaked-OST0017-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476901034 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.108@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0000_UUID (at 192.168.1.102@o2ib10)
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.109@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: soaked-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0002_UUID (at 192.168.1.104@o2ib10)
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476901054/real 1476901054]  req@ffff8808366116c0 x1548641289373344/t0(0) o8->soaked-OST0016-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476901059 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 24 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0003_UUID (at 192.168.1.105@o2ib10)
Lustre: soaked-MDT0002: Will be in recovery for at least 5:00, or until 22 clients reconnect
Lustre: soaked-MDT0002: Connection restored to MGC192.168.1.108@o2ib10_1 (at 192.168.1.109@o2ib10)
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0005_UUID (at 192.168.1.107@o2ib10)
Lustre: Skipped 2 previous similar messages
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476901079/real 1476901079]  req@ffff880837d643c0 x1548641289373872/t0(0) o8->soaked-OST0017-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476901089 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 15 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0002_UUID (at 192.168.1.104@o2ib10)
Lustre: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0002_UUID (at 192.168.1.104@o2ib10)
Lustre: Skipped 5 previous similar messages
Lustre: soaked-MDT0002: Denying connection for new client c32ac4b6-85da-327f-24ce-7b2a5255c455(at 192.168.1.113@o2ib100), waiting for 22 known clients (3 recovered, 0 in progress, and 0 evicted) to recover in 3:08
Oct 19 11:20:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Denying connection for new client c32ac4b6-85da-327f-24ce-7b2a5255c455(at 192.168.1.113@o2ib100), waiting for 22 known clients (3 recovered, 0 in progress, and 0 evicted) to recover in 2:43
Lustre: soaked-MDT0002: Denying connection for new client c32ac4b6-85da-327f-24ce-7b2a5255c455(at 192.168.1.113@o2ib100), waiting for 22 known clients (3 recovered, 0 in progress, and 0 evicted) to recover in 2:18
Lustre: soaked-MDT0002: Denying connection for new client c32ac4b6-85da-327f-24ce-7b2a5255c455(at 192.168.1.113@o2ib100), waiting for 22 known clients (3 recovered, 0 in progress, and 0 evicted) to recover in 1:53
Lustre: soaked-MDT0002: Denying connection for new client c32ac4b6-85da-327f-24ce-7b2a5255c455(at 192.168.1.113@o2ib100), waiting for 22 known clients (3 recovered, 0 in progress, and 0 evicted) to recover in 1:28
Lustre: soaked-MDT0002: Denying connection for new client c32ac4b6-85da-327f-24ce-7b2a5255c455(at 192.168.1.113@o2ib100), waiting for 22 known clients (3 recovered, 0 in progress, and 0 evicted) to recover in 1:03
Lustre: soaked-MDT0000-osp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Lustre: Skipped 9 previous similar messages
Lustre: soaked-MDT0002: Denying connection for new client c32ac4b6-85da-327f-24ce-7b2a5255c455(at 192.168.1.113@o2ib100), waiting for 22 known clients (3 recovered, 0 in progress, and 0 evicted) to recover in 0:38
Lustre: soaked-MDT0002: Denying connection for new client 4ef7dc7a-7144-0a99-211e-7322009418d7(at 192.168.1.131@o2ib100), waiting for 22 known clients (3 recovered, 0 in progress, and 0 evicted) to recover in 0:05
Lustre: Skipped 14 previous similar messages
Lustre: soaked-MDT0002: recovery is timed out, evict stale exports
Lustre: soaked-MDT0002: disconnecting 19 stale clients
Lustre: soaked-MDT0002: Recovery over after 5:00, of 22 clients 3 recovered and 19 were evicted.
Lustre: soaked-OST0013-osc-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: Skipped 39 previous similar messages
Oct 19 11:25:01 lola-10 TIME: Time stamp for console
Oct 19 11:30:01 lola-10 TIME: Time stamp for console
Oct 19 11:35:01 lola-10 TIME: Time stamp for console
Oct 19 11:40:01 lola-10 TIME: Time stamp for console
Oct 19 11:45:01 lola-10 TIME: Time stamp for console
Oct 19 11:50:01 lola-10 TIME: Time stamp for console
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               Version 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.                                                                                                                                                                          MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           LSI Corporation MPT SAS2 BIOS                                                   Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                 Initializing../                                                                 Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                                                                                                 Press Ctrl-C to start LSI Corp Configuration Utility...                         Searching for devices at HBA 0...                                               LSI Corporation MPT SAS2 BIOS                                                   MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                            PCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    SLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    ---- ---- --- -------- ---------------- ----------- ----------                    3           LSI      SAS2308-IT       15.00.00.00  0F:00:00:03                  3    4   7  LSI      Universal Xport  0786         20.00 MiB                    3    4   41  LSI      INF-01-00        0786         14.55 TiB                   3    4   42  LSI      INF-01-00        0786         14.55 TiB                   3    4   43  LSI      INF-01-00        0786         14.55 TiB                   3    4   44  LSI      INF-01-00        0786         14.55 TiB                   3    4   45  LSI      INF-01-00        0786         14.55 TiB                   3    4   46  LSI      INF-01-00        0786         14.55 TiB                   3    0   7  LSI      Universal Xport  0786         20.00 MiB                    3    0   41  LSI      INF-01-00        0786         14.55 TiB                   3    0   42  LSI      INF-01-00        0786         14.55 TiB                   3    0   43  LSI      INF-01-00        0786         14.55 TiB                   3    0   44  LSI      INF-01-00        0786         14.55 TiB                   3    0   45  LSI      INF-01-00        0786         14.55 TiB                   3    0   46  LSI      INF-01-00        0786         14.55 TiB                 Copyright 2000-2012 LSI Corporation.                                                                                                                              RAID Volumes:                                                                   None defined.                                                                   Physical Devices:                                                             �  ID   Device Model     Serial #                     Size Type/Status(Vol ID)     0    ST500NM0011      Z1M0X1F9                  465.7GB Non-RAID Disk           1    ST500NM0011      Z1M0X1GG                  465.7GB Non-RAID Disk         Press <CTRL-I> to enter Configuration Utility..                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Copyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   Press <CTRL-I> to enter Configuration Utility...                                                                                                                PXE 2.1 Build 091 (WfM 2.0)                                                     Press Ctrl+S to enter the Setup Menu.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                          Bios Version: SE5C600.86B.01.08.0003.022620131521                               BMC Firmware Version: 1.17.4207                                                 SDR Version: SDR Package 1.09                                                   ME Firmware Version: 2.1.7.112                                                  Platform ID: S2600GZ                                                            System memory detected: 32768 MB                                                Current memory speed: 1333 MT/s                                                 Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        Number of physical processors identified: 2                                     ********************************************************************************AHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          SAS/SATA Capable Controller configured with 4 ports in SATA mode                ********************************************************************************USB Keyboard detected                                                           USB Mouse detected                                                                                                                                              Press <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                                     
Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

    GNU GRUB  version 0.97  (571K lower / 3066652K upper memory)

+-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+
      Use the ^ and v keys to select which entry is highlighted.
      Press enter to boot the selected OS, 'e' to edit the
      commands before booting, 'a' to modify the kernel arguments
      before booting, or 'c' for a command-line.  CentOS (2.6.32-573.26.1.el6_lustre.x86_64)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  The highlighted entry will be booted automatically in 5 seconds.    The highlighted entry will be booted automatically in 4 seconds.    The highlighted entry will be booted automatically in 3 seconds.    The highlighted entry will be booted automatically in 2 seconds.    The highlighted entry will be booted automatically in 1 seconds.    Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-573.26.1.el6_lustre.x86_64 (soakbuilder@lola-16.lola.whamcloud.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-16) (GCC) ) #1 SMP Mon Oct 17 13:07:39 PDT 2016
Command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=auto SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000008ec00 (usable)
 BIOS-e820: 000000000008ec00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bb3c7000 (usable)
 BIOS-e820: 00000000bb3c7000 - 00000000bdd2f000 (reserved)
 BIOS-e820: 00000000bdd2f000 - 00000000bddcd000 (ACPI NVS)
 BIOS-e820: 00000000bddcd000 - 00000000bdea1000 (ACPI data)
 BIOS-e820: 00000000bdea1000 - 00000000bdf2f000 (ACPI NVS)
 BIOS-e820: 00000000bdf2f000 - 00000000bdfac000 (ACPI data)
 BIOS-e820: 00000000bdfac000 - 00000000be000000 (usable)
 BIOS-e820: 00000000be000000 - 00000000d0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
 BIOS-e820: 00000000fed19000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ffa20000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000840000000 (usable)
DMI 2.6 present.
SMBIOS version 2.6 @ 0xF0440
No AGP bridge found
last_pfn = 0x840000 max_arch_pfn = 0x400000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xbe000 max_arch_pfn = 0x400000000
Using GB pages for direct mapping
init_memory_mapping: 0000000000000000-00000000be000000
init_memory_mapping: 0000000100000000-0000000840000000
RAMDISK: 3601e000 - 37fef30d
ACPI: Deleted _OSI()
ACPI: Deleted _OSI()
ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20090903/tbfadt-611)
ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
ACPI: FACS 00000000bdfa9f40 00040
ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
Setting APIC routing to flat.
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: PXM 0 -> APIC 2 -> Node 0
SRAT: PXM 0 -> APIC 3 -> Node 0
SRAT: PXM 0 -> APIC 4 -> Node 0
SRAT: PXM 0 -> APIC 5 -> Node 0
SRAT: PXM 0 -> APIC 6 -> Node 0
SRAT: PXM 0 -> APIC 7 -> Node 0
SRAT: PXM 0 -> APIC 8 -> Node 0
SRAT: PXM 0 -> APIC 9 -> Node 0
SRAT: PXM 0 -> APIC 10 -> Node 0
SRAT: PXM 0 -> APIC 11 -> Node 0
SRAT: PXM 0 -> APIC 12 -> Node 0
SRAT: PXM 0 -> APIC 13 -> Node 0
SRAT: PXM 0 -> APIC 14 -> Node 0
SRAT: PXM 0 -> APIC 15 -> Node 0
SRAT: PXM 1 -> APIC 32 -> Node 1
SRAT: PXM 1 -> APIC 33 -> Node 1
SRAT: PXM 1 -> APIC 34 -> Node 1
SRAT: PXM 1 -> APIC 35 -> Node 1
SRAT: PXM 1 -> APIC 36 -> Node 1
SRAT: PXM 1 -> APIC 37 -> Node 1
SRAT: PXM 1 -> APIC 38 -> Node 1
SRAT: PXM 1 -> APIC 39 -> Node 1
SRAT: PXM 1 -> APIC 40 -> Node 1
SRAT: PXM 1 -> APIC 41 -> Node 1
SRAT: PXM 1 -> APIC 42 -> Node 1
SRAT: PXM 1 -> APIC 43 -> Node 1
SRAT: PXM 1 -> APIC 44 -> Node 1
SRAT: PXM 1 -> APIC 45 -> Node 1
SRAT: PXM 1 -> APIC 46 -> Node 1
SRAT: PXM 1 -> APIC 47 -> Node 1
SRAT: Node 0 PXM 0 0-c0000000
SRAT: Node 0 PXM 0 100000000-440000000
SRAT: Node 1 PXM 1 440000000-840000000
Bootmem setup node 0 0000000000000000-0000000440000000
  NODE_DATA [0000000000009000 - 000000000003cfff]
  bootmap [0000000000100000 -  0000000000187fff] pages 88
(8 early reservations) ==> bootmem [0000000000 - 0440000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS ==> [0001000000 - 000203eb64]
  #3 [003601e000 - 0037fef30d]          RAMDISK ==> [003601e000 - 0037fef30d]
  #4 [000008ec00 - 0000100000]    BIOS reserved ==> [000008ec00 - 0000100000]
  #5 [000203f000 - 000203f9b8]              BRK ==> [000203f000 - 000203f9b8]
  #6 [0000008000 - 0000009000]          PGTABLE ==> [0000008000 - 0000009000]
  #7 [0000001000 - 0000001030]        ACPI SLIT ==> [0000001000 - 0000001030]
Bootmem setup node 1 0000000440000000-0000000840000000
  NODE_DATA [0000000440000040 - 000000044003403f]
  bootmap [0000000440035000 -  00000004400b4fff] pages 80
(8 early reservations) ==> bootmem [0440000000 - 0840000000]
  #0 [0000000000 - 0000001000]   BIOS data page
  #1 [0000006000 - 0000008000]       TRAMPOLINE
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS
  #3 [003601e000 - 0037fef30d]          RAMDISK
  #4 [000008ec00 - 0000100000]    BIOS reserved
  #5 [000203f000 - 000203f9b8]              BRK
  #6 [0000008000 - 0000009000]          PGTABLE
  #7 [0000001000 - 0000001030]        ACPI SLIT
found SMP MP-table at [ffff8800000fcd70] fcd70
Reserving 131MB of memory at 48MB for crashkernel (System RAM: 33792MB)
Zone PFN ranges:
  DMA      0x00000001 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   0x00100000 -> 0x00840000
Movable zone start PFN for each node
early_node_map[5] active PFN ranges
    0: 0x00000001 -> 0x0000008e
    0: 0x00000100 -> 0x000bb3c7
    0: 0x000bdfac -> 0x000be000
    0: 0x00100000 -> 0x00440000
    1: 0x00440000 -> 0x00840000
ACPI: PM-Timer IO Port: 0x408
Setting APIC routing to flat.
ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a701 base: 0xfed00000
SMP: Allowing 240 CPUs, 208 hotplug CPUs
PM: Registered nosave memory: 000000000008e000 - 000000000008f000
PM: Registered nosave memory: 000000000008f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
PM: Registered nosave memory: 00000000bb3c7000 - 00000000bdd2f000
PM: Registered nosave memory: 00000000bdd2f000 - 00000000bddcd000
PM: Registered nosave memory: 00000000bddcd000 - 00000000bdea1000
PM: Registered nosave memory: 00000000bdea1000 - 00000000bdf2f000
PM: Registered nosave memory: 00000000bdf2f000 - 00000000bdfac000
PM: Registered nosave memory: 00000000be000000 - 00000000d0000000
PM: Registered nosave memory: 00000000d0000000 - 00000000fec00000
PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
PM: Registered nosave memory: 00000000fec01000 - 00000000fed19000
PM: Registered nosave memory: 00000000fed19000 - 00000000fed1a000
PM: Registered nosave memory: 00000000fed1a000 - 00000000fed1c000
PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
PM: Registered nosave memory: 00000000fed20000 - 00000000fee00000
PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
PM: Registered nosave memory: 00000000fee01000 - 00000000ffa20000
PM: Registered nosave memory: 00000000ffa20000 - 0000000100000000
Allocating PCI resources starting at d0000000 (gap: d0000000:2ec00000)
Booting paravirtualized kernel on bare hardware
NR_CPUS:4096 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
PERCPU: Embedded 30 pages/cpu @ffff880038600000 s91288 r8192 d23400 u131072
pcpu-alloc: s91288 r8192 d23400 u131072 alloc=1*2097152
pcpu-alloc: [0] 000 001 002 003 004 005 006 007 016 017 018 019 020 021 022 023 
pcpu-alloc: [0] 032 034 036 038 040 042 044 046 048 050 052 054 056 058 060 062 
pcpu-alloc: [0] 064 066 068 070 072 074 076 078 080 082 084 086 088 090 092 094 
pcpu-alloc: [0] 096 098 100 102 104 106 108 110 112 114 116 118 120 122 124 126 
pcpu-alloc: [0] 128 130 132 134 136 138 140 142 144 146 148 150 152 154 156 158 
pcpu-alloc: [0] 160 162 164 166 168 170 172 174 176 178 180 182 184 186 188 190 
pcpu-alloc: [0] 192 194 196 198 200 202 204 206 208 210 212 214 216 218 220 222 
pcpu-alloc: [0] 224 226 228 230 232 234 236 238 --- --- --- --- --- --- --- --- 
pcpu-alloc: [1] 008 009 010 011 012 013 014 015 024 025 026 027 028 029 030 031 
pcpu-alloc: [1] 033 035 037 039 041 043 045 047 049 051 053 055 057 059 061 063 
pcpu-alloc: [1] 065 067 069 071 073 075 077 079 081 083 085 087 089 091 093 095 
pcpu-alloc: [1] 097 099 101 103 105 107 109 111 113 115 117 119 121 123 125 127 
pcpu-alloc: [1] 129 131 133 135 137 139 141 143 145 147 149 151 153 155 157 159 
pcpu-alloc: [1] 161 163 165 167 169 171 173 175 177 179 181 183 185 187 189 191 
pcpu-alloc: [1] 193 195 197 199 201 203 205 207 209 211 213 215 217 219 221 223 
pcpu-alloc: [1] 225 227 229 231 233 235 237 239 --- --- --- --- --- --- --- --- 
Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8250675
Policy zone: Normal
Kernel command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=131M@0M SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
PID hash table entries: 4096 (order: 3, 32768 bytes)
xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
Checking aperture...
No AGP bridge found
Memory: 32738448k/34603008k available (5400k kernel code, 1126752k absent, 737808k reserved, 7008k data, 1304k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:3144
Extended CMOS year: 2000
Console: colour VGA+ 80x25
console [ttyS0] enabled
allocated 134217728 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
TSC: cpu family 6 model 45, tsc initial value = 7659ea0855
Fast TSC calibration using PIT
Detected 2693.389 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.77 BogoMIPS (lpj=2693389)
pid_max: default: 245760 minimum: 1920
Security Framework initialized
SELinux:  Initializing.
Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 20 MCE banks
CPU0: Thermal monitoring enabled (TM1)
using mwait in idle threads.
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 22144 entries in 87 pages
x2apic not enabled, IRQ remapping init failed
APIC routing finalized to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz stepping 07
Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
... version:                3
... bit width:              48
... generic registers:      4
... value mask:             0000ffffffffffff
... max period:             0000ffffffffffff
... fixed-purpose events:   3
... event mask:             000000070000000f
NMI watchdog enabled, takes one hw-pmu counter.
Booting Node   0, Processors  #1 #2 #3 #4 #5 #6 #7 Ok.
Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 Ok.
Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 Ok.
Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
Brought up 32 CPUs
Total of 32 processors activated (172368.92 BogoMIPS).
devtmpfs: initialized
PM: Registering ACPI NVS region at bdd2f000 (647168 bytes)
PM: Registering ACPI NVS region at bdea1000 (581632 bytes)
regulator: core version 0.5
NET: Registered protocol family 16
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MCFG configuration 0: base c0000000 segment 0 buses 0 - 255
PCI: MCFG area at c0000000 reserved in E820
PCI: Using MMCONFIG at c0000000 - cfffffff
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: Executed 1 blocks of module-level executable AML code
ACPI: BIOS _OSI(Linux) query ignored
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
HEST: Table parsing has been initialized.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
pci_root PNP0A08:00: host bridge window [io  0x0000-0xbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:00: host bridge window [mem 0x000c0000-0x000c3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c4000-0x000c7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c8000-0x000cbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000cc000-0x000cffff]
pci_root PNP0A08:00: host bridge window [mem 0x000d0000-0x000d3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d4000-0x000d7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d8000-0x000dbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000dc000-0x000dffff]
pci_root PNP0A08:00: host bridge window [mem 0x000e0000-0x000e3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e4000-0x000e7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e8000-0x000ebfff]
pci_root PNP0A08:00: host bridge window [mem 0x000ec000-0x000effff]
pci_root PNP0A08:00: host bridge window [mem 0x000f0000-0x000fffff]
pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xebffffff]
pci_root PNP0A08:00: host bridge window [mem 0x380000000000-0x38007fffffff]
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdfff])
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff]
pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff]
pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff]
pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff]
pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff]
pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff]
pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff]
pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff]
pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff]
pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff]
pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff]
pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff]
pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff]
pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
pci 0000:00:00.0: PME# disabled
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
pci 0000:00:01.1: PME# disabled
pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
pci 0000:00:02.0: PME# disabled
pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
pci 0000:00:02.2: PME# disabled
pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
pci 0000:00:03.0: PME# disabled
pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
pci 0000:00:11.0: PME# disabled
pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.0: PME# disabled
pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
pci 0000:00:16.1: PME# disabled
pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.7: PME# disabled
pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.0: PME# disabled
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:00.0: PME# disabled
pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
pci 0000:02:00.1: PME# disabled
pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
pci 0000:02:00.2: PME# disabled
pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
pci 0000:02:00.3: PME# disabled
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:07:00.3: PME# supported from D0 D3hot D3cold
pci 0000:07:00.3: PME# disabled
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a] (subtractive decode)
 pci0000:00: Requesting ACPI _OSC control (0x1d)
 pci0000:00: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
pci_root PNP0A08:01: host bridge window [io  0x03b0-0x03df]
pci_root PNP0A08:01: host bridge window [io  0xc000-0xffff]
pci_root PNP0A08:01: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:01: host bridge window [mem 0xec000000-0xfbffffff]
pci_root PNP0A08:01: host bridge window [mem 0x380080000000-0x3800ffffffff]
PCI host bridge to bus 0000:80
pci_bus 0000:80: root bus resource [io  0x03b0-0x03df]
pci_bus 0000:80: root bus resource [io  0xc000-0xffff]
pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff]
pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff]
pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
pci 0000:80:01.0: PME# disabled
pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
pci 0000:80:02.0: PME# disabled
pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
pci 0000:80:03.0: PME# disabled
pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
pci 0000:80:03.2: PME# disabled
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
 pci0000:80: Requesting ACPI _OSC control (0x1d)
 pci0000:80: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
PCI host bridge to bus 0000:7f
 pci0000:7f: Requesting ACPI _OSC control (0x1d)
 pci0000:7f: ACPI _OSC control (0x10) granted
ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
PCI host bridge to bus 0000:ff
 pci0000:ff: Requesting ACPI _OSC control (0x1d)
 pci0000:ff: ACPI _OSC control (0x10) granted
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:09:00.0
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
HPET: 8 timers in total, 5 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 72, 73, 74, 75, 76, 0
hpet0: 8 comparators, 64-bit 14.318180 MHz counter
Switching to clocksource hpet
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 15 devices
ACPI: ACPI bus type pnp unregistered
system 00:05: [io  0x0680-0x069f] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0x0400-0x0453] has been reserved
system 00:05: [io  0x0458-0x047f] has been reserved
system 00:05: [io  0x0500-0x057f] has been reserved
system 00:05: [io  0x0600-0x061f] has been reserved
system 00:05: [io  0x0ca2-0x0ca5] has been reserved
system 00:05: [io  0x0cf9] could not be reserved
system 00:07: [io  0x0454-0x0457] has been reserved
system 00:0a: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:0a: [mem 0xebfff000-0xebffffff] has been reserved
system 00:0a: [mem 0xc0000000-0xcfffffff] has been reserved
system 00:0a: [mem 0xfed20000-0xfed3ffff] has been reserved
system 00:0a: [mem 0xfed45000-0xfed8ffff] has been reserved
system 00:0a: [mem 0xff000000-0xffffffff] could not be reserved
system 00:0a: [mem 0xfee00000-0xfeefffff] could not be reserved
system 00:0a: [mem 0xfec00000-0xfecfffff] could not be reserved
system 00:0a: [mem 0xd0f70000-0xd0f70fff] has been reserved
system 00:0c: [mem 0x00000000-0x0009cfff] could not be reserved
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
pci 0000:00:02.0:   bridge window [mem 0xeb000000-0xeb7fffff 64bit pref]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
pci 0000:00:11.0:   bridge window [mem 0xeb800000-0xebcfffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a]
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
pci 0000:00:01.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:01.1: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.2: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:03.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:11.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
pci 0000:80:01.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:02.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.2: PCI INT A -> GSI 71 (level, low) -> IRQ 71
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1a.0: PCI INT B disabled
pci 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1d.0: PCI I�NT A disabled
e as initramfs...
Freeing initrd memory: 32580k freed
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
futex hash table entries: 65536 (order: 10, 4194304 bytes)
audit: initializing netlink socket (disabled)
type=2000 audit(1476903434.101:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 32768
ksign: Installing public key data
Loading keyring
- Added public key 3B396075E393847B
- User ID: Red Hat, Inc. (Kernel Module GPG key)
- Added public key D4A26C9CCD09BEDA
- User ID: Red Hat Enterprise Linux Driver Update Program <secalert@redhat.com>
- Added public key CB445E0DA3EA1F65
- User ID: Red Hat Enterprise Linux Driver Update Program (key 4) <secalert@redhat.com>
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
acpiphp: Slot [2] registered
acpiphp: Slot [2-1] registered
acpiphp: Slot [2-2] registered
acpiphp: Slot [2-3] registered
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
[Firmware Bug]: No valid trip found
ERST: Error Record Serialization Table (ERST) support is initialized.
GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
�serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input1
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
ehci_hcd 0000:00:1a.0: EHCI Host Controller
ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.0: debug port 2
ehci_hcd 0000:00:1a.0: irq 22, io mem 0xd0f20000
ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb1: SerialNumber: 0000:00:1a.0
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
ehci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
ehci_hcd 0000:00:1d.0: EHCI Host Controller
ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
ehci_hcd 0000:00:1d.0: debug port 2
ehci_hcd 0000:00:1d.0: irq 20, io mem 0xd0f10000
Refined TSC clocksource calibration: 2693.509 MHz.
Switching to clocksource tsc
ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: EHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
PNP: No PS/2 controller found. Probing ports directly.
mice: PS/2 mouse device common for all mice
rtc_cmos 00:06: RTC can wake from S4
rtc_cmos 00:06: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
cpuidle: using governor ladder
cpuidle: using governor menu
EFI Variables Facility v0.08 2004-May-17
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
GRE over IPv4 demultiplexor driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
rtc_cmos 00:06: setting system clock to 2016-10-19 18:57:19 UTC (1476903439)
Initalizing network drop monitor service
Freeing unused kernel memory: 1304k freed
Write protecting the kernel read-only data: 10240k
Freeing unused kernel memory: 724k freed
Freeing unused kernel memory: 1572k freed
rdac: device handler registered
dracut: dracut-004-388.el6
dracut: rd_NO_LUKS: removing cryptoluks activation
dracut: rd_NO_LVM: removing LVM activation
usb 1-1: new high speed USB device number 2 using ehci_hcd
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: dm-devel@redhat.com
udev: starting version 147
usb 1-1: New USB device found, idVendor=8087, idProduct=0024
usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 1-1: configuration #1 chosen from 1 choice
hub 1-1:1.0: USB hub found
hub 1-1:1.0: 6 ports detected
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
usb 2-1: new high speed USB device number 2 using ehci_hcd
mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)
mlx4_core: Initializing 0000:04:00.0
mlx4_core 0000:04:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
usb 2-1: New USB device found, idVendor=8087, idProduct=0024
usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 2-1: configuration #1 chosen from 1 choice
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 8 ports detected
usb 2-1.4: new full speed USB device number 3 using ehci_hcd
usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.4: Product: Virtual Keyboard and Mouse
usb 2-1.4: Manufacturer: American Megatrends Inc.
usb 2-1.4: SerialNumber: serial
usb 2-1.4: configuration #1 chosen from 1 choice
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input2
generic-usb 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input3
generic-usb 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)
mlx4_en 0000:04:00.0: registered PHC clock
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
<mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014)
mpt2sas version 20.101.00.00 loaded
mpt2sas 0000:06:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32774632 kB)
mpt2sas0: MSI-X vectors supported: 8, no of cores: 32, max_msix_vectors: 8
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 127
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 128
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 129
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 130
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 131
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 132
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 133
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 134
mpt2sas0: iomem(0x00000000d0a40000), mapped(0xffffc900147c0000), size(65536)
mpt2sas0: ioport(0x0000000000002000), size(256)
mpt2sas0: sending message unit reset !!
mpt2sas0: message unit reset: SUCCESS
mpt2sas0: Allocated physical memory: size(17329 kB)
mpt2sas0: Current Controller Queue Depth(9979), Max Controller Queue Depth(10240)
mpt2sas0: Scatter Gather Elements per IO(128)
mpt2sas0: LSISAS2308: FWVersion(15.00.00.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
mpt2sas0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi0 : Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas0: host_add: handle(0x0001), sas_addr(0x500605b005d6d910), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:41: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:42: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:43: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:44: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:45: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:46: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:41: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:42: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:43: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:44: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:45: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:46: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:0:41: rdac: LUN 41 (RDAC) (owned)
scsi 0:0:0:42: rdac: LUN 42 (RDAC) (unowned)
scsi 0:0:0:43: rdac: LUN 43 (RDAC) (owned)
scsi 0:0:0:44: rdac: LUN 44 (RDAC) (unowned)
scsi 0:0:0:45: rdac: LUN 45 (RDAC) (owned)
scsi 0:0:0:46: rdac: LUN 46 (RDAC) (unowned)
scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:1:41: rdac: LUN 41 (RDAC) (unowned)
scsi 0:0:1:42: rdac: LUN 42 (RDAC) (owned)
scsi 0:0:1:43: rdac: LUN 43 (RDAC) (unowned)
scsi 0:0:1:44: rdac: LUN 44 (RDAC) (owned)
scsi 0:0:1:45: rdac: LUN 45 (RDAC) (unowned)
scsi 0:0:1:46: rdac: LUN 46 (RDAC) (owned)
ACPI: WMI: Mapper loaded
isci: Intel(R) C600 SAS Controller Driver - version 1.1.0-rh
isci 0000:07:00.0: driver configured for rev: 6 silicon
isci 0000:07:00.0: OEM parameter table found in OROM
isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
isci 0000:07:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
scsi1 : isci
ata1.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata1.00: configured for UDMA/133
scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ata2.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata2.00: configured for UDMA/133
scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ahci 0000:00:1f.2: PCI INT B -> GSI 21 (level, low) -> IRQ 21
ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
scsi2 : ahci
scsi3 : ahci
scsi4 : ahci
scsi5 : ahci
scsi6 : ahci
scsi7 : ahci
ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 137
ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 137
ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 137
ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 137
ata7: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 137
ata8: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 137
ata3: SATA link down (SStatus 0 SControl 300)
ata4: SATA link down (SStatus 0 SControl 300)
ata5: SATA link down (SStatus 0 SControl 300)
ata6: SATA link down (SStatus 0 SControl 300)
ata7: SATA link down (SStatus 0 SControl 300)
ata8: SATA link down (SStatus 0 SControl 300)
%Gsd 0:0:0:7: [sda] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:0:41: [sdb] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:42: [sdc] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:43: [sdd] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:41: [sdb] Write Protect is off
sd 0:0:0:44: [sde] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:42: [sdc] Write Protect is off
sd 0:0:0:41: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:43: [sdd] Write Protect is off
sd 0:0:0:42: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] Write Protect is off
sd 0:0:0:43: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:44: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:0:45: [sdf] Write Protect is off
sd 0:0:1:42: [sdj] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:41: [sdi] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] Write Protect is off
sd 0:0:1:43: [sdk] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:46: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:44: [sdl] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:45: [sdm] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:7: [sdh] Write Protect is off
sd 0:0:1:42: [sdj] Write Protect is off
sd 1:0:0:0: [sdo] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 0:0:1:46: [sdn] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 1:0:0:0: [sdo] Write Protect is off
 sdc:
sd 1:0:0:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 0:0:1:41: [sdi] Write Protect is off
Dev sdc: unable to read RDB block 0
 unable to read partition table
sd 1:0:1:0: [sdp] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 0:0:1:42: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 1:0:1:0: [sdp] Write Protect is off
sd 1:0:1:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 0:0:1:41: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:44: [sdl] Write Protect is off
sd 0:0:1:44: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:46: [sdn] Write Protect is off
sd 0:0:1:46: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:43: [sdk] Write Protect is off
sd 0:0:1:43: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:45: [sdm] Write Protect is off
sd 0:0:1:45: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdb:
sd 0:0:0:42: [sdc] Attached SCSI disk
 sdd:
sd 0:0:0:7: [sda] Write Protect is off
sd 0:0:0:7: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
 unknown partition table
 sdo:
 sde:
 sdg:
 sdp:
sd 0:0:0:43: [sdd] Attached SCSI disk
 sdo1 sdo2
Dev sde: unable to read RDB block 0
Dev sdg: unable to read RDB block 0
 sdi:
 sdn:
sd 1:0:0:0: [sdo] Attached SCSI disk
 unable to read partition table
 sdl:
sd 0:0:0:46: [sdg] Attached SCSI disk
 sdm: unknown partition table
 unable to read partition table
 unknown partition table
sd 0:0:1:46: [sdn] Attached SCSI disk
sd 0:0:0:44: [sde] Attached SCSI disk
 sdk:Dev sdi: unable to read RDB block 0
sd 0:0:1:44: [sdl] Attached SCSI disk
 unable to read partition table
Dev sdm: unable to read RDB block 0
sd 0:0:1:41: [sdi] Attached SCSI disk
Dev sdk: unable to read RDB block 0
 unable to read partition table
 unable to read partition table
 unknown partition table
sd 0:0:1:45: [sdm] Attached SCSI disk
 sdf:
sd 0:0:1:43: [sdk] Attached SCSI disk
 unknown partition table
 sdh:
 sda:
 sdj:
sd 0:0:0:41: [sdb] Attached SCSI disk
 unknown partition table
sd 0:0:0:45: [sdf] Attached SCSI disk
 sdp1 sdp9
sd 1:0:1:0: [sdp] Attached SCSI disk
sd 0:0:1:42: [sdj] Attached SCSI disk
 unknown partition table
sd 0:0:1:7: [sdh] Attached SCSI disk
 unknown partition table
sd 0:0:0:7: [sda] Attached SCSI disk
EXT3-fs (sdo1): recovery required on readonly filesystem
EXT3-fs (sdo1): write access will be enabled during recovery
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sdo1): orphan cleanup on readonly fs
EXT3-fs (sdo1): 1 orphan inode deleted
EXT3-fs (sdo1): recovery complete
EXT3-fs (sdo1): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/sdo1
SELinux:  Disabled at runtime.
type=1404 audit(1476903456.050:2): selinux=0 auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
cat: /proc/self/attr/current: Invalid argument

		Welcome to CentOS 

Starting udev: udev: starting version 147
dca service started, version 1.12.1
igb: Intel(R) Gigabit Ethernet Network Driver - version 5.2.15-k
igb: Copyright (c) 2007-2014 Intel Corporation.
igb 0000:02:00.0: PCI INT A -> GSI 27 (level, low) -> IRQ 27
igb 0000:02:00.0: added PHC on eth0
igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b3
igb 0000:02:00.0: eth0: PBA No: 100000-000
igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.1: PCI INT B -> GSI 30 (level, low) -> IRQ 30
igb 0000:02:00.1: added PHC on eth1
igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b4
igb 0000:02:00.1: eth1: PBA No: 100000-000
igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.2: PCI INT C -> GSI 28 (level, low) -> IRQ 28
igb 0000:02:00.2: added PHC on eth2
igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b5
igb 0000:02:00.2: eth2: PBA No: 100000-000
igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.3: PCI INT D -> GSI 29 (level, low) -> IRQ 29
igb 0000:02:00.3: added PHC on eth3
igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b6
igb 0000:02:00.3: eth3: PBA No: 100000-000
igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
scsi 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:0:7: Attached scsi generic sg1 type 0
sd 0:0:0:41: Attached scsi generic sg2 type 0
sd 0:0:0:42: Attached scsi generic sg3 type 0
sd 0:0:0:43: Attached scsi generic sg4 type 0
sd 0:0:0:44: Attached scsi generic sg5 type 0
sd 0:0:0:45: Attached scsi generic sg6 type 0
sd 0:0:0:46: Attached scsi generic sg7 type 0
scsi 0:0:1:0: Attached scsi generic sg8 type 0
sd 0:0:1:7: Attached scsi generic sg9 type 0
sd 0:0:1:41: Attached scsi generic sg10 type 0
sd 0:0:1:42: Attached scsi generic sg11 type 0
sd 0:0:1:43: Attached scsi generic sg12 type 0
sd 0:0:1:44: Attached scsi generic sg13 type 0
sd 0:0:1:45: Attached scsi generic sg14 type 0
sd 0:0:1:46: Attached scsi generic sg15 type 0
sd 1:0:0:0: Attached scsi generic sg16 type 0
sd 1:0:1:0: Attached scsi generic sg17 type 0
ioatdma: Intel(R) QuickData Technology Driver 4.00
ioatdma 0000:00:04.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
igb 0000:02:00.0: DCA enabled
igb 0000:02:00.1: DCA enabled
ioatdma 0000:00:04.1: PCI INT B -> GSI 39 (level, low) -> IRQ 39
igb 0000:02:00.2: DCA enabled
igb 0000:02:00.3: DCA enabled
ioatdma 0000:00:04.2: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.3: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.4: PCI INT A -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.5: PCI INT B -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.6: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.7: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:80:04.0: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.1: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.2: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.3: PCI INT D -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.4: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.5: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.6: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.7: PCI INT D -> GSI 63 (level, low) -> IRQ 63
i801_smbus 0000:00:1f.3: PCI INT C -> GSI 23 (level, low) -> IRQ 23
ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
i801_smbus 0000:07:00.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
i801_smbus 0000:07:00.3: Enabling SMBus device
ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042f conflicts with OpRegion 0x0000000000000400-0x000000000000047f (\PMIO) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000053f (\FBPC) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000052f (\_SI_.SIOR) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
lpc_ich: Resource conflict(s) found affecting gpio_ich
EDAC MC: Ver: 2.1.0 Oct 17 2016
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0
EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0
EDAC sbridge: Driver loaded.
%Gzunicode: module license 'CDDL' taints kernel.
Disabling lock debugging due to kernel taint
SPL: Loaded module v0.6.5.7-1
ZFS: Loaded module v0.6.5.7-1, ZFS pool version 5000, ZFS filesystem version 5
iTCO_vendor_support: vendor-support=0
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.07rh
iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
microcode: CPU0 updated to revision 0x710, date = 2013-06-17 
microcode: CPU1 updated to revision 0x710, date = 2013-06-17 
microcode: CPU2 updated to revision 0x710, date = 2013-06-17 
microcode: CPU3 updated to revision 0x710, date = 2013-06-17 
microcode: CPU4 updated to revision 0x710, date = 2013-06-17 
microcode: CPU5 updated to revision 0x710, date = 2013-06-17 
microcode: CPU6 updated to revision 0x710, date = 2013-06-17 
microcode: CPU7 updated to revision 0x710, date = 2013-06-17 
microcode: CPU8 updated to revision 0x710, date = 2013-06-17 
microcode: CPU9 updated to revision 0x710, date = 2013-06-17 
microcode: CPU10 updated to revision 0x710, date = 2013-06-17 
microcode: CPU11 updated to revision 0x710, date = 2013-06-17 
microcode: CPU12 updated to revision 0x710, date = 2013-06-17 
microcode: CPU13 updated to revision 0x710, date = 2013-06-17 
microcode: CPU14 updated to revision 0x710, date = 2013-06-17 
microcode: CPU15 updated to revision 0x710, date = 2013-06-17 
microcode: CPU16 updated to revision 0x710, date = 2013-06-17 
microcode: CPU17 updated to revision 0x710, date = 2013-06-17 
microcode: CPU18 updated to revision 0x710, date = 2013-06-17 
microcode: CPU19 updated to revision 0x710, date = 2013-06-17 
microcode: CPU20 updated to revision 0x710, date = 2013-06-17 
microcode: CPU21 updated to revision 0x710, date = 2013-06-17 
microcode: CPU22 updated to revision 0x710, date = 2013-06-17 
microcode: CPU23 updated to revision 0x710, date = 2013-06-17 
microcode: CPU24 updated to revision 0x710, date = 2013-06-17 
microcode: CPU25 updated to revision 0x710, date = 2013-06-17 
microcode: CPU26 updated to revision 0x710, date = 2013-06-17 
microcode: CPU27 updated to revision 0x710, date = 2013-06-17 
microcode: CPU28 updated to revision 0x710, date = 2013-06-17 
microcode: CPU29 updated to revision 0x710, date = 2013-06-17 
microcode: CPU30 updated to revision 0x710, date = 2013-06-17 
microcode: CPU31 updated to revision 0x710, date = 2013-06-17 
[  OK  ]


Setting hostname lola-10.lola.whamcloud.com:  [  OK  ]


device-mapper: multipath: version 1.6.0 loaded
Oct 19 11:57:40 | ignoring extra data starting with 'udev_dir' on line 2 of /etc/multipath.conf

device-mapper: multipath round-robin: version 1.0.0 loaded
device-mapper: table: 253:6: multipath: error getting device
device-mapper: ioctl: error adding target to table
Add partition mappings:  [  OK  ]


ERROR: asr: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: hpt37x: reading /dev/sdm[Input/output error]

ERROR: hpt45x: reading /dev/sdm[Input/output error]

ERROR: isw: reading /dev/sdm[Input/output error]

ERROR: jmicron: reading /dev/sdm[Input/output error]

ERROR: lsi: reading /dev/sdm[Input/output error]

ERROR: nvidia: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: sil: reading /dev/sdm[Input/output error]

ERROR: via: reading /dev/sdm[Input/output error]

ERROR: asr: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: hpt37x: reading /dev/sdk[Input/output error]

ERROR: hpt45x: reading /dev/sdk[Input/output error]

ERROR: isw: reading /dev/sdk[Input/output error]

ERROR: jmicron: reading /dev/sdk[Input/output error]

ERROR: lsi: reading /dev/sdk[Input/output error]

ERROR: nvidia: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: sil: reading /dev/sdk[Input/output error]

ERROR: via: reading /dev/sdk[Input/output error]

ERROR: asr: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: hpt37x: reading /dev/sdi[Input/output error]

ERROR: hpt45x: reading /dev/sdi[Input/output error]

ERROR: isw: reading /dev/sdi[Input/output error]

ERROR: jmicron: reading /dev/sdi[Input/output error]

ERROR: lsi: reading /dev/sdi[Input/output error]

ERROR: nvidia: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: sil: reading /dev/sdi[Input/output error]

ERROR: via: reading /dev/sdi[Input/output error]

ERROR: asr: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: hpt37x: reading /dev/sdg[Input/output error]

ERROR: hpt45x: reading /dev/sdg[Input/output error]

ERROR: isw: reading /dev/sdg[Input/output error]

ERROR: jmicron: reading /dev/sdg[Input/output error]

ERROR: lsi: reading /dev/sdg[Input/output error]

ERROR: nvidia: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: sil: reading /dev/sdg[Input/output error]

ERROR: via: reading /dev/sdg[Input/output error]

ERROR: asr: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: hpt37x: reading /dev/sde[Input/output error]

ERROR: hpt45x: reading /dev/sde[Input/output error]

ERROR: isw: reading /dev/sde[Input/output error]

ERROR: jmicron: reading /dev/sde[Input/output error]

ERROR: lsi: reading /dev/sde[Input/output error]

ERROR: nvidia: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: sil: reading /dev/sde[Input/output error]

ERROR: via: reading /dev/sde[Input/output error]

ERROR: asr: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: hpt37x: reading /dev/sdc[Input/output error]

ERROR: hpt45x: reading /dev/sdc[Input/output error]

ERROR: isw: reading /dev/sdc[Input/output error]

ERROR: jmicron: reading /dev/sdc[Input/output error]

ERROR: lsi: reading /dev/sdc[Input/output error]

ERROR: nvidia: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: sil: reading /dev/sdc[Input/output error]

ERROR: via: reading /dev/sdc[Input/output error]

Setting up Logical Volume Management: [  OK  ]


Checking filesystems

Checking all file systems.

[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/sdo1 

/dev/sdo1: clean, 131822/1310720 files, 3481415/5242880 blocks

[  OK  ]


RemEXT3-fs (sdo1): ounting root filusing internal journal
esystem in read-write mode:  [  OK  ]


Mounting local filesystems:  [  OK  ]


Enabling local filesystem quotas:  [  OK  ]


Enabling /etc/fstab swaps:  Adding 16457724k swap on /dev/sdo2.  Priority:-1 extents:1 across:16457724k 
[  OK  ]


Entering non-interactive startup

Calling the system activity data collector (sadc)... 

Loading OpenIB kernel modules:[  OK  ]


Mounting ZFS filesystem(s)  [  OK  ]


ip6tables: No config file.[WARNING]


iptables: No config file.[WARNING]


Bringing up loopback interface:  [  OK  ]


Bringing up interface eth0:  ADDRCONF(NETDEV_UP): eth0: link is not ready
Determining if ip address 10.4.0.110 is already in use for device eth0...

igb 0000:02:00.0: eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  OK  ]


Bringing up interface ib0:  ADDRCONF(NETDEV_UP): ib0: link is not ready
ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
[  OK  ]


Bringing up interface ipmi:  Device ipmi does not seem to be present, delaying initialization.

[FAILED]


Starting auditd: type=1305 audit(1476903480.784:3): audit_pid=4479 old=0 auid=4294967295 ses=4294967295 res=1
[  OK  ]


Loading Lustre module stack...LNet: HW CPU cores: 32, npartitions: 2
alg: No test for adler32 (adler32-zlib)
alg: No test for crc32 (crc32-table)
alg: No test for crc32 (crc32-pclmul)
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
Lustre: Lustre: Build Version: 2.8.59_25_g401d7fc
LNetError: 3905:0:(o2iblnd_cb.c:2302:kiblnd_passive_connect()) Can't accept conn from 192.168.1.108@o2ib10 on NA (ib0:0:192.168.1.110): bad dst nid 192.168.1.110@o2ib10
LNet: Added LNI 192.168.1.110@o2ib10 [8/256/0/180]


Starting system logger: [  OK  ]


Enabling ondemand cpu frequency scaling: [  OK  ]


Starting irqbalance: [  OK  ]


Starting rpcbind: [  OK  ]


ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Starting NFS statd: [  OK  ]


Starting system message bus: [  OK  ]


Setting NIS domain: domain is 'lola.whamcloud.com'  [  OK  ]


Starting NIS service: [  OK  ]


Binding NIS service: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
.[  OK  ]


Starting ibacm daemon:[  OK  ]


NFS filesystems queued to be mounted

Mounting filesystems:  RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Slow work thread pool: Starting up
Slow work thread pool: Ready
FS-Cache: Loaded
NFS: Registering the id_resolver key type
FS-Cache: Netfs 'nfs' registered for caching
[  OK  ]


Starting acpi daemon: [  OK  ]


Starting HAL daemon: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
[  OK  ]


Retrigger failed udev events[  OK  ]


Starting ZFS Event Daemon  [  OK  ]
[  OK  ]


Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Starting NFS services:  [  OK  ]


Starting NFS quotas: [  OK  ]


Starting NFS mountd: [  OK  ]


Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
[  OK  ]


Starting RPC idmapd: [  OK  ]


Sharing ZFS filesystems  [  OK  ]


Starting MUNGE: munged[  OK  ]


Starting kdump:[  OK  ]


Starting sshd: [  OK  ]


Starting xinetd: [  OK  ]


Starting ntpd: [  OK  ]


Starting GANGLIA gmond: [  OK  ]


Starting sendmail: [  OK  ]


Starting sm-client: [  OK  ]


Starting crond: [  OK  ]


802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
8021q: adding VLAN 0 to HW filter on device eth0
starting slurmd: [  OK  ]


Starting atd: [  OK  ]


Starting collectl: [  OK  ]



CentOS release 6.7 (Final)
Kernel 2.6.32-573.26.1.el6_lustre.x86_64 on an x86_64

lola-10.lola.whamcloud.com login: LDISKFS-fs warning (device dm-1): ldiskfs_multi_mount_protect: MMP interval 42 higher than expected, please wait.

Oct 19 12:00:01 lola-10 TIME: Time stamp for console
LDISKFS-fs (dm-1): recovery complete
LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. quota=on. Opts: 
LustreError: 11-0: soaked-MDT0000-osp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -16
Lustre: soaked-MDT0002: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-450
Lustre: soaked-MDT0002: Will be in recovery for at least 2:30, or until 21 clients reconnect
Lustre: soaked-MDT0002: Connection restored to 1a9770ca-d51d-1ec7-9291-66c7a374ca9c (at 192.168.1.130@o2ib100)
Lustre: soaked-MDT0002: Connection restored to e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 521f1f5f-66d5-5c01-ed6a-0ed604037e7a (at 192.168.1.123@o2ib100)
Lustre: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 60ad7b22-6f4d-940e-dc0f-f9ffdfa423e5 (at 192.168.1.133@o2ib100)
Lustre: Skipped 7 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 9fd25548-7f50-ff16-780f-4ca6928531fe (at 192.168.1.116@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to MGC192.168.1.108@o2ib10_0 (at 192.168.1.108@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: Skipped 16 previous similar messages
Lustre: soaked-MDT0002: Recovery over after 1:30, of 21 clients 21 recovered and 0 were evicted.
sd 0:0:1:42: attempting task abort! scmd(ffff88040cc77cc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f a0 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88040cc77cc0)
sd 0:0:1:42: attempting task abort! scmd(ffff88040ccdd180)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f c8 00 00 80 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88040ccdd180)
Oct 19 12:05:01 lola-10 TIME: Time stamp for console
Oct 19 12:10:01 lola-10 TIME: Time stamp for console
Oct 19 12:15:01 lola-10 TIME: Time stamp for console
Oct 19 12:20:01 lola-10 TIME: Time stamp for console
Oct 19 12:25:01 lola-10 TIME: Time stamp for console
Oct 19 12:30:02 lola-10 TIME: Time stamp for console
Oct 19 12:35:01 lola-10 TIME: Time stamp for console
Oct 19 12:40:01 lola-10 TIME: Time stamp for console
Oct 19 12:45:01 lola-10 TIME: Time stamp for console
Oct 19 12:50:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 4ef7dc7a-7144-0a99-211e-7322009418d7 (at 192.168.1.131@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 4ef7dc7a-7144-0a99-211e-7322009418d7 (at 192.168.1.131@o2ib100)
Lustre: Skipped 9 previous similar messages
Oct 19 12:55:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100)
Lustre: soaked-MDT0002: Client d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100)
Lustre: soaked-MDT0002: Client d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100)
Lustre: soaked-MDT0002: Client d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100)
Oct 19 13:00:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 60ad7b22-6f4d-940e-dc0f-f9ffdfa423e5 (at 192.168.1.133@o2ib100) reconnecting
Lustre: soaked-MDT0002: Client c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Client d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100) reconnecting
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100)
Lustre: Skipped 1 previous similar message
Oct 19 13:05:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100)
Oct 19 13:10:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: Skipped 1 previous similar message
Oct 19 13:15:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 60ad7b22-6f4d-940e-dc0f-f9ffdfa423e5 (at 192.168.1.133@o2ib100) reconnecting
Lustre: Skipped 2 previous similar messages
Lustre: 6061:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476908305/real 1476908305]  req@ffff88078e1256c0 x1548646097360208/t0(0) o104->soaked-MDT0002@192.168.1.126@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476908312 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-MDT0002: Connection restored to f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100)
Lustre: Skipped 6 previous similar messages
Oct 19 13:20:01 lola-10 TIME: Time stamp for console
Oct 19 13:25:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 8ffd2fb9-3d57-7767-a5b4-d8680336d61b (at 192.168.1.132@o2ib100) reconnecting
Lustre: Skipped 6 previous similar messages
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 6 previous similar messages
Oct 19 13:30:01 lola-10 TIME: Time stamp for console
Oct 19 13:35:01 lola-10 TIME: Time stamp for console
Oct 19 13:40:01 lola-10 TIME: Time stamp for console
Oct 19 13:45:01 lola-10 TIME: Time stamp for console
Oct 19 13:50:01 lola-10 TIME: Time stamp for console
Oct 19 13:55:01 lola-10 TIME: Time stamp for console
Oct 19 14:00:01 lola-10 TIME: Time stamp for console
Oct 19 14:05:01 lola-10 TIME: Time stamp for console
Oct 19 14:10:01 lola-10 TIME: Time stamp for console
Oct 19 14:15:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100) reconnecting
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Connection restored to c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100)
Oct 19 14:20:01 lola-10 TIME: Time stamp for console
Oct 19 14:25:01 lola-10 TIME: Time stamp for console
Oct 19 14:30:01 lola-10 TIME: Time stamp for console
Oct 19 14:35:01 lola-10 TIME: Time stamp for console
Oct 19 14:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 521f1f5f-66d5-5c01-ed6a-0ed604037e7a (at 192.168.1.123@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 521f1f5f-66d5-5c01-ed6a-0ed604037e7a (at 192.168.1.123@o2ib100)
Oct 19 14:45:01 lola-10 TIME: Time stamp for console
Oct 19 14:50:01 lola-10 TIME: Time stamp for console
Oct 19 14:55:01 lola-10 TIME: Time stamp for console
Oct 19 15:00:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9a80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0c d8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9a80)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9d80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 00 00 00 38 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9d80)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9980)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 40 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9980)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9880)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 60 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9880)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9480)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 80 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9480)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9080)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 90 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9080)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9180)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d a0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9180)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9280)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d a8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9280)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9580)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d b8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9580)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9680)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d d0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9680)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9b80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d e0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9b80)
sd 0:0:1:42: attempting task abort! scmd(ffff88078d9c9e80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d e8 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078d9c9e80)
sd 0:0:1:42: attempting task abort! scmd(ffff88081f6298c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 08 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88081f6298c0)
sd 0:0:1:42: attempting task abort! scmd(ffff88081f629ac0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 20 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88081f629ac0)
sd 0:0:1:42: attempting task abort! scmd(ffff88081f629ec0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 50 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88081f629ec0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ce07e0c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 68 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ce07e0c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807cd6a8880)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 88 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807cd6a8880)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ed7e82c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e a0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ed7e82c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f2e049c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e e8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f2e049c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807d9c43980)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 28 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807d9c43980)
sd 0:0:1:42: attempting task abort! scmd(ffff8807cd6a8d80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 58 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807cd6a8d80)
sd 0:0:1:42: attempting task abort! scmd(ffff8807cd6a8a80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 70 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807cd6a8a80)
sd 0:0:1:42: attempting task abort! scmd(ffff8807cd6a8180)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 90 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807cd6a8180)
sd 0:0:1:42: attempting task abort! scmd(ffff8807cd6a8280)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f a0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807cd6a8280)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ed7e84c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f b8 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ed7e84c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ed7e8dc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f d8 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ed7e8dc0)
Oct 19 15:05:01 lola-10 TIME: Time stamp for console
Oct 19 15:10:01 lola-10 TIME: Time stamp for console
Oct 19 15:15:01 lola-10 TIME: Time stamp for console
Oct 19 15:20:01 lola-10 TIME: Time stamp for console
Oct 19 15:25:01 lola-10 TIME: Time stamp for console
Lustre: 5963:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476916042/real 0]  req@ffff8807d2991380 x1548646197342944/t0(0) o1000->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 360/4320 e 0 to 1 dl 1476916054 ref 3 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476916054/real 0]  req@ffff8807cdeec6c0 x1548646197352912/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476916060 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.108@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.105@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 8 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.113@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.107@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.107@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 11 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476916104/real 0]  req@ffff8807d9f19c80 x1548646197356896/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476916115 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.126@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 4 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.108@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 2 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.126@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 36 previous similar messages
Oct 19 15:30:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476916204/real 0]  req@ffff8807cc9a9980 x1548646197364864/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476916220 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.130@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 48 previous similar messages
LNet: Service thread pid 6032 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6032, comm: mdt01_003

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa12414ef>] mdd_create+0x135f/0x1770 [mdd]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa1107e2c>] mdt_reint_create+0xbdc/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476916238.6032
LNet: Service thread pid 6060 was inactive for 201.82s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6060, comm: mdt00_007

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa12414ef>] mdd_create+0x135f/0x1770 [mdd]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa1107e2c>] mdt_reint_create+0xbdc/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff8106ee50>] ? pick_next_task_fair+0xd0/0x130
 [<ffffffff81539896>] ? schedule+0x176/0x3a0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 5932, comm: mdt01_000

Call Trace:
 [<ffffffffa09ce8f8>] ? at_measured+0x108/0x380 [ptlrpc]
 [<ffffffffa09c990b>] ? ptlrpc_pinger_commit_expected+0x1b/0x60 [ptlrpc]
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa0984126>] ldlm_cli_enqueue_fini+0x936/0xe30 [ptlrpc]
 [<ffffffffa09a46bb>] ? ptlrpc_set_destroy+0x26b/0x450 [ptlrpc]
 [<ffffffffa09884cd>] ldlm_cli_enqueue+0x3ad/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffffa11c71df>] lod_object_lock+0x14f/0x900 [lod]
 [<ffffffffa07bc83f>] ? lu_object_find_try+0x9f/0x260 [obdclass]
 [<ffffffffa06fff0d>] ? lnet_send+0x6fd/0xc20 [lnet]
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa10edd9a>] mdt_remote_object_lock+0x15a/0x4a0 [mdt]
 [<ffffffffa09b5905>] ? lustre_msg_buf+0x55/0x60 [ptlrpc]
 [<ffffffffa10ee24a>] mdt_object_lock_internal+0x16a/0x320 [mdt]
 [<ffffffffa10ee614>] mdt_object_lock+0x14/0x20 [mdt]
 [<ffffffffa110794a>] mdt_reint_create+0x6fa/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10f990f>] ? ucred_set_jobid+0x5f/0x70 [mdt]
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 6057, comm: mdt01_007

Call Trace:
 [<ffffffffa09ce8f8>] ? at_measured+0x108/0x380 [ptlrpc]
 [<ffffffffa09c990b>] ? ptlrpc_pinger_commit_expected+0x1b/0x60 [ptlrpc]
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa0984126>] ldlm_cli_enqueue_fini+0x936/0xe30 [ptlrpc]
 [<ffffffffa09a46bb>] ? ptlrpc_set_destroy+0x26b/0x450 [ptlrpc]
 [<ffffffffa09884cd>] ldlm_cli_enqueue+0x3ad/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffffa11c71df>] lod_object_lock+0x14f/0x900 [lod]
 [<ffffffffa07bc83f>] ? lu_object_find_try+0x9f/0x260 [obdclass]
 [<ffffffffa06fff0d>] ? lnet_send+0x6fd/0xc20 [lnet]
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa10edd9a>] mdt_remote_object_lock+0x15a/0x4a0 [mdt]
 [<ffffffffa09b5905>] ? lustre_msg_buf+0x55/0x60 [ptlrpc]
 [<ffffffffa10ee24a>] mdt_object_lock_internal+0x16a/0x320 [mdt]
 [<ffffffffa10ee614>] mdt_object_lock+0x14/0x20 [mdt]
 [<ffffffffa110794a>] mdt_reint_create+0x6fa/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10f990f>] ? ucred_set_jobid+0x5f/0x70 [mdt]
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff8106ee50>] ? pick_next_task_fair+0xd0/0x130
 [<ffffffff81539896>] ? schedule+0x176/0x3a0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 6105, comm: mdt01_021

Call Trace:
 [<ffffffffa09ce8f8>] ? at_measured+0x108/0x380 [ptlrpc]
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa0984126>] ldlm_cli_enqueue_fini+0x936/0xe30 [ptlrpc]
 [<ffffffffa09a46bb>] ? ptlrpc_set_destroy+0x26b/0x450 [ptlrpc]
 [<ffffffffa09884cd>] ldlm_cli_enqueue+0x3ad/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffffa11c71df>] lod_object_lock+0x14f/0x900 [lod]
 [<ffffffffa07bc83f>] ? lu_object_find_try+0x9f/0x260 [obdclass]
 [<ffffffff81291489>] ? cpumask_next_and+0x29/0x50
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa10edd9a>] mdt_remote_object_lock+0x15a/0x4a0 [mdt]
 [<ffffffffa09b5905>] ? lustre_msg_buf+0x55/0x60 [ptlrpc]
 [<ffffffffa10ee24a>] mdt_object_lock_internal+0x16a/0x320 [mdt]
 [<ffffffffa10ee614>] mdt_object_lock+0x14/0x20 [mdt]
 [<ffffffffa110794a>] mdt_reint_create+0x6fa/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10f990f>] ? ucred_set_jobid+0x5f/0x70 [mdt]
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LNet: Service thread pid 6063 was inactive for 202.65s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Lustre: soaked-MDT0002: haven't heard from client soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib10) in 229 seconds. I think it's dead, and I am evicting it. exp ffff88043517fc00, cur 1476916267 expire 1476916117 last 1476916038
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476916304/real 1476916304]  req@ffff8807ce0b5cc0 x1548646197372832/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476916325 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
LDISKFS-fs warning (device dm-3): ldiskfs_multi_mount_protect: MMP interval 42 higher than expected, please wait.

LustreError: 6063:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476916038, 300s ago), entering recovery for soaked-MDT0003_UUID@192.168.1.110@o2ib10 ns: soaked-MDT0003-osp-MDT0002 lock: ffff8803ef774dc0/0xceb65f69183a129 lrc: 4/0,1 mode: --/EX res: [0x2c00090b7:0x7e02:0x0].0x0 bits 0x2 rrc: 3 type: IBT flags: 0x1000001000000 nid: local remote: 0xd1f4b900a2e13aa6 expref: -99 pid: 6063 timeout: 0 lvb_type: 0
Lustre: soaked-MDT0000-osp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0000-osp-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
LustreError: 6063:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) Skipped 3 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476916363/real 1476916363]  req@ffff880806757380 x1548646197377584/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476916389 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.121@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 112 previous similar messages
LDISKFS-fs (dm-3): recovery complete
LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. quota=on. Opts: 
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-mdtlov_UUID (at 0@lo)
Lustre: soaked-MDT0003: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-450
Lustre: soaked-MDT0003: Will be in recovery for at least 2:30, or until 21 clients reconnect
Lustre: soaked-MDT0003: Connection restored to soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0003: Connection restored to c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100)
Lustre: Skipped 13 previous similar messages
Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0006_UUID (at 192.168.1.102@o2ib10)
Lustre: Skipped 12 previous similar messages
Lustre: soaked-MDT0003: Connection restored to 29d3cbaa-30a5-6daf-223a-2835f382279d (at 192.168.1.134@o2ib100)
Lustre: Skipped 14 previous similar messages
Lustre: soaked-MDT0003: Recovery over after 0:41, of 21 clients 21 recovered and 0 were evicted.
LNet: Service thread pid 6067 completed after 390.47s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 1 previous similar message
Lustre: Failing over soaked-MDT0003
LustreError: 11-0: soaked-MDT0003-osp-MDT0002: operation out_update to node 0@lo failed: rc = -19
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
LustreError: Skipped 7 previous similar messages
Lustre: soaked-MDT0003: Not available for connect from 192.168.1.121@o2ib100 (stopping)
Lustre: Skipped 2 previous similar messages
LustreError: 4580:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff8807a45a39c0 x1548646197590496/t0(0) o13->soaked-OST000f-osc-MDT0003@192.168.1.105@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4580:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 1 previous similar message
LustreError: 4578:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff8807e43ee380 x1548646197590848/t0(0) o13->soaked-OST0006-osc-MDT0003@192.168.1.102@o2ib10:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 4578:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 19 previous similar messages
Lustre: soaked-MDT0003: Not available for connect from 192.168.1.103@o2ib10 (stopping)
Lustre: Skipped 2 previous similar messages
Lustre: server umount soaked-MDT0003 complete
Lustre: soaked-MDT0003-osp-MDT0002: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10)
Lustre: Skipped 2 previous similar messages
Oct 19 15:35:01 lola-10 TIME: Time stamp for console
Oct 19 15:40:01 lola-10 TIME: Time stamp for console
Oct 19 15:45:01 lola-10 TIME: Time stamp for console
Oct 19 15:50:01 lola-10 TIME: Time stamp for console
Oct 19 15:55:01 lola-10 TIME: Time stamp for console
Oct 19 16:00:01 lola-10 TIME: Time stamp for console
Oct 19 16:05:01 lola-10 TIME: Time stamp for console
Oct 19 16:10:01 lola-10 TIME: Time stamp for console
Oct 19 16:15:01 lola-10 TIME: Time stamp for console
Oct 19 16:20:01 lola-10 TIME: Time stamp for console
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476919362/real 0]  req@ffff8803ca144980 x1548646235071280/t0(0) o13->soaked-OST0001-osc-MDT0002@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476919369 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST0001-osc-MDT0002: Connection to soaked-OST0001 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0007-osc-MDT0002: Connection to soaked-OST0007 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4569:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476919365/real 0]  req@ffff8803f7468980 x1548646235071472/t0(0) o13->soaked-OST000d-osc-MDT0002@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476919372 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4569:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: soaked-OST000d-osc-MDT0002: Connection to soaked-OST000d (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476919370/real 0]  req@ffff880793184c80 x1548646235122704/t0(0) o8->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476919376 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476919422/real 0]  req@ffff8807a4dce680 x1548646236049552/t0(0) o8->soaked-OST000d-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476919433 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 2 previous similar messages
Oct 19 16:25:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476919497/real 0]  req@ffff8807d4505080 x1548646236704896/t0(0) o8->soaked-OST000d-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476919513 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476919572/real 0]  req@ffff8807d33159c0 x1548646237232336/t0(0) o8->soaked-OST0013-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476919593 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-lwp-OST0006_UUID (at 192.168.1.102@o2ib10)
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-lwp-OST0006_UUID (at 192.168.1.102@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476919647/real 1476919647]  req@ffff8807eeb27c80 x1548646237237632/t0(0) o8->soaked-OST0013-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476919673 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-OST0001-osc-MDT0002: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10)
Lustre: Skipped 1 previous similar message
LustreError: 11-0: soaked-OST0013-osc-MDT0002: operation ost_statfs to node 192.168.1.102@o2ib10 failed: rc = -107
Lustre: soaked-OST0013-osc-MDT0002: Connection to soaked-OST0013 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
LustreError: 11-0: soaked-OST0001-osc-MDT0002: operation ost_statfs to node 192.168.1.102@o2ib10 failed: rc = -107
Lustre: soaked-OST0001-osc-MDT0002: Connection to soaked-OST0001 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.103@o2ib10)
Lustre: Skipped 4 previous similar messages
LustreError: 11-0: soaked-OST0007-osc-MDT0002: operation ost_statfs to node 192.168.1.102@o2ib10 failed: rc = -107
Lustre: soaked-OST0007-osc-MDT0002: Connection to soaked-OST0007 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST000d-osc-MDT0002: operation ost_statfs to node 192.168.1.102@o2ib10 failed: rc = -107
Oct 19 16:30:01 lola-10 TIME: Time stamp for console
Oct 19 16:35:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff880404242080)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 28 fd e8 00 00 00 10 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880404242080)
sd 0:0:1:42: attempting task abort! scmd(ffff8803ec7a9480)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 28 fe 00 00 00 00 18 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803ec7a9480)
sd 0:0:1:42: attempting task abort! scmd(ffff8803ec999bc0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 28 fe 28 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803ec999bc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c15ada80)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 28 fe 40 00 00 00 18 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c15ada80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803f27731c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 28 fe 68 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803f27731c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803f76ebbc0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 28 fe 78 00 00 00 18 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803f76ebbc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803f7ae57c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 28 fe a0 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803f7ae57c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803ecbba8c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 28 fe b8 00 00 00 20 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803ecbba8c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803ec7a9d80)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 28 fe f0 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803ec7a9d80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803f76ad980)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 28 ff 08 00 00 00 10 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803f76ad980)
Oct 19 16:40:01 lola-10 TIME: Time stamp for console
Oct 19 16:45:01 lola-10 TIME: Time stamp for console
Oct 19 16:50:01 lola-10 TIME: Time stamp for console
Oct 19 16:55:01 lola-10 TIME: Time stamp for console
Oct 19 17:00:01 lola-10 TIME: Time stamp for console
Lustre: 4575:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476921714/real 0]  req@ffff8807fd5ae9c0 x1548646343603824/t0(0) o103->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:17/18 lens 328/224 e 0 to 1 dl 1476921726 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4575:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-MDT0001-osp-MDT0002: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476921776/real 0]  req@ffff8803f601bcc0 x1548646348065712/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476921787 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476921851/real 0]  req@ffff8803c397c6c0 x1548646349783136/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476921867 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Oct 19 17:05:01 lola-10 TIME: Time stamp for console
LNet: Service thread pid 6105 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
LNet: Skipped 3 previous similar messages
Pid: 6105, comm: mdt01_021

Call Trace:
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa098935e>] ldlm_cli_enqueue_local+0x21e/0x810 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e07a0>] ? mdt_blocking_ast+0x0/0x2e0 [mdt]
 [<ffffffffa10ed426>] mdt_object_local_lock+0x2e6/0xb00 [mdt]
 [<ffffffffa10e07a0>] ? mdt_blocking_ast+0x0/0x2e0 [mdt]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10ee143>] mdt_object_lock_internal+0x63/0x320 [mdt]
 [<ffffffffa10ee614>] mdt_object_lock+0x14/0x20 [mdt]
 [<ffffffffa111278b>] mdt_reint_open+0x8db/0x3230 [mdt]
 [<ffffffffa07ce7cc>] ? upcall_cache_get_entry+0x29c/0x880 [obdclass]
 [<ffffffffa07d38d0>] ? lu_ucred+0x20/0x30 [obdclass]
 [<ffffffffa10df795>] ? mdt_ucred+0x15/0x20 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e83b6>] mdt_intent_reint+0x1f6/0x440 [mdt]
 [<ffffffffa10e691e>] mdt_intent_policy+0x4be/0xc70 [mdt]
 [<ffffffffa09687c7>] ldlm_lock_enqueue+0x127/0x990 [ptlrpc]
 [<ffffffffa0993feb>] ldlm_handle_enqueue0+0x98b/0x14e0 [ptlrpc]
 [<ffffffffa0a088e1>] ? tgt_lookup_reply+0x31/0x190 [ptlrpc]
 [<ffffffffa0a19e91>] tgt_enqueue+0x61/0x230 [ptlrpc]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476921911.6105
LNet: Service thread pid 6100 was inactive for 200.69s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6100, comm: mdt01_020

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa07d38d0>] ? lu_ucred+0x20/0x30 [obdclass]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa124b52b>] mdd_attr_set+0x84b/0x1610 [mdd]
 [<ffffffffa09b683c>] ? lustre_msg_get_versions+0x8c/0x100 [ptlrpc]
 [<ffffffffa1108298>] mo_attr_set+0x18/0x50 [mdt]
 [<ffffffffa1108b14>] mdt_reint_setxattr+0x844/0xe70 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff8106ee50>] ? pick_next_task_fair+0xd0/0x130
 [<ffffffff81539896>] ? schedule+0x176/0x3a0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 6097, comm: mdt01_018

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa07d38d0>] ? lu_ucred+0x20/0x30 [obdclass]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa124b52b>] mdd_attr_set+0x84b/0x1610 [mdd]
 [<ffffffffa09b683c>] ? lustre_msg_get_versions+0x8c/0x100 [ptlrpc]
 [<ffffffffa1108298>] mo_attr_set+0x18/0x50 [mdt]
 [<ffffffffa1108b14>] mdt_reint_setxattr+0x844/0xe70 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff8106ee50>] ? pick_next_task_fair+0xd0/0x130
 [<ffffffff81539896>] ? schedule+0x176/0x3a0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LNet: Service thread pid 8618 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
LNet: Skipped 1 previous similar message
Pid: 8618, comm: mdt00_023

Call Trace:
 [<ffffffff81089e8c>] ? lock_timer_base+0x3c/0x70
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa09ab781>] ptlrpc_set_wait+0x321/0x960 [ptlrpc]
 [<ffffffffa09a08d0>] ? ptlrpc_interrupted_set+0x0/0x120 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa09b7c65>] ? lustre_msg_set_jobid+0xf5/0x130 [ptlrpc]
 [<ffffffffa09abe41>] ptlrpc_queue_wait+0x81/0x220 [ptlrpc]
 [<ffffffffa098848a>] ldlm_cli_enqueue+0x36a/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffff8117904c>] ? __kmalloc+0x21c/0x230
 [<ffffffffa11c7473>] lod_object_lock+0x3e3/0x900 [lod]
 [<ffffffffa07bcab1>] ? lu_object_find_at+0xb1/0xe0 [obdclass]
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa1105195>] mdt_lock_slaves+0x145/0x400 [mdt]
 [<ffffffffa1105dfb>] mdt_reint_unlink+0x9ab/0x10c0 [mdt]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476921913.8618
Lustre: soaked-MDT0002: haven't heard from client soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib10) in 229 seconds. I think it's dead, and I am evicting it. exp ffff88041fa27000, cur 1476921939 expire 1476921789 last 1476921710
LustreError: 5922:0:(client.c:1164:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff8803f4331cc0 x1548646349790336/t0(0) o105->soaked-MDT0002@192.168.1.109@o2ib10:15/16 lens 304/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
LustreError: 5922:0:(client.c:1164:ptlrpc_import_delay_req()) Skipped 2 previous similar messages
LustreError: 5922:0:(ldlm_lockd.c:687:ldlm_handle_ast_error()) ### client (nid 192.168.1.109@o2ib10) failed to reply to completion AST (req@ffff8803f4331cc0 x1548646349790336 status 0 rc -5), evict it ns: mdt-soaked-MDT0002_UUID lock: ffff8808177b7c80/0xceb65f696f040c7 lrc: 3/0,0 mode: EX/EX res: [0x2800088d6:0x1a1ad:0x0].0x0 bits 0x2 rrc: 5 type: IBT flags: 0x60000001000020 nid: 192.168.1.109@o2ib10 remote: 0x5e7f07a078eb6448 expref: 5 pid: 6121 timeout: 0 lvb_type: 0
LustreError: 138-a: soaked-MDT0002: A client on nid 192.168.1.109@o2ib10 was evicted due to a lock completion callback time out: rc -5
LNet: Service thread pid 6105 completed after 228.90s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 5 previous similar messages
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476921951/real 0]  req@ffff8803f4c9a3c0 x1548646349791280/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476921972 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476922101/real 1476922101]  req@ffff8803c3cd0980 x1548646349803248/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476922132 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Lustre: Skipped 6 previous similar messages
Oct 19 17:10:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0001-osp-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
LNet: Service thread pid 6097 completed after 504.48s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 1 previous similar message
Oct 19 17:15:01 lola-10 TIME: Time stamp for console
Oct 19 17:20:01 lola-10 TIME: Time stamp for console
Oct 19 17:25:01 lola-10 TIME: Time stamp for console
Oct 19 17:30:02 lola-10 TIME: Time stamp for console
Lustre: 4560:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476923572/real 0]  req@ffff880383be69c0 x1548646440795296/t0(0) o13->soaked-OST000a-osc-MDT0002@192.168.1.106@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476923579 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST000a-osc-MDT0002: Connection to soaked-OST000a (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4567:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476923573/real 0]  req@ffff88037904d3c0 x1548646440811024/t0(0) o6->soaked-OST000a-osc-MDT0002@192.168.1.106@o2ib10:28/4 lens 664/432 e 0 to 1 dl 1476923617 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4567:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 21 previous similar messages
Oct 19 17:35:01 lola-10 TIME: Time stamp for console
LustreError: 5984:0:(osp_precreate.c:615:osp_precreate_send()) soaked-OST000a-osc-MDT0002: can't precreate: rc = -11
LustreError: 5984:0:(osp_precreate.c:1225:osp_precreate_thread()) soaked-OST000a-osc-MDT0002: cannot precreate objects: rc = -11
LNet: Service thread pid 8756 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
LNet: Service thread pid 8756 completed after 200.00s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 1 previous similar message
Pid: 8756, comm: mdt01_025

Call Trace:
 [<ffffffffa09bcb88>] ? ptlrpc_server_normal_pending+0x38/0xc0 [ptlrpc]
 [<ffffffffa09c108d>] ptlrpc_wait_event+0x2cd/0x2e0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa09c727f>] ptlrpc_main+0x81f/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476923832/real 1476923832]  req@ffff88037c34c980 x1548646444221888/t0(0) o8->soaked-OST0016-osc-MDT0002@192.168.1.106@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476923843 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 18 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.106@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0016_UUID (at 192.168.1.106@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.106@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0004_UUID (at 192.168.1.106@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.106@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST000a_UUID (at 192.168.1.106@o2ib10) because it is indicating it is a new client
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.106@o2ib10, removing former export from same NID
format at ldlm_lib.c:1222:target_handle_connect doesn't end in newline
Lustre: soaked-MDT0002: Rejecting reconnect from the known client soaked-MDT0002-lwp-OST0010_UUID (at 192.168.1.106@o2ib10) because it is indicating it is a new client
Lustre: soaked-OST0016-osc-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: soaked-OST000a-osc-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.106@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 33 previous similar messages
Oct 19 17:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.106@o2ib10, removing former export from same NID
Lustre: Skipped 2 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.106@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.106@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.106@o2ib10, removing former export from same NID
Lustre: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.106@o2ib10, removing former export from same NID
Lustre: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.106@o2ib10, removing former export from same NID
Lustre: Skipped 3 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.106@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 11 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.106@o2ib10, removing former export from same NID
Lustre: Skipped 6 previous similar messages
Oct 19 17:45:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: soaked-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.106@o2ib10, removing former export from same NID
Lustre: Skipped 8 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Oct 19 17:50:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8803f073b0c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 00 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803f073b0c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c200de80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 28 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c200de80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c200dd80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 58 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c200dd80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c200dc80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 78 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c200dc80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c200db80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 80 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c200db80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c200da80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f a8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c200da80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c200d980)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f b8 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c200d980)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c200d880)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c200d880)
Oct 19 17:55:01 lola-10 TIME: Time stamp for console
Oct 19 18:00:01 lola-10 TIME: Time stamp for console
Oct 19 18:05:01 lola-10 TIME: Time stamp for console
Oct 19 18:10:01 lola-10 TIME: Time stamp for console
Oct 19 18:15:01 lola-10 TIME: Time stamp for console
Oct 19 18:20:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff88078cdfbd80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 58 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078cdfbd80)
sd 0:0:1:42: attempting task abort! scmd(ffff88078cdfbc80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 88 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078cdfbc80)
sd 0:0:1:42: attempting task abort! scmd(ffff88078cdfbb80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 98 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078cdfbb80)
sd 0:0:1:42: attempting task abort! scmd(ffff88078cdfba80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f b0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078cdfba80)
sd 0:0:1:42: attempting task abort! scmd(ffff88078cdfb980)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f c0 00 00 28 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88078cdfb980)
Oct 19 18:25:01 lola-10 TIME: Time stamp for console
Oct 19 18:30:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100)
Lustre: soaked-MDT0002: Client c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100)
Lustre: soaked-MDT0002: Client 1a9770ca-d51d-1ec7-9291-66c7a374ca9c (at 192.168.1.130@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 1a9770ca-d51d-1ec7-9291-66c7a374ca9c (at 192.168.1.130@o2ib100)
Lustre: soaked-MDT0002: Client f102f5da-2adb-d564-5415-e1621da9dda4 (at 192.168.1.120@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to f102f5da-2adb-d564-5415-e1621da9dda4 (at 192.168.1.120@o2ib100)
Oct 19 18:35:01 lola-10 TIME: Time stamp for console
Lustre: 6082:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476927485/real 1476927485]  req@ffff8803ec29d080 x1548646672201984/t0(0) o104->soaked-MDT0002@192.168.1.125@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476927492 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 6082:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 10 previous similar messages
Lustre: soaked-MDT0002: Client e8dbe6d0-9b2b-63cc-d307-77a1f450c597 (at 192.168.1.125@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to e8dbe6d0-9b2b-63cc-d307-77a1f450c597 (at 192.168.1.125@o2ib100)
Oct 19 18:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100)
Lustre: 6097:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476927865/real 1476927865]  req@ffff8807ee217680 x1548646682433600/t0(0) o104->soaked-MDT0002@192.168.1.130@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476927872 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Oct 19 18:45:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 1fa09166-d179-bf77-a8ee-6be97e97bca5 (at 192.168.1.129@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 60ad7b22-6f4d-940e-dc0f-f9ffdfa423e5 (at 192.168.1.133@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: 6098:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476928044/real 1476928044]  req@ffff88078c7026c0 x1548646687060064/t0(0) o104->soaked-MDT0002@192.168.1.132@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476928051 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-MDT0002: Client 29d3cbaa-30a5-6daf-223a-2835f382279d (at 192.168.1.134@o2ib100) reconnecting
Lustre: Skipped 1 previous similar message
Oct 19 18:50:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e8dbe6d0-9b2b-63cc-d307-77a1f450c597 (at 192.168.1.125@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 3bf16639-ba44-da4f-3ae0-9f8f041df65f (at 192.168.1.127@o2ib100)
Lustre: Skipped 3 previous similar messages
Oct 19 18:55:01 lola-10 TIME: Time stamp for console
Lustre: 5932:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476928711/real 1476928711]  req@ffff8807d56410c0 x1548646711116672/t0(0) o104->soaked-MDT0002@192.168.1.119@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476928718 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: Skipped 7 previous similar messages
Oct 19 19:00:01 lola-10 TIME: Time stamp for console
Oct 19 19:05:01 lola-10 TIME: Time stamp for console
Oct 19 19:10:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 8ffd2fb9-3d57-7767-a5b4-d8680336d61b (at 192.168.1.132@o2ib100) reconnecting
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 8ffd2fb9-3d57-7767-a5b4-d8680336d61b (at 192.168.1.132@o2ib100)
Lustre: Skipped 7 previous similar messages
Lustre: 6056:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476929555/real 1476929555]  req@ffff8807d1cce0c0 x1548646745579344/t0(0) o104->soaked-MDT0002@192.168.1.131@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476929562 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 6056:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Oct 19 19:15:01 lola-10 TIME: Time stamp for console
Oct 19 19:20:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 521f1f5f-66d5-5c01-ed6a-0ed604037e7a (at 192.168.1.123@o2ib100) reconnecting
Lustre: Skipped 5 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 521f1f5f-66d5-5c01-ed6a-0ed604037e7a (at 192.168.1.123@o2ib100)
Lustre: Skipped 5 previous similar messages
Lustre: 6032:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476930262/real 1476930262]  req@ffff8807a484e3c0 x1548646761024944/t0(0) o104->soaked-MDT0002@192.168.1.119@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476930269 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Oct 19 19:25:01 lola-10 TIME: Time stamp for console
Oct 19 19:30:01 lola-10 TIME: Time stamp for console
Oct 19 19:35:01 lola-10 TIME: Time stamp for console
Oct 19 19:40:01 lola-10 TIME: Time stamp for console
Oct 19 19:45:01 lola-10 TIME: Time stamp for console
Oct 19 19:50:01 lola-10 TIME: Time stamp for console
Oct 19 19:55:01 lola-10 TIME: Time stamp for console
Oct 19 20:00:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client f102f5da-2adb-d564-5415-e1621da9dda4 (at 192.168.1.120@o2ib100) reconnecting
Lustre: Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Connection restored to f102f5da-2adb-d564-5415-e1621da9dda4 (at 192.168.1.120@o2ib100)
Lustre: Skipped 3 previous similar messages
Oct 19 20:05:01 lola-10 TIME: Time stamp for console
Oct 19 20:10:01 lola-10 TIME: Time stamp for console
Oct 19 20:15:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8804009e96c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 98 00 00 88 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8804009e96c0)
Oct 19 20:20:01 lola-10 TIME: Time stamp for console
Oct 19 20:25:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8807f7e68280)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e c8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f7e68280)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f7e68180)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e e8 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f7e68180)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f7e68080)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 30 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f7e68080)
sd 0:0:1:42: attempting task abort! scmd(ffff8806efcd2ec0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 38 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8806efcd2ec0)
sd 0:0:1:42: attempting task abort! scmd(ffff8806efcd2dc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 48 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8806efcd2dc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8806efcd2cc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 58 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8806efcd2cc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8806efcd2bc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 68 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8806efcd2bc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8806efcd2ac0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 98 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8806efcd2ac0)
sd 0:0:1:42: attempting task abort! scmd(ffff8806efcd29c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f b0 00 00 18 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8806efcd29c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8806efcd28c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f d8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8806efcd28c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8806efcd27c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f f8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8806efcd27c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807d9ac4cc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 10 00 00 28 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807d9ac4cc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f2fc7680)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 17 50 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f2fc7680)
Oct 19 20:30:01 lola-10 TIME: Time stamp for console
Oct 19 20:35:01 lola-10 TIME: Time stamp for console
Oct 19 20:40:01 lola-10 TIME: Time stamp for console
Lustre: 4580:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476935070/real 0]  req@ffff8807d09683c0 x1548646844280880/t0(0) o13->soaked-OST0012-osc-MDT0002@192.168.1.102@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476935077 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST0012-osc-MDT0002: Connection to soaked-OST0012 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 3 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476935072/real 0]  req@ffff88040cd2bc80 x1548646844281120/t0(0) o13->soaked-OST0000-osc-MDT0002@192.168.1.102@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476935079 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST0000-osc-MDT0002: Connection to soaked-OST0000 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476935073/real 0]  req@ffff880406f37380 x1548646844281200/t0(0) o13->soaked-OST0006-osc-MDT0002@192.168.1.102@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476935080 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4559:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: soaked-OST0006-osc-MDT0002: Connection to soaked-OST0006 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476935077/real 0]  req@ffff8807870d09c0 x1548646844282752/t0(0) o8->soaked-OST0012-osc-MDT0002@192.168.1.102@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476935083 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4587:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476935069/real 1476935094]  req@ffff8807870d00c0 x1548646844279440/t0(0) o6->soaked-OST0012-osc-MDT0002@192.168.1.102@o2ib10:28/4 lens 664/432 e 0 to 1 dl 1476935116 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1
Lustre: 4587:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 4 previous similar messages
Oct 19 20:45:01 lola-10 TIME: Time stamp for console
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476935130/real 0]  req@ffff8807e4ae36c0 x1548646844523888/t0(0) o8->soaked-OST0012-osc-MDT0002@192.168.1.102@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476935141 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476935180/real 0]  req@ffff8807e9950080 x1548646844631104/t0(0) o8->soaked-OST000c-osc-MDT0002@192.168.1.102@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476935191 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476935255/real 0]  req@ffff8807fdbaf9c0 x1548646844824032/t0(0) o8->soaked-OST000c-osc-MDT0002@192.168.1.102@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476935271 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.103@o2ib10, removing former export from 192.168.1.102@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.103@o2ib10)
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.103@o2ib10, removing former export from 192.168.1.102@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.103@o2ib10, removing former export from 192.168.1.102@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.103@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.103@o2ib10, removing former export from 192.168.1.102@o2ib10
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476935355/real 1476935355]  req@ffff8807e4f6a6c0 x1548646845013200/t0(0) o8->soaked-OST0006-osc-MDT0002@192.168.1.102@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476935376 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4556:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-OST0000-osc-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: Skipped 2 previous similar messages
Oct 19 20:50:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-OST0012-osc-MDT0002: operation ost_statfs to node 192.168.1.103@o2ib10 failed: rc = -107
Lustre: soaked-OST0012-osc-MDT0002: Connection to soaked-OST0012 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST0000-osc-MDT0002: operation ost_destroy to node 192.168.1.103@o2ib10 failed: rc = -19
Lustre: soaked-OST0000-osc-MDT0002: Connection to soaked-OST0000 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST0006-osc-MDT0002: operation ost_destroy to node 192.168.1.103@o2ib10 failed: rc = -19
Lustre: soaked-OST0006-osc-MDT0002: Connection to soaked-OST0006 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0000-osc-MDT0002: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10)
Lustre: Skipped 5 previous similar messages
LustreError: 11-0: soaked-OST000c-osc-MDT0002: operation ost_destroy to node 192.168.1.103@o2ib10 failed: rc = -19
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               Version 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.                                                                                                                                                                          MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           LSI Corporation MPT SAS2 BIOS                                                   Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                 Initializing../                                                                 Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                                                                                                 Press Ctrl-C to start LSI Corp Configuration Utility...                         Searching for devices at HBA 0...                                               LSI Corporation MPT SAS2 BIOS                                                   MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                            PCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    SLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    ---- ---- --- -------- ---------------- ----------- ----------                    3           LSI      SAS2308-IT       15.00.00.00  0F:00:00:03                  3    4   7  LSI      Universal Xport  0786         20.00 MiB                    3    4   41  LSI      INF-01-00        0786         14.55 TiB                   3    4   42  LSI      INF-01-00        0786         14.55 TiB                   3    4   43  LSI      INF-01-00        0786         14.55 TiB                   3    4   44  LSI      INF-01-00        0786         14.55 TiB                   3    4   45  LSI      INF-01-00        0786         14.55 TiB                   3    4   46  LSI      INF-01-00        0786         14.55 TiB                   3    0   7  LSI      Universal Xport  0786         20.00 MiB                    3    0   41  LSI      INF-01-00        0786         14.55 TiB                   3    0   42  LSI      INF-01-00        0786         14.55 TiB                   3    0   43  LSI      INF-01-00        0786         14.55 TiB                   3    0   44  LSI      INF-01-00        0786         14.55 TiB                   3    0   45  LSI      INF-01-00        0786         14.55 TiB                   3    0   46  LSI      INF-01-00        0786         14.55 TiB                 Copyright 2000-2012 LSI Corporation.                                                                                                                              RAID Volumes:                                                                   None defined.                                                                   Physical Devices:                                                             �  ID   Device Model     Serial #                     Size Type/Status(Vol ID)     0    ST500NM0011      Z1M0X1F9                  465.7GB Non-RAID Disk           1    ST500NM0011      Z1M0X1GG                  465.7GB Non-RAID Disk         Press <CTRL-I> to enter Configuration Utility..                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Copyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   Press <CTRL-I> to enter Configuration Utility...                                                                                                                PXE 2.1 Build 091 (WfM 2.0)                                                     Press Ctrl+S to enter the Setup Menu.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                          Bios Version: SE5C600.86B.01.08.0003.022620131521                               BMC Firmware Version: 1.17.4207                                                 SDR Version: SDR Package 1.09                                                   ME Firmware Version: 2.1.7.112                                                  Platform ID: S2600GZ                                                            System memory detected: 32768 MB                                                Current memory speed: 1333 MT/s                                                 Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        Number of physical processors identified: 2                                     ********************************************************************************AHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          SAS/SATA Capable Controller configured with 4 ports in SATA mode                ********************************************************************************USB Keyboard detected                                                           USB Mouse detected                                                                                                                                              Press <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                                     
Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

    GNU GRUB  version 0.97  (571K lower / 3066652K upper memory)

+-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+
      Use the ^ and v keys to select which entry is highlighted.
      Press enter to boot the selected OS, 'e' to edit the
      commands before booting, 'a' to modify the kernel arguments
      before booting, or 'c' for a command-line.  CentOS (2.6.32-573.26.1.el6_lustre.x86_64)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  The highlighted entry will be booted automatically in 5 seconds.    The highlighted entry will be booted automatically in 4 seconds.    The highlighted entry will be booted automatically in 3 seconds.    The highlighted entry will be booted automatically in 2 seconds.    The highlighted entry will be booted automatically in 1 seconds.    Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-573.26.1.el6_lustre.x86_64 (soakbuilder@lola-16.lola.whamcloud.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-16) (GCC) ) #1 SMP Mon Oct 17 13:07:39 PDT 2016
Command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=auto SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000008ec00 (usable)
 BIOS-e820: 000000000008ec00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bb3c7000 (usable)
 BIOS-e820: 00000000bb3c7000 - 00000000bdd2f000 (reserved)
 BIOS-e820: 00000000bdd2f000 - 00000000bddcd000 (ACPI NVS)
 BIOS-e820: 00000000bddcd000 - 00000000bdea1000 (ACPI data)
 BIOS-e820: 00000000bdea1000 - 00000000bdf2f000 (ACPI NVS)
 BIOS-e820: 00000000bdf2f000 - 00000000bdfac000 (ACPI data)
 BIOS-e820: 00000000bdfac000 - 00000000be000000 (usable)
 BIOS-e820: 00000000be000000 - 00000000d0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
 BIOS-e820: 00000000fed19000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ffa20000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000840000000 (usable)
DMI 2.6 present.
SMBIOS version 2.6 @ 0xF0440
No AGP bridge found
last_pfn = 0x840000 max_arch_pfn = 0x400000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xbe000 max_arch_pfn = 0x400000000
Using GB pages for direct mapping
init_memory_mapping: 0000000000000000-00000000be000000
init_memory_mapping: 0000000100000000-0000000840000000
RAMDISK: 3601e000 - 37fef30d
ACPI: Deleted _OSI()
ACPI: Deleted _OSI()
ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20090903/tbfadt-611)
ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
ACPI: FACS 00000000bdfa9f40 00040
ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
Setting APIC routing to flat.
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: PXM 0 -> APIC 2 -> Node 0
SRAT: PXM 0 -> APIC 3 -> Node 0
SRAT: PXM 0 -> APIC 4 -> Node 0
SRAT: PXM 0 -> APIC 5 -> Node 0
SRAT: PXM 0 -> APIC 6 -> Node 0
SRAT: PXM 0 -> APIC 7 -> Node 0
SRAT: PXM 0 -> APIC 8 -> Node 0
SRAT: PXM 0 -> APIC 9 -> Node 0
SRAT: PXM 0 -> APIC 10 -> Node 0
SRAT: PXM 0 -> APIC 11 -> Node 0
SRAT: PXM 0 -> APIC 12 -> Node 0
SRAT: PXM 0 -> APIC 13 -> Node 0
SRAT: PXM 0 -> APIC 14 -> Node 0
SRAT: PXM 0 -> APIC 15 -> Node 0
SRAT: PXM 1 -> APIC 32 -> Node 1
SRAT: PXM 1 -> APIC 33 -> Node 1
SRAT: PXM 1 -> APIC 34 -> Node 1
SRAT: PXM 1 -> APIC 35 -> Node 1
SRAT: PXM 1 -> APIC 36 -> Node 1
SRAT: PXM 1 -> APIC 37 -> Node 1
SRAT: PXM 1 -> APIC 38 -> Node 1
SRAT: PXM 1 -> APIC 39 -> Node 1
SRAT: PXM 1 -> APIC 40 -> Node 1
SRAT: PXM 1 -> APIC 41 -> Node 1
SRAT: PXM 1 -> APIC 42 -> Node 1
SRAT: PXM 1 -> APIC 43 -> Node 1
SRAT: PXM 1 -> APIC 44 -> Node 1
SRAT: PXM 1 -> APIC 45 -> Node 1
SRAT: PXM 1 -> APIC 46 -> Node 1
SRAT: PXM 1 -> APIC 47 -> Node 1
SRAT: Node 0 PXM 0 0-c0000000
SRAT: Node 0 PXM 0 100000000-440000000
SRAT: Node 1 PXM 1 440000000-840000000
Bootmem setup node 0 0000000000000000-0000000440000000
  NODE_DATA [0000000000009000 - 000000000003cfff]
  bootmap [0000000000100000 -  0000000000187fff] pages 88
(8 early reservations) ==> bootmem [0000000000 - 0440000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS ==> [0001000000 - 000203eb64]
  #3 [003601e000 - 0037fef30d]          RAMDISK ==> [003601e000 - 0037fef30d]
  #4 [000008ec00 - 0000100000]    BIOS reserved ==> [000008ec00 - 0000100000]
  #5 [000203f000 - 000203f9b8]              BRK ==> [000203f000 - 000203f9b8]
  #6 [0000008000 - 0000009000]          PGTABLE ==> [0000008000 - 0000009000]
  #7 [0000001000 - 0000001030]        ACPI SLIT ==> [0000001000 - 0000001030]
Bootmem setup node 1 0000000440000000-0000000840000000
  NODE_DATA [0000000440000040 - 000000044003403f]
  bootmap [0000000440035000 -  00000004400b4fff] pages 80
(8 early reservations) ==> bootmem [0440000000 - 0840000000]
  #0 [0000000000 - 0000001000]   BIOS data page
  #1 [0000006000 - 0000008000]       TRAMPOLINE
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS
  #3 [003601e000 - 0037fef30d]          RAMDISK
  #4 [000008ec00 - 0000100000]    BIOS reserved
  #5 [000203f000 - 000203f9b8]              BRK
  #6 [0000008000 - 0000009000]          PGTABLE
  #7 [0000001000 - 0000001030]        ACPI SLIT
found SMP MP-table at [ffff8800000fcd70] fcd70
Reserving 131MB of memory at 48MB for crashkernel (System RAM: 33792MB)
Zone PFN ranges:
  DMA      0x00000001 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   0x00100000 -> 0x00840000
Movable zone start PFN for each node
early_node_map[5] active PFN ranges
    0: 0x00000001 -> 0x0000008e
    0: 0x00000100 -> 0x000bb3c7
    0: 0x000bdfac -> 0x000be000
    0: 0x00100000 -> 0x00440000
    1: 0x00440000 -> 0x00840000
ACPI: PM-Timer IO Port: 0x408
Setting APIC routing to flat.
ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a701 base: 0xfed00000
SMP: Allowing 240 CPUs, 208 hotplug CPUs
PM: Registered nosave memory: 000000000008e000 - 000000000008f000
PM: Registered nosave memory: 000000000008f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
PM: Registered nosave memory: 00000000bb3c7000 - 00000000bdd2f000
PM: Registered nosave memory: 00000000bdd2f000 - 00000000bddcd000
PM: Registered nosave memory: 00000000bddcd000 - 00000000bdea1000
PM: Registered nosave memory: 00000000bdea1000 - 00000000bdf2f000
PM: Registered nosave memory: 00000000bdf2f000 - 00000000bdfac000
PM: Registered nosave memory: 00000000be000000 - 00000000d0000000
PM: Registered nosave memory: 00000000d0000000 - 00000000fec00000
PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
PM: Registered nosave memory: 00000000fec01000 - 00000000fed19000
PM: Registered nosave memory: 00000000fed19000 - 00000000fed1a000
PM: Registered nosave memory: 00000000fed1a000 - 00000000fed1c000
PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
PM: Registered nosave memory: 00000000fed20000 - 00000000fee00000
PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
PM: Registered nosave memory: 00000000fee01000 - 00000000ffa20000
PM: Registered nosave memory: 00000000ffa20000 - 0000000100000000
Allocating PCI resources starting at d0000000 (gap: d0000000:2ec00000)
Booting paravirtualized kernel on bare hardware
NR_CPUS:4096 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
PERCPU: Embedded 30 pages/cpu @ffff880038600000 s91288 r8192 d23400 u131072
pcpu-alloc: s91288 r8192 d23400 u131072 alloc=1*2097152
pcpu-alloc: [0] 000 001 002 003 004 005 006 007 016 017 018 019 020 021 022 023 
pcpu-alloc: [0] 032 034 036 038 040 042 044 046 048 050 052 054 056 058 060 062 
pcpu-alloc: [0] 064 066 068 070 072 074 076 078 080 082 084 086 088 090 092 094 
pcpu-alloc: [0] 096 098 100 102 104 106 108 110 112 114 116 118 120 122 124 126 
pcpu-alloc: [0] 128 130 132 134 136 138 140 142 144 146 148 150 152 154 156 158 
pcpu-alloc: [0] 160 162 164 166 168 170 172 174 176 178 180 182 184 186 188 190 
pcpu-alloc: [0] 192 194 196 198 200 202 204 206 208 210 212 214 216 218 220 222 
pcpu-alloc: [0] 224 226 228 230 232 234 236 238 --- --- --- --- --- --- --- --- 
pcpu-alloc: [1] 008 009 010 011 012 013 014 015 024 025 026 027 028 029 030 031 
pcpu-alloc: [1] 033 035 037 039 041 043 045 047 049 051 053 055 057 059 061 063 
pcpu-alloc: [1] 065 067 069 071 073 075 077 079 081 083 085 087 089 091 093 095 
pcpu-alloc: [1] 097 099 101 103 105 107 109 111 113 115 117 119 121 123 125 127 
pcpu-alloc: [1] 129 131 133 135 137 139 141 143 145 147 149 151 153 155 157 159 
pcpu-alloc: [1] 161 163 165 167 169 171 173 175 177 179 181 183 185 187 189 191 
pcpu-alloc: [1] 193 195 197 199 201 203 205 207 209 211 213 215 217 219 221 223 
pcpu-alloc: [1] 225 227 229 231 233 235 237 239 --- --- --- --- --- --- --- --- 
Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8250675
Policy zone: Normal
Kernel command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=131M@0M SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
PID hash table entries: 4096 (order: 3, 32768 bytes)
xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
Checking aperture...
No AGP bridge found
Memory: 32738448k/34603008k available (5400k kernel code, 1126752k absent, 737808k reserved, 7008k data, 1304k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:3144
Extended CMOS year: 2000
Console: colour VGA+ 80x25
console [ttyS0] enabled
allocated 134217728 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
TSC: cpu family 6 model 45, tsc initial value = 762c2c1e1c
Fast TSC calibration using PIT
Detected 2693.582 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5387.16 BogoMIPS (lpj=2693582)
pid_max: default: 245760 minimum: 1920
Security Framework initialized
SELinux:  Initializing.
Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 20 MCE banks
CPU0: Thermal monitoring enabled (TM1)
using mwait in idle threads.
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 22144 entries in 87 pages
x2apic not enabled, IRQ remapping init failed
APIC routing finalized to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz stepping 07
Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
... version:                3
... bit width:              48
... generic registers:      4
... value mask:             0000ffffffffffff
... max period:             0000ffffffffffff
... fixed-purpose events:   3
... event mask:             000000070000000f
NMI watchdog enabled, takes one hw-pmu counter.
Booting Node   0, Processors  #1 #2 #3 #4 #5 #6 #7 Ok.
Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 Ok.
Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 Ok.
Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
Brought up 32 CPUs
Total of 32 processors activated (172374.97 BogoMIPS).
devtmpfs: initialized
PM: Registering ACPI NVS region at bdd2f000 (647168 bytes)
PM: Registering ACPI NVS region at bdea1000 (581632 bytes)
regulator: core version 0.5
NET: Registered protocol family 16
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MCFG configuration 0: base c0000000 segment 0 buses 0 - 255
PCI: MCFG area at c0000000 reserved in E820
PCI: Using MMCONFIG at c0000000 - cfffffff
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: Executed 1 blocks of module-level executable AML code
ACPI: BIOS _OSI(Linux) query ignored
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
HEST: Table parsing has been initialized.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
pci_root PNP0A08:00: host bridge window [io  0x0000-0xbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:00: host bridge window [mem 0x000c0000-0x000c3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c4000-0x000c7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c8000-0x000cbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000cc000-0x000cffff]
pci_root PNP0A08:00: host bridge window [mem 0x000d0000-0x000d3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d4000-0x000d7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d8000-0x000dbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000dc000-0x000dffff]
pci_root PNP0A08:00: host bridge window [mem 0x000e0000-0x000e3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e4000-0x000e7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e8000-0x000ebfff]
pci_root PNP0A08:00: host bridge window [mem 0x000ec000-0x000effff]
pci_root PNP0A08:00: host bridge window [mem 0x000f0000-0x000fffff]
pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xebffffff]
pci_root PNP0A08:00: host bridge window [mem 0x380000000000-0x38007fffffff]
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdfff])
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff]
pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff]
pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff]
pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff]
pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff]
pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff]
pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff]
pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff]
pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff]
pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff]
pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff]
pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff]
pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff]
pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
pci 0000:00:00.0: PME# disabled
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
pci 0000:00:01.1: PME# disabled
pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
pci 0000:00:02.0: PME# disabled
pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
pci 0000:00:02.2: PME# disabled
pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
pci 0000:00:03.0: PME# disabled
pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
pci 0000:00:11.0: PME# disabled
pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.0: PME# disabled
pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
pci 0000:00:16.1: PME# disabled
pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.7: PME# disabled
pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.0: PME# disabled
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:00.0: PME# disabled
pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
pci 0000:02:00.1: PME# disabled
pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
pci 0000:02:00.2: PME# disabled
pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
pci 0000:02:00.3: PME# disabled
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:07:00.3: PME# supported from D0 D3hot D3cold
pci 0000:07:00.3: PME# disabled
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a] (subtractive decode)
 pci0000:00: Requesting ACPI _OSC control (0x1d)
 pci0000:00: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
pci_root PNP0A08:01: host bridge window [io  0x03b0-0x03df]
pci_root PNP0A08:01: host bridge window [io  0xc000-0xffff]
pci_root PNP0A08:01: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:01: host bridge window [mem 0xec000000-0xfbffffff]
pci_root PNP0A08:01: host bridge window [mem 0x380080000000-0x3800ffffffff]
PCI host bridge to bus 0000:80
pci_bus 0000:80: root bus resource [io  0x03b0-0x03df]
pci_bus 0000:80: root bus resource [io  0xc000-0xffff]
pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff]
pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff]
pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
pci 0000:80:01.0: PME# disabled
pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
pci 0000:80:02.0: PME# disabled
pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
pci 0000:80:03.0: PME# disabled
pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
pci 0000:80:03.2: PME# disabled
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
 pci0000:80: Requesting ACPI _OSC control (0x1d)
 pci0000:80: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
PCI host bridge to bus 0000:7f
 pci0000:7f: Requesting ACPI _OSC control (0x1d)
 pci0000:7f: ACPI _OSC control (0x10) granted
ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
PCI host bridge to bus 0000:ff
 pci0000:ff: Requesting ACPI _OSC control (0x1d)
 pci0000:ff: ACPI _OSC control (0x10) granted
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:09:00.0
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
HPET: 8 timers in total, 5 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 72, 73, 74, 75, 76, 0
hpet0: 8 comparators, 64-bit 14.318180 MHz counter
Switching to clocksource hpet
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 15 devices
ACPI: ACPI bus type pnp unregistered
system 00:05: [io  0x0680-0x069f] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0x0400-0x0453] has been reserved
system 00:05: [io  0x0458-0x047f] has been reserved
system 00:05: [io  0x0500-0x057f] has been reserved
system 00:05: [io  0x0600-0x061f] has been reserved
system 00:05: [io  0x0ca2-0x0ca5] has been reserved
system 00:05: [io  0x0cf9] could not be reserved
system 00:07: [io  0x0454-0x0457] has been reserved
system 00:0a: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:0a: [mem 0xebfff000-0xebffffff] has been reserved
system 00:0a: [mem 0xc0000000-0xcfffffff] has been reserved
system 00:0a: [mem 0xfed20000-0xfed3ffff] has been reserved
system 00:0a: [mem 0xfed45000-0xfed8ffff] has been reserved
system 00:0a: [mem 0xff000000-0xffffffff] could not be reserved
system 00:0a: [mem 0xfee00000-0xfeefffff] could not be reserved
system 00:0a: [mem 0xfec00000-0xfecfffff] could not be reserved
system 00:0a: [mem 0xd0f70000-0xd0f70fff] has been reserved
system 00:0c: [mem 0x00000000-0x0009cfff] could not be reserved
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
pci 0000:00:02.0:   bridge window [mem 0xeb000000-0xeb7fffff 64bit pref]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
pci 0000:00:11.0:   bridge window [mem 0xeb800000-0xebcfffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a]
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
pci 0000:00:01.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:01.1: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.2: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:03.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:11.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
pci 0000:80:01.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:02.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.2: PCI INT A -> GSI 71 (level, low) -> IRQ 71
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1a.0: PCI INT B disabled
pci 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1d.0: PCI INT A dis�abled
Trying ttramfs...
Freeing initrd memory: 32580k freed
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
futex hash table entries: 65536 (order: 10, 4194304 bytes)
audit: initializing netlink socket (disabled)
type=2000 audit(1476935781.101:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 32768
ksign: Installing public key data
Loading keyring
- Added public key 3B396075E393847B
- User ID: Red Hat, Inc. (Kernel Module GPG key)
- Added public key D4A26C9CCD09BEDA
- User ID: Red Hat Enterprise Linux Driver Update Program <secalert@redhat.com>
- Added public key CB445E0DA3EA1F65
- User ID: Red Hat Enterprise Linux Driver Update Program (key 4) <secalert@redhat.com>
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
acpiphp: Slot [2] registered
acpiphp: Slot [2-1] registered
acpiphp: Slot [2-2] registered
acpiphp: Slot [2-3] registered
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
[Firmware Bug]: No valid trip found
ERST: Error Record Serialization Table (ERST) support is initialized.
GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
�serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input1
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
ehci_hcd 0000:00:1a.0: EHCI Host Controller
ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.0: debug port 2
ehci_hcd 0000:00:1a.0: irq 22, io mem 0xd0f20000
ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb1: SerialNumber: 0000:00:1a.0
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
ehci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
ehci_hcd 0000:00:1d.0: EHCI Host Controller
ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
ehci_hcd 0000:00:1d.0: debug port 2
ehci_hcd 0000:00:1d.0: irq 20, io mem 0xd0f10000
Refined TSC clocksource calibration: 2693.509 MHz.
Switching to clocksource tsc
ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: EHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
PNP: No PS/2 controller found. Probing ports directly.
mice: PS/2 mouse device common for all mice
rtc_cmos 00:06: RTC can wake from S4
rtc_cmos 00:06: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
cpuidle: using governor ladder
cpuidle: using governor menu
EFI Variables Facility v0.08 2004-May-17
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
GRE over IPv4 demultiplexor driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
rtc_cmos 00:06: setting system clock to 2016-10-20 03:56:26 UTC (1476935786)
Initalizing network drop monitor service
Freeing unused kernel memory: 1304k freed
Write protecting the kernel read-only data: 10240k
Freeing unused kernel memory: 724k freed
Freeing unused kernel memory: 1572k freed
rdac: device handler registered
dracut: dracut-004-388.el6
dracut: rd_NO_LUKS: removing cryptoluks activation
dracut: rd_NO_LVM: removing LVM activation
usb 1-1: new high speed USB device number 2 using ehci_hcd
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: dm-devel@redhat.com
udev: starting version 147
usb 1-1: New USB device found, idVendor=8087, idProduct=0024
usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 1-1: configuration #1 chosen from 1 choice
hub 1-1:1.0: USB hub found
hub 1-1:1.0: 6 ports detected
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
usb 2-1: new high speed USB device number 2 using ehci_hcd
mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)
mlx4_core: Initializing 0000:04:00.0
mlx4_core 0000:04:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
usb 2-1: New USB device found, idVendor=8087, idProduct=0024
usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 2-1: configuration #1 chosen from 1 choice
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 8 ports detected
usb 2-1.4: new full speed USB device number 3 using ehci_hcd
usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.4: Product: Virtual Keyboard and Mouse
usb 2-1.4: Manufacturer: American Megatrends Inc.
usb 2-1.4: SerialNumber: serial
usb 2-1.4: configuration #1 chosen from 1 choice
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input2
generic-usb 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input3
generic-usb 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)
mlx4_en 0000:04:00.0: registered PHC clock
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
<mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014)
mpt2sas version 20.101.00.00 loaded
mpt2sas 0000:06:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32774632 kB)
mpt2sas0: MSI-X vectors supported: 8, no of cores: 32, max_msix_vectors: 8
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 127
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 128
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 129
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 130
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 131
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 132
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 133
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 134
mpt2sas0: iomem(0x00000000d0a40000), mapped(0xffffc900147c0000), size(65536)
mpt2sas0: ioport(0x0000000000002000), size(256)
mpt2sas0: sending message unit reset !!
mpt2sas0: message unit reset: SUCCESS
mpt2sas0: Allocated physical memory: size(17329 kB)
mpt2sas0: Current Controller Queue Depth(9979), Max Controller Queue Depth(10240)
mpt2sas0: Scatter Gather Elements per IO(128)
mpt2sas0: LSISAS2308: FWVersion(15.00.00.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
mpt2sas0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi0 : Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas0: host_add: handle(0x0001), sas_addr(0x500605b005d6d910), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:41: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:42: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:43: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:44: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:45: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:46: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:41: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:42: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:43: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:44: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:45: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:46: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:0:41: rdac: LUN 41 (RDAC) (owned)
scsi 0:0:0:42: rdac: LUN 42 (RDAC) (unowned)
scsi 0:0:0:43: rdac: LUN 43 (RDAC) (owned)
scsi 0:0:0:44: rdac: LUN 44 (RDAC) (unowned)
scsi 0:0:0:45: rdac: LUN 45 (RDAC) (owned)
scsi 0:0:0:46: rdac: LUN 46 (RDAC) (unowned)
scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:1:41: rdac: LUN 41 (RDAC) (unowned)
scsi 0:0:1:42: rdac: LUN 42 (RDAC) (owned)
scsi 0:0:1:43: rdac: LUN 43 (RDAC) (unowned)
scsi 0:0:1:44: rdac: LUN 44 (RDAC) (owned)
scsi 0:0:1:45: rdac: LUN 45 (RDAC) (unowned)
scsi 0:0:1:46: rdac: LUN 46 (RDAC) (owned)
isci: Intel(R) C600 SAS Controller Driver - version 1.1.0-rh
isci 0000:07:00.0: driver configured for rev: 6 silicon
isci 0000:07:00.0: OEM parameter table found in OROM
isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
isci 0000:07:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
scsi1 : isci
ata1.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata1.00: configured for UDMA/133
scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ata2.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata2.00: configured for UDMA/133
scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ACPI: WMI: Mapper loaded
ahci 0000:00:1f.2: PCI INT B -> GSI 21 (level, low) -> IRQ 21
ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
scsi2 : ahci
scsi3 : ahci
scsi4 : ahci
scsi5 : ahci
scsi6 : ahci
scsi7 : ahci
ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 137
ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 137
ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 137
ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 137
ata7: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 137
ata8: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 137
ata4: SATA link down (SStatus 0 SControl 300)
ata6: SATA link down (SStatus 0 SControl 300)
ata5: SATA link down (SStatus 0 SControl 300)
ata8: SATA link down (SStatus 0 SControl 300)
ata7: SATA link down (SStatus 0 SControl 300)
ata3: SATA link down (SStatus 0 SControl 300)
%Gsd 0:0:0:7: [sda] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 1:0:0:0: [sdo] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:0:0: [sdo] Write Protect is off
sd 1:0:0:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sdo:
sd 1:0:1:0: [sdp] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:1:0: [sdp] Write Protect is off
sd 1:0:1:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sdp:
sd 0:0:0:41: [sdb] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
 sdo1 sdo2
sd 0:0:0:43: [sdd] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:1:46: [sdn] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:42: [sdj] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:43: [sdk] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:42: [sdc] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:46: [sdg] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:41: [sdi] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:45: [sdm] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:44: [sdl] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:7: [sda] Write Protect is off
sd 0:0:0:41: [sdb] Write Protect is off
sd 0:0:1:43: [sdk] Write Protect is off
sd 0:0:1:46: [sdn] Write Protect is off
sd 0:0:0:7: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:42: [sdc] Write Protect is off
sd 0:0:0:45: [sdf] Write Protect is off
sd 0:0:1:7: [sdh] Write Protect is off
sd 0:0:0:44: [sde] Write Protect is off
sd 0:0:1:45: [sdm] Write Protect is off
sd 0:0:1:43: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] Write Protect is off
sd 0:0:0:41: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:45: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:44: [sdl] Write Protect is off
sd 0:0:1:42: [sdj] Write Protect is off
sd 0:0:1:46: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:45: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:44: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:42: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:44: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:41: [sdi] Write Protect is off
 sdb:
sd 0:0:1:41: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:42: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdg:
 sdn:
 sdl:
 sdf:
 sdh:Dev sdg: unable to read RDB block 0
 unable to read partition table
 unknown partition table
sd 0:0:0:43: [sdd] Write Protect is off
sd 0:0:0:43: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
 unknown partition table
 unknown partition table
sd 1:0:0:0: [sdo] Attached SCSI disk
sd 0:0:0:41: [sdb] Attached SCSI disk
sd 0:0:0:46: [sdg] Attached SCSI disk
sd 0:0:0:45: [sdf] Attached SCSI disk
 sda:
sd 0:0:1:44: [sdl] Attached SCSI disk
 unknown partition table
 sde:
 sdc:
 sdk:
sd 0:0:1:46: [sdn] Attached SCSI disk
 sdm:Dev sdm: unable to read RDB block 0
Dev sdk: unable to read RDB block 0
Dev sde: unable to read RDB block 0
 unable to read partition table
Dev sdc: unable to read RDB block 0
 unable to read partition table
sd 0:0:1:45: [sdm] Attached SCSI disk
 unable to read partition table
sd 0:0:1:43: [sdk] Attached SCSI disk
 unable to read partition table
 sdi:
 sdj: sdp1 sdp9
Dev sdi: unable to read RDB block 0
sd 0:0:0:44: [sde] Attached SCSI disk
sd 1:0:1:0: [sdp] Attached SCSI disk
sd 0:0:0:42: [sdc] Attached SCSI disk
 sdd: unknown partition table
 unknown partition table
 unable to read partition table
sd 0:0:1:42: [sdj] Attached SCSI disk
sd 0:0:1:41: [sdi] Attached SCSI disk
sd 0:0:0:43: [sdd] Attached SCSI disk
 unknown partition table
sd 0:0:1:7: [sdh] Attached SCSI disk
 unknown partition table
sd 0:0:0:7: [sda] Attached SCSI disk
EXT3-fs (sdo1): recovery required on readonly filesystem
EXT3-fs (sdo1): write access will be enabled during recovery
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sdo1): orphan cleanup on readonly fs
EXT3-fs (sdo1): 1 orphan inode deleted
EXT3-fs (sdo1): recovery complete
EXT3-fs (sdo1): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/sdo1
SELinux:  Disabled at runtime.
type=1404 audit(1476935803.605:2): selinux=0 auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
cat: /proc/self/attr/current: Invalid argument

		Welcome to CentOS 

Starting udev: udev: starting version 147
dca service started, version 1.12.1
igb: Intel(R) Gigabit Ethernet Network Driver - version 5.2.15-k
igb: Copyright (c) 2007-2014 Intel Corporation.
igb 0000:02:00.0: PCI INT A -> GSI 27 (level, low) -> IRQ 27
igb 0000:02:00.0: added PHC on eth0
igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b3
igb 0000:02:00.0: eth0: PBA No: 100000-000
igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.1: PCI INT B -> GSI 30 (level, low) -> IRQ 30
igb 0000:02:00.1: added PHC on eth1
igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b4
igb 0000:02:00.1: eth1: PBA No: 100000-000
igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.2: PCI INT C -> GSI 28 (level, low) -> IRQ 28
igb 0000:02:00.2: added PHC on eth2
igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b5
igb 0000:02:00.2: eth2: PBA No: 100000-000
igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.3: PCI INT D -> GSI 29 (level, low) -> IRQ 29
igb 0000:02:00.3: added PHC on eth3
igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b6
igb 0000:02:00.3: eth3: PBA No: 100000-000
igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
scsi 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:0:7: Attached scsi generic sg1 type 0
sd 0:0:0:41: Attached scsi generic sg2 type 0
sd 0:0:0:42: Attached scsi generic sg3 type 0
sd 0:0:0:43: Attached scsi generic sg4 type 0
sd 0:0:0:44: Attached scsi generic sg5 type 0
sd 0:0:0:45: Attached scsi generic sg6 type 0
sd 0:0:0:46: Attached scsi generic sg7 type 0
scsi 0:0:1:0: Attached scsi generic sg8 type 0
sd 0:0:1:7: Attached scsi generic sg9 type 0
sd 0:0:1:41: Attached scsi generic sg10 type 0
sd 0:0:1:42: Attached scsi generic sg11 type 0
sd 0:0:1:43: Attached scsi generic sg12 type 0
sd 0:0:1:44: Attached scsi generic sg13 type 0
sd 0:0:1:45: Attached scsi generic sg14 type 0
sd 0:0:1:46: Attached scsi generic sg15 type 0
sd 1:0:0:0: Attached scsi generic sg16 type 0
sd 1:0:1:0: Attached scsi generic sg17 type 0
ioatdma: Intel(R) QuickData Technology Driver 4.00
ioatdma 0000:00:04.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
igb 0000:02:00.0: DCA enabled
igb 0000:02:00.1: DCA enabled
ioatdma 0000:00:04.1: PCI INT B -> GSI 39 (level, low) -> IRQ 39
igb 0000:02:00.2: DCA enabled
igb 0000:02:00.3: DCA enabled
ioatdma 0000:00:04.2: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.3: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.4: PCI INT A -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.5: PCI INT B -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.6: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.7: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:80:04.0: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.1: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.2: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.3: PCI INT D -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.4: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.5: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.6: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.7: PCI INT D -> GSI 63 (level, low) -> IRQ 63
i801_smbus 0000:00:1f.3: PCI INT C -> GSI 23 (level, low) -> IRQ 23
ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
i801_smbus 0000:07:00.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
i801_smbus 0000:07:00.3: Enabling SMBus device
ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042f conflicts with OpRegion 0x0000000000000400-0x000000000000047f (\PMIO) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000053f (\FBPC) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000052f (\_SI_.SIOR) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
lpc_ich: Resource conflict(s) found affecting gpio_ich
EDAC MC: Ver: 2.1.0 Oct 17 2016
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
%GEDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0
EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0
EDAC sbridge: Driver loaded.
zunicode: module license 'CDDL' taints kernel.
Disabling lock debugging due to kernel taint
SPL: Loaded module v0.6.5.7-1
ZFS: Loaded module v0.6.5.7-1, ZFS pool version 5000, ZFS filesystem version 5
iTCO_vendor_support: vendor-support=0
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.07rh
iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
microcode: CPU0 updated to revision 0x710, date = 2013-06-17 
microcode: CPU1 updated to revision 0x710, date = 2013-06-17 
microcode: CPU2 updated to revision 0x710, date = 2013-06-17 
microcode: CPU3 updated to revision 0x710, date = 2013-06-17 
microcode: CPU4 updated to revision 0x710, date = 2013-06-17 
microcode: CPU5 updated to revision 0x710, date = 2013-06-17 
microcode: CPU6 updated to revision 0x710, date = 2013-06-17 
microcode: CPU7 updated to revision 0x710, date = 2013-06-17 
microcode: CPU8 updated to revision 0x710, date = 2013-06-17 
microcode: CPU9 updated to revision 0x710, date = 2013-06-17 
microcode: CPU10 updated to revision 0x710, date = 2013-06-17 
microcode: CPU11 updated to revision 0x710, date = 2013-06-17 
microcode: CPU12 updated to revision 0x710, date = 2013-06-17 
microcode: CPU13 updated to revision 0x710, date = 2013-06-17 
microcode: CPU14 updated to revision 0x710, date = 2013-06-17 
microcode: CPU15 updated to revision 0x710, date = 2013-06-17 
microcode: CPU16 updated to revision 0x710, date = 2013-06-17 
microcode: CPU17 updated to revision 0x710, date = 2013-06-17 
microcode: CPU18 updated to revision 0x710, date = 2013-06-17 
microcode: CPU19 updated to revision 0x710, date = 2013-06-17 
microcode: CPU20 updated to revision 0x710, date = 2013-06-17 
microcode: CPU21 updated to revision 0x710, date = 2013-06-17 
microcode: CPU22 updated to revision 0x710, date = 2013-06-17 
microcode: CPU23 updated to revision 0x710, date = 2013-06-17 
microcode: CPU24 updated to revision 0x710, date = 2013-06-17 
microcode: CPU25 updated to revision 0x710, date = 2013-06-17 
microcode: CPU26 updated to revision 0x710, date = 2013-06-17 
microcode: CPU27 updated to revision 0x710, date = 2013-06-17 
microcode: CPU28 updated to revision 0x710, date = 2013-06-17 
microcode: CPU29 updated to revision 0x710, date = 2013-06-17 
microcode: CPU30 updated to revision 0x710, date = 2013-06-17 
microcode: CPU31 updated to revision 0x710, date = 2013-06-17 
[  OK  ]


Setting hostname lola-10.lola.whamcloud.com:  [  OK  ]


device-mapper: multipath: version 1.6.0 loaded
Oct 19 20:56:48 | ignoring extra data starting with 'udev_dir' on line 2 of /etc/multipath.conf

device-mapper: multipath round-robin: version 1.0.0 loaded
device-mapper: table: 253:0: multipath: error getting device
device-mapper: ioctl: error adding target to table
Add partition mappings:  [  OK  ]


ERROR: asr: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: hpt37x: reading /dev/sdi[Input/output error]

ERROR: hpt45x: reading /dev/sdi[Input/output error]

ERROR: isw: reading /dev/sdi[Input/output error]

ERROR: jmicron: reading /dev/sdi[Input/output error]

ERROR: lsi: reading /dev/sdi[Input/output error]

ERROR: nvidia: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: sil: reading /dev/sdi[Input/output error]

ERROR: via: reading /dev/sdi[Input/output error]

ERROR: asr: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: hpt37x: reading /dev/sde[Input/output error]

ERROR: hpt45x: reading /dev/sde[Input/output error]

ERROR: isw: reading /dev/sde[Input/output error]

ERROR: jmicron: reading /dev/sde[Input/output error]

ERROR: lsi: reading /dev/sde[Input/output error]

ERROR: nvidia: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: sil: reading /dev/sde[Input/output error]

ERROR: via: reading /dev/sde[Input/output error]

ERROR: asr: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: hpt37x: reading /dev/sdc[Input/output error]

ERROR: hpt45x: reading /dev/sdc[Input/output error]

ERROR: isw: reading /dev/sdc[Input/output error]

ERROR: jmicron: reading /dev/sdc[Input/output error]

ERROR: lsi: reading /dev/sdc[Input/output error]

ERROR: nvidia: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: sil: reading /dev/sdc[Input/output error]

ERROR: via: reading /dev/sdc[Input/output error]

ERROR: asr: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: hpt37x: reading /dev/sdm[Input/output error]

ERROR: hpt45x: reading /dev/sdm[Input/output error]

ERROR: isw: reading /dev/sdm[Input/output error]

ERROR: jmicron: reading /dev/sdm[Input/output error]

ERROR: lsi: reading /dev/sdm[Input/output error]

ERROR: nvidia: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: sil: reading /dev/sdm[Input/output error]

ERROR: via: reading /dev/sdm[Input/output error]

ERROR: asr: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: hpt37x: reading /dev/sdg[Input/output error]

ERROR: hpt45x: reading /dev/sdg[Input/output error]

ERROR: isw: reading /dev/sdg[Input/output error]

ERROR: jmicron: reading /dev/sdg[Input/output error]

ERROR: lsi: reading /dev/sdg[Input/output error]

ERROR: nvidia: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: sil: reading /dev/sdg[Input/output error]

ERROR: via: reading /dev/sdg[Input/output error]

ERROR: asr: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: hpt37x: reading /dev/sdk[Input/output error]

ERROR: hpt45x: reading /dev/sdk[Input/output error]

ERROR: isw: reading /dev/sdk[Input/output error]

ERROR: jmicron: reading /dev/sdk[Input/output error]

ERROR: lsi: reading /dev/sdk[Input/output error]

ERROR: nvidia: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: sil: reading /dev/sdk[Input/output error]

ERROR: via: reading /dev/sdk[Input/output error]

Setting up Logical Volume Management: [  OK  ]


Checking filesystems

Checking all file systems.

[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/sdo1 

/dev/sdo1: clean, 131828/1310720 files, 3561034/5242880 blocks

[  OK  ]


Remounting root filEXT3-fs (sdo1): using internal journal
esystem in read-write mode:  [  OK  ]


Mounting local filesystems:  [  OK  ]


Enabling local filesystem quotas:  [  OK  ]


Enabling /etc/fstab swaps:  Adding 16457724k swap on /dev/sdo2.  Priority:-1 extents:1 across:16457724k 
[  OK  ]


Entering non-interactive startup

Calling the system activity data collector (sadc)... 

Loading OpenIB kernel modules:[  OK  ]


Mounting ZFS filesystem(s)  [  OK  ]


ip6tables: No config file.[WARNING]


iptables: No config file.[WARNING]


Bringing up loopback interface:  [  OK  ]


Bringing up interface eth0:  ADDRCONF(NETDEV_UP): eth0: link is not ready
Determining if ip address 10.4.0.110 is already in use for device eth0...

igb 0000:02:00.0: eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  OK  ]


Bringing up interface ib0:  ADDRCONF(NETDEV_UP): ib0: link is not ready
ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
[  OK  ]


Bringing up interface ipmi:  Device ipmi does not seem to be present, delaying initialization.

[FAILED]


Starting auditd: type=1305 audit(1476935828.177:3): audit_pid=4478 old=0 auid=4294967295 ses=4294967295 res=1
[  OK  ]


Loading Lustre module stack...LNet: HW CPU cores: 32, npartitions: 2
alg: No test for adler32 (adler32-zlib)
alg: No test for crc32 (crc32-table)
alg: No test for crc32 (crc32-pclmul)
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
Lustre: Lustre: Build Version: 2.8.59_25_g401d7fc
LNetError: 3904:0:(o2iblnd_cb.c:2302:kiblnd_passive_connect()) Can't accept conn from 192.168.1.108@o2ib10 on NA (ib0:0:192.168.1.110): bad dst nid 192.168.1.110@o2ib10
LNet: Added LNI 192.168.1.110@o2ib10 [8/256/0/180]


Starting system logger: [  OK  ]


Enabling ondemand cpu frequency scaling: [  OK  ]


Starting irqbalance: [  OK  ]


Starting rpcbind: [  OK  ]


ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Starting NFS statd: [  OK  ]


Starting system message bus: [  OK  ]


Setting NIS domain: domain is 'lola.whamcloud.com'  [  OK  ]


Starting NIS service: [  OK  ]


Binding NIS service: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
.ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
[  OK  ]


Starting ibacm daemon:[  OK  ]


NFS filesystems queued to be mounted

Mounting filesystems:  RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Slow work thread pool: Starting up
Slow work thread pool: Ready
FS-Cache: Loaded
NFS: Registering the id_resolver key type
FS-Cache: Netfs 'nfs' registered for caching
[  OK  ]


Starting acpi daemon: [  OK  ]


Starting HAL daemon: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
[  OK  ]


Retrigger failed udev events[  OK  ]


Starting ZFS Event Daemon  [  OK  ]
[  OK  ]


Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Starting NFS services:  [  OK  ]


Starting NFS quotas: [  OK  ]


Starting NFS mountd: [  OK  ]


Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
[  OK  ]


Starting RPC idmapd: [  OK  ]


Sharing ZFS filesystems  [  OK  ]


Starting MUNGE: munged[  OK  ]


Starting kdump:[  OK  ]


Starting sshd: [  OK  ]


Starting xinetd: [  OK  ]


Starting ntpd: [  OK  ]


Starting GANGLIA gmond: [  OK  ]


Starting sendmail: [  OK  ]


Starting sm-client: [  OK  ]


Starting crond: [  OK  ]


starting slurmd: 802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
8021q: adding VLAN 0 to HW filter on device eth0
[  OK  ]


Starting atd: [  OK  ]


Starting collectl: [  OK  ]



CentOS release 6.7 (Final)
Kernel 2.6.32-573.26.1.el6_lustre.x86_64 on an x86_64

lola-10.lola.whamcloud.com login: LDISKFS-fs warning (device dm-6): ldiskfs_multi_mount_protect: MMP interval 42 higher than expected, please wait.

Oct 19 21:00:01 lola-10 TIME: Time stamp for console
LDISKFS-fs (dm-6): recovery complete
LDISKFS-fs (dm-6): mounted filesystem with ordered data mode. quota=on. Opts: 
LustreError: 11-0: soaked-MDT0000-osp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -16
Lustre: soaked-MDT0002: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-450
Lustre: soaked-MDT0002: Will be in recovery for at least 2:30, or until 21 clients reconnect
Lustre: soaked-MDT0002: Connection restored to d39ccc70-54fd-d6aa-597f-74654617c478 (at 192.168.1.117@o2ib100)
Lustre: soaked-MDT0002: Connection restored to c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 1a9770ca-d51d-1ec7-9291-66c7a374ca9c (at 192.168.1.130@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: soaked-MDT0002: Connection restored to 4ef7dc7a-7144-0a99-211e-7322009418d7 (at 192.168.1.131@o2ib100)
Lustre: Skipped 15 previous similar messages
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0006_UUID (at 192.168.1.102@o2ib10)
Lustre: Skipped 14 previous similar messages
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: Skipped 5 previous similar messages
Lustre: soaked-MDT0002: Recovery over after 1:26, of 21 clients 21 recovered and 0 were evicted.
sd 0:0:1:42: attempting task abort! scmd(ffff8803d919a880)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e e8 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803d919a880)
sd 0:0:1:42: attempting task abort! scmd(ffff8803d919a780)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 10 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803d919a780)
sd 0:0:1:42: attempting task abort! scmd(ffff8803d919a680)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 20 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803d919a680)
sd 0:0:1:42: attempting task abort! scmd(ffff8803d919a580)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 38 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803d919a580)
sd 0:0:1:42: attempting task abort! scmd(ffff8803d919a480)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 58 00 00 50 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803d919a480)
sd 0:0:1:42: attempting task abort! scmd(ffff8803d919a380)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f b8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803d919a380)
sd 0:0:1:42: attempting task abort! scmd(ffff8803d919a280)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f c8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803d919a280)
sd 0:0:1:42: attempting task abort! scmd(ffff8803d919a180)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803d919a180)
sd 0:0:1:42: attempting task abort! scmd(ffff8803d919a080)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f f8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803d919a080)
Oct 19 21:05:01 lola-10 TIME: Time stamp for console
Oct 19 21:10:01 lola-10 TIME: Time stamp for console
Oct 19 21:15:01 lola-10 TIME: Time stamp for console
Oct 19 21:20:01 lola-10 TIME: Time stamp for console
Oct 19 21:25:01 lola-10 TIME: Time stamp for console
Oct 19 21:30:01 lola-10 TIME: Time stamp for console
Oct 19 21:35:01 lola-10 TIME: Time stamp for console
Oct 19 21:40:01 lola-10 TIME: Time stamp for console
Oct 19 21:45:01 lola-10 TIME: Time stamp for console
Oct 19 21:50:01 lola-10 TIME: Time stamp for console
Oct 19 21:55:01 lola-10 TIME: Time stamp for console
Oct 19 22:00:01 lola-10 TIME: Time stamp for console
Oct 19 22:05:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 3bf16639-ba44-da4f-3ae0-9f8f041df65f (at 192.168.1.127@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 3bf16639-ba44-da4f-3ae0-9f8f041df65f (at 192.168.1.127@o2ib100)
Lustre: Skipped 1 previous similar message
Oct 19 22:10:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100)
Oct 19 22:15:01 lola-10 TIME: Time stamp for console
Lustre: 6082:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476940751/real 1476940751]  req@ffff8807aeaaccc0 x1548680403268016/t0(0) o104->soaked-MDT0002@192.168.1.121@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476940758 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Oct 19 22:20:01 lola-10 TIME: Time stamp for console
Oct 19 22:25:01 lola-10 TIME: Time stamp for console
Oct 19 22:30:01 lola-10 TIME: Time stamp for console
Oct 19 22:35:01 lola-10 TIME: Time stamp for console
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               Version 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.                                                                                                                                                                          MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           LSI Corporation MPT SAS2 BIOS                                                   Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                 Initializing../                                                                 Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                                                                                                 Press Ctrl-C to start LSI Corp Configuration Utility...                         Searching for devices at HBA 0...                                               LSI Corporation MPT SAS2 BIOS                                                   MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                            PCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    SLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    ---- ---- --- -------- ---------------- ----------- ----------                    3           LSI      SAS2308-IT       15.00.00.00  0F:00:00:03                  3    4   7  LSI      Universal Xport  0786         20.00 MiB                    3    4   41  LSI      INF-01-00        0786         14.55 TiB                   3    4   42  LSI      INF-01-00        0786         14.55 TiB                   3    4   43  LSI      INF-01-00        0786         14.55 TiB                   3    4   44  LSI      INF-01-00        0786         14.55 TiB                   3    4   45  LSI      INF-01-00        0786         14.55 TiB                   3    4   46  LSI      INF-01-00        0786         14.55 TiB                   3    0   7  LSI      Universal Xport  0786         20.00 MiB                    3    0   41  LSI      INF-01-00        0786         14.55 TiB                   3    0   42  LSI      INF-01-00        0786         14.55 TiB                   3    0   43  LSI      INF-01-00        0786         14.55 TiB                   3    0   44  LSI      INF-01-00        0786         14.55 TiB                   3    0   45  LSI      INF-01-00        0786         14.55 TiB                   3    0   46  LSI      INF-01-00        0786         14.55 TiB                 Copyright 2000-2012 LSI Corporation.                                                                                                                              RAID Volumes:                                                                   None defined.                                                                   Physical Devices:                                                             �  ID   Device Model     Serial #                     Size Type/Status(Vol ID)     0    ST500NM0011      Z1M0X1F9                  465.7GB Non-RAID Disk           1    ST500NM0011      Z1M0X1GG                  465.7GB Non-RAID Disk         Press <CTRL-I> to enter Configuration Utility..                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Copyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                     RAID Volumes:                                                                 Press <CTRL-I> to enter Configuration Utility...                                                                                                                PXE 2.1 Build 091 (WfM 2.0)                                                     Press Ctrl+S to enter the Setup Menu.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                          Bios Version: SE5C600.86B.01.08.0003.022620131521                               BMC Firmware Version: 1.17.4207                                                 SDR Version: SDR Package 1.09                                                   ME Firmware Version: 2.1.7.112                                                  Platform ID: S2600GZ                                                            System memory detected: 32768 MB                                                Current memory speed: 1333 MT/s                                                 Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        Number of physical processors identified: 2                                     ********************************************************************************AHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          SAS/SATA Capable Controller configured with 4 ports in SATA mode                ********************************************************************************USB Keyboard detected                                                           USB Mouse detected                                                                                                                                              Press <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                                     
Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

    GNU GRUB  version 0.97  (571K lower / 3066652K upper memory)

+-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+
      Use the ^ and v keys to select which entry is highlighted.
      Press enter to boot the selected OS, 'e' to edit the
      commands before booting, 'a' to modify the kernel arguments
      before booting, or 'c' for a command-line.  CentOS (2.6.32-573.26.1.el6_lustre.x86_64)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  The highlighted entry will be booted automatically in 5 seconds.    The highlighted entry will be booted automatically in 4 seconds.    The highlighted entry will be booted automatically in 3 seconds.    The highlighted entry will be booted automatically in 2 seconds.    The highlighted entry will be booted automatically in 1 seconds.    Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-573.26.1.el6_lustre.x86_64 (soakbuilder@lola-16.lola.whamcloud.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-16) (GCC) ) #1 SMP Mon Oct 17 13:07:39 PDT 2016
Command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=auto SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000008ec00 (usable)
 BIOS-e820: 000000000008ec00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bb3c7000 (usable)
 BIOS-e820: 00000000bb3c7000 - 00000000bdd2f000 (reserved)
 BIOS-e820: 00000000bdd2f000 - 00000000bddcd000 (ACPI NVS)
 BIOS-e820: 00000000bddcd000 - 00000000bdea1000 (ACPI data)
 BIOS-e820: 00000000bdea1000 - 00000000bdf2f000 (ACPI NVS)
 BIOS-e820: 00000000bdf2f000 - 00000000bdfac000 (ACPI data)
 BIOS-e820: 00000000bdfac000 - 00000000be000000 (usable)
 BIOS-e820: 00000000be000000 - 00000000d0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
 BIOS-e820: 00000000fed19000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ffa20000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000840000000 (usable)
DMI 2.6 present.
SMBIOS version 2.6 @ 0xF0440
No AGP bridge found
last_pfn = 0x840000 max_arch_pfn = 0x400000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xbe000 max_arch_pfn = 0x400000000
Using GB pages for direct mapping
init_memory_mapping: 0000000000000000-00000000be000000
init_memory_mapping: 0000000100000000-0000000840000000
RAMDISK: 3601e000 - 37fef30d
ACPI: Deleted _OSI()
ACPI: Deleted _OSI()
ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20090903/tbfadt-611)
ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
ACPI: FACS 00000000bdfa9f40 00040
ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
Setting APIC routing to flat.
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: PXM 0 -> APIC 2 -> Node 0
SRAT: PXM 0 -> APIC 3 -> Node 0
SRAT: PXM 0 -> APIC 4 -> Node 0
SRAT: PXM 0 -> APIC 5 -> Node 0
SRAT: PXM 0 -> APIC 6 -> Node 0
SRAT: PXM 0 -> APIC 7 -> Node 0
SRAT: PXM 0 -> APIC 8 -> Node 0
SRAT: PXM 0 -> APIC 9 -> Node 0
SRAT: PXM 0 -> APIC 10 -> Node 0
SRAT: PXM 0 -> APIC 11 -> Node 0
SRAT: PXM 0 -> APIC 12 -> Node 0
SRAT: PXM 0 -> APIC 13 -> Node 0
SRAT: PXM 0 -> APIC 14 -> Node 0
SRAT: PXM 0 -> APIC 15 -> Node 0
SRAT: PXM 1 -> APIC 32 -> Node 1
SRAT: PXM 1 -> APIC 33 -> Node 1
SRAT: PXM 1 -> APIC 34 -> Node 1
SRAT: PXM 1 -> APIC 35 -> Node 1
SRAT: PXM 1 -> APIC 36 -> Node 1
SRAT: PXM 1 -> APIC 37 -> Node 1
SRAT: PXM 1 -> APIC 38 -> Node 1
SRAT: PXM 1 -> APIC 39 -> Node 1
SRAT: PXM 1 -> APIC 40 -> Node 1
SRAT: PXM 1 -> APIC 41 -> Node 1
SRAT: PXM 1 -> APIC 42 -> Node 1
SRAT: PXM 1 -> APIC 43 -> Node 1
SRAT: PXM 1 -> APIC 44 -> Node 1
SRAT: PXM 1 -> APIC 45 -> Node 1
SRAT: PXM 1 -> APIC 46 -> Node 1
SRAT: PXM 1 -> APIC 47 -> Node 1
SRAT: Node 0 PXM 0 0-c0000000
SRAT: Node 0 PXM 0 100000000-440000000
SRAT: Node 1 PXM 1 440000000-840000000
Bootmem setup node 0 0000000000000000-0000000440000000
  NODE_DATA [0000000000009000 - 000000000003cfff]
  bootmap [0000000000100000 -  0000000000187fff] pages 88
(8 early reservations) ==> bootmem [0000000000 - 0440000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS ==> [0001000000 - 000203eb64]
  #3 [003601e000 - 0037fef30d]          RAMDISK ==> [003601e000 - 0037fef30d]
  #4 [000008ec00 - 0000100000]    BIOS reserved ==> [000008ec00 - 0000100000]
  #5 [000203f000 - 000203f9b8]              BRK ==> [000203f000 - 000203f9b8]
  #6 [0000008000 - 0000009000]          PGTABLE ==> [0000008000 - 0000009000]
  #7 [0000001000 - 0000001030]        ACPI SLIT ==> [0000001000 - 0000001030]
Bootmem setup node 1 0000000440000000-0000000840000000
  NODE_DATA [0000000440000040 - 000000044003403f]
  bootmap [0000000440035000 -  00000004400b4fff] pages 80
(8 early reservations) ==> bootmem [0440000000 - 0840000000]
  #0 [0000000000 - 0000001000]   BIOS data page
  #1 [0000006000 - 0000008000]       TRAMPOLINE
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS
  #3 [003601e000 - 0037fef30d]          RAMDISK
  #4 [000008ec00 - 0000100000]    BIOS reserved
  #5 [000203f000 - 000203f9b8]              BRK
  #6 [0000008000 - 0000009000]          PGTABLE
  #7 [0000001000 - 0000001030]        ACPI SLIT
found SMP MP-table at [ffff8800000fcd70] fcd70
Reserving 131MB of memory at 48MB for crashkernel (System RAM: 33792MB)
Zone PFN ranges:
  DMA      0x00000001 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   0x00100000 -> 0x00840000
Movable zone start PFN for each node
early_node_map[5] active PFN ranges
    0: 0x00000001 -> 0x0000008e
    0: 0x00000100 -> 0x000bb3c7
    0: 0x000bdfac -> 0x000be000
    0: 0x00100000 -> 0x00440000
    1: 0x00440000 -> 0x00840000
ACPI: PM-Timer IO Port: 0x408
Setting APIC routing to flat.
ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a701 base: 0xfed00000
SMP: Allowing 240 CPUs, 208 hotplug CPUs
PM: Registered nosave memory: 000000000008e000 - 000000000008f000
PM: Registered nosave memory: 000000000008f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
PM: Registered nosave memory: 00000000bb3c7000 - 00000000bdd2f000
PM: Registered nosave memory: 00000000bdd2f000 - 00000000bddcd000
PM: Registered nosave memory: 00000000bddcd000 - 00000000bdea1000
PM: Registered nosave memory: 00000000bdea1000 - 00000000bdf2f000
PM: Registered nosave memory: 00000000bdf2f000 - 00000000bdfac000
PM: Registered nosave memory: 00000000be000000 - 00000000d0000000
PM: Registered nosave memory: 00000000d0000000 - 00000000fec00000
PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
PM: Registered nosave memory: 00000000fec01000 - 00000000fed19000
PM: Registered nosave memory: 00000000fed19000 - 00000000fed1a000
PM: Registered nosave memory: 00000000fed1a000 - 00000000fed1c000
PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
PM: Registered nosave memory: 00000000fed20000 - 00000000fee00000
PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
PM: Registered nosave memory: 00000000fee01000 - 00000000ffa20000
PM: Registered nosave memory: 00000000ffa20000 - 0000000100000000
Allocating PCI resources starting at d0000000 (gap: d0000000:2ec00000)
Booting paravirtualized kernel on bare hardware
NR_CPUS:4096 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
PERCPU: Embedded 30 pages/cpu @ffff880038600000 s91288 r8192 d23400 u131072
pcpu-alloc: s91288 r8192 d23400 u131072 alloc=1*2097152
pcpu-alloc: [0] 000 001 002 003 004 005 006 007 016 017 018 019 020 021 022 023 
pcpu-alloc: [0] 032 034 036 038 040 042 044 046 048 050 052 054 056 058 060 062 
pcpu-alloc: [0] 064 066 068 070 072 074 076 078 080 082 084 086 088 090 092 094 
pcpu-alloc: [0] 096 098 100 102 104 106 108 110 112 114 116 118 120 122 124 126 
pcpu-alloc: [0] 128 130 132 134 136 138 140 142 144 146 148 150 152 154 156 158 
pcpu-alloc: [0] 160 162 164 166 168 170 172 174 176 178 180 182 184 186 188 190 
pcpu-alloc: [0] 192 194 196 198 200 202 204 206 208 210 212 214 216 218 220 222 
pcpu-alloc: [0] 224 226 228 230 232 234 236 238 --- --- --- --- --- --- --- --- 
pcpu-alloc: [1] 008 009 010 011 012 013 014 015 024 025 026 027 028 029 030 031 
pcpu-alloc: [1] 033 035 037 039 041 043 045 047 049 051 053 055 057 059 061 063 
pcpu-alloc: [1] 065 067 069 071 073 075 077 079 081 083 085 087 089 091 093 095 
pcpu-alloc: [1] 097 099 101 103 105 107 109 111 113 115 117 119 121 123 125 127 
pcpu-alloc: [1] 129 131 133 135 137 139 141 143 145 147 149 151 153 155 157 159 
pcpu-alloc: [1] 161 163 165 167 169 171 173 175 177 179 181 183 185 187 189 191 
pcpu-alloc: [1] 193 195 197 199 201 203 205 207 209 211 213 215 217 219 221 223 
pcpu-alloc: [1] 225 227 229 231 233 235 237 239 --- --- --- --- --- --- --- --- 
Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8250675
Policy zone: Normal
Kernel command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=131M@0M SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
PID hash table entries: 4096 (order: 3, 32768 bytes)
xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
Checking aperture...
No AGP bridge found
Memory: 32738448k/34603008k available (5400k kernel code, 1126752k absent, 737808k reserved, 7008k data, 1304k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:3144
Extended CMOS year: 2000
Console: colour VGA+ 80x25
console [ttyS0] enabled
allocated 134217728 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
TSC: cpu family 6 model 45, tsc initial value = 75a4799d10
Fast TSC calibration using PIT
Detected 2693.450 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.90 BogoMIPS (lpj=2693450)
pid_max: default: 245760 minimum: 1920
Security Framework initialized
SELinux:  Initializing.
Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 20 MCE banks
CPU0: Thermal monitoring enabled (TM1)
using mwait in idle threads.
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 22144 entries in 87 pages
x2apic not enabled, IRQ remapping init failed
APIC routing finalized to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz stepping 07
Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
... version:                3
... bit width:              48
... generic registers:      4
... value mask:             0000ffffffffffff
... max period:             0000ffffffffffff
... fixed-purpose events:   3
... event mask:             000000070000000f
NMI watchdog enabled, takes one hw-pmu counter.
Booting Node   0, Processors  #1 #2 #3 #4 #5 #6 #7 Ok.
Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 Ok.
Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 Ok.
Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
Brought up 32 CPUs
Total of 32 processors activated (172370.68 BogoMIPS).
devtmpfs: initialized
PM: Registering ACPI NVS region at bdd2f000 (647168 bytes)
PM: Registering ACPI NVS region at bdea1000 (581632 bytes)
regulator: core version 0.5
NET: Registered protocol family 16
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MCFG configuration 0: base c0000000 segment 0 buses 0 - 255
PCI: MCFG area at c0000000 reserved in E820
PCI: Using MMCONFIG at c0000000 - cfffffff
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: Executed 1 blocks of module-level executable AML code
ACPI: BIOS _OSI(Linux) query ignored
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
HEST: Table parsing has been initialized.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
pci_root PNP0A08:00: host bridge window [io  0x0000-0xbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:00: host bridge window [mem 0x000c0000-0x000c3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c4000-0x000c7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c8000-0x000cbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000cc000-0x000cffff]
pci_root PNP0A08:00: host bridge window [mem 0x000d0000-0x000d3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d4000-0x000d7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d8000-0x000dbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000dc000-0x000dffff]
pci_root PNP0A08:00: host bridge window [mem 0x000e0000-0x000e3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e4000-0x000e7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e8000-0x000ebfff]
pci_root PNP0A08:00: host bridge window [mem 0x000ec000-0x000effff]
pci_root PNP0A08:00: host bridge window [mem 0x000f0000-0x000fffff]
pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xebffffff]
pci_root PNP0A08:00: host bridge window [mem 0x380000000000-0x38007fffffff]
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdfff])
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff]
pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff]
pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff]
pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff]
pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff]
pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff]
pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff]
pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff]
pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff]
pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff]
pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff]
pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff]
pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff]
pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
pci 0000:00:00.0: PME# disabled
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
pci 0000:00:01.1: PME# disabled
pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
pci 0000:00:02.0: PME# disabled
pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
pci 0000:00:02.2: PME# disabled
pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
pci 0000:00:03.0: PME# disabled
pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
pci 0000:00:11.0: PME# disabled
pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.0: PME# disabled
pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
pci 0000:00:16.1: PME# disabled
pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.7: PME# disabled
pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.0: PME# disabled
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:00.0: PME# disabled
pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
pci 0000:02:00.1: PME# disabled
pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
pci 0000:02:00.2: PME# disabled
pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
pci 0000:02:00.3: PME# disabled
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:07:00.3: PME# supported from D0 D3hot D3cold
pci 0000:07:00.3: PME# disabled
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a] (subtractive decode)
 pci0000:00: Requesting ACPI _OSC control (0x1d)
 pci0000:00: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
pci_root PNP0A08:01: host bridge window [io  0x03b0-0x03df]
pci_root PNP0A08:01: host bridge window [io  0xc000-0xffff]
pci_root PNP0A08:01: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:01: host bridge window [mem 0xec000000-0xfbffffff]
pci_root PNP0A08:01: host bridge window [mem 0x380080000000-0x3800ffffffff]
PCI host bridge to bus 0000:80
pci_bus 0000:80: root bus resource [io  0x03b0-0x03df]
pci_bus 0000:80: root bus resource [io  0xc000-0xffff]
pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff]
pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff]
pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
pci 0000:80:01.0: PME# disabled
pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
pci 0000:80:02.0: PME# disabled
pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
pci 0000:80:03.0: PME# disabled
pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
pci 0000:80:03.2: PME# disabled
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
 pci0000:80: Requesting ACPI _OSC control (0x1d)
 pci0000:80: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
PCI host bridge to bus 0000:7f
 pci0000:7f: Requesting ACPI _OSC control (0x1d)
 pci0000:7f: ACPI _OSC control (0x10) granted
ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
PCI host bridge to bus 0000:ff
 pci0000:ff: Requesting ACPI _OSC control (0x1d)
 pci0000:ff: ACPI _OSC control (0x10) granted
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:09:00.0
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
HPET: 8 timers in total, 5 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 72, 73, 74, 75, 76, 0
hpet0: 8 comparators, 64-bit 14.318180 MHz counter
Switching to clocksource hpet
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 15 devices
ACPI: ACPI bus type pnp unregistered
system 00:05: [io  0x0680-0x069f] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0x0400-0x0453] has been reserved
system 00:05: [io  0x0458-0x047f] has been reserved
system 00:05: [io  0x0500-0x057f] has been reserved
system 00:05: [io  0x0600-0x061f] has been reserved
system 00:05: [io  0x0ca2-0x0ca5] has been reserved
system 00:05: [io  0x0cf9] could not be reserved
system 00:07: [io  0x0454-0x0457] has been reserved
system 00:0a: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:0a: [mem 0xebfff000-0xebffffff] has been reserved
system 00:0a: [mem 0xc0000000-0xcfffffff] has been reserved
system 00:0a: [mem 0xfed20000-0xfed3ffff] has been reserved
system 00:0a: [mem 0xfed45000-0xfed8ffff] has been reserved
system 00:0a: [mem 0xff000000-0xffffffff] could not be reserved
system 00:0a: [mem 0xfee00000-0xfeefffff] could not be reserved
system 00:0a: [mem 0xfec00000-0xfecfffff] could not be reserved
system 00:0a: [mem 0xd0f70000-0xd0f70fff] has been reserved
system 00:0c: [mem 0x00000000-0x0009cfff] could not be reserved
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
pci 0000:00:02.0:   bridge window [mem 0xeb000000-0xeb7fffff 64bit pref]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
pci 0000:00:11.0:   bridge window [mem 0xeb800000-0xebcfffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a]
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
pci 0000:00:01.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:01.1: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.2: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:03.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:11.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
pci 0000:80:01.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:02.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.2: PCI INT A -> GSI 71 (level, low) -> IRQ 71
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1a.0: PCI INT B disabled
pci 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1d.0: PCI I�NT A disabled
age as initramfs...
Freeing initrd memory: 32580k freed
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
futex hash table entries: 65536 (order: 10, 4194304 bytes)
audit: initializing netlink socket (disabled)
type=2000 audit(1476942039.104:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 32768
ksign: Installing public key data
Loading keyring
- Added public key 3B396075E393847B
- User ID: Red Hat, Inc. (Kernel Module GPG key)
- Added public key D4A26C9CCD09BEDA
- User ID: Red Hat Enterprise Linux Driver Update Program <secalert@redhat.com>
- Added public key CB445E0DA3EA1F65
- User ID: Red Hat Enterprise Linux Driver Update Program (key 4) <secalert@redhat.com>
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
acpiphp: Slot [2] registered
acpiphp: Slot [2-1] registered
acpiphp: Slot [2-2] registered
acpiphp: Slot [2-3] registered
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
[Firmware Bug]: No valid trip found
ERST: Error Record Serialization Table (ERST) support is initialized.
GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
�serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input1
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
ehci_hcd 0000:00:1a.0: EHCI Host Controller
ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.0: debug port 2
ehci_hcd 0000:00:1a.0: irq 22, io mem 0xd0f20000
ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb1: SerialNumber: 0000:00:1a.0
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
ehci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
ehci_hcd 0000:00:1d.0: EHCI Host Controller
ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
ehci_hcd 0000:00:1d.0: debug port 2
ehci_hcd 0000:00:1d.0: irq 20, io mem 0xd0f10000
Refined TSC clocksource calibration: 2693.509 MHz.
Switching to clocksource tsc
ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: EHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
PNP: No PS/2 controller found. Probing ports directly.
mice: PS/2 mouse device common for all mice
rtc_cmos 00:06: RTC can wake from S4
rtc_cmos 00:06: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
cpuidle: using governor ladder
cpuidle: using governor menu
EFI Variables Facility v0.08 2004-May-17
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
GRE over IPv4 demultiplexor driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
rtc_cmos 00:06: setting system clock to 2016-10-20 05:40:44 UTC (1476942044)
Initalizing network drop monitor service
Freeing unused kernel memory: 1304k freed
Write protecting the kernel read-only data: 10240k
Freeing unused kernel memory: 724k freed
Freeing unused kernel memory: 1572k freed
rdac: device handler registered
dracut: dracut-004-388.el6
dracut: rd_NO_LUKS: removing cryptoluks activation
dracut: rd_NO_LVM: removing LVM activation
usb 1-1: new high speed USB device number 2 using ehci_hcd
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: dm-devel@redhat.com
udev: starting version 147
usb 1-1: New USB device found, idVendor=8087, idProduct=0024
usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 1-1: configuration #1 chosen from 1 choice
hub 1-1:1.0: USB hub found
hub 1-1:1.0: 6 ports detected
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
usb 2-1: new high speed USB device number 2 using ehci_hcd
mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)
mlx4_core: Initializing 0000:04:00.0
mlx4_core 0000:04:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
usb 2-1: New USB device found, idVendor=8087, idProduct=0024
usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 2-1: configuration #1 chosen from 1 choice
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 8 ports detected
usb 2-1.4: new full speed USB device number 3 using ehci_hcd
usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.4: Product: Virtual Keyboard and Mouse
usb 2-1.4: Manufacturer: American Megatrends Inc.
usb 2-1.4: SerialNumber: serial
usb 2-1.4: configuration #1 chosen from 1 choice
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input2
generic-usb 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input3
generic-usb 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)
mlx4_en 0000:04:00.0: registered PHC clock
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
<mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014)
mpt2sas version 20.101.00.00 loaded
mpt2sas 0000:06:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32774632 kB)
mpt2sas0: MSI-X vectors supported: 8, no of cores: 32, max_msix_vectors: 8
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 127
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 128
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 129
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 130
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 131
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 132
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 133
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 134
mpt2sas0: iomem(0x00000000d0a40000), mapped(0xffffc900147c0000), size(65536)
mpt2sas0: ioport(0x0000000000002000), size(256)
mpt2sas0: sending message unit reset !!
mpt2sas0: message unit reset: SUCCESS
mpt2sas0: Allocated physical memory: size(17329 kB)
mpt2sas0: Current Controller Queue Depth(9979), Max Controller Queue Depth(10240)
mpt2sas0: Scatter Gather Elements per IO(128)
mpt2sas0: LSISAS2308: FWVersion(15.00.00.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
mpt2sas0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi0 : Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas0: host_add: handle(0x0001), sas_addr(0x500605b005d6d910), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:41: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:42: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:43: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:44: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:45: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:46: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:41: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:42: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:43: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:44: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:45: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:46: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:0:41: rdac: LUN 41 (RDAC) (owned)
scsi 0:0:0:42: rdac: LUN 42 (RDAC) (unowned)
scsi 0:0:0:43: rdac: LUN 43 (RDAC) (owned)
scsi 0:0:0:44: rdac: LUN 44 (RDAC) (unowned)
scsi 0:0:0:45: rdac: LUN 45 (RDAC) (owned)
scsi 0:0:0:46: rdac: LUN 46 (RDAC) (unowned)
scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:1:41: rdac: LUN 41 (RDAC) (unowned)
scsi 0:0:1:42: rdac: LUN 42 (RDAC) (owned)
scsi 0:0:1:43: rdac: LUN 43 (RDAC) (unowned)
scsi 0:0:1:44: rdac: LUN 44 (RDAC) (owned)
scsi 0:0:1:45: rdac: LUN 45 (RDAC) (unowned)
scsi 0:0:1:46: rdac: LUN 46 (RDAC) (owned)
isci: Intel(R) C600 SAS Controller Driver - version 1.1.0-rh
isci 0000:07:00.0: driver configured for rev: 6 silicon
isci 0000:07:00.0: OEM parameter table found in OROM
isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
isci 0000:07:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
scsi1 : isci
ata1.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata1.00: configured for UDMA/133
scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ata2.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata2.00: configured for UDMA/133
scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ACPI: WMI: Mapper loaded
ahci 0000:00:1f.2: PCI INT B -> GSI 21 (level, low) -> IRQ 21
ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
scsi2 : ahci
scsi3 : ahci
scsi4 : ahci
scsi5 : ahci
scsi6 : ahci
scsi7 : ahci
ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 137
ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 137
ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 137
ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 137
ata7: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 137
ata8: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 137
ata5: SATA link down (SStatus 0 SControl 300)
ata8: SATA link down (SStatus 0 SControl 300)
ata6: SATA link down (SStatus 0 SControl 300)
ata4: SATA link down (SStatus 0 SControl 300)
ata7: SATA link down (SStatus 0 SControl 300)
ata3: SATA link down (SStatus 0 SControl 300)
%Gsd 0:0:0:7: [sda] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 1:0:0:0: [sdo] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:0:0: [sdo] Write Protect is off
sd 1:0:0:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sdo:
sd 1:0:1:0: [sdp] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 0:0:0:42: [sdc] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
 sdo1 sdo2
sd 0:0:0:43: [sdd] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:43: [sdk] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:44: [sdl] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:45: [sdm] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:46: [sdg] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:1:41: [sdi] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:42: [sdj] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:46: [sdn] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:41: [sdb] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:42: [sdc] Write Protect is off
sd 0:0:1:43: [sdk] Write Protect is off
sd 0:0:0:44: [sde] Write Protect is off
sd 0:0:1:45: [sdm] Write Protect is off
sd 0:0:0:43: [sdd] Write Protect is off
sd 0:0:1:41: [sdi] Write Protect is off
sd 0:0:1:42: [sdj] Write Protect is off
sd 0:0:1:44: [sdl] Write Protect is off
sd 0:0:1:46: [sdn] Write Protect is off
sd 0:0:1:7: [sdh] Write Protect is off
sd 0:0:0:44: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] Write Protect is off
sd 0:0:1:43: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:41: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:45: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:41: [sdb] Write Protect is off
sd 0:0:1:46: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:42: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:7: [sda] Write Protect is off
sd 0:0:0:41: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:42: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:45: [sdf] Write Protect is off
sd 0:0:0:43: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:7: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:45: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:44: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdk:
 sdi:
 sdg:Dev sdk: unable to read RDB block 0
 sdh: unable to read partition table
Dev sdg: unable to read RDB block 0
sd 1:0:1:0: [sdp] Write Protect is off
sd 1:0:1:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 0:0:1:43: [sdk] Attached SCSI disk
Dev sdi: unable to read RDB block 0
 sdn:
sd 1:0:0:0: [sdo] Attached SCSI disk
 unable to read partition table
 unable to read partition table
sd 0:0:0:46: [sdg] Attached SCSI disk
 unknown partition table
sd 0:0:1:41: [sdi] Attached SCSI disk
 sdd:
sd 0:0:1:46: [sdn] Attached SCSI disk
 sdc:
 sdp: unknown partition table
 sda:
sd 0:0:0:43: [sdd] Attached SCSI disk
 sdm:
 sdf:Dev sdc: unable to read RDB block 0
 unable to read partition table
 unknown partition table
sd 0:0:0:42: [sdc] Attached SCSI disk
Dev sdm: unable to read RDB block 0
 unable to read partition table
 sde:
sd 0:0:0:45: [sdf] Attached SCSI disk
Dev sde: unable to read RDB block 0
sd 0:0:1:45: [sdm] Attached SCSI disk
 sdj:
 sdb: unable to read partition table
 unknown partition table
 sdl:
sd 0:0:1:42: [sdj] Attached SCSI disk
sd 0:0:0:44: [sde] Attached SCSI disk
 unknown partition table
 unknown partition table
sd 0:0:0:41: [sdb] Attached SCSI disk
sd 0:0:1:44: [sdl] Attached SCSI disk
 sdp1 sdp9
sd 1:0:1:0: [sdp] Attached SCSI disk
 unknown partition table
sd 0:0:1:7: [sdh] Attached SCSI disk
 unknown partition table
sd 0:0:0:7: [sda] Attached SCSI disk
EXT3-fs (sdo1): recovery required on readonly filesystem
EXT3-fs (sdo1): write access will be enabled during recovery
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sdo1): orphan cleanup on readonly fs
EXT3-fs (sdo1): 1 orphan inode deleted
EXT3-fs (sdo1): recovery complete
EXT3-fs (sdo1): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/sdo1
SELinux:  Disabled at runtime.
type=1404 audit(1476942060.990:2): selinux=0 auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
cat: /proc/self/attr/current: Invalid argument

		Welcome to CentOS 

Starting udev: udev: starting version 147
dca service started, version 1.12.1
igb: Intel(R) Gigabit Ethernet Network Driver - version 5.2.15-k
igb: Copyright (c) 2007-2014 Intel Corporation.
igb 0000:02:00.0: PCI INT A -> GSI 27 (level, low) -> IRQ 27
igb 0000:02:00.0: added PHC on eth0
igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b3
igb 0000:02:00.0: eth0: PBA No: 100000-000
igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.1: PCI INT B -> GSI 30 (level, low) -> IRQ 30
igb 0000:02:00.1: added PHC on eth1
igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b4
igb 0000:02:00.1: eth1: PBA No: 100000-000
igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.2: PCI INT C -> GSI 28 (level, low) -> IRQ 28
igb 0000:02:00.2: added PHC on eth2
igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b5
igb 0000:02:00.2: eth2: PBA No: 100000-000
igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.3: PCI INT D -> GSI 29 (level, low) -> IRQ 29
igb 0000:02:00.3: added PHC on eth3
igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b6
igb 0000:02:00.3: eth3: PBA No: 100000-000
igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
scsi 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:0:7: Attached scsi generic sg1 type 0
sd 0:0:0:41: Attached scsi generic sg2 type 0
sd 0:0:0:42: Attached scsi generic sg3 type 0
sd 0:0:0:43: Attached scsi generic sg4 type 0
sd 0:0:0:44: Attached scsi generic sg5 type 0
sd 0:0:0:45: Attached scsi generic sg6 type 0
sd 0:0:0:46: Attached scsi generic sg7 type 0
scsi 0:0:1:0: Attached scsi generic sg8 type 0
sd 0:0:1:7: Attached scsi generic sg9 type 0
sd 0:0:1:41: Attached scsi generic sg10 type 0
sd 0:0:1:42: Attached scsi generic sg11 type 0
sd 0:0:1:43: Attached scsi generic sg12 type 0
sd 0:0:1:44: Attached scsi generic sg13 type 0
sd 0:0:1:45: Attached scsi generic sg14 type 0
sd 0:0:1:46: Attached scsi generic sg15 type 0
sd 1:0:0:0: Attached scsi generic sg16 type 0
sd 1:0:1:0: Attached scsi generic sg17 type 0
ioatdma: Intel(R) QuickData Technology Driver 4.00
ioatdma 0000:00:04.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
igb 0000:02:00.0: DCA enabled
igb 0000:02:00.1: DCA enabled
ioatdma 0000:00:04.1: PCI INT B -> GSI 39 (level, low) -> IRQ 39
igb 0000:02:00.2: DCA enabled
igb 0000:02:00.3: DCA enabled
ioatdma 0000:00:04.2: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.3: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.4: PCI INT A -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.5: PCI INT B -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.6: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.7: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:80:04.0: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.1: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.2: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.3: PCI INT D -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.4: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.5: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.6: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.7: PCI INT D -> GSI 63 (level, low) -> IRQ 63
i801_smbus 0000:00:1f.3: PCI INT C -> GSI 23 (level, low) -> IRQ 23
ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
i801_smbus 0000:07:00.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
i801_smbus 0000:07:00.3: Enabling SMBus device
ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042f conflicts with OpRegion 0x0000000000000400-0x000000000000047f (\PMIO) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000053f (\FBPC) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000052f (\_SI_.SIOR) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
lpc_ich: Resource conflict(s) found affecting gpio_ich
EDAC MC: Ver: 2.1.0 Oct 17 2016
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0
EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0
EDAC sbridge: Driver loaded.
%Gzunicode: module license 'CDDL' taints kernel.
Disabling lock debugging due to kernel taint
SPL: Loaded module v0.6.5.7-1
ZFS: Loaded module v0.6.5.7-1, ZFS pool version 5000, ZFS filesystem version 5
iTCO_vendor_support: vendor-support=0
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.07rh
iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
microcode: CPU0 updated to revision 0x710, date = 2013-06-17 
microcode: CPU1 updated to revision 0x710, date = 2013-06-17 
microcode: CPU2 updated to revision 0x710, date = 2013-06-17 
microcode: CPU3 updated to revision 0x710, date = 2013-06-17 
microcode: CPU4 updated to revision 0x710, date = 2013-06-17 
microcode: CPU5 updated to revision 0x710, date = 2013-06-17 
microcode: CPU6 updated to revision 0x710, date = 2013-06-17 
microcode: CPU7 updated to revision 0x710, date = 2013-06-17 
microcode: CPU8 updated to revision 0x710, date = 2013-06-17 
microcode: CPU9 updated to revision 0x710, date = 2013-06-17 
microcode: CPU10 updated to revision 0x710, date = 2013-06-17 
microcode: CPU11 updated to revision 0x710, date = 2013-06-17 
microcode: CPU12 updated to revision 0x710, date = 2013-06-17 
microcode: CPU13 updated to revision 0x710, date = 2013-06-17 
microcode: CPU14 updated to revision 0x710, date = 2013-06-17 
microcode: CPU15 updated to revision 0x710, date = 2013-06-17 
microcode: CPU16 updated to revision 0x710, date = 2013-06-17 
microcode: CPU17 updated to revision 0x710, date = 2013-06-17 
microcode: CPU18 updated to revision 0x710, date = 2013-06-17 
microcode: CPU19 updated to revision 0x710, date = 2013-06-17 
microcode: CPU20 updated to revision 0x710, date = 2013-06-17 
microcode: CPU21 updated to revision 0x710, date = 2013-06-17 
microcode: CPU22 updated to revision 0x710, date = 2013-06-17 
microcode: CPU23 updated to revision 0x710, date = 2013-06-17 
microcode: CPU24 updated to revision 0x710, date = 2013-06-17 
microcode: CPU25 updated to revision 0x710, date = 2013-06-17 
microcode: CPU26 updated to revision 0x710, date = 2013-06-17 
microcode: CPU27 updated to revision 0x710, date = 2013-06-17 
microcode: CPU28 updated to revision 0x710, date = 2013-06-17 
microcode: CPU29 updated to revision 0x710, date = 2013-06-17 
microcode: CPU30 updated to revision 0x710, date = 2013-06-17 
microcode: CPU31 updated to revision 0x710, date = 2013-06-17 
[  OK  ]


Setting hostname lola-10.lola.whamcloud.com:  [  OK  ]


device-mapper: multipath: version 1.6.0 loaded
Oct 19 22:41:05 | ignoring extra data starting with 'udev_dir' on line 2 of /etc/multipath.conf

device-mapper: multipath round-robin: version 1.0.0 loaded
device-mapper: table: 253:0: multipath: error getting device
device-mapper: ioctl: error adding target to table
Add partition mappings:  [  OK  ]


ERROR: asr: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: hpt37x: reading /dev/sdc[Input/output error]

ERROR: hpt45x: reading /dev/sdc[Input/output error]

ERROR: isw: reading /dev/sdc[Input/output error]

ERROR: jmicron: reading /dev/sdc[Input/output error]

ERROR: lsi: reading /dev/sdc[Input/output error]

ERROR: nvidia: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: sil: reading /dev/sdc[Input/output error]

ERROR: via: reading /dev/sdc[Input/output error]

ERROR: asr: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: hpt37x: reading /dev/sdg[Input/output error]

ERROR: hpt45x: reading /dev/sdg[Input/output error]

ERROR: isw: reading /dev/sdg[Input/output error]

ERROR: jmicron: reading /dev/sdg[Input/output error]

ERROR: lsi: reading /dev/sdg[Input/output error]

ERROR: nvidia: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: sil: reading /dev/sdg[Input/output error]

ERROR: via: reading /dev/sdg[Input/output error]

ERROR: asr: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: hpt37x: reading /dev/sdm[Input/output error]

ERROR: hpt45x: reading /dev/sdm[Input/output error]

ERROR: isw: reading /dev/sdm[Input/output error]

ERROR: jmicron: reading /dev/sdm[Input/output error]

ERROR: lsi: reading /dev/sdm[Input/output error]

ERROR: nvidia: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: sil: reading /dev/sdm[Input/output error]

ERROR: via: reading /dev/sdm[Input/output error]

ERROR: asr: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: hpt37x: reading /dev/sdi[Input/output error]

ERROR: hpt45x: reading /dev/sdi[Input/output error]

ERROR: isw: reading /dev/sdi[Input/output error]

ERROR: jmicron: reading /dev/sdi[Input/output error]

ERROR: lsi: reading /dev/sdi[Input/output error]

ERROR: nvidia: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: sil: reading /dev/sdi[Input/output error]

ERROR: via: reading /dev/sdi[Input/output error]

ERROR: asr: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: hpt37x: reading /dev/sde[Input/output error]

ERROR: hpt45x: reading /dev/sde[Input/output error]

ERROR: isw: reading /dev/sde[Input/output error]

ERROR: jmicron: reading /dev/sde[Input/output error]

ERROR: lsi: reading /dev/sde[Input/output error]

ERROR: nvidia: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: sil: reading /dev/sde[Input/output error]

ERROR: via: reading /dev/sde[Input/output error]

ERROR: asr: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: hpt37x: reading /dev/sdk[Input/output error]

ERROR: hpt45x: reading /dev/sdk[Input/output error]

ERROR: isw: reading /dev/sdk[Input/output error]

ERROR: jmicron: reading /dev/sdk[Input/output error]

ERROR: lsi: reading /dev/sdk[Input/output error]

ERROR: nvidia: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: readingEXT3-fs (sdo1):  /dev/sdk[Input/using internal journaloutput error]


ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: sil: reading /dev/sdk[Input/output error]

ERROR: via: reading /dev/sdk[Input/output error]

Setting up Logical Volume Management: [  OK  ]


Checking filesystems

Checking all file systems.

[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/sdo1 

/dev/sdo1: clean, 131829/1310720 files, 3565765/5242880 blocks

[  OK  ]


Remounting root filesystem in read-write mode:  [  OK  ]


Mounting local filesystems:  [  OK  ]


Enabling local filesystem quotas:  [  OK  ]


Enabling /etc/fstab swaps:  Adding 16457724k swap on /dev/sdo2.  Priority:-1 extents:1 across:16457724k 
[  OK  ]


Entering non-interactive startup

Calling the system activity data collector (sadc)... 

Loading OpenIB kernel modules:[  OK  ]


Mounting ZFS filesystem(s)  [  OK  ]


ip6tables: No config file.[WARNING]


iptables: No config file.[WARNING]


Bringing up loopback interface:  [  OK  ]


Bringing up interface eth0:  ADDRCONF(NETDEV_UP): eth0: link is not ready
Determining if ip address 10.4.0.110 is already in use for device eth0...

igb 0000:02:00.0: eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  OK  ]


Bringing up interface ib0:  ADDRCONF(NETDEV_UP): ib0: link is not ready
ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
[  OK  ]


Bringing up interface ipmi:  Device ipmi does not seem to be present, delaying initialization.

[FAILED]


Starting auditd: type=1305 audit(1476942085.396:3): audit_pid=4480 old=0 auid=4294967295 ses=4294967295 res=1
[  OK  ]


Loading Lustre module stack...LNet: HW CPU cores: 32, npartitions: 2
alg: No test for adler32 (adler32-zlib)
alg: No test for crc32 (crc32-table)
alg: No test for crc32 (crc32-pclmul)
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
Lustre: Lustre: Build Version: 2.8.59_25_g401d7fc
LNet: Added LNI 192.168.1.110@o2ib10 [8/256/0/180]


Starting system logger: [  OK  ]


Enabling ondemand cpu frequency scaling: [  OK  ]


Starting irqbalance: [  OK  ]


Starting rpcbind: [  OK  ]


ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Starting NFS statd: [  OK  ]


Starting system message bus: [  OK  ]


Setting NIS domain: domain is 'lola.whamcloud.com'  [  OK  ]


Starting NIS service: [  OK  ]


Binding NIS service: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
.[  OK  ]


Starting ibacm daemon:[  OK  ]


NFS filesystems queued to be mounted

Mounting filesystems:  RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Slow work thread pool: Starting up
Slow work thread pool: Ready
FS-Cache: Loaded
NFS: Registering the id_resolver key type
FS-Cache: Netfs 'nfs' registered for caching
[  OK  ]


Starting acpi daemon: [  OK  ]


Starting HAL daemon: [  OK  ]


Retrigger failed udev events[  OK  ]


Starting ZFS Event Daemon  [  OK  ]
[  OK  ]


Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Starting NFS services:  [  OK  ]


Starting NFS quotas: [  OK  ]


Starting NFS mountd: [  OK  ]


Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
[  OK  ]


Starting RPC idmapd: [  OK  ]


Sharing ZFS filesystems  [  OK  ]


Starting MUNGE: munged[  OK  ]


Starting kdump:[  OK  ]


Starting sshd: [  OK  ]


Starting xinetd: [  OK  ]


Starting ntpd: [  OK  ]


Starting GANGLIA gmond: [  OK  ]


Starting sendmail: [  OK  ]


Starting sm-client: [  OK  ]


Starting crond: [  OK  ]


starting slurmd: 802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
8021q: adding VLAN 0 to HW filter on device eth0
[  OK  ]


Starting atd: [  OK  ]


Starting collectl: [  OK  ]



CentOS release 6.7 (Final)
Kernel 2.6.32-573.26.1.el6_lustre.x86_64 on an x86_64

lola-10.lola.whamcloud.com login: LDISKFS-fs warning (device dm-5): ldiskfs_multi_mount_protect: MMP interval 42 higher than expected, please wait.

LDISKFS-fs (dm-5): recovery complete
LDISKFS-fs (dm-5): mounted filesystem with ordered data mode. quota=on. Opts: 
LustreError: 11-0: soaked-MDT0000-osp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
Lustre: soaked-MDT0002: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-450
Lustre: soaked-MDT0002: Will be in recovery for at least 2:30, or until 21 clients reconnect
Lustre: soaked-MDT0002: Connection restored to 21b1a87e-6aa2-f34d-c9d8-0b6c57b20ecb (at 192.168.1.122@o2ib100)
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0003_UUID (at 192.168.1.105@o2ib10)
Lustre: soaked-MDT0002: Connection restored to e8dbe6d0-9b2b-63cc-d307-77a1f450c597 (at 192.168.1.125@o2ib100)
Lustre: Skipped 4 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 1a9770ca-d51d-1ec7-9291-66c7a374ca9c (at 192.168.1.130@o2ib100)
Lustre: Skipped 9 previous similar messages
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 2 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
Lustre: soaked-MDT0002: Connection restored to 4ef7dc7a-7144-0a99-211e-7322009418d7 (at 192.168.1.131@o2ib100)
Lustre: Skipped 5 previous similar messages
Lustre: soaked-MDT0002: Connection restored to MGC192.168.1.108@o2ib10_0 (at 192.168.1.108@o2ib10)
Lustre: Skipped 1 previous similar message
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
LustreError: Skipped 3 previous similar messages
Oct 19 22:45:01 lola-10 TIME: Time stamp for console
LustreError: 11-0: soaked-MDT0000-lwp-MDT0002: operation mds_connect to node 192.168.1.108@o2ib10 failed: rc = -114
Lustre: soaked-MDT0002: Recovery over after 2:30, of 21 clients 21 recovered and 0 were evicted.
Oct 19 22:50:01 lola-10 TIME: Time stamp for console
Oct 19 22:55:01 lola-10 TIME: Time stamp for console
Oct 19 23:00:01 lola-10 TIME: Time stamp for console
Oct 19 23:05:01 lola-10 TIME: Time stamp for console
Oct 19 23:10:01 lola-10 TIME: Time stamp for console
Oct 19 23:15:01 lola-10 TIME: Time stamp for console
Oct 19 23:20:01 lola-10 TIME: Time stamp for console
Oct 19 23:25:01 lola-10 TIME: Time stamp for console
Lustre: 4580:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476944767/real 0]  req@ffff8807f4105680 x1548686895849344/t0(0) o13->soaked-OST000d-osc-MDT0002@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476944774 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST000d-osc-MDT0002: Connection to soaked-OST000d (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4567:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476944767/real 0]  req@ffff8803d176e0c0 x1548686895849360/t0(0) o13->soaked-OST0007-osc-MDT0002@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476944774 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST0007-osc-MDT0002: Connection to soaked-OST0007 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476944769/real 0]  req@ffff8803e67c09c0 x1548686895851248/t0(0) o6->soaked-OST000d-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 664/432 e 0 to 1 dl 1476944776 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4558:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 9 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476944774/real 0]  req@ffff8803d14ba380 x1548686895859984/t0(0) o8->soaked-OST000d-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476944780 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 23 previous similar messages
Oct 19 23:30:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476945025/real 0]  req@ffff8803d95fa3c0 x1548686895877008/t0(0) o8->soaked-OST0013-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476945036 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0000_UUID (at 192.168.1.102@o2ib10)
Lustre: Skipped 16 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0000_UUID (at 192.168.1.102@o2ib10)
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476945100/real 1476945100]  req@ffff8803c47833c0 x1548686895882176/t0(0) o8->soaked-OST0013-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476945116 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0000_UUID (at 192.168.1.102@o2ib10)
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.102@o2ib10, removing former export from 192.168.1.103@o2ib10
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0000_UUID (at 192.168.1.102@o2ib10)
Lustre: Skipped 2 previous similar messages
Lustre: soaked-OST000d-osc-MDT0002: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10)
Lustre: Skipped 1 previous similar message
LustreError: 11-0: soaked-OST0013-osc-MDT0002: operation ost_destroy to node 192.168.1.102@o2ib10 failed: rc = -19
Lustre: soaked-OST0013-osc-MDT0002: Connection to soaked-OST0013 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 2 previous similar messages
LustreError: Skipped 3 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476945225/real 1476945225]  req@ffff8803da2ed9c0 x1548686895929008/t0(0) o8->soaked-OST0013-osc-MDT0002@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476945231 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
LustreError: 11-0: soaked-OST0001-osc-MDT0002: operation ost_statfs to node 192.168.1.102@o2ib10 failed: rc = -107
Lustre: soaked-OST0001-osc-MDT0002: Connection to soaked-OST0001 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST0007-osc-MDT0002: operation ost_destroy to node 192.168.1.102@o2ib10 failed: rc = -107
Lustre: soaked-OST0007-osc-MDT0002: Connection to soaked-OST0007 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: Skipped 5 previous similar messages
Lustre: soaked-OST0001-osc-MDT0002: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10)
Lustre: Skipped 3 previous similar messages
LustreError: 11-0: soaked-OST000d-osc-MDT0002: operation ost_statfs to node 192.168.1.102@o2ib10 failed: rc = -107
LustreError: Skipped 2 previous similar messages
Lustre: soaked-OST000d-osc-MDT0002: Connection to soaked-OST000d (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Oct 19 23:35:01 lola-10 TIME: Time stamp for console
Oct 19 23:40:01 lola-10 TIME: Time stamp for console
Oct 19 23:45:02 lola-10 TIME: Time stamp for console
Oct 19 23:50:01 lola-10 TIME: Time stamp for console
Oct 19 23:55:01 lola-10 TIME: Time stamp for console
Oct 20 00:00:01 lola-10 TIME: Time stamp for console
Oct 20 00:05:01 lola-10 TIME: Time stamp for console
Oct 20 00:10:01 lola-10 TIME: Time stamp for console
Oct 20 00:15:01 lola-10 TIME: Time stamp for console
Oct 20 00:20:01 lola-10 TIME: Time stamp for console
Oct 20 00:25:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100)
Lustre: Skipped 4 previous similar messages
Lustre: soaked-MDT0002: Client 29d3cbaa-30a5-6daf-223a-2835f382279d (at 192.168.1.134@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to 29d3cbaa-30a5-6daf-223a-2835f382279d (at 192.168.1.134@o2ib100)
Lustre: soaked-MDT0002: Client e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100)
Oct 20 00:30:01 lola-10 TIME: Time stamp for console
Oct 20 00:35:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100)
Lustre: soaked-MDT0002: Client c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100) reconnecting
Oct 20 00:40:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100)
Lustre: Skipped 1 previous similar message
Oct 20 00:45:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e8dbe6d0-9b2b-63cc-d307-77a1f450c597 (at 192.168.1.125@o2ib100) reconnecting
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to e8dbe6d0-9b2b-63cc-d307-77a1f450c597 (at 192.168.1.125@o2ib100)
Lustre: Skipped 1 previous similar message
Oct 20 00:50:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 1fa09166-d179-bf77-a8ee-6be97e97bca5 (at 192.168.1.129@o2ib100) reconnecting
Oct 20 00:55:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: 5924:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476950171/real 1476950171]  req@ffff8803da56f980 x1548686991885008/t0(0) o104->soaked-MDT0002@192.168.1.120@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476950178 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-MDT0002: Client e9d38f32-5477-8a6c-d96e-8d8a5a05b01f (at 192.168.1.121@o2ib100) reconnecting
Lustre: Skipped 1 previous similar message
Lustre: 6071:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476950381/real 1476950381]  req@ffff8803e5532c80 x1548686994712208/t0(0) o104->soaked-MDT0002@192.168.1.133@o2ib100:15/16 lens 296/224 e 0 to 1 dl 1476950388 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Oct 20 01:00:01 lola-10 TIME: Time stamp for console
Oct 20 01:05:01 lola-10 TIME: Time stamp for console
Oct 20 01:10:01 lola-10 TIME: Time stamp for console
Oct 20 01:15:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8807f26f39c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ee c8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f26f39c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807fe7908c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ee d8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807fe7908c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807e92d85c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ee e8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807e92d85c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807fec34ac0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ee f8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807fec34ac0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807dfac9bc0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef 08 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807dfac9bc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ea27e780)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef 18 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ea27e780)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f26f35c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef 28 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f26f35c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ea27e080)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef 38 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ea27e080)
sd 0:0:1:42: attempting task abort! scmd(ffff8807e31f4080)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef 48 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807e31f4080)
sd 0:0:1:42: attempting task abort! scmd(ffff8807e92d8ac0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef 58 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807e92d8ac0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807e31f4580)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef 68 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807e31f4580)
sd 0:0:1:42: attempting task abort! scmd(ffff8808179835c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef 78 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8808179835c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f26f3ec0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef 88 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f26f3ec0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807e35f79c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef 98 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807e35f79c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f50ae4c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef a8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f50ae4c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880807a1f080)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef b8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880807a1f080)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f472f980)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef c8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f472f980)
sd 0:0:1:42: attempting task abort! scmd(ffff8807e35f7cc0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef d8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807e35f7cc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807f472f180)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef f0 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807f472f180)
sd 0:0:1:42: attempting task abort! scmd(ffff8807fe7901c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 04 e0 3d ef f8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807fe7901c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880409f128c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0e d8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880409f128c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803b35287c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 00 00 00 00 18 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803b35287c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c7fea8c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 20 00 00 00 10 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c7fea8c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803d1be4880)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 38 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803d1be4880)
sd 0:0:1:42: attempting task abort! scmd(ffff880395d56080)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 40 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880395d56080)
sd 0:0:1:42: attempting task abort! scmd(ffff8804041adc80)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 50 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8804041adc80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803b35280c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 60 00 00 00 20 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803b35280c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c0012c80)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 88 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c0012c80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803e57ea8c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f 98 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803e57ea8c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c0012980)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f a8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c0012980)
sd 0:0:1:42: attempting task abort! scmd(ffff8803bbfba580)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f b8 00 00 00 10 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803bbfba580)
sd 0:0:1:42: attempting task abort! scmd(ffff88036c649180)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f d8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88036c649180)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c7fea1c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f e8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c7fea1c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803ffeac3c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 0f f8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803ffeac3c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803e57ea6c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 06 2f 25 16 90 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803e57ea6c0)
Oct 20 01:20:01 lola-10 TIME: Time stamp for console
Oct 20 01:25:01 lola-10 TIME: Time stamp for console
Oct 20 01:30:01 lola-10 TIME: Time stamp for console
Oct 20 01:35:01 lola-10 TIME: Time stamp for console
Oct 20 01:40:01 lola-10 TIME: Time stamp for console
Oct 20 01:45:01 lola-10 TIME: Time stamp for console
Oct 20 01:50:01 lola-10 TIME: Time stamp for console
Oct 20 01:55:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8807e79502c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0c 88 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807e79502c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807e79501c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0c 98 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807e79501c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807e79500c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0c e0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807e79500c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9abe80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0c f0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9abe80)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9abd80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 00 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9abd80)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9abc80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 18 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9abc80)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9abb80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 30 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9abb80)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9aba80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 50 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9aba80)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9ab980)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 68 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9ab980)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9ab880)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 80 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9ab880)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9ab780)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d 90 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9ab780)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9ab680)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d a8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9ab680)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9ab580)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d c8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9ab580)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9ab480)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d d0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9ab480)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9ab380)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0d e8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9ab380)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9ab280)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 00 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9ab280)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9ab180)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 40 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9ab180)
sd 0:0:1:42: attempting task abort! scmd(ffff8807be9ab080)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 48 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807be9ab080)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ecec0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 60 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ecec0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ecdc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 78 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ecdc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2eccc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e e0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2eccc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ecbc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e f0 00 00 28 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ecbc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ecac0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 20 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ecac0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ec9c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 40 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ec9c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ec8c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 70 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ec8c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ec7c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 98 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ec7c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ec6c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f b8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ec6c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ec5c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f d0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ec5c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ec4c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ec4c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ec3c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ec3c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8807ff2ec2c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f f8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8807ff2ec2c0)
Oct 20 02:00:01 lola-10 TIME: Time stamp for console
Oct 20 02:05:01 lola-10 TIME: Time stamp for console
Oct 20 02:10:01 lola-10 TIME: Time stamp for console
Oct 20 02:15:01 lola-10 TIME: Time stamp for console
Oct 20 02:20:01 lola-10 TIME: Time stamp for console
Oct 20 02:25:01 lola-10 TIME: Time stamp for console
Oct 20 02:30:01 lola-10 TIME: Time stamp for console
Oct 20 02:35:01 lola-10 TIME: Time stamp for console
Oct 20 02:40:01 lola-10 TIME: Time stamp for console
Oct 20 02:45:01 lola-10 TIME: Time stamp for console
Oct 20 02:50:01 lola-10 TIME: Time stamp for console
Lustre: 5956:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476957131/real 1476957156]  req@ffff8808064763c0 x1548687161587120/t0(0) o1000->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 488/4320 e 0 to 1 dl 1476957178 ref 2 fl Rpc:eX/0/ffffffff rc 0/-1
Lustre: soaked-MDT0001-osp-MDT0002: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 5956:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 5 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476957156/real 0]  req@ffff8807f2bec980 x1548687161591600/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476957162 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476957256/real 0]  req@ffff8807ec07f380 x1548687161599552/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476957267 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Oct 20 02:55:01 lola-10 TIME: Time stamp for console
LNet: Service thread pid 7303 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 7303, comm: mdt00_024

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa07d38d0>] ? lu_ucred+0x20/0x30 [obdclass]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa124b52b>] mdd_attr_set+0x84b/0x1610 [mdd]
 [<ffffffffa09b683c>] ? lustre_msg_get_versions+0x8c/0x100 [ptlrpc]
 [<ffffffffa1108298>] mo_attr_set+0x18/0x50 [mdt]
 [<ffffffffa1108b14>] mdt_reint_setxattr+0x844/0xe70 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476957328.7303
LNet: Service thread pid 6121 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6121, comm: mdt01_013

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa12414ef>] mdd_create+0x135f/0x1770 [mdd]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa1107e2c>] mdt_reint_create+0xbdc/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476957337.6121
Pid: 7282, comm: mdt00_022

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa12414ef>] mdd_create+0x135f/0x1770 [mdd]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa1107e2c>] mdt_reint_create+0xbdc/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 7340, comm: mdt01_021

Call Trace:
 [<ffffffff81089e8c>] ? lock_timer_base+0x3c/0x70
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa09ab781>] ptlrpc_set_wait+0x321/0x960 [ptlrpc]
 [<ffffffffa09a08d0>] ? ptlrpc_interrupted_set+0x0/0x120 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa09b7c65>] ? lustre_msg_set_jobid+0xf5/0x130 [ptlrpc]
 [<ffffffffa09abe41>] ptlrpc_queue_wait+0x81/0x220 [ptlrpc]
 [<ffffffffa098848a>] ldlm_cli_enqueue+0x36a/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffff8117904c>] ? __kmalloc+0x21c/0x230
 [<ffffffffa11c7473>] lod_object_lock+0x3e3/0x900 [lod]
 [<ffffffffa07bcab1>] ? lu_object_find_at+0xb1/0xe0 [obdclass]
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa1105195>] mdt_lock_slaves+0x145/0x400 [mdt]
 [<ffffffffa1105dfb>] mdt_reint_unlink+0x9ab/0x10c0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 6049, comm: mdt01_007

Call Trace:
 [<ffffffff81089e8c>] ? lock_timer_base+0x3c/0x70
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa09ab781>] ptlrpc_set_wait+0x321/0x960 [ptlrpc]
 [<ffffffffa09a08d0>] ? ptlrpc_interrupted_set+0x0/0x120 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa09b7c65>] ? lustre_msg_set_jobid+0xf5/0x130 [ptlrpc]
 [<ffffffffa09abe41>] ptlrpc_queue_wait+0x81/0x220 [ptlrpc]
 [<ffffffffa098848a>] ldlm_cli_enqueue+0x36a/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffff8117904c>] ? __kmalloc+0x21c/0x230
 [<ffffffffa11c7473>] lod_object_lock+0x3e3/0x900 [lod]
 [<ffffffffa07bcab1>] ? lu_object_find_at+0xb1/0xe0 [obdclass]
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa1105195>] mdt_lock_slaves+0x145/0x400 [mdt]
 [<ffffffffa1105dfb>] mdt_reint_unlink+0x9ab/0x10c0 [mdt]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476957331/real 0]  req@ffff8807e56f2680 x1548687161605536/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476957347 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: soaked-MDT0002: haven't heard from client soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib10) in 229 seconds. I think it's dead, and I am evicting it. exp ffff8804183fb000, cur 1476957356 expire 1476957206 last 1476957127
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476957431/real 0]  req@ffff8807e93bc080 x1548687161613504/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476957452 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476957506/real 1476957506]  req@ffff8807befdd680 x1548687161619488/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476957532 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476957556/real 1476957556]  req@ffff8807e25550c0 x1548687161623488/t0(0) o38->soaked-MDT0001-osp-MDT0002@192.168.1.109@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476957587 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: soaked-MDT0002: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10)
Lustre: Skipped 6 previous similar messages
Oct 20 03:00:01 lola-10 TIME: Time stamp for console
LNet: Service thread pid 7303 completed after 478.28s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 4 previous similar messages
LustreError: 11-0: soaked-MDT0001-osp-MDT0002: operation out_update to node 192.168.1.108@o2ib10 failed: rc = -19
Lustre: soaked-MDT0001-osp-MDT0002: Connection to soaked-MDT0001 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: Skipped 1 previous similar message
Lustre: soaked-MDT0001-osp-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Lustre: Skipped 2 previous similar messages
Oct 20 03:05:01 lola-10 TIME: Time stamp for console
Oct 20 03:10:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8803c23971c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 58 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c23971c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803c23970c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 80 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803c23970c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4e80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e 98 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4e80)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4d80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e a0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4d80)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4c80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e b0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4c80)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4b80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e c8 00 00 48 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4b80)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4a80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 18 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4a80)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4980)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 20 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4980)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4880)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 30 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4880)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4780)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 50 00 00 20 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4780)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4680)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 78 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4680)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4580)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 80 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4580)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4480)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f a0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4480)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4380)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f c0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4380)
sd 0:0:1:42: attempting task abort! scmd(ffff880374fc4280)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f d0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880374fc4280)
sd 0:0:1:42: attempting task abort! scmd(ffff88037ea008c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f d8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88037ea008c0)
sd 0:0:1:42: attempting task abort! scmd(ffff88041ad4cec0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f f0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88041ad4cec0)
Oct 20 03:15:01 lola-10 TIME: Time stamp for console
Oct 20 03:20:01 lola-10 TIME: Time stamp for console
Oct 20 03:25:01 lola-10 TIME: Time stamp for console
Oct 20 03:30:01 lola-10 TIME: Time stamp for console
Oct 20 03:35:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff88037dfa0d80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88037dfa0d80)
sd 0:0:1:42: attempting task abort! scmd(ffff88037dfa0c80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f f8 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88037dfa0c80)
Oct 20 03:40:01 lola-10 TIME: Time stamp for console
Lustre: 4582:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476960029/real 0]  req@ffff880805f6d3c0 x1548687193601344/t0(0) o103->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:17/18 lens 328/224 e 0 to 1 dl 1476960046 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4582:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.109@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.119@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.104@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 4 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.113@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.134@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 4 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.116@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 5 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.102@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 12 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.129@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 31 previous similar messages
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 46 previous similar messages
LNet: Service thread pid 7266 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
LNet: Skipped 3 previous similar messages
Pid: 7266, comm: mdt00_020

Call Trace:
 [<ffffffffa09ce8f8>] ? at_measured+0x108/0x380 [ptlrpc]
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa0984126>] ldlm_cli_enqueue_fini+0x936/0xe30 [ptlrpc]
 [<ffffffffa09a46bb>] ? ptlrpc_set_destroy+0x26b/0x450 [ptlrpc]
 [<ffffffffa09884cd>] ldlm_cli_enqueue+0x3ad/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffffa11c71df>] lod_object_lock+0x14f/0x900 [lod]
 [<ffffffffa07bc83f>] ? lu_object_find_try+0x9f/0x260 [obdclass]
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa10edd9a>] mdt_remote_object_lock+0x15a/0x4a0 [mdt]
 [<ffffffffa10ee24a>] mdt_object_lock_internal+0x16a/0x320 [mdt]
 [<ffffffffa10ee5c0>] mdt_reint_object_lock+0x20/0x60 [mdt]
 [<ffffffffa11056a7>] mdt_reint_unlink+0x257/0x10c0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476960229.7266
LNet: Service thread pid 6071 was inactive for 201.33s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6071, comm: mdt00_010

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa12414ef>] mdd_create+0x135f/0x1770 [mdd]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa1107e2c>] mdt_reint_create+0xbdc/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Lustre: soaked-MDT0002: haven't heard from client soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib10) in 227 seconds. I think it's dead, and I am evicting it. exp ffff880361c32400, cur 1476960255 expire 1476960105 last 1476960028
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476960246/real 0]  req@ffff8803bc5adcc0 x1548687193625088/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476960257 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 22 previous similar messages
Oct 20 03:45:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476960321/real 1476960321]  req@ffff8803f81b0980 x1548687193631072/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476960337 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.109@o2ib10, removing former export from same NID
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib10)
LustreError: 7266:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476960029, 300s ago), entering recovery for soaked-MDT0003_UUID@192.168.1.111@o2ib10 ns: soaked-MDT0003-osp-MDT0002 lock: ffff8803dd167280/0x6ebcba138b5c603f lrc: 4/0,1 mode: --/EX res: [0x2c000a05c:0x1927f:0x0].0x0 bits 0x2 rrc: 1 type: IBT flags: 0x1000001000000 nid: local remote: 0xc018f9eae32fb815 expref: -99 pid: 7266 timeout: 0 lvb_type: 0
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.107@o2ib10 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 100 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476960371/real 1476960371]  req@ffff880368d7ecc0 x1548687193635072/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476960392 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476960471/real 1476960471]  req@ffff88036f6ff3c0 x1548687193643072/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476960502 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Oct 20 03:50:01 lola-10 TIME: Time stamp for console
LustreError: 137-5: soaked-MDT0003_UUID: not available for connect from 192.168.1.113@o2ib100 (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: Skipped 176 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476960571/real 1476960571]  req@ffff880384569cc0 x1548687193651072/t0(0) o38->soaked-MDT0003-osp-MDT0002@192.168.1.111@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476960612 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Lustre: 7265:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff8803d987d6c0 x1548643782383360/t0(0) o36->c32ac4b6-85da-327f-24ce-7b2a5255c455@192.168.1.113@o2ib100:-1/-1 lens 624/3128 e 23 to 0 dl 1476960629 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: soaked-MDT0002: Client c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100) reconnecting
Lustre: Skipped 4 previous similar messages
Lustre: soaked-MDT0002: Connection restored to c32ac4b6-85da-327f-24ce-7b2a5255c455 (at 192.168.1.113@o2ib100)
Lustre: soaked-MDT0002: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10)
Lustre: soaked-MDT0003-osp-MDT0002: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10)
Lustre: 6071:0:(service.c:2099:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (600:186s); client may timeout.  req@ffff880816fe3380 x1548643782394352/t85905450831(0) o36->c32ac4b6-85da-327f-24ce-7b2a5255c455@192.168.1.113@o2ib100:-1/-1 lens 624/416 e 23 to 0 dl 1476960629 ref 1 fl Complete:/0/0 rc 0/0
LNet: Service thread pid 6071 completed after 785.91s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
Oct 20 03:55:01 lola-10 TIME: Time stamp for console
Oct 20 04:00:01 lola-10 TIME: Time stamp for console
Oct 20 04:05:01 lola-10 TIME: Time stamp for console
Oct 20 04:10:01 lola-10 TIME: Time stamp for console
Oct 20 04:15:02 lola-10 TIME: Time stamp for console
Oct 20 04:20:01 lola-10 TIME: Time stamp for console
Lustre: 4572:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476962489/real 0]  req@ffff8803d18d4680 x1548687215721472/t0(0) o13->soaked-OST0017-osc-MDT0002@192.168.1.107@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1476962496 ref 2 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: soaked-OST0005-osc-MDT0002: Connection to soaked-OST0005 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: 4572:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 16 previous similar messages
Oct 20 04:25:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476962746/real 1476962746]  req@ffff88036ec0a980 x1548687216803792/t0(0) o8->soaked-OST000b-osc-MDT0002@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1476962757 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 24 previous similar messages
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Received LWP connection from 192.168.1.106@o2ib10, removing former export from 192.168.1.107@o2ib10
Lustre: soaked-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: Skipped 4 previous similar messages
Lustre: soaked-OST000b-osc-MDT0002: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10)
Lustre: Skipped 1 previous similar message
LustreError: 11-0: soaked-OST0017-osc-MDT0002: operation ost_destroy to node 192.168.1.106@o2ib10 failed: rc = -107
Lustre: soaked-OST0017-osc-MDT0002: Connection to soaked-OST0017 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 2 previous similar messages
LustreError: Skipped 2 previous similar messages
LustreError: 11-0: soaked-OST0005-osc-MDT0002: operation ost_statfs to node 192.168.1.106@o2ib10 failed: rc = -107
Lustre: soaked-OST0005-osc-MDT0002: Connection to soaked-OST0005 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 11-0: soaked-OST000b-osc-MDT0002: operation ost_destroy to node 192.168.1.106@o2ib10 failed: rc = -19
Lustre: soaked-OST000b-osc-MDT0002: Connection to soaked-OST000b (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: Skipped 1 previous similar message
LustreError: 11-0: soaked-OST0011-osc-MDT0002: operation ost_statfs to node 192.168.1.106@o2ib10 failed: rc = -107
Lustre: soaked-OST0011-osc-MDT0002: Connection to soaked-OST0011 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0002-lwp-OST0005_UUID (at 192.168.1.107@o2ib10)
Lustre: Skipped 5 previous similar messages
Oct 20 04:30:01 lola-10 TIME: Time stamp for console
Oct 20 04:35:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff8803f160e580)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0e d8 00 00 38 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803f160e580)
sd 0:0:1:42: attempting task abort! scmd(ffff8803e9fe5e80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 20 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803e9fe5e80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803e9fe5c80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 90 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803e9fe5c80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803e9fe5d80)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f a0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803e9fe5d80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803e9fe5580)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f c0 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803e9fe5580)
sd 0:0:1:42: attempting task abort! scmd(ffff8803fe32dec0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803fe32dec0)
Oct 20 04:40:01 lola-10 TIME: Time stamp for console
Lustre: 6049:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476963751/real 0]  req@ffff8807e43cc9c0 x1548687229102304/t0(0) o1000->soaked-MDT0000-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 328/4320 e 0 to 1 dl 1476963773 ref 3 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 6049:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
Lustre: soaked-MDT0000-osp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476963775/real 0]  req@ffff8807e3a329c0 x1548687229130144/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476963781 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 6 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476963825/real 1476963825]  req@ffff88082243a980 x1548687229134048/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476963831 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 1 previous similar message
Oct 20 04:45:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476963900/real 1476963900]  req@ffff8808060eb980 x1548687229140480/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476963911 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
LNet: Service thread pid 6190 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6190, comm: mdt01_015

Call Trace:
 [<ffffffff81089e8c>] ? lock_timer_base+0x3c/0x70
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa09ab781>] ptlrpc_set_wait+0x321/0x960 [ptlrpc]
 [<ffffffffa09a08d0>] ? ptlrpc_interrupted_set+0x0/0x120 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa09b7c65>] ? lustre_msg_set_jobid+0xf5/0x130 [ptlrpc]
 [<ffffffffa09abe41>] ptlrpc_queue_wait+0x81/0x220 [ptlrpc]
 [<ffffffffa098848a>] ldlm_cli_enqueue+0x36a/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffff8117904c>] ? __kmalloc+0x21c/0x230
 [<ffffffffa11c7473>] lod_object_lock+0x3e3/0x900 [lod]
 [<ffffffffa07bcab1>] ? lu_object_find_at+0xb1/0xe0 [obdclass]
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa1105195>] mdt_lock_slaves+0x145/0x400 [mdt]
 [<ffffffffa10e04b7>] ? mdt_object_unlock+0x67/0x350 [mdt]
 [<ffffffffa1108174>] mdt_reint_create+0xf24/0xfe0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476963930.6190
LNet: Service thread pid 6136 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6136, comm: mdt00_012

Call Trace:
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa09ab781>] ptlrpc_set_wait+0x321/0x960 [ptlrpc]
 [<ffffffffa09a08d0>] ? ptlrpc_interrupted_set+0x0/0x120 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa09b7c65>] ? lustre_msg_set_jobid+0xf5/0x130 [ptlrpc]
 [<ffffffffa09abe41>] ptlrpc_queue_wait+0x81/0x220 [ptlrpc]
 [<ffffffffa098848a>] ldlm_cli_enqueue+0x36a/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffff8117904c>] ? __kmalloc+0x21c/0x230
 [<ffffffffa11c7473>] lod_object_lock+0x3e3/0x900 [lod]
 [<ffffffffa07bcab1>] ? lu_object_find_at+0xb1/0xe0 [obdclass]
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa1105195>] mdt_lock_slaves+0x145/0x400 [mdt]
 [<ffffffffa1105dfb>] mdt_reint_unlink+0x9ab/0x10c0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476963937.6136
Pid: 8707, comm: mdt01_022

Call Trace:
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa098935e>] ldlm_cli_enqueue_local+0x21e/0x810 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e07a0>] ? mdt_blocking_ast+0x0/0x2e0 [mdt]
 [<ffffffffa10ed4e4>] mdt_object_local_lock+0x3a4/0xb00 [mdt]
 [<ffffffffa10e07a0>] ? mdt_blocking_ast+0x0/0x2e0 [mdt]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10ee143>] mdt_object_lock_internal+0x63/0x320 [mdt]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa10ee5c0>] mdt_reint_object_lock+0x20/0x60 [mdt]
 [<ffffffffa11056a7>] mdt_reint_unlink+0x257/0x10c0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 7265, comm: mdt00_019

Call Trace:
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa098935e>] ldlm_cli_enqueue_local+0x21e/0x810 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e07a0>] ? mdt_blocking_ast+0x0/0x2e0 [mdt]
 [<ffffffffa10ed4e4>] mdt_object_local_lock+0x3a4/0xb00 [mdt]
 [<ffffffffa10e07a0>] ? mdt_blocking_ast+0x0/0x2e0 [mdt]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10ee143>] mdt_object_lock_internal+0x63/0x320 [mdt]
 [<ffffffffa10e04b7>] ? mdt_object_unlock+0x67/0x350 [mdt]
 [<ffffffffa10ee5c0>] mdt_reint_object_lock+0x20/0x60 [mdt]
 [<ffffffffa11056a7>] mdt_reint_unlink+0x257/0x10c0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 6121, comm: mdt01_013

Call Trace:
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa098935e>] ldlm_cli_enqueue_local+0x21e/0x810 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e07a0>] ? mdt_blocking_ast+0x0/0x2e0 [mdt]
 [<ffffffffa10ed4e4>] mdt_object_local_lock+0x3a4/0xb00 [mdt]
 [<ffffffffa10e07a0>] ? mdt_blocking_ast+0x0/0x2e0 [mdt]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10ee143>] mdt_object_lock_internal+0x63/0x320 [mdt]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa10ee5c0>] mdt_reint_object_lock+0x20/0x60 [mdt]
 [<ffffffffa11056a7>] mdt_reint_unlink+0x257/0x10c0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LNet: Service thread pid 6049 was inactive for 200.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
LustreError: dumping log to /tmp/lustre-log.1476963951.6049
LNet: Service thread pid 7282 was inactive for 200.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
LustreError: dumping log to /tmp/lustre-log.1476963955.7282
Lustre: soaked-MDT0002: haven't heard from client soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib10) in 229 seconds. I think it's dead, and I am evicting it. exp ffff8804181c9c00, cur 1476963958 expire 1476963808 last 1476963729
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476964000/real 1476964000]  req@ffff8807e44d96c0 x1548687229148384/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476964016 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 3 previous similar messages
LustreError: 6121:0:(ldlm_request.c:129:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476963737, 300s ago); not entering recovery in server code, just going back to sleep ns: mdt-soaked-MDT0002_UUID lock: ffff8807c118bac0/0x6ebcba138cc9e402 lrc: 3/0,1 mode: --/PW res: [0x280009875:0x19488:0x0].0x87c148a6 bits 0x2 rrc: 4 type: IBT flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6121 timeout: 0 lvb_type: 0
LustreError: dumping log to /tmp/lustre-log.1476964037.8707
LustreError: 6121:0:(ldlm_request.c:129:ldlm_expired_completion_wait()) Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Received new LWP connection from 192.168.1.111@o2ib10, removing former export from same NID
Lustre: soaked-MDT0002: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10)
Lustre: Skipped 2 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476964175/real 1476964175]  req@ffff8808107689c0 x1548687229162288/t0(0) o38->soaked-MDT0000-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476964206 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
Oct 20 04:50:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Connection restored to soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib10)
LustreError: 6056:0:(tgt_lastrcvd.c:1317:tgt_last_rcvd_update()) soaked-MDT0002: trying to overwrite bigger transno:on-disk: 85906193356, new: 85906193355 replay: 0. See LU-617.
Lustre: 5927:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff8803da45d0c0 x1548642821147568/t85906193124(0) o36->3bf16639-ba44-da4f-3ae0-9f8f041df65f@192.168.1.127@o2ib100:-1/-1 lens 632/568 e 21 to 0 dl 1476964329 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: 5927:0:(service.c:1331:ptlrpc_at_send_early_reply()) Skipped 1 previous similar message
Lustre: soaked-MDT0002: Client 3bf16639-ba44-da4f-3ae0-9f8f041df65f (at 192.168.1.127@o2ib100) reconnecting
Lustre: 7245:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff88081269f3c0 x1548643808880240/t0(0) o36->c32ac4b6-85da-327f-24ce-7b2a5255c455@192.168.1.113@o2ib100:-1/-1 lens 616/3128 e 23 to 0 dl 1476964337 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: soaked-MDT0002: Client 8ffd2fb9-3d57-7767-a5b4-d8680336d61b (at 192.168.1.132@o2ib100) reconnecting
Lustre: Skipped 3 previous similar messages
Lustre: 5927:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff88036563c980 x1548643627937472/t0(0) o101->e45b0a62-d534-1b66-333c-62b9ad3eee7a@192.168.1.119@o2ib100:-1/-1 lens 1368/3512 e 21 to 0 dl 1476964351 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: 5927:0:(service.c:1331:ptlrpc_at_send_early_reply()) Skipped 3 previous similar messages
Lustre: 7245:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff8803ef7ad9c0 x1548643007214448/t85906193274(0) o36->521f1f5f-66d5-5c01-ed6a-0ed604037e7a@192.168.1.123@o2ib100:-1/-1 lens 632/568 e 23 to 0 dl 1476964355 ref 2 fl Interpret:/0/0 rc 0/0
LustreError: 167-0: soaked-MDT0000-lwp-MDT0002: This client was evicted by soaked-MDT0000; in progress operations using this service will fail.
Lustre: soaked-MDT0002: Client e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100) reconnecting
Lustre: Evicted from MGS (at MGC192.168.1.108@o2ib10_0) after server handle changed from 0x4dc61caa9d674658 to 0x2459b6735c13e087
Lustre: MGC192.168.1.108@o2ib10: Connection restored to MGC192.168.1.108@o2ib10_0 (at 192.168.1.108@o2ib10)
Lustre: Skipped 8 previous similar messages
Lustre: 6190:0:(service.c:2099:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (600:73s); client may timeout.  req@ffff8803da45d0c0 x1548642821147568/t85906193124(0) o36->3bf16639-ba44-da4f-3ae0-9f8f041df65f@192.168.1.127@o2ib100:-1/-1 lens 632/416 e 21 to 0 dl 1476964329 ref 1 fl Complete:/0/0 rc 0/0
LNet: Service thread pid 6049 completed after 651.10s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 1 previous similar message
Lustre: 6190:0:(service.c:2099:ptlrpc_server_handle_request()) Skipped 2 previous similar messages
Lustre: 7265:0:(service.c:2099:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (600:65s); client may timeout.  req@ffff880390d3f080 x1548643172663344/t0(0) o36->4ef7dc7a-7144-0a99-211e-7322009418d7@192.168.1.131@o2ib100:-1/-1 lens 616/424 e 23 to 0 dl 1476964337 ref 1 fl Complete:/0/0 rc -2/-2
Lustre: 7265:0:(service.c:2099:ptlrpc_server_handle_request()) Skipped 4 previous similar messages
LNet: Service thread pid 7265 completed after 665.43s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources).
LNet: Skipped 5 previous similar messages
Oct 20 04:55:01 lola-10 TIME: Time stamp for console
Oct 20 05:00:01 lola-10 TIME: Time stamp for console
sd 0:0:1:42: attempting task abort! scmd(ffff880384404bc0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f 60 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880384404bc0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803df0494c0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f c8 00 00 10 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803df0494c0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803b350aec0)
sd 0:0:1:42: [sdj] CDB: Write(10): 2a 00 00 00 0f e0 00 00 08 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803b350aec0)
sd 0:0:1:42: attempting task abort! scmd(ffff88036f759480)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 03 05 d7 ce f0 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88036f759480)
sd 0:0:1:42: attempting task abort! scmd(ffff88037c11aac0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 03 05 d7 cf 18 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88037c11aac0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803f3600a80)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 03 05 d7 cf 40 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803f3600a80)
sd 0:0:1:42: attempting task abort! scmd(ffff8803fe785a80)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 03 05 d7 cf 68 00 00 00 18 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803fe785a80)
sd 0:0:1:42: attempting task abort! scmd(ffff880366c80ec0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 03 05 d7 cf 98 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880366c80ec0)
sd 0:0:1:42: attempting task abort! scmd(ffff8803843387c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 03 05 d7 cf a8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff8803843387c0)
sd 0:0:1:42: attempting task abort! scmd(ffff880379460580)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 03 05 d7 cf c8 00 00 00 08 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff880379460580)
sd 0:0:1:42: attempting task abort! scmd(ffff88037c11a7c0)
sd 0:0:1:42: [sdj] CDB: Write(16): 8a 00 00 00 00 03 05 d7 cf e8 00 00 00 18 00 00
scsi target0:0:1: handle(0x0009), sas_address(0x50080e51fedb8014), phy(0)
scsi target0:0:1: enclosure_logical_id(0x500605b005d6d910), slot(0)
sd 0:0:1:42: task abort: SUCCESS scmd(ffff88037c11a7c0)
Oct 20 05:05:01 lola-10 TIME: Time stamp for console
Oct 20 05:10:01 lola-10 TIME: Time stamp for console
Oct 20 05:15:01 lola-10 TIME: Time stamp for console
Oct 20 05:20:01 lola-10 TIME: Time stamp for console
Oct 20 05:25:01 lola-10 TIME: Time stamp for console
Oct 20 05:30:01 lola-10 TIME: Time stamp for console
Oct 20 05:35:01 lola-10 TIME: Time stamp for console
Lustre: 4576:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476967135/real 1476967135]  req@ffff880823fe80c0 x1548687267354512/t0(0) o103->soaked-MDT0000-osp-MDT0002@192.168.1.108@o2ib10:17/18 lens 328/224 e 0 to 1 dl 1476967142 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
Lustre: 4576:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 10 previous similar messages
Lustre: soaked-MDT0000-osp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: 4576:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1476967167/real 0]  req@ffff8807a2d286c0 x1548687267366384/t0(0) o400->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 224/224 e 0 to 1 dl 1476967174 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4576:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 9 previous similar messages
LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail
LNetError: 4547:0:(o2iblnd_cb.c:3131:kiblnd_check_txs_locked()) Timed out tx: tx_queue, 9 seconds
LNetError: 4547:0:(o2iblnd_cb.c:3194:kiblnd_check_conns()) Timed out RDMA with 192.168.1.108@o2ib10 (59): c: 0, oc: 0, rc: 8
Lustre: soaked-MDT0000-lwp-MDT0002: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Oct 20 05:40:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476967248/real 1476967248]  req@ffff88079f2e3380 x1548687267372848/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476967259 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 7 previous similar messages
LNet: Service thread pid 6041 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
LNet: Skipped 3 previous similar messages
Pid: 6041, comm: mdt00_006

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa12414ef>] mdd_create+0x135f/0x1770 [mdd]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa1107e2c>] mdt_reint_create+0xbdc/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476967315.6041
LNet: Service thread pid 7252 was inactive for 201.11s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 7252, comm: mdt00_017

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa07d38d0>] ? lu_ucred+0x20/0x30 [obdclass]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa124b52b>] mdd_attr_set+0x84b/0x1610 [mdd]
 [<ffffffffa09b683c>] ? lustre_msg_get_versions+0x8c/0x100 [ptlrpc]
 [<ffffffffa1108298>] mo_attr_set+0x18/0x50 [mdt]
 [<ffffffffa1108b14>] mdt_reint_setxattr+0x844/0xe70 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 6642, comm: mdt01_016

Call Trace:
 [<ffffffffa09ce8f8>] ? at_measured+0x108/0x380 [ptlrpc]
 [<ffffffffa09c990b>] ? ptlrpc_pinger_commit_expected+0x1b/0x60 [ptlrpc]
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa0984126>] ldlm_cli_enqueue_fini+0x936/0xe30 [ptlrpc]
 [<ffffffffa09a46bb>] ? ptlrpc_set_destroy+0x26b/0x450 [ptlrpc]
 [<ffffffffa09884cd>] ldlm_cli_enqueue+0x3ad/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffffa11c71df>] lod_object_lock+0x14f/0x900 [lod]
 [<ffffffffa07bc83f>] ? lu_object_find_try+0x9f/0x260 [obdclass]
 [<ffffffff81291489>] ? cpumask_next_and+0x29/0x50
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa10edd9a>] mdt_remote_object_lock+0x15a/0x4a0 [mdt]
 [<ffffffffa09b5905>] ? lustre_msg_buf+0x55/0x60 [ptlrpc]
 [<ffffffffa10ee24a>] mdt_object_lock_internal+0x16a/0x320 [mdt]
 [<ffffffffa10ee614>] mdt_object_lock+0x14/0x20 [mdt]
 [<ffffffffa110794a>] mdt_reint_create+0x6fa/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10f990f>] ? ucred_set_jobid+0x5f/0x70 [mdt]
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff8106ee50>] ? pick_next_task_fair+0xd0/0x130
 [<ffffffff81539896>] ? schedule+0x176/0x3a0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 7304, comm: mdt01_020

Call Trace:
 [<ffffffff8105e4e3>] ? __wake_up+0x53/0x70
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa12414ef>] mdd_create+0x135f/0x1770 [mdd]
 [<ffffffffa10fdd74>] ? mdt_version_save+0x84/0x1a0 [mdt]
 [<ffffffffa1107e2c>] mdt_reint_create+0xbdc/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 6143, comm: mdt01_014

Call Trace:
 [<ffffffffa0a2fa02>] top_trans_stop+0x782/0xbd0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa11acaac>] lod_trans_stop+0x2bc/0x330 [lod]
 [<ffffffffa11cdc2c>] ? lod_attr_get+0x9c/0x1b0 [lod]
 [<ffffffffa12520a1>] mdd_trans_stop+0x21/0xc6 [mdd]
 [<ffffffffa1237b12>] mdd_unlink+0x532/0x1020 [mdd]
 [<ffffffffa10fcff8>] mdo_unlink+0x18/0x50 [mdt]
 [<ffffffffa11060ff>] mdt_reint_unlink+0xcaf/0x10c0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LNet: Service thread pid 9407 was inactive for 200.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
LustreError: dumping log to /tmp/lustre-log.1476967319.9407
LNet: Service thread pid 6018 was inactive for 200.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
LNet: Skipped 28 previous similar messages
LustreError: dumping log to /tmp/lustre-log.1476967323.6018
LNet: Service thread pid 6111 was inactive for 200.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
LNet: Skipped 1 previous similar message
LustreError: dumping log to /tmp/lustre-log.1476967332.6111
LustreError: dumping log to /tmp/lustre-log.1476967333.6071
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476967373/real 1476967373]  req@ffff8807bf8f4980 x1548687267382784/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476967394 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 9 previous similar messages
LustreError: 6642:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476967116, 300s ago), entering recovery for soaked-MDT0000_UUID@192.168.1.108@o2ib10 ns: soaked-MDT0000-osp-MDT0002 lock: ffff88081061c540/0x6ebcba138f6ee21c lrc: 4/0,1 mode: --/EX res: [0x20000b7b1:0x60ee:0x0].0x0 bits 0x2 rrc: 2 type: IBT flags: 0x1000001000000 nid: local remote: 0x2459b6735d9942e1 expref: -99 pid: 6642 timeout: 0 lvb_type: 0
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 7340:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476967119, 300s ago), entering recovery for soaked-MDT0001_UUID@192.168.1.109@o2ib10 ns: soaked-MDT0001-osp-MDT0002 lock: ffff8807fe5260c0/0x6ebcba138f6eea50 lrc: 4/0,1 mode: --/EX res: [0x240008110:0x164b1:0x0].0x0 bits 0x2 rrc: 4 type: IBT flags: 0x1000001000000 nid: local remote: 0xc1e0acc7743e33f5 expref: -99 pid: 7340 timeout: 0 lvb_type: 0
Lustre: soaked-MDT0001-osp-MDT0002: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10)
Lustre: Skipped 1 previous similar message
Lustre: Skipped 1 previous similar message
Oct 20 05:45:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476967669/real 1476967669]  req@ffff88080a625080 x1548687267406352/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476967715 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 13 previous similar messages
Lustre: 6070:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff8803c8daacc0 x1548643083731088/t85907501658(0) o36->f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd@192.168.1.126@o2ib100:-1/-1 lens 624/568 e 21 to 0 dl 1476967715 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: 6070:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff88037aca7680 x1548643111011280/t85907501607(0) o36->60ad7b22-6f4d-940e-dc0f-f9ffdfa423e5@192.168.1.133@o2ib100:-1/-1 lens 624/440 e 21 to 0 dl 1476967716 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: 6070:0:(service.c:1331:ptlrpc_at_send_early_reply()) Skipped 1 previous similar message
Lustre: 6070:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff8803b7aa39c0 x1548643111011328/t85907501666(0) o36->60ad7b22-6f4d-940e-dc0f-f9ffdfa423e5@192.168.1.133@o2ib100:-1/-1 lens 632/568 e 21 to 0 dl 1476967719 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: 6070:0:(service.c:1331:ptlrpc_at_send_early_reply()) Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: Skipped 1 previous similar message
Lustre: soaked-MDT0002: Connection restored to f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100)
Lustre: Skipped 1 previous similar message
Lustre: 9543:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff8803f6d419c0 x1548643010816816/t85907501680(0) o36->521f1f5f-66d5-5c01-ed6a-0ed604037e7a@192.168.1.123@o2ib100:-1/-1 lens 632/568 e 21 to 0 dl 1476967723 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: 9543:0:(service.c:1331:ptlrpc_at_send_early_reply()) Skipped 28 previous similar messages
Lustre: soaked-MDT0002: Client a4c0d6ee-3c7d-be3d-7997-1b92bd313f72 (at 192.168.1.124@o2ib100) reconnecting
Lustre: Skipped 11 previous similar messages
Lustre: 9543:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff8807bf345cc0 x1548643230087936/t85907501684(0) o36->f102f5da-2adb-d564-5415-e1621da9dda4@192.168.1.120@o2ib100:-1/-1 lens 624/568 e 21 to 0 dl 1476967732 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: 9543:0:(service.c:1331:ptlrpc_at_send_early_reply()) Skipped 1 previous similar message
Oct 20 05:50:01 lola-10 TIME: Time stamp for console
Oct 20 05:55:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476968219/real 1476968219]  req@ffff88080b06f6c0 x1548687267450192/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476968275 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 33 previous similar messages
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: Skipped 2 previous similar messages
Lustre: soaked-MDT0002: Connection restored to f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100)
Lustre: Skipped 16 previous similar messages
Oct 20 06:00:01 lola-10 TIME: Time stamp for console
Oct 20 06:05:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476968769/real 1476968769]  req@ffff8807a43ec680 x1548687267493968/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476968824 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 37 previous similar messages
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: Skipped 16 previous similar messages
Lustre: soaked-MDT0002: Connection restored to f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100)
Lustre: Skipped 16 previous similar messages
Oct 20 06:10:01 lola-10 TIME: Time stamp for console
Oct 20 06:15:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476969444/real 1476969444]  req@ffff8807ffc6ec80 x1548687267547744/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476969499 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: Skipped 16 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 8ffd2fb9-3d57-7767-a5b4-d8680336d61b (at 192.168.1.132@o2ib100)
Lustre: Skipped 16 previous similar messages
Oct 20 06:20:01 lola-10 TIME: Time stamp for console
Oct 20 06:25:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476970069/real 1476970069]  req@ffff8807ffc6e680 x1548687267597616/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476970125 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: Skipped 15 previous similar messages
Lustre: soaked-MDT0002: Connection restored to f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100)
Lustre: Skipped 16 previous similar messages
Oct 20 06:30:01 lola-10 TIME: Time stamp for console
Oct 20 06:35:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476970719/real 1476970719]  req@ffff8807e53ec3c0 x1548687267649392/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476970760 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 37 previous similar messages
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: Skipped 16 previous similar messages
Lustre: soaked-MDT0002: Connection restored to f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100)
Lustre: Skipped 16 previous similar messages
Oct 20 06:40:01 lola-10 TIME: Time stamp for console
Oct 20 06:45:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 16 previous similar messages
Lustre: Skipped 17 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476971269/real 1476971269]  req@ffff8804060eb9c0 x1548687267693168/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476971324 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 37 previous similar messages
Oct 20 06:50:01 lola-10 TIME: Time stamp for console
Oct 20 06:55:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100) reconnecting
Lustre: Skipped 15 previous similar messages
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 16 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476971944/real 1476971944]  req@ffff8803d14a6cc0 x1548687267746944/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476971999 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Oct 20 07:00:01 lola-10 TIME: Time stamp for console
Oct 20 07:05:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100) reconnecting
Lustre: Skipped 16 previous similar messages
Lustre: soaked-MDT0002: Connection restored to f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100)
Lustre: Skipped 16 previous similar messages
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476972569/real 1476972569]  req@ffff88040430e080 x1548687267796816/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476972585 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Oct 20 07:10:01 lola-10 TIME: Time stamp for console
Oct 20 07:15:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 16 previous similar messages
Lustre: Skipped 16 previous similar messages
Oct 20 07:20:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476973219/real 1476973219]  req@ffff880409ce7c80 x1548687267848592/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476973275 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 37 previous similar messages
Oct 20 07:25:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100) reconnecting
Lustre: Skipped 15 previous similar messages
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 16 previous similar messages
Oct 20 07:30:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476973769/real 1476973769]  req@ffff8803de6de9c0 x1548687267892368/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476973824 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 37 previous similar messages
Oct 20 07:35:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100)
Lustre: Skipped 16 previous similar messages
Lustre: Skipped 17 previous similar messages
Oct 20 07:40:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476974444/real 1476974444]  req@ffff8803c23d8cc0 x1548687267946144/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476974499 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Oct 20 07:45:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: Skipped 15 previous similar messages
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 16 previous similar messages
Oct 20 07:50:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476975069/real 1476975069]  req@ffff8803f64cf380 x1548687267996016/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476975124 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Oct 20 07:55:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100) reconnecting
Lustre: Skipped 15 previous similar messages
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 16 previous similar messages
Oct 20 08:00:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476975719/real 1476975719]  req@ffff8803f7ad3980 x1548687268047744/t0(0) o38->soaked-MDT0000-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476975735 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 37 previous similar messages
Oct 20 08:05:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100)
Lustre: Skipped 15 previous similar messages
Lustre: Skipped 17 previous similar messages
Oct 20 08:10:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476976269/real 1476976269]  req@ffff88037aca7c80 x1548687268091568/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476976324 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 37 previous similar messages
Oct 20 08:15:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client f2256d86-a1d3-2a3f-6ecd-7ddbf45510bd (at 192.168.1.126@o2ib100) reconnecting
Lustre: Skipped 14 previous similar messages
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 16 previous similar messages
Oct 20 08:20:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476976944/real 1476976944]  req@ffff8803d3a406c0 x1548687268145344/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476976999 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Oct 20 08:25:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100) reconnecting
Lustre: Skipped 14 previous similar messages
Lustre: soaked-MDT0002: Connection restored to 3bf16639-ba44-da4f-3ae0-9f8f041df65f (at 192.168.1.127@o2ib100)
Lustre: Skipped 16 previous similar messages
Oct 20 08:30:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476977569/real 1476977569]  req@ffff880384d30980 x1548687268195216/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476977625 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Oct 20 08:35:01 lola-10 TIME: Time stamp for console
Lustre: soaked-MDT0002: Client 3bf16639-ba44-da4f-3ae0-9f8f041df65f (at 192.168.1.127@o2ib100) reconnecting
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 16 previous similar messages
Lustre: Skipped 16 previous similar messages
Oct 20 08:40:01 lola-10 TIME: Time stamp for console
LNet: Service thread pid 9395 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
LNet: Skipped 3 previous similar messages
Pid: 9395, comm: mdt01_024

Call Trace:
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa0984126>] ldlm_cli_enqueue_fini+0x936/0xe30 [ptlrpc]
 [<ffffffffa09a46bb>] ? ptlrpc_set_destroy+0x26b/0x450 [ptlrpc]
 [<ffffffffa09884cd>] ldlm_cli_enqueue+0x3ad/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffffa11c71df>] lod_object_lock+0x14f/0x900 [lod]
 [<ffffffffa07bc83f>] ? lu_object_find_try+0x9f/0x260 [obdclass]
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa10edd9a>] mdt_remote_object_lock+0x15a/0x4a0 [mdt]
 [<ffffffffa09b5905>] ? lustre_msg_buf+0x55/0x60 [ptlrpc]
 [<ffffffffa10ee24a>] mdt_object_lock_internal+0x16a/0x320 [mdt]
 [<ffffffffa10ee614>] mdt_object_lock+0x14/0x20 [mdt]
 [<ffffffffa110794a>] mdt_reint_create+0x6fa/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10f990f>] ? ucred_set_jobid+0x5f/0x70 [mdt]
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476978134.9395
LNet: Service thread pid 6054 was inactive for 200.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Pid: 6054, comm: mdt01_009

Call Trace:
 [<ffffffffa09ce8f8>] ? at_measured+0x108/0x380 [ptlrpc]
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa0984126>] ldlm_cli_enqueue_fini+0x936/0xe30 [ptlrpc]
 [<ffffffffa09a46bb>] ? ptlrpc_set_destroy+0x26b/0x450 [ptlrpc]
 [<ffffffffa09884cd>] ldlm_cli_enqueue+0x3ad/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffffa11c71df>] lod_object_lock+0x14f/0x900 [lod]
 [<ffffffffa07bc83f>] ? lu_object_find_try+0x9f/0x260 [obdclass]
 [<ffffffff81291489>] ? cpumask_next_and+0x29/0x50
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa10edd9a>] mdt_remote_object_lock+0x15a/0x4a0 [mdt]
 [<ffffffffa09b5905>] ? lustre_msg_buf+0x55/0x60 [ptlrpc]
 [<ffffffffa10ee24a>] mdt_object_lock_internal+0x16a/0x320 [mdt]
 [<ffffffffa10ee614>] mdt_object_lock+0x14/0x20 [mdt]
 [<ffffffffa110794a>] mdt_reint_create+0x6fa/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10f990f>] ? ucred_set_jobid+0x5f/0x70 [mdt]
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

LustreError: dumping log to /tmp/lustre-log.1476978137.6054
Pid: 9543, comm: mdt00_027

Call Trace:
 [<ffffffffa09ce8f8>] ? at_measured+0x108/0x380 [ptlrpc]
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa0984126>] ldlm_cli_enqueue_fini+0x936/0xe30 [ptlrpc]
 [<ffffffffa09a46bb>] ? ptlrpc_set_destroy+0x26b/0x450 [ptlrpc]
 [<ffffffffa09884cd>] ldlm_cli_enqueue+0x3ad/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffffa11c71df>] lod_object_lock+0x14f/0x900 [lod]
 [<ffffffffa07bc83f>] ? lu_object_find_try+0x9f/0x260 [obdclass]
 [<ffffffff81291489>] ? cpumask_next_and+0x29/0x50
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa10edd9a>] mdt_remote_object_lock+0x15a/0x4a0 [mdt]
 [<ffffffffa09b5905>] ? lustre_msg_buf+0x55/0x60 [ptlrpc]
 [<ffffffffa10ee24a>] mdt_object_lock_internal+0x16a/0x320 [mdt]
 [<ffffffffa10ee614>] mdt_object_lock+0x14/0x20 [mdt]
 [<ffffffffa110794a>] mdt_reint_create+0x6fa/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10f990f>] ? ucred_set_jobid+0x5f/0x70 [mdt]
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Pid: 7040, comm: mdt00_014

Call Trace:
 [<ffffffffa09ce8f8>] ? at_measured+0x108/0x380 [ptlrpc]
 [<ffffffff8153a9b2>] schedule_timeout+0x192/0x2e0
 [<ffffffff81089fa0>] ? process_timeout+0x0/0x10
 [<ffffffffa0984c40>] ? ldlm_expired_completion_wait+0x0/0x250 [ptlrpc]
 [<ffffffffa0989f49>] ldlm_completion_ast+0x5f9/0x9a0 [ptlrpc]
 [<ffffffff81067650>] ? default_wake_function+0x0/0x20
 [<ffffffffa0984126>] ldlm_cli_enqueue_fini+0x936/0xe30 [ptlrpc]
 [<ffffffffa09a46bb>] ? ptlrpc_set_destroy+0x26b/0x450 [ptlrpc]
 [<ffffffffa09884cd>] ldlm_cli_enqueue+0x3ad/0x7d0 [ptlrpc]
 [<ffffffffa0989950>] ? ldlm_completion_ast+0x0/0x9a0 [ptlrpc]
 [<ffffffffa10e5e00>] ? mdt_remote_blocking_ast+0x0/0x4e0 [mdt]
 [<ffffffffa12b28fd>] osp_md_object_lock+0x1ed/0x2d0 [osp]
 [<ffffffffa11c71df>] lod_object_lock+0x14f/0x900 [lod]
 [<ffffffffa07bc83f>] ? lu_object_find_try+0x9f/0x260 [obdclass]
 [<ffffffff81291489>] ? cpumask_next_and+0x29/0x50
 [<ffffffffa1243e9b>] mdd_object_lock+0x3b/0xd0 [mdd]
 [<ffffffffa10edd9a>] mdt_remote_object_lock+0x15a/0x4a0 [mdt]
 [<ffffffffa09b5905>] ? lustre_msg_buf+0x55/0x60 [ptlrpc]
 [<ffffffffa10ee24a>] mdt_object_lock_internal+0x16a/0x320 [mdt]
 [<ffffffffa10ee614>] mdt_object_lock+0x14/0x20 [mdt]
 [<ffffffffa110794a>] mdt_reint_create+0x6fa/0xfe0 [mdt]
 [<ffffffffa10f94ec>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
 [<ffffffffa09b6b5b>] ? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
 [<ffffffff81299b7a>] ? strlcpy+0x4a/0x60
 [<ffffffffa10f990f>] ? ucred_set_jobid+0x5f/0x70 [mdt]
 [<ffffffffa10fab5a>] ? old_init_ucred_common+0xda/0x2b0 [mdt]
 [<ffffffffa10fd08d>] mdt_reint_rec+0x5d/0x200 [mdt]
 [<ffffffffa10e7d9b>] mdt_reint_internal+0x62b/0xa50 [mdt]
 [<ffffffffa10e866b>] mdt_reint+0x6b/0x120 [mdt]
 [<ffffffffa0a1b03c>] tgt_request_handle+0x8ec/0x1440 [ptlrpc]
 [<ffffffffa09c7791>] ptlrpc_main+0xd31/0x1800 [ptlrpc]
 [<ffffffff81539b0e>] ? thread_return+0x4e/0x7d0
 [<ffffffffa09c6a60>] ? ptlrpc_main+0x0/0x1800 [ptlrpc]
 [<ffffffff810a138e>] kthread+0x9e/0xc0
 [<ffffffff8100c28a>] child_rip+0xa/0x20
 [<ffffffff810a12f0>] ? kthread+0x0/0xc0
 [<ffffffff8100c280>] ? child_rip+0x0/0x20

Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476978119/real 1476978119]  req@ffff8803c23d8cc0 x1548687268238896/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476978174 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 31 previous similar messages
Lustre: soaked-MDT0003-osp-MDT0002: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 9395:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476977934, 300s ago), entering recovery for soaked-MDT0003_UUID@192.168.1.111@o2ib10 ns: soaked-MDT0003-osp-MDT0002 lock: ffff880825baa3c0/0x6ebcba138f6eeff2 lrc: 4/0,1 mode: --/EX res: [0x2c000a811:0xcc07:0x0].0x0 bits 0x2 rrc: 5 type: IBT flags: 0x1000001000000 nid: local remote: 0x8bcf75889e596694 expref: -99 pid: 9395 timeout: 0 lvb_type: 0
LustreError: 9395:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) Skipped 4 previous similar messages
LustreError: 6054:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1476977937, 300s ago), entering recovery for soaked-MDT0003_UUID@192.168.1.111@o2ib10 ns: soaked-MDT0003-osp-MDT0002 lock: ffff8807bf1bf080/0x6ebcba138f6eeff9 lrc: 4/0,1 mode: --/EX res: [0x2c000a811:0xcc07:0x0].0x0 bits 0x2 rrc: 5 type: IBT flags: 0x1000001000000 nid: local remote: 0x8bcf75889e59669b expref: -99 pid: 6054 timeout: 0 lvb_type: 0
Lustre: soaked-MDT0001-osp-MDT0002: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
LustreError: 6054:0:(ldlm_request.c:148:ldlm_expired_completion_wait()) Skipped 1 previous similar message
Oct 20 08:45:01 lola-10 TIME: Time stamp for console
Lustre: 6031:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff8803dc6bb980 x1548643667842224/t0(0) o36->e45b0a62-d534-1b66-333c-62b9ad3eee7a@192.168.1.119@o2ib100:-1/-1 lens 624/568 e 24 to 0 dl 1476978534 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: 6031:0:(service.c:1331:ptlrpc_at_send_early_reply()) Skipped 9 previous similar messages
Lustre: 6031:0:(service.c:1331:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/5), not sending early reply
  req@ffff880394e293c0 x1548643383093008/t0(0) o36->e9d38f32-5477-8a6c-d96e-8d8a5a05b01f@192.168.1.121@o2ib100:-1/-1 lens 624/568 e 23 to 0 dl 1476978537 ref 2 fl Interpret:/0/0 rc 0/0
Lustre: soaked-MDT0002: Client e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100) reconnecting
Lustre: Skipped 14 previous similar messages
Lustre: soaked-MDT0002: Connection restored to e45b0a62-d534-1b66-333c-62b9ad3eee7a (at 192.168.1.119@o2ib100)
Lustre: Skipped 18 previous similar messages
Oct 20 08:50:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476978787/real 1476978787]  req@ffff8803c82f29c0 x1548687268292128/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476978842 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Oct 20 08:55:01 lola-10 TIME: Time stamp for console
Oct 20 09:00:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476979412/real 1476979412]  req@ffff8803b9077c80 x1548687268342000/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476979467 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Oct 20 09:05:01 lola-10 TIME: Time stamp for console
Oct 20 09:10:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476980062/real 1476980062]  req@ffff880374add6c0 x1548687268393728/t0(0) o38->soaked-MDT0000-osp-MDT0002@192.168.1.108@o2ib10:24/4 lens 520/544 e 0 to 1 dl 1476980078 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 37 previous similar messages
Oct 20 09:15:01 lola-10 TIME: Time stamp for console
Oct 20 09:20:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1476980612/real 1476980612]  req@ffff8803c82f2cc0 x1548687268437552/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476980667 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 37 previous similar messages
Oct 20 09:25:01 lola-10 TIME: Time stamp for console
Oct 20 09:30:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476981287/real 1476981287]  req@ffff88037613fcc0 x1548687268491328/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476981342 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Oct 20 09:35:01 lola-10 TIME: Time stamp for console
Oct 20 09:40:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476981887/real 1476981887]  req@ffff88039514e680 x1548687268539136/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1476981942 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 35 previous similar messages
Oct 20 09:45:01 lola-10 TIME: Time stamp for console
Oct 20 09:50:01 lola-10 TIME: Time stamp for console
Oct 20 09:55:01 lola-10 TIME: Time stamp for console
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1476982512/real 1476982512]  req@ffff88036a0429c0 x1548687268589008/t0(0) o38->soaked-MDT0000-lwp-MDT0002@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1476982563 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1
Lustre: 4557:0:(client.c:2111:ptlrpc_expire_one_request()) Skipped 36 previous similar messages
Lustre: soaked-OST0012-osc-MDT0002: Connection to soaked-OST0012 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0006-osc-MDT0002: Connection to soaked-OST0006 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0000-osc-MDT0002: Connection to soaked-OST0000 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: soaked-OST0013-osc-MDT0002: Connection to soaked-OST0013 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: soaked-OST0014-osc-MDT0002: Connection to soaked-OST0014 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 3 previous similar messages
Oct 20 10:00:01 lola-10 TIME: Time stamp for console
Lustre: soaked-OST000f-osc-MDT0002: Connection to soaked-OST000f (at 192.168.1.105@o2ib10) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 4 previous similar messages
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               Version 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.                                                                                                                                                                          MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           LSI Corporation MPT SAS2 BIOS                                                   Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                 Initializing../                                                                 Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                                                                                                 Press Ctrl-C to start LSI Corp Configuration Utility...                         Searching for devices at HBA 0...                                               LSI Corporation MPT SAS2 BIOS                                                   MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                            PCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    SLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    ---- ---- --- -------- ---------------- ----------- ----------                    3           LSI      SAS2308-IT       15.00.00.00  0F:00:00:03                  3    4   7  LSI      Universal Xport  0786         20.00 MiB                    3    4   41  LSI      INF-01-00        0786         14.55 TiB                   3    4   42  LSI      INF-01-00        0786         14.55 TiB                   3    4   43  LSI      INF-01-00        0786         14.55 TiB                   3    4   44  LSI      INF-01-00        0786         14.55 TiB                   3    4   45  LSI      INF-01-00        0786         14.55 TiB                   3    4   46  LSI      INF-01-00        0786         14.55 TiB                   3    0   7  LSI      Universal Xport  0786         20.00 MiB                    3    0   41  LSI      INF-01-00        0786         14.55 TiB                   3    0   42  LSI      INF-01-00        0786         14.55 TiB                   3    0   43  LSI      INF-01-00        0786         14.55 TiB                   3    0   44  LSI      INF-01-00        0786         14.55 TiB                   3    0   45  LSI      INF-01-00        0786         14.55 TiB                   3    0   46  LSI      INF-01-00        0786         14.55 TiB                 Copyright 2000-2012 LSI Corporation.                                                                                                                              RAID Volumes:                                                                   None defined.                                                                   Physical Devices:                                                             �  ID   Device Model     Serial #                     Size Type/Status(Vol ID)     0    ST500NM0011      Z1M0X1F9                  465.7GB Non-RAID Disk           1    ST500NM0011      Z1M0X1GG                  465.7GB Non-RAID Disk         Press <CTRL-I> to enter Configuration Utility..                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Copyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   Press <CTRL-I> to enter Configuration Utility...                                                                                                                PXE 2.1 Build 091 (WfM 2.0)                                                     Press Ctrl+S to enter the Setup Menu.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                          Bios Version: SE5C600.86B.01.08.0003.022620131521                               BMC Firmware Version: 1.17.4207                                                 SDR Version: SDR Package 1.09                                                   ME Firmware Version: 2.1.7.112                                                  Platform ID: S2600GZ                                                            System memory detected: 32768 MB                                                Current memory speed: 1333 MT/s                                                 Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        Number of physical processors identified: 2                                     ********************************************************************************AHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          SAS/SATA Capable Controller configured with 4 ports in SATA mode                ********************************************************************************USB Keyboard detected                                                           USB Mouse detected                                                                                                                                              Press <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                                     
Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

    GNU GRUB  version 0.97  (571K lower / 3066652K upper memory)

+-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+
      Use the ^ and v keys to select which entry is highlighted.
      Press enter to boot the selected OS, 'e' to edit the
      commands before booting, 'a' to modify the kernel arguments
      before booting, or 'c' for a command-line.  CentOS (2.6.32-573.26.1.el6_lustre.x86_64)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  The highlighted entry will be booted automatically in 5 seconds.    The highlighted entry will be booted automatically in 4 seconds.    The highlighted entry will be booted automatically in 3 seconds.    The highlighted entry will be booted automatically in 2 seconds.    The highlighted entry will be booted automatically in 1 seconds.    Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-573.26.1.el6_lustre.x86_64 (soakbuilder@lola-16.lola.whamcloud.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-16) (GCC) ) #1 SMP Mon Oct 17 13:07:39 PDT 2016
Command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=auto SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000008ec00 (usable)
 BIOS-e820: 000000000008ec00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bb3c7000 (usable)
 BIOS-e820: 00000000bb3c7000 - 00000000bdd2f000 (reserved)
 BIOS-e820: 00000000bdd2f000 - 00000000bddcd000 (ACPI NVS)
 BIOS-e820: 00000000bddcd000 - 00000000bdea1000 (ACPI data)
 BIOS-e820: 00000000bdea1000 - 00000000bdf2f000 (ACPI NVS)
 BIOS-e820: 00000000bdf2f000 - 00000000bdfac000 (ACPI data)
 BIOS-e820: 00000000bdfac000 - 00000000be000000 (usable)
 BIOS-e820: 00000000be000000 - 00000000d0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
 BIOS-e820: 00000000fed19000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ffa20000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000840000000 (usable)
DMI 2.6 present.
SMBIOS version 2.6 @ 0xF0440
No AGP bridge found
last_pfn = 0x840000 max_arch_pfn = 0x400000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xbe000 max_arch_pfn = 0x400000000
Using GB pages for direct mapping
init_memory_mapping: 0000000000000000-00000000be000000
init_memory_mapping: 0000000100000000-0000000840000000
RAMDISK: 3601e000 - 37fef30d
ACPI: Deleted _OSI()
ACPI: Deleted _OSI()
ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20090903/tbfadt-611)
ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
ACPI: FACS 00000000bdfa9f40 00040
ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
Setting APIC routing to flat.
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: PXM 0 -> APIC 2 -> Node 0
SRAT: PXM 0 -> APIC 3 -> Node 0
SRAT: PXM 0 -> APIC 4 -> Node 0
SRAT: PXM 0 -> APIC 5 -> Node 0
SRAT: PXM 0 -> APIC 6 -> Node 0
SRAT: PXM 0 -> APIC 7 -> Node 0
SRAT: PXM 0 -> APIC 8 -> Node 0
SRAT: PXM 0 -> APIC 9 -> Node 0
SRAT: PXM 0 -> APIC 10 -> Node 0
SRAT: PXM 0 -> APIC 11 -> Node 0
SRAT: PXM 0 -> APIC 12 -> Node 0
SRAT: PXM 0 -> APIC 13 -> Node 0
SRAT: PXM 0 -> APIC 14 -> Node 0
SRAT: PXM 0 -> APIC 15 -> Node 0
SRAT: PXM 1 -> APIC 32 -> Node 1
SRAT: PXM 1 -> APIC 33 -> Node 1
SRAT: PXM 1 -> APIC 34 -> Node 1
SRAT: PXM 1 -> APIC 35 -> Node 1
SRAT: PXM 1 -> APIC 36 -> Node 1
SRAT: PXM 1 -> APIC 37 -> Node 1
SRAT: PXM 1 -> APIC 38 -> Node 1
SRAT: PXM 1 -> APIC 39 -> Node 1
SRAT: PXM 1 -> APIC 40 -> Node 1
SRAT: PXM 1 -> APIC 41 -> Node 1
SRAT: PXM 1 -> APIC 42 -> Node 1
SRAT: PXM 1 -> APIC 43 -> Node 1
SRAT: PXM 1 -> APIC 44 -> Node 1
SRAT: PXM 1 -> APIC 45 -> Node 1
SRAT: PXM 1 -> APIC 46 -> Node 1
SRAT: PXM 1 -> APIC 47 -> Node 1
SRAT: Node 0 PXM 0 0-c0000000
SRAT: Node 0 PXM 0 100000000-440000000
SRAT: Node 1 PXM 1 440000000-840000000
Bootmem setup node 0 0000000000000000-0000000440000000
  NODE_DATA [0000000000009000 - 000000000003cfff]
  bootmap [0000000000100000 -  0000000000187fff] pages 88
(8 early reservations) ==> bootmem [0000000000 - 0440000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS ==> [0001000000 - 000203eb64]
  #3 [003601e000 - 0037fef30d]          RAMDISK ==> [003601e000 - 0037fef30d]
  #4 [000008ec00 - 0000100000]    BIOS reserved ==> [000008ec00 - 0000100000]
  #5 [000203f000 - 000203f9b8]              BRK ==> [000203f000 - 000203f9b8]
  #6 [0000008000 - 0000009000]          PGTABLE ==> [0000008000 - 0000009000]
  #7 [0000001000 - 0000001030]        ACPI SLIT ==> [0000001000 - 0000001030]
Bootmem setup node 1 0000000440000000-0000000840000000
  NODE_DATA [0000000440000040 - 000000044003403f]
  bootmap [0000000440035000 -  00000004400b4fff] pages 80
(8 early reservations) ==> bootmem [0440000000 - 0840000000]
  #0 [0000000000 - 0000001000]   BIOS data page
  #1 [0000006000 - 0000008000]       TRAMPOLINE
  #2 [0001000000 - 000203eb64]    TEXT DATA BSS
  #3 [003601e000 - 0037fef30d]          RAMDISK
  #4 [000008ec00 - 0000100000]    BIOS reserved
  #5 [000203f000 - 000203f9b8]              BRK
  #6 [0000008000 - 0000009000]          PGTABLE
  #7 [0000001000 - 0000001030]        ACPI SLIT
found SMP MP-table at [ffff8800000fcd70] fcd70
Reserving 131MB of memory at 48MB for crashkernel (System RAM: 33792MB)
Zone PFN ranges:
  DMA      0x00000001 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   0x00100000 -> 0x00840000
Movable zone start PFN for each node
early_node_map[5] active PFN ranges
    0: 0x00000001 -> 0x0000008e
    0: 0x00000100 -> 0x000bb3c7
    0: 0x000bdfac -> 0x000be000
    0: 0x00100000 -> 0x00440000
    1: 0x00440000 -> 0x00840000
ACPI: PM-Timer IO Port: 0x408
Setting APIC routing to flat.
ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a701 base: 0xfed00000
SMP: Allowing 240 CPUs, 208 hotplug CPUs
PM: Registered nosave memory: 000000000008e000 - 000000000008f000
PM: Registered nosave memory: 000000000008f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
PM: Registered nosave memory: 00000000bb3c7000 - 00000000bdd2f000
PM: Registered nosave memory: 00000000bdd2f000 - 00000000bddcd000
PM: Registered nosave memory: 00000000bddcd000 - 00000000bdea1000
PM: Registered nosave memory: 00000000bdea1000 - 00000000bdf2f000
PM: Registered nosave memory: 00000000bdf2f000 - 00000000bdfac000
PM: Registered nosave memory: 00000000be000000 - 00000000d0000000
PM: Registered nosave memory: 00000000d0000000 - 00000000fec00000
PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
PM: Registered nosave memory: 00000000fec01000 - 00000000fed19000
PM: Registered nosave memory: 00000000fed19000 - 00000000fed1a000
PM: Registered nosave memory: 00000000fed1a000 - 00000000fed1c000
PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
PM: Registered nosave memory: 00000000fed20000 - 00000000fee00000
PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
PM: Registered nosave memory: 00000000fee01000 - 00000000ffa20000
PM: Registered nosave memory: 00000000ffa20000 - 0000000100000000
Allocating PCI resources starting at d0000000 (gap: d0000000:2ec00000)
Booting paravirtualized kernel on bare hardware
NR_CPUS:4096 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
PERCPU: Embedded 30 pages/cpu @ffff880038600000 s91288 r8192 d23400 u131072
pcpu-alloc: s91288 r8192 d23400 u131072 alloc=1*2097152
pcpu-alloc: [0] 000 001 002 003 004 005 006 007 016 017 018 019 020 021 022 023 
pcpu-alloc: [0] 032 034 036 038 040 042 044 046 048 050 052 054 056 058 060 062 
pcpu-alloc: [0] 064 066 068 070 072 074 076 078 080 082 084 086 088 090 092 094 
pcpu-alloc: [0] 096 098 100 102 104 106 108 110 112 114 116 118 120 122 124 126 
pcpu-alloc: [0] 128 130 132 134 136 138 140 142 144 146 148 150 152 154 156 158 
pcpu-alloc: [0] 160 162 164 166 168 170 172 174 176 178 180 182 184 186 188 190 
pcpu-alloc: [0] 192 194 196 198 200 202 204 206 208 210 212 214 216 218 220 222 
pcpu-alloc: [0] 224 226 228 230 232 234 236 238 --- --- --- --- --- --- --- --- 
pcpu-alloc: [1] 008 009 010 011 012 013 014 015 024 025 026 027 028 029 030 031 
pcpu-alloc: [1] 033 035 037 039 041 043 045 047 049 051 053 055 057 059 061 063 
pcpu-alloc: [1] 065 067 069 071 073 075 077 079 081 083 085 087 089 091 093 095 
pcpu-alloc: [1] 097 099 101 103 105 107 109 111 113 115 117 119 121 123 125 127 
pcpu-alloc: [1] 129 131 133 135 137 139 141 143 145 147 149 151 153 155 157 159 
pcpu-alloc: [1] 161 163 165 167 169 171 173 175 177 179 181 183 185 187 189 191 
pcpu-alloc: [1] 193 195 197 199 201 203 205 207 209 211 213 215 217 219 221 223 
pcpu-alloc: [1] 225 227 229 231 233 235 237 239 --- --- --- --- --- --- --- --- 
Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8250675
Policy zone: Normal
Kernel command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=131M@0M SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
PID hash table entries: 4096 (order: 3, 32768 bytes)
xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
Checking aperture...
No AGP bridge found
Memory: 32738448k/34603008k available (5400k kernel code, 1126752k absent, 737808k reserved, 7008k data, 1304k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:3144
Extended CMOS year: 2000
Console: colour VGA+ 80x25
console [ttyS0] enabled
allocated 134217728 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
TSC: cpu family 6 model 45, tsc initial value = 7697021e16
Fast TSC calibration using PIT
Detected 2693.317 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.63 BogoMIPS (lpj=2693317)
pid_max: default: 245760 minimum: 1920
Security Framework initialized
SELinux:  Initializing.
Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 20 MCE banks
CPU0: Thermal monitoring enabled (TM1)
using mwait in idle threads.
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 22144 entries in 87 pages
x2apic not enabled, IRQ remapping init failed
APIC routing finalized to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz stepping 07
Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
... version:                3
... bit width:              48
... generic registers:      4
... value mask:             0000ffffffffffff
... max period:             0000ffffffffffff
... fixed-purpose events:   3
... event mask:             000000070000000f
NMI watchdog enabled, takes one hw-pmu counter.
Booting Node   0, Processors  #1 #2 #3 #4 #5 #6 #7 Ok.
Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 Ok.
Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 Ok.
Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
Brought up 32 CPUs
Total of 32 processors activated (172367.58 BogoMIPS).
devtmpfs: initialized
PM: Registering ACPI NVS region at bdd2f000 (647168 bytes)
PM: Registering ACPI NVS region at bdea1000 (581632 bytes)
regulator: core version 0.5
NET: Registered protocol family 16
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MCFG configuration 0: base c0000000 segment 0 buses 0 - 255
PCI: MCFG area at c0000000 reserved in E820
PCI: Using MMCONFIG at c0000000 - cfffffff
PCI: Using configuration type 1 for base access
bio: create slab <bio-0> at 0
ACPI: Executed 1 blocks of module-level executable AML code
ACPI: BIOS _OSI(Linux) query ignored
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
HEST: Table parsing has been initialized.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
pci_root PNP0A08:00: host bridge window [io  0x0000-0xbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:00: host bridge window [mem 0x000c0000-0x000c3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c4000-0x000c7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c8000-0x000cbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000cc000-0x000cffff]
pci_root PNP0A08:00: host bridge window [mem 0x000d0000-0x000d3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d4000-0x000d7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d8000-0x000dbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000dc000-0x000dffff]
pci_root PNP0A08:00: host bridge window [mem 0x000e0000-0x000e3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e4000-0x000e7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e8000-0x000ebfff]
pci_root PNP0A08:00: host bridge window [mem 0x000ec000-0x000effff]
pci_root PNP0A08:00: host bridge window [mem 0x000f0000-0x000fffff]
pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xebffffff]
pci_root PNP0A08:00: host bridge window [mem 0x380000000000-0x38007fffffff]
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdfff])
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff]
pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff]
pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff]
pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff]
pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff]
pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff]
pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff]
pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff]
pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff]
pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff]
pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff]
pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff]
pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff]
pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
pci 0000:00:00.0: PME# disabled
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
pci 0000:00:01.1: PME# disabled
pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
pci 0000:00:02.0: PME# disabled
pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
pci 0000:00:02.2: PME# disabled
pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
pci 0000:00:03.0: PME# disabled
pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
pci 0000:00:11.0: PME# disabled
pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.0: PME# disabled
pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
pci 0000:00:16.1: PME# disabled
pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.7: PME# disabled
pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.0: PME# disabled
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:00.0: PME# disabled
pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
pci 0000:02:00.1: PME# disabled
pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
pci 0000:02:00.2: PME# disabled
pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
pci 0000:02:00.3: PME# disabled
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:07:00.3: PME# supported from D0 D3hot D3cold
pci 0000:07:00.3: PME# disabled
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a] (subtractive decode)
 pci0000:00: Requesting ACPI _OSC control (0x1d)
 pci0000:00: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
pci_root PNP0A08:01: host bridge window [io  0x03b0-0x03df]
pci_root PNP0A08:01: host bridge window [io  0xc000-0xffff]
pci_root PNP0A08:01: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:01: host bridge window [mem 0xec000000-0xfbffffff]
pci_root PNP0A08:01: host bridge window [mem 0x380080000000-0x3800ffffffff]
PCI host bridge to bus 0000:80
pci_bus 0000:80: root bus resource [io  0x03b0-0x03df]
pci_bus 0000:80: root bus resource [io  0xc000-0xffff]
pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff]
pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff]
pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
pci 0000:80:01.0: PME# disabled
pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
pci 0000:80:02.0: PME# disabled
pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
pci 0000:80:03.0: PME# disabled
pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
pci 0000:80:03.2: PME# disabled
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
 pci0000:80: Requesting ACPI _OSC control (0x1d)
 pci0000:80: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
PCI host bridge to bus 0000:7f
 pci0000:7f: Requesting ACPI _OSC control (0x1d)
 pci0000:7f: ACPI _OSC control (0x10) granted
ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
PCI host bridge to bus 0000:ff
 pci0000:ff: Requesting ACPI _OSC control (0x1d)
 pci0000:ff: ACPI _OSC control (0x10) granted
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:09:00.0
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
HPET: 8 timers in total, 5 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 72, 73, 74, 75, 76, 0
hpet0: 8 comparators, 64-bit 14.318180 MHz counter
Switching to clocksource hpet
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 15 devices
ACPI: ACPI bus type pnp unregistered
system 00:05: [io  0x0680-0x069f] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0x0400-0x0453] has been reserved
system 00:05: [io  0x0458-0x047f] has been reserved
system 00:05: [io  0x0500-0x057f] has been reserved
system 00:05: [io  0x0600-0x061f] has been reserved
system 00:05: [io  0x0ca2-0x0ca5] has been reserved
system 00:05: [io  0x0cf9] could not be reserved
system 00:07: [io  0x0454-0x0457] has been reserved
system 00:0a: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:0a: [mem 0xebfff000-0xebffffff] has been reserved
system 00:0a: [mem 0xc0000000-0xcfffffff] has been reserved
system 00:0a: [mem 0xfed20000-0xfed3ffff] has been reserved
system 00:0a: [mem 0xfed45000-0xfed8ffff] has been reserved
system 00:0a: [mem 0xff000000-0xffffffff] could not be reserved
system 00:0a: [mem 0xfee00000-0xfeefffff] could not be reserved
system 00:0a: [mem 0xfec00000-0xfecfffff] could not be reserved
system 00:0a: [mem 0xd0f70000-0xd0f70fff] has been reserved
system 00:0c: [mem 0x00000000-0x0009cfff] could not be reserved
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
pci 0000:00:02.0:   bridge window [mem 0xeb000000-0xeb7fffff 64bit pref]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
pci 0000:00:11.0:   bridge window [mem 0xeb800000-0xebcfffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a]
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
pci 0000:00:01.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:01.1: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.2: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:03.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:11.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
pci 0000:80:01.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:02.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.2: PCI INT A -> GSI 71 (level, low) -> IRQ 71
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1a.0: PCI INT B disabled
pci 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1d.0: PCI INT A dis�abled
Trying tinitramfs...
Freeing initrd memory: 32580k freed
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
futex hash table entries: 65536 (order: 10, 4194304 bytes)
audit: initializing netlink socket (disabled)
type=2000 audit(1476983029.103:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 32768
ksign: Installing public key data
Loading keyring
- Added public key 3B396075E393847B
- User ID: Red Hat, Inc. (Kernel Module GPG key)
- Added public key D4A26C9CCD09BEDA
- User ID: Red Hat Enterprise Linux Driver Update Program <secalert@redhat.com>
- Added public key CB445E0DA3EA1F65
- User ID: Red Hat Enterprise Linux Driver Update Program (key 4) <secalert@redhat.com>
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
acpiphp: Slot [2] registered
acpiphp: Slot [2-1] registered
acpiphp: Slot [2-2] registered
acpiphp: Slot [2-3] registered
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
[Firmware Bug]: No valid trip found
ERST: Error Record Serialization Table (ERST) support is initialized.
GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
�serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input1
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
ehci_hcd 0000:00:1a.0: EHCI Host Controller
ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.0: debug port 2
ehci_hcd 0000:00:1a.0: irq 22, io mem 0xd0f20000
ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb1: SerialNumber: 0000:00:1a.0
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
ehci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
ehci_hcd 0000:00:1d.0: EHCI Host Controller
ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
ehci_hcd 0000:00:1d.0: debug port 2
ehci_hcd 0000:00:1d.0: irq 20, io mem 0xd0f10000
Refined TSC clocksource calibration: 2693.509 MHz.
Switching to clocksource tsc
ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: EHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.32-573.26.1.el6_lustre.x86_64 ehci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
PNP: No PS/2 controller found. Probing ports directly.
mice: PS/2 mouse device common for all mice
rtc_cmos 00:06: RTC can wake from S4
rtc_cmos 00:06: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
cpuidle: using governor ladder
cpuidle: using governor menu
EFI Variables Facility v0.08 2004-May-17
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
GRE over IPv4 demultiplexor driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
rtc_cmos 00:06: setting system clock to 2016-10-20 17:03:54 UTC (1476983034)
Initalizing network drop monitor service
Freeing unused kernel memory: 1304k freed
Write protecting the kernel read-only data: 10240k
Freeing unused kernel memory: 724k freed
Freeing unused kernel memory: 1572k freed
rdac: device handler registered
dracut: dracut-004-388.el6
dracut: rd_NO_LUKS: removing cryptoluks activation
dracut: rd_NO_LVM: removing LVM activation
usb 1-1: new high speed USB device number 2 using ehci_hcd
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.29.0-ioctl (2014-10-28) initialised: dm-devel@redhat.com
udev: starting version 147
usb 1-1: New USB device found, idVendor=8087, idProduct=0024
usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 1-1: configuration #1 chosen from 1 choice
hub 1-1:1.0: USB hub found
hub 1-1:1.0: 6 ports detected
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
usb 2-1: new high speed USB device number 2 using ehci_hcd
mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)
mlx4_core: Initializing 0000:04:00.0
mlx4_core 0000:04:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
usb 2-1: New USB device found, idVendor=8087, idProduct=0024
usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 2-1: configuration #1 chosen from 1 choice
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 8 ports detected
usb 2-1.4: new full speed USB device number 3 using ehci_hcd
usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.4: Product: Virtual Keyboard and Mouse
usb 2-1.4: Manufacturer: American Megatrends Inc.
usb 2-1.4: SerialNumber: serial
usb 2-1.4: configuration #1 chosen from 1 choice
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input2
generic-usb 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input3
generic-usb 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)
mlx4_en 0000:04:00.0: registered PHC clock
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
<mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014)
mpt2sas version 20.101.00.00 loaded
mpt2sas 0000:06:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32774632 kB)
mpt2sas0: MSI-X vectors supported: 8, no of cores: 32, max_msix_vectors: 8
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 127
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 128
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 129
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 130
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 131
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 132
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 133
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 134
mpt2sas0: iomem(0x00000000d0a40000), mapped(0xffffc900147c0000), size(65536)
mpt2sas0: ioport(0x0000000000002000), size(256)
mpt2sas0: sending message unit reset !!
mpt2sas0: message unit reset: SUCCESS
mpt2sas0: Allocated physical memory: size(17329 kB)
mpt2sas0: Current Controller Queue Depth(9979), Max Controller Queue Depth(10240)
mpt2sas0: Scatter Gather Elements per IO(128)
mpt2sas0: LSISAS2308: FWVersion(15.00.00.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
mpt2sas0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
scsi0 : Fusion MPT SAS Host
mpt2sas0: sending port enable !!
mpt2sas0: host_add: handle(0x0001), sas_addr(0x500605b005d6d910), phys(8)
mpt2sas0: port enable: SUCCESS
scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:41: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:42: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:43: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:44: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:45: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:46: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:0: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:7: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:41: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:41: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:42: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:42: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:43: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:43: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:44: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:44: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:45: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:45: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:46: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:46: qdepth(254), tagged(1), simple(1), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:0:41: rdac: LUN 41 (RDAC) (owned)
scsi 0:0:0:42: rdac: LUN 42 (RDAC) (unowned)
scsi 0:0:0:43: rdac: LUN 43 (RDAC) (owned)
scsi 0:0:0:44: rdac: LUN 44 (RDAC) (unowned)
scsi 0:0:0:45: rdac: LUN 45 (RDAC) (owned)
scsi 0:0:0:46: rdac: LUN 46 (RDAC) (unowned)
scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:1:41: rdac: LUN 41 (RDAC) (unowned)
scsi 0:0:1:42: rdac: LUN 42 (RDAC) (owned)
scsi 0:0:1:43: rdac: LUN 43 (RDAC) (unowned)
scsi 0:0:1:44: rdac: LUN 44 (RDAC) (owned)
scsi 0:0:1:45: rdac: LUN 45 (RDAC) (unowned)
scsi 0:0:1:46: rdac: LUN 46 (RDAC) (owned)
isci: Intel(R) C600 SAS Controller Driver - version 1.1.0-rh
isci 0000:07:00.0: driver configured for rev: 6 silicon
isci 0000:07:00.0: OEM parameter table found in OROM
isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
isci 0000:07:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
scsi1 : isci
ata1.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata1.00: configured for UDMA/133
scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ata2.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata2.00: configured for UDMA/133
scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ACPI: WMI: Mapper loaded
ahci 0000:00:1f.2: PCI INT B -> GSI 21 (level, low) -> IRQ 21
ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
scsi2 : ahci
scsi3 : ahci
scsi4 : ahci
scsi5 : ahci
scsi6 : ahci
scsi7 : ahci
ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 137
ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 137
ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 137
ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 137
ata7: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 137
ata8: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 137
ata8: SATA link down (SStatus 0 SControl 300)
ata4: SATA link down (SStatus 0 SControl 300)
ata3: SATA link down (SStatus 0 SControl 300)
ata5: SATA link down (SStatus 0 SControl 300)
ata7: SATA link down (SStatus 0 SControl 300)
ata6: SATA link down (SStatus 0 SControl 300)
%Gsd 0:0:0:7: [sda] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 1:0:0:0: [sdo] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:0:0: [sdo] Write Protect is off
sd 1:0:0:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 1:0:1:0: [sdp] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 1:0:1:0: [sdp] Write Protect is off
sd 1:0:1:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sdo:
 sdp: sdo1
sd 0:0:0:42: [sdc] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:42: [sdj] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:44: [sdl] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:46: [sdn] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:41: [sdb] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:46: [sdg] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:43: [sdk] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:1:41: [sdi] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:43: [sdd] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:45: [sdm] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:42: [sdc] Write Protect is off
sd 0:0:1:44: [sdl] Write Protect is off
sd 0:0:1:43: [sdk] Write Protect is off
sd 0:0:0:41: [sdb] Write Protect is off
sd 0:0:0:46: [sdg] Write Protect is off
sd 0:0:1:42: [sdj] Write Protect is off
sd 0:0:0:7: [sda] Write Protect is off
sd 0:0:1:46: [sdn] Write Protect is off
sd 0:0:0:44: [sde] Write Protect is off
sd 0:0:1:7: [sdh] Write Protect is off
sd 0:0:0:43: [sdd] Write Protect is off
sd 0:0:1:41: [sdi] Write Protect is off
sd 0:0:0:42: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:44: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:45: [sdm] Write Protect is off
sd 0:0:1:45: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:46: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:43: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:44: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:42: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:43: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:7: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:41: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:45: [sdf] Write Protect is off
sd 0:0:1:41: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:45: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdo2
 sda:
 sdn:
 sdi:
 sdb:
 sdm:
 sdl:
 sdc: unknown partition table
 sde:
sd 0:0:0:41: [sdb] Attached SCSI disk
 sdh:
sd 1:0:0:0: [sdo] Attached SCSI disk
 unknown partition table
Dev sdi: unable to read RDB block 0
sd 0:0:1:46: [sdn] Attached SCSI disk
 sdf: unknown partition table
 unable to read partition table
sd 0:0:1:44: [sdl] Attached SCSI disk
Dev sdm: unable to read RDB block 0
sd 0:0:1:41: [sdi] Attached SCSI disk
 unknown partition table
Dev sdc: unable to read RDB block 0
sd 0:0:0:45: [sdf] Attached SCSI disk
Dev sde: unable to read RDB block 0
 unable to read partition table
 unable to read partition table
sd 0:0:1:45: [sdm] Attached SCSI disk
 unable to read partition table
sd 0:0:0:42: [sdc] Attached SCSI disk
 sdk:Dev sdk: unable to read RDB block 0
 sdp1 sdp9
 sdj:
 sdg:
sd 0:0:0:44: [sde] Attached SCSI disk
sd 1:0:1:0: [sdp] Attached SCSI disk
 sdd: unable to read partition table
 unknown partition table
 unknown partition table
sd 0:0:1:43: [sdk] Attached SCSI disk
Dev sdg: unable to read RDB block 0
sd 0:0:0:43: [sdd] Attached SCSI disk
sd 0:0:1:42: [sdj] Attached SCSI disk
 unable to read partition table
sd 0:0:0:46: [sdg] Attached SCSI disk
 unknown partition table
sd 0:0:0:7: [sda] Attached SCSI disk
 unknown partition table
sd 0:0:1:7: [sdh] Attached SCSI disk
EXT3-fs (sdo1): recovery required on readonly filesystem
EXT3-fs (sdo1): write access will be enabled during recovery
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sdo1): orphan cleanup on readonly fs
EXT3-fs (sdo1): 1 orphan inode deleted
EXT3-fs (sdo1): recovery complete
EXT3-fs (sdo1): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/sdo1
SELinux:  Disabled at runtime.
type=1404 audit(1476983052.957:2): selinux=0 auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
cat: /proc/self/attr/current: Invalid argument

		Welcome to CentOS 

Starting udev: udev: starting version 147
dca service started, version 1.12.1
igb: Intel(R) Gigabit Ethernet Network Driver - version 5.2.15-k
igb: Copyright (c) 2007-2014 Intel Corporation.
igb 0000:02:00.0: PCI INT A -> GSI 27 (level, low) -> IRQ 27
igb 0000:02:00.0: added PHC on eth0
igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b3
igb 0000:02:00.0: eth0: PBA No: 100000-000
igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.1: PCI INT B -> GSI 30 (level, low) -> IRQ 30
igb 0000:02:00.1: added PHC on eth1
igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b4
igb 0000:02:00.1: eth1: PBA No: 100000-000
igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.2: PCI INT C -> GSI 28 (level, low) -> IRQ 28
igb 0000:02:00.2: added PHC on eth2
igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b5
igb 0000:02:00.2: eth2: PBA No: 100000-000
igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.3: PCI INT D -> GSI 29 (level, low) -> IRQ 29
igb 0000:02:00.3: added PHC on eth3
igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b6
igb 0000:02:00.3: eth3: PBA No: 100000-000
igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
scsi 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:0:7: Attached scsi generic sg1 type 0
sd 0:0:0:41: Attached scsi generic sg2 type 0
sd 0:0:0:42: Attached scsi generic sg3 type 0
sd 0:0:0:43: Attached scsi generic sg4 type 0
sd 0:0:0:44: Attached scsi generic sg5 type 0
sd 0:0:0:45: Attached scsi generic sg6 type 0
sd 0:0:0:46: Attached scsi generic sg7 type 0
scsi 0:0:1:0: Attached scsi generic sg8 type 0
sd 0:0:1:7: Attached scsi generic sg9 type 0
sd 0:0:1:41: Attached scsi generic sg10 type 0
sd 0:0:1:42: Attached scsi generic sg11 type 0
sd 0:0:1:43: Attached scsi generic sg12 type 0
sd 0:0:1:44: Attached scsi generic sg13 type 0
sd 0:0:1:45: Attached scsi generic sg14 type 0
sd 0:0:1:46: Attached scsi generic sg15 type 0
sd 1:0:0:0: Attached scsi generic sg16 type 0
sd 1:0:1:0: Attached scsi generic sg17 type 0
ioatdma: Intel(R) QuickData Technology Driver 4.00
ioatdma 0000:00:04.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
igb 0000:02:00.0: DCA enabled
igb 0000:02:00.1: DCA enabled
ioatdma 0000:00:04.1: PCI INT B -> GSI 39 (level, low) -> IRQ 39
igb 0000:02:00.2: DCA enabled
igb 0000:02:00.3: DCA enabled
ioatdma 0000:00:04.2: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.3: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.4: PCI INT A -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.5: PCI INT B -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.6: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.7: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:80:04.0: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.1: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.2: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.3: PCI INT D -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.4: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.5: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.6: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.7: PCI INT D -> GSI 63 (level, low) -> IRQ 63
i801_smbus 0000:00:1f.3: PCI INT C -> GSI 23 (level, low) -> IRQ 23
ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
i801_smbus 0000:07:00.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
i801_smbus 0000:07:00.3: Enabling SMBus device
ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042f conflicts with OpRegion 0x0000000000000400-0x000000000000047f (\PMIO) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000053f (\FBPC) (20090903/utaddress-254)
ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000053f conflicts with OpRegion 0x0000000000000500-0x000000000000052f (\_SI_.SIOR) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
lpc_ich: Resource conflict(s) found affecting gpio_ich
EDAC MC: Ver: 2.1.0 Oct 17 2016
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0
EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0
EDAC sbridge: Driver loaded.
%Gzunicode: module license 'CDDL' taints kernel.
Disabling lock debugging due to kernel taint
SPL: Loaded module v0.6.5.7-1
ZFS: Loaded module v0.6.5.7-1, ZFS pool version 5000, ZFS filesystem version 5
iTCO_vendor_support: vendor-support=0
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.07rh
iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
microcode: CPU0 updated to revision 0x710, date = 2013-06-17 
microcode: CPU1 updated to revision 0x710, date = 2013-06-17 
microcode: CPU2 updated to revision 0x710, date = 2013-06-17 
microcode: CPU3 updated to revision 0x710, date = 2013-06-17 
microcode: CPU4 updated to revision 0x710, date = 2013-06-17 
microcode: CPU5 updated to revision 0x710, date = 2013-06-17 
microcode: CPU6 updated to revision 0x710, date = 2013-06-17 
microcode: CPU7 updated to revision 0x710, date = 2013-06-17 
microcode: CPU8 updated to revision 0x710, date = 2013-06-17 
microcode: CPU9 updated to revision 0x710, date = 2013-06-17 
microcode: CPU10 updated to revision 0x710, date = 2013-06-17 
microcode: CPU11 updated to revision 0x710, date = 2013-06-17 
microcode: CPU12 updated to revision 0x710, date = 2013-06-17 
microcode: CPU13 updated to revision 0x710, date = 2013-06-17 
microcode: CPU14 updated to revision 0x710, date = 2013-06-17 
microcode: CPU15 updated to revision 0x710, date = 2013-06-17 
microcode: CPU16 updated to revision 0x710, date = 2013-06-17 
microcode: CPU17 updated to revision 0x710, date = 2013-06-17 
microcode: CPU18 updated to revision 0x710, date = 2013-06-17 
microcode: CPU19 updated to revision 0x710, date = 2013-06-17 
microcode: CPU20 updated to revision 0x710, date = 2013-06-17 
microcode: CPU21 updated to revision 0x710, date = 2013-06-17 
microcode: CPU22 updated to revision 0x710, date = 2013-06-17 
microcode: CPU23 updated to revision 0x710, date = 2013-06-17 
microcode: CPU24 updated to revision 0x710, date = 2013-06-17 
microcode: CPU25 updated to revision 0x710, date = 2013-06-17 
microcode: CPU26 updated to revision 0x710, date = 2013-06-17 
microcode: CPU27 updated to revision 0x710, date = 2013-06-17 
microcode: CPU28 updated to revision 0x710, date = 2013-06-17 
microcode: CPU29 updated to revision 0x710, date = 2013-06-17 
microcode: CPU30 updated to revision 0x710, date = 2013-06-17 
microcode: CPU31 updated to revision 0x710, date = 2013-06-17 
[  OK  ]


Setting hostname lola-10.lola.whamcloud.com:  [  OK  ]


device-mapper: multipath: version 1.6.0 loaded
Oct 20 10:04:18 | ignoring extra data starting with 'udev_dir' on line 2 of /etc/multipath.conf

device-mapper: multipath round-robin: version 1.0.0 loaded
device-mapper: table: 253:0: multipath: error getting device
device-mapper: ioctl: error adding target to table
Add partition mappings:  [  OK  ]


ERROR: asr: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: hpt37x: reading /dev/sdi[Input/output error]

ERROR: hpt45x: reading /dev/sdi[Input/output error]

ERROR: isw: reading /dev/sdi[Input/output error]

ERROR: jmicron: reading /dev/sdi[Input/output error]

ERROR: lsi: reading /dev/sdi[Input/output error]

ERROR: nvidia: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: sil: reading /dev/sdi[Input/output error]

ERROR: via: reading /dev/sdi[Input/output error]

ERROR: asr: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: hpt37x: reading /dev/sde[Input/output error]

ERROR: hpt45x: reading /dev/sde[Input/output error]

ERROR: isw: reading /dev/sde[Input/output error]

ERROR: jmicron: reading /dev/sde[Input/output error]

ERROR: lsi: reading /dev/sde[Input/output error]

ERROR: nvidia: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: sil: reading /dev/sde[Input/output error]

ERROR: via: reading /dev/sde[Input/output error]

ERROR: asr: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: hpt37x: reading /dev/sdk[Input/output error]

ERROR: hpt45x: reading /dev/sdk[Input/output error]

ERROR: isw: reading /dev/sdk[Input/output error]

ERROR: jmicron: reading /dev/sdk[Input/output error]

ERROR: lsi: reading /dev/sdk[Input/output error]

ERROR: nvidia: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: sil: reading /dev/sdk[Input/output error]

ERROR: via: reading /dev/sdk[Input/output error]

ERROR: asr: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: hpt37x: reading /dev/sdg[Input/output error]

ERROR: hpt45x: reading /dev/sdg[Input/output error]

ERROR: isw: reading /dev/sdg[Input/output error]

ERROR: jmicron: reading /dev/sdg[Input/output error]

ERROR: lsi: reading /dev/sdg[Input/output error]

ERROR: nvidia: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: sil: reading /dev/sdg[Input/output error]

ERROR: via: reading /dev/sdg[Input/output error]

ERROR: asr: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: hpt37x: reading /dev/sdm[Input/output error]

ERROR: hpt45x: reading /dev/sdm[Input/output error]

ERROR: isw: reading /dev/sdm[Input/output error]

ERROR: jmicron: reading /dev/sdm[Input/output error]

ERROR: lsi: reading /dev/sdm[Input/output error]

ERROR: nvidia: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: sil: reading /dEXT3-fs (sdo1): ev/sdm[Input/outusing internal journal
put error]

ERROR: via: reading /dev/sdm[Input/output error]

ERROR: asr: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: hpt37x: reading /dev/sdc[Input/output error]

ERROR: hpt45x: reading /dev/sdc[Input/output error]

ERROR: isw: reading /dev/sdc[Input/output error]

ERROR: jmicron: reading /dev/sdc[Input/output error]

ERROR: lsi: reading /dev/sdc[Input/output error]

ERROR: nvidia: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: sil: reading /dev/sdc[Input/output error]

ERROR: via: reading /dev/sdc[Input/output error]

Setting up Logical Volume Management: [  OK  ]


Checking filesystems

Checking all file systems.

[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/sdo1 

/dev/sdo1: clean, 131844/1310720 files, 3645616/5242880 blocks

[  OK  ]


Remounting root filesystem in read-write mode:  [  OK  ]


Mounting local filesystems:  [  OK  ]


Enabling local filesystem quotas:  [  OK  ]


Enabling /etc/fstab swaps:  Adding 16457724k swap on /dev/sdo2.  Priority:-1 extents:1 across:16457724k 
[  OK  ]


Entering non-interactive startup

Calling the system activity data collector (sadc)... 

Loading OpenIB kernel modules:[  OK  ]


Mounting ZFS filesystem(s)  [  OK  ]


ip6tables: No config file.[WARNING]


iptables: No config file.[WARNING]


Bringing up loopback interface:  [  OK  ]


Bringing up interface eth0:  ADDRCONF(NETDEV_UP): eth0: link is not ready
Determining if ip address 10.4.0.110 is already in use for device eth0...

igb 0000:02:00.0: eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  OK  ]


Bringing up interface ib0:  ADDRCONF(NETDEV_UP): ib0: link is not ready
ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
[  OK  ]


Bringing up interface ipmi:  Device ipmi does not seem to be present, delaying initialization.

[FAILED]


Starting auditd: type=1305 audit(1476983079.948:3): audit_pid=4478 old=0 auid=4294967295 ses=4294967295 res=1
[  OK  ]


Loading Lustre module stack...LNet: HW CPU cores: 32, npartitions: 2
alg: No test for adler32 (adler32-zlib)
alg: No test for crc32 (crc32-table)
alg: No test for crc32 (crc32-pclmul)
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0002, status -22
Lustre: Lustre: Build Version: 2.8.59_25_g401d7fc
LNet: Added LNI 192.168.1.110@o2ib10 [8/256/0/180]


Starting system logger: [  OK  ]


Enabling ondemand cpu frequency scaling: [  OK  ]


Starting irqbalance: [  OK  ]


Starting rpcbind: [  OK  ]


ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
Starting NFS statd: [  OK  ]


Starting system message bus: [  OK  ]


Setting NIS domain: domain is 'lola.whamcloud.com'  [  OK  ]


Starting NIS service: [  OK  ]


Binding NIS service: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
.[  OK  ]


Starting ibacm daemon:[  OK  ]


NFS filesystems queued to be mounted

Mounting filesystems:  RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Slow work thread pool: Starting up
Slow work thread pool: Ready
FS-Cache: Loaded
NFS: Registering the id_resolver key type
FS-Cache: Netfs 'nfs' registered for caching
[  OK  ]


Starting acpi daemon: [  OK  ]


Starting HAL daemon: ib0: sendonly multicast join failed for ff12:601b:ffff:0000:0000:0000:0000:0016, status -22
[  OK  ]


Retrigger failed udev events[  OK  ]


Starting ZFS Event Daemon  [  OK  ]
[  OK  ]


Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Starting NFS services:  [  OK  ]


Starting NFS quotas: [  OK  ]


Starting NFS mountd: [  OK  ]


Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
[  OK  ]


Starting RPC idmapd: [  OK  ]


Sharing ZFS filesystems  [  OK  ]


Starting MUNGE: munged[  OK  ]


Starting kdump:[  OK  ]


Starting sshd: [  OK  ]


Starting xinetd: [  OK  ]


Starting ntpd: [  OK  ]


Starting GANGLIA gmond: [  OK  ]


Starting sendmail: [  OK  ]


Starting sm-client: [  OK  ]


Starting crond: [  OK  ]


starting slurmd: 802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
8021q: adding VLAN 0 to HW filter on device eth0
[  OK  ]


Starting atd: [  OK  ]


Starting collectl: Oct 20 10:05:01 lola-10 TIME: Time stamp for console

[  OK  ]



CentOS release 6.7 (Final)
Kernel 2.6.32-573.26.1.el6_lustre.x86_64 on an x86_64

lola-10.lola.whamcloud.com login: Oct 20 10:10:01 lola-10 TIME: Time stamp for console
Oct 20 10:15:01 lola-10 TIME: Time stamp for console
Oct 20 10:20:01 lola-10 TIME: Time stamp for console
Oct 20 10:25:01 lola-10 TIME: Time stamp for console
Oct 20 10:30:01 lola-10 TIME: Time stamp for console
Oct 20 10:35:01 lola-10 TIME: Time stamp for console
Oct 20 10:40:01 lola-10 TIME: Time stamp for console
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. 
Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. 
Installed BIOS: SE5C600.86B.01.08.0003
Platform ID: S2600GZ 
SOL session closed by BMC

<ConMan> Console [lola-10] disconnected from "ipmitool.exp" (pid 10187) after 1d5h40m37s at 10-20 13:53.

<ConMan> Console [lola-10] connected to "ipmitool.exp" (pid 14611) at 10-20 13:53.
Connection established via ipmitool (pid 14615).
Copyright (c) 2009 - 2012 Intel Corporation. All rights reserved.               Version 2.00.1201. Copyright (C) 2010 - 2012 American Megatrends, Inc.                                                                                                                                                                          MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           LSI Corporation MPT SAS2 BIOS                                                   Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                 Initializing../                                                                 Initializing..-                                                                 Initializing..\                                                                 Initializing..|                                                                                                                                                 Press Ctrl-C to start LSI Corp Configuration Utility...                         Searching for devices at HBA 0...                                               LSI Corporation MPT SAS2 BIOS                                                   MPT2BIOS-7.29.00.00 (2012.11.12)                                                Copyright 2000-2012 LSI Corporation.                                                                                                                            PCI  ENCL LUN VENDOR   PRODUCT          PRODUCT       SIZE \                    SLOT SLOT NUM NAME     IDENTIFIER       REVISION      NVDATA                    ---- ---- --- -------- ---------------- ----------- ----------                    3           LSI      SAS2308-IT       15.00.00.00  0F:00:00:03                  3    4   7  LSI      Universal Xport  0786         20.00 MiB                    3    4   41  LSI      INF-01-00        0786         14.55 TiB                   3    4   42  LSI      INF-01-00        0786         14.55 TiB                   3    4   43  LSI      INF-01-00        0786         14.55 TiB                   3    4   44  LSI      INF-01-00        0786         14.55 TiB                   3    4   45  LSI      INF-01-00        0786         14.55 TiB                   3    4   46  LSI      INF-01-00        0786         14.55 TiB                   3    0   7  LSI      Universal Xport  0786         20.00 MiB                    3    0   41  LSI      INF-01-00        0786         14.55 TiB                   3    0   42  LSI      INF-01-00        0786         14.55 TiB                   3    0   43  LSI      INF-01-00        0786         14.55 TiB                   3    0   44  LSI      INF-01-00        0786         14.55 TiB                   3    0   45  LSI      INF-01-00        0786         14.55 TiB                   3    0   46  LSI      INF-01-00        0786         14.55 TiB                 Copyright 2000-2012 LSI Corporation.                                                                                                                              RAID Volumes:                                                                   None defined.                                                                   Physical Devices:                                                             �  ID   Device Model     Serial #                     Size Type/Status(Vol ID)     0    ST500NM0011      Z1M0X1F9                  465.7GB Non-RAID Disk           1    ST500NM0011      Z1M0X1GG                  465.7GB Non-RAID Disk         Press <CTRL-I> to enter Configuration Utility..                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Copyright(C) 2003-12 Intel Corporation.  All Rights Reserved.                   Press <CTRL-I> to enter Configuration Utility...                                                                                                                PXE 2.1 Build 091 (WfM 2.0)                                                     Press Ctrl+S to enter the Setup Menu.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                                                                                                          Press Ctrl+S to enter the Setup Menu.                                           Initializing Intel(R) Boot Agent GE v1.4.04                                     Press Ctrl+S to enter the Setup Menu..                                          Bios Version: SE5C600.86B.01.08.0003.022620131521                               BMC Firmware Version: 1.17.4207                                                 SDR Version: SDR Package 1.09                                                   ME Firmware Version: 2.1.7.112                                                  Platform ID: S2600GZ                                                            System memory detected: 32768 MB                                                Current memory speed: 1333 MT/s                                                 Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz                                        Number of physical processors identified: 2                                     ********************************************************************************AHCI Capable Controller enabling 2 ports of 6Gb/s SATA                          SAS/SATA Capable Controller configured with 4 ports in SATA mode                ********************************************************************************USB Keyboard detected                                                           USB Mouse detected                                                                                                                                              Press <F2> to enter setup, <F6> Boot Menu, <F12> Network Boot                                     
Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

Press any key to continue.

    GNU GRUB  version 0.97  (571K lower / 3066652K upper memory)

+-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+
      Use the ^ and v keys to select which entry is highlighted.
      Press enter to boot the selected OS, 'e' to edit the
      commands before booting, 'a' to modify the kernel arguments
      before booting, or 'c' for a command-line.  CentOS (2.6.32-642.6.1.el6_lustre.x86_64)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   The highlighted entry will be booted automatically in 5 seconds.    The highlighted entry will be booted automatically in 4 seconds.    The highlighted entry will be booted automatically in 3 seconds.    The highlighted entry will be booted automatically in 2 seconds.    The highlighted entry will be booted automatically in 1 seconds.    Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-642.6.1.el6_lustre.x86_64 (jenkins@onyx-1-sdc1-el6-x8664.onyx.hpdd.intel.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-11) (GCC) ) #1 SMP Wed Oct 19 19:06:29 PDT 2016
Command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=auto SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
KERNEL supported cpus:
  Intel GenuineIntel
  AMD AuthenticAMD
  Centaur CentaurHauls
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000008ec00 (usable)
 BIOS-e820: 000000000008ec00 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 00000000bb3c7000 (usable)
 BIOS-e820: 00000000bb3c7000 - 00000000bdd2f000 (reserved)
 BIOS-e820: 00000000bdd2f000 - 00000000bddcd000 (ACPI NVS)
 BIOS-e820: 00000000bddcd000 - 00000000bdea1000 (ACPI data)
 BIOS-e820: 00000000bdea1000 - 00000000bdf2f000 (ACPI NVS)
 BIOS-e820: 00000000bdf2f000 - 00000000bdfac000 (ACPI data)
 BIOS-e820: 00000000bdfac000 - 00000000be000000 (usable)
 BIOS-e820: 00000000be000000 - 00000000d0000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
 BIOS-e820: 00000000fed19000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed20000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ffa20000 - 0000000100000000 (reserved)
 BIOS-e820: 0000000100000000 - 0000000840000000 (usable)
SMBIOS version 2.6 @ 0xF0440
SMBIOS 2.6 present.
last_pfn = 0x840000 max_arch_pfn = 0x400000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xbe000 max_arch_pfn = 0x400000000
Using GB pages for direct mapping
init_memory_mapping: 0000000000000000-00000000be000000
init_memory_mapping: 0000000100000000-0000000840000000
RAMDISK: 35f4e000 - 37fef265
ACPI: Deleted _OSI()
ACPI: Deleted _OSI()
ACPI: RSDP 00000000000f0410 00024 (v02 INTEL )
ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI Warning: Invalid length for Pm1aControlBlock: 32, using default 16 (20090903/tbfadt-611)
ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL   S2600GZ 00000008 INTL 20100331)
ACPI: FACS 00000000bdfa9f40 00040
ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL   S2600GZ 00001000 INTL 20100331)
ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL   S2600GZ 00004000 INTL 20100331)
ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL   S2600GZ 06222004 INTL 20090903)
ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL   S2600GZ 00000001 INTL 00000001)
ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL   S2600GZ 00000002 INTL 20100331)
ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL   S2600GZ 00000001 INTL 20100331)
ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL   S2600GZ 00000003 INTL 20100331)
Setting APIC routing to flat.
SRAT: PXM 0 -> APIC 0 -> Node 0
SRAT: PXM 0 -> APIC 1 -> Node 0
SRAT: PXM 0 -> APIC 2 -> Node 0
SRAT: PXM 0 -> APIC 3 -> Node 0
SRAT: PXM 0 -> APIC 4 -> Node 0
SRAT: PXM 0 -> APIC 5 -> Node 0
SRAT: PXM 0 -> APIC 6 -> Node 0
SRAT: PXM 0 -> APIC 7 -> Node 0
SRAT: PXM 0 -> APIC 8 -> Node 0
SRAT: PXM 0 -> APIC 9 -> Node 0
SRAT: PXM 0 -> APIC 10 -> Node 0
SRAT: PXM 0 -> APIC 11 -> Node 0
SRAT: PXM 0 -> APIC 12 -> Node 0
SRAT: PXM 0 -> APIC 13 -> Node 0
SRAT: PXM 0 -> APIC 14 -> Node 0
SRAT: PXM 0 -> APIC 15 -> Node 0
SRAT: PXM 1 -> APIC 32 -> Node 1
SRAT: PXM 1 -> APIC 33 -> Node 1
SRAT: PXM 1 -> APIC 34 -> Node 1
SRAT: PXM 1 -> APIC 35 -> Node 1
SRAT: PXM 1 -> APIC 36 -> Node 1
SRAT: PXM 1 -> APIC 37 -> Node 1
SRAT: PXM 1 -> APIC 38 -> Node 1
SRAT: PXM 1 -> APIC 39 -> Node 1
SRAT: PXM 1 -> APIC 40 -> Node 1
SRAT: PXM 1 -> APIC 41 -> Node 1
SRAT: PXM 1 -> APIC 42 -> Node 1
SRAT: PXM 1 -> APIC 43 -> Node 1
SRAT: PXM 1 -> APIC 44 -> Node 1
SRAT: PXM 1 -> APIC 45 -> Node 1
SRAT: PXM 1 -> APIC 46 -> Node 1
SRAT: PXM 1 -> APIC 47 -> Node 1
SRAT: Node 0 PXM 0 0-c0000000
SRAT: Node 0 PXM 0 100000000-440000000
SRAT: Node 1 PXM 1 440000000-840000000
Bootmem setup node 0 0000000000000000-0000000440000000
  NODE_DATA [0000000000009000 - 000000000003cfff]
  bootmap [0000000000100000 -  0000000000187fff] pages 88
(8 early reservations) ==> bootmem [0000000000 - 0440000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
  #2 [0001000000 - 0002044924]    TEXT DATA BSS ==> [0001000000 - 0002044924]
  #3 [0035f4e000 - 0037fef265]          RAMDISK ==> [0035f4e000 - 0037fef265]
  #4 [000008ec00 - 0000100000]    BIOS reserved ==> [000008ec00 - 0000100000]
  #5 [0002045000 - 00020459b8]              BRK ==> [0002045000 - 00020459b8]
  #6 [0000008000 - 0000009000]          PGTABLE ==> [0000008000 - 0000009000]
  #7 [0000001000 - 0000001030]        ACPI SLIT ==> [0000001000 - 0000001030]
Bootmem setup node 1 0000000440000000-0000000840000000
  NODE_DATA [0000000440000040 - 000000044003403f]
  bootmap [0000000440035000 -  00000004400b4fff] pages 80
(8 early reservations) ==> bootmem [0440000000 - 0840000000]
  #0 [0000000000 - 0000001000]   BIOS data page
  #1 [0000006000 - 0000008000]       TRAMPOLINE
  #2 [0001000000 - 0002044924]    TEXT DATA BSS
  #3 [0035f4e000 - 0037fef265]          RAMDISK
  #4 [000008ec00 - 0000100000]    BIOS reserved
  #5 [0002045000 - 00020459b8]              BRK
  #6 [0000008000 - 0000009000]          PGTABLE
  #7 [0000001000 - 0000001030]        ACPI SLIT
found SMP MP-table at [ffff8800000fcd70] fcd70
Reserving 131MB of memory at 48MB for crashkernel (System RAM: 33792MB)
Zone PFN ranges:
  DMA      0x00000001 -> 0x00001000
  DMA32    0x00001000 -> 0x00100000
  Normal   0x00100000 -> 0x00840000
Movable zone start PFN for each node
early_node_map[5] active PFN ranges
    0: 0x00000001 -> 0x0000008e
    0: 0x00000100 -> 0x000bb3c7
    0: 0x000bdfac -> 0x000be000
    0: 0x00100000 -> 0x00440000
    1: 0x00440000 -> 0x00840000
ACPI: PM-Timer IO Port: 0x408
Setting APIC routing to flat.
ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled)
ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled)
ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled)
ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled)
ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled)
ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled)
ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled)
ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled)
ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled)
ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled)
ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled)
ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled)
ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled)
ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled)
ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled)
ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled)
ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled)
ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled)
ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled)
ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled)
ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled)
ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled)
ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled)
ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled)
ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled)
ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled)
ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled)
ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled)
ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled)
ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled)
ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled)
ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled)
ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled)
ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled)
ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled)
ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled)
ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled)
ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled)
ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled)
ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled)
ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled)
ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled)
ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled)
ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled)
ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled)
ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled)
ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled)
ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled)
ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled)
ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled)
ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled)
ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled)
ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled)
ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled)
ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled)
ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled)
ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled)
ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled)
ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled)
ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled)
ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled)
ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled)
ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled)
ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled)
ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled)
ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled)
ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled)
ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled)
ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled)
ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled)
ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled)
ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled)
ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled)
ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled)
ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled)
ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled)
ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled)
ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled)
ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled)
ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled)
ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled)
ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled)
ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled)
ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled)
ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled)
ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled)
ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled)
ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled)
ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled)
ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled)
ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled)
ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled)
ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled)
ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled)
ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled)
ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled)
ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled)
ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled)
ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled)
ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled)
ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled)
ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled)
ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled)
ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled)
ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled)
ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled)
ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled)
ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled)
ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled)
ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled)
ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled)
ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled)
ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled)
ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled)
ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled)
ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled)
ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled)
ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled)
ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled)
ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled)
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled)
ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled)
ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24])
IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47
ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48])
IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a701 base: 0xfed00000
SMP: Allowing 240 CPUs, 208 hotplug CPUs
PM: Registered nosave memory: 000000000008e000 - 000000000008f000
PM: Registered nosave memory: 000000000008f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
PM: Registered nosave memory: 00000000bb3c7000 - 00000000bdd2f000
PM: Registered nosave memory: 00000000bdd2f000 - 00000000bddcd000
PM: Registered nosave memory: 00000000bddcd000 - 00000000bdea1000
PM: Registered nosave memory: 00000000bdea1000 - 00000000bdf2f000
PM: Registered nosave memory: 00000000bdf2f000 - 00000000bdfac000
PM: Registered nosave memory: 00000000be000000 - 00000000d0000000
PM: Registered nosave memory: 00000000d0000000 - 00000000fec00000
PM: Registered nosave memory: 00000000fec00000 - 00000000fec01000
PM: Registered nosave memory: 00000000fec01000 - 00000000fed19000
PM: Registered nosave memory: 00000000fed19000 - 00000000fed1a000
PM: Registered nosave memory: 00000000fed1a000 - 00000000fed1c000
PM: Registered nosave memory: 00000000fed1c000 - 00000000fed20000
PM: Registered nosave memory: 00000000fed20000 - 00000000fee00000
PM: Registered nosave memory: 00000000fee00000 - 00000000fee01000
PM: Registered nosave memory: 00000000fee01000 - 00000000ffa20000
PM: Registered nosave memory: 00000000ffa20000 - 0000000100000000
Allocating PCI resources starting at d0000000 (gap: d0000000:2ec00000)
Booting paravirtualized kernel on bare hardware
NR_CPUS:4096 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2
PERCPU: Embedded 31 pages/cpu @ffff880038800000 s96664 r8192 d22120 u131072
pcpu-alloc: s96664 r8192 d22120 u131072 alloc=1*2097152
pcpu-alloc: [0] 000 001 002 003 004 005 006 007 016 017 018 019 020 021 022 023 
pcpu-alloc: [0] 032 034 036 038 040 042 044 046 048 050 052 054 056 058 060 062 
pcpu-alloc: [0] 064 066 068 070 072 074 076 078 080 082 084 086 088 090 092 094 
pcpu-alloc: [0] 096 098 100 102 104 106 108 110 112 114 116 118 120 122 124 126 
pcpu-alloc: [0] 128 130 132 134 136 138 140 142 144 146 148 150 152 154 156 158 
pcpu-alloc: [0] 160 162 164 166 168 170 172 174 176 178 180 182 184 186 188 190 
pcpu-alloc: [0] 192 194 196 198 200 202 204 206 208 210 212 214 216 218 220 222 
pcpu-alloc: [0] 224 226 228 230 232 234 236 238 --- --- --- --- --- --- --- --- 
pcpu-alloc: [1] 008 009 010 011 012 013 014 015 024 025 026 027 028 029 030 031 
pcpu-alloc: [1] 033 035 037 039 041 043 045 047 049 051 053 055 057 059 061 063 
pcpu-alloc: [1] 065 067 069 071 073 075 077 079 081 083 085 087 089 091 093 095 
pcpu-alloc: [1] 097 099 101 103 105 107 109 111 113 115 117 119 121 123 125 127 
pcpu-alloc: [1] 129 131 133 135 137 139 141 143 145 147 149 151 153 155 157 159 
pcpu-alloc: [1] 161 163 165 167 169 171 173 175 177 179 181 183 185 187 189 191 
pcpu-alloc: [1] 193 195 197 199 201 203 205 207 209 211 213 215 217 219 221 223 
pcpu-alloc: [1] 225 227 229 231 233 235 237 239 --- --- --- --- --- --- --- --- 
Built 2 zonelists in Zone order, mobility grouping on.  Total pages: 8250675
Policy zone: Normal
Kernel command line: ro root=UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=ttyS0,115200 crashkernel=131M@0M SYSFONT=latarcyrheb-sun16  KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rdloaddriver=scsi_dh_rdac
PID hash table entries: 4096 (order: 3, 32768 bytes)
x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
Memory: 32736608k/34603008k available (5462k kernel code, 1126752k absent, 739648k reserved, 6957k data, 1316k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:3144
Extended CMOS year: 2000
Console: colour VGA+ 80x25
console [ttyS0] enabled
allocated 134217728 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
TSC: cpu family 6 model 45, tsc initial value = 76624776bb
Fast TSC calibration using PIT
Detected 2693.332 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.66 BogoMIPS (lpj=2693332)
pid_max: default: 245760 minimum: 1920
Security Framework initialized
SELinux:  Initializing.
Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 20 MCE banks
CPU0: Thermal monitoring enabled (TM1)
using mwait in idle threads.
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 22351 entries in 88 pages
x2apic not enabled, IRQ remapping init failed
APIC routing finalized to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz stepping 07
Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
... version:                3
... bit width:              48
... generic registers:      4
... value mask:             0000ffffffffffff
... max period:             0000ffffffffffff
... fixed-purpose events:   3
... event mask:             000000070000000f
NMI watchdog enabled, takes one hw-pmu counter.
Booting Node   0, Processors  #1 #2 #3 #4 #5 #6 #7 Ok.
Booting Node   1, Processors  #8 #9 #10 #11 #12 #13 #14 #15 Ok.
Booting Node   0, Processors  #16 #17 #18 #19 #20 #21 #22 #23 Ok.
Booting Node   1, Processors  #24 #25 #26 #27 #28 #29 #30 #31
Brought up 32 CPUs
Total of 32 processors activated (172366.97 BogoMIPS).
devtmpfs: initialized
PM: Registering ACPI NVS region at bdd2f000 (647168 bytes)
PM: Registering ACPI NVS region at bdea1000 (581632 bytes)
regulator: core version 0.5
NET: Registered protocol family 16
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MCFG configuration 0: base c0000000 segment 0 buses 0 - 255
PCI: MCFG area at c0000000 reserved in E820
PCI: Using MMCONFIG at c0000000 - cfffffff
PCI: Using configuration type 1 for base access
PMU erratum BJ122, BV98, HSD29 worked around, HT is on
bio: create slab <bio-0> at 0
ACPI: Executed 1 blocks of module-level executable AML code
ACPI: BIOS _OSI(Linux) query ignored
ACPI: Interpreter enabled
ACPI: (supports S0 S1 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
HEST: Table parsing has been initialized.
PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
pci_root PNP0A08:00: host bridge window [io  0x0000-0xbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:00: host bridge window [mem 0x000c0000-0x000c3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c4000-0x000c7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000c8000-0x000cbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000cc000-0x000cffff]
pci_root PNP0A08:00: host bridge window [mem 0x000d0000-0x000d3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d4000-0x000d7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000d8000-0x000dbfff]
pci_root PNP0A08:00: host bridge window [mem 0x000dc000-0x000dffff]
pci_root PNP0A08:00: host bridge window [mem 0x000e0000-0x000e3fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e4000-0x000e7fff]
pci_root PNP0A08:00: host bridge window [mem 0x000e8000-0x000ebfff]
pci_root PNP0A08:00: host bridge window [mem 0x000ec000-0x000effff]
pci_root PNP0A08:00: host bridge window [mem 0x000f0000-0x000fffff]
pci_root PNP0A08:00: host bridge window [mem 0xd0000000-0xebffffff]
pci_root PNP0A08:00: host bridge window [mem 0x380000000000-0x38007fffffff]
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdfff])
pci_root PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff])
PCI host bridge to bus 0000:00
pci_bus 0000:00: root bus resource [io  0x0000-0xbfff]
pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff]
pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff]
pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff]
pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff]
pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff]
pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff]
pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff]
pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff]
pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff]
pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff]
pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff]
pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff]
pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff]
pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
pci 0000:00:00.0: PME# disabled
pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
pci 0000:00:01.0: PME# disabled
pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
pci 0000:00:01.1: PME# disabled
pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
pci 0000:00:02.0: PME# disabled
pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
pci 0000:00:02.2: PME# disabled
pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
pci 0000:00:03.0: PME# disabled
pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
pci 0000:00:11.0: PME# disabled
pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
pci 0000:00:16.0: PME# disabled
pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
pci 0000:00:16.1: PME# disabled
pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.7: PME# disabled
pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.0: PME# disabled
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
pci 0000:02:00.0: PME# disabled
pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
pci 0000:02:00.1: PME# disabled
pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
pci 0000:02:00.2: PME# disabled
pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
pci 0000:02:00.3: PME# disabled
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:07:00.3: PME# supported from D0 D3hot D3cold
pci 0000:07:00.3: PME# disabled
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a] (subtractive decode)
 pci0000:00: Requesting ACPI _OSC control (0x1d)
 pci0000:00: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
pci_root PNP0A08:01: host bridge window [io  0x03b0-0x03df]
pci_root PNP0A08:01: host bridge window [io  0xc000-0xffff]
pci_root PNP0A08:01: host bridge window [mem 0x000a0000-0x000bffff]
pci_root PNP0A08:01: host bridge window [mem 0xec000000-0xfbffffff]
pci_root PNP0A08:01: host bridge window [mem 0x380080000000-0x3800ffffffff]
PCI host bridge to bus 0000:80
pci_bus 0000:80: root bus resource [io  0x03b0-0x03df]
pci_bus 0000:80: root bus resource [io  0xc000-0xffff]
pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff]
pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff]
pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff]
pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
pci 0000:80:01.0: PME# disabled
pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
pci 0000:80:02.0: PME# disabled
pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
pci 0000:80:03.0: PME# disabled
pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
pci 0000:80:03.2: PME# disabled
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
 pci0000:80: Requesting ACPI _OSC control (0x1d)
 pci0000:80: ACPI _OSC control (0x15) granted
ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f])
PCI host bridge to bus 0000:7f
 pci0000:7f: Requesting ACPI _OSC control (0x1d)
 pci0000:7f: ACPI _OSC control (0x10) granted
ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff])
PCI host bridge to bus 0000:ff
 pci0000:ff: Requesting ACPI _OSC control (0x1d)
 pci0000:ff: ACPI _OSC control (0x10) granted
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none
vgaarb: loaded
vgaarb: bridge control possible 0000:09:00.0
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
HPET: 8 timers in total, 5 timers will be used for per-cpu timer
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 72, 73, 74, 75, 76, 0
hpet0: 8 comparators, 64-bit 14.318180 MHz counter
Switching to clocksource hpet
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 15 devices
ACPI: ACPI bus type pnp unregistered
system 00:05: [io  0x0680-0x069f] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0xffff] has been reserved
system 00:05: [io  0x0400-0x0453] has been reserved
system 00:05: [io  0x0458-0x047f] has been reserved
system 00:05: [io  0x0500-0x057f] has been reserved
system 00:05: [io  0x0600-0x061f] has been reserved
system 00:05: [io  0x0ca2-0x0ca5] has been reserved
system 00:05: [io  0x0cf9] could not be reserved
system 00:07: [io  0x0454-0x0457] has been reserved
system 00:0a: [mem 0xfed1c000-0xfed1ffff] has been reserved
system 00:0a: [mem 0xebfff000-0xebffffff] has been reserved
system 00:0a: [mem 0xc0000000-0xcfffffff] has been reserved
system 00:0a: [mem 0xfed20000-0xfed3ffff] has been reserved
system 00:0a: [mem 0xfed45000-0xfed8ffff] has been reserved
system 00:0a: [mem 0xff000000-0xffffffff] could not be reserved
system 00:0a: [mem 0xfee00000-0xfeefffff] could not be reserved
system 00:0a: [mem 0xfec00000-0xfecfffff] could not be reserved
system 00:0a: [mem 0xd0f70000-0xd0f70fff] has been reserved
system 00:0c: [mem 0x00000000-0x0009cfff] could not be reserved
pci 0000:00:01.0: PCI bridge to [bus 01-01]
pci 0000:00:01.1: PCI bridge to [bus 02-03]
pci 0000:00:01.1:   bridge window [io  0x3000-0x3fff]
pci 0000:00:01.1:   bridge window [mem 0xd0b00000-0xd0cfffff]
pci 0000:00:02.0: PCI bridge to [bus 04-04]
pci 0000:00:02.0:   bridge window [mem 0xd0e00000-0xd0efffff]
pci 0000:00:02.0:   bridge window [mem 0xeb000000-0xeb7fffff 64bit pref]
pci 0000:00:02.2: PCI bridge to [bus 05-05]
pci 0000:00:03.0: PCI bridge to [bus 06-06]
pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
pci 0000:00:03.0:   bridge window [mem 0xd0900000-0xd0afffff]
pci 0000:00:11.0: PCI bridge to [bus 07-07]
pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
pci 0000:00:11.0:   bridge window [mem 0xd0d00000-0xd0dfffff]
pci 0000:00:11.0:   bridge window [mem 0xeb800000-0xebcfffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 08-08]
pci 0000:00:1c.7: PCI bridge to [bus 09-09]
pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd08fffff]
pci 0000:00:1c.7:   bridge window [mem 0xea000000-0xeaffffff 64bit pref]
pci 0000:00:1e.0: PCI bridge to [bus 0a-0a]
pci 0000:80:01.0: PCI bridge to [bus 81-81]
pci 0000:80:02.0: PCI bridge to [bus 82-82]
pci 0000:80:03.0: PCI bridge to [bus 83-83]
pci 0000:80:03.2: PCI bridge to [bus 84-84]
pci 0000:00:01.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:01.1: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.0: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:02.2: PCI INT A -> GSI 47 (level, low) -> IRQ 47
pci 0000:00:03.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:11.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:00:1c.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
pci 0000:80:01.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:02.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.0: PCI INT A -> GSI 71 (level, low) -> IRQ 71
pci 0000:80:03.2: PCI INT A -> GSI 71 (level, low) -> IRQ 71
NET: Registered protocol family 2
IP route cache hash table entries: 524288 (order: 10, 4194304 bytes)
TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 524288 bind 65536)
TCP reno registered
NET: Registered protocol family 1
pci 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1a.0: PCI INT B disabled
pci 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001
pci 0000:00:1d.0: PCI INT A dis�abled
Trying tnitramfs...
Freeing initrd memory: 33412k freed
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
sha256_ssse3: Using AVX optimized SHA-256 implementation
futex hash table entries: 65536 (order: 10, 4194304 bytes)
audit: initializing netlink socket (disabled)
type=2000 audit(1476985549.814:1): initialized
HugeTLB registered 2 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 32768
ksign: Installing public key data
Loading keyring
- Added public key F63A808EAE1D83
- User ID: Red Hat, Inc. (Kernel Module GPG key)
- Added public key D4A26C9CCD09BEDA
- User ID: Red Hat Enterprise Linux Driver Update Program <secalert@redhat.com>
- Added public key CB445E0DA3EA1F65
- User ID: Red Hat Enterprise Linux Driver Update Program (key 4) <secalert@redhat.com>
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered (default)
io scheduler cfq registered
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
pciehp: PCI Express Hot Plug Controller Driver version: 0.4
acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
acpiphp: Slot [2] registered
acpiphp: Slot [2-1] registered
acpiphp: Slot [2-2] registered
acpiphp: Slot [2-3] registered
input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
ACPI: Power Button [PWRF]
[Firmware Bug]: No valid trip found
ERST: Error Record Serialization Table (ERST) support is initialized.
GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
Non-volatile memory driver v1.3
Linux agpgart interface v0.103
crash memory driver: version 1.1
Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
�serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:09: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
brd: module loaded
loop: module loaded
input: Macintosh mouse button emulation as /devices/virtual/input/input1
Fixed MDIO Bus: probed
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci_hcd 0000:00:1a.0: PCI INT B -> GSI 22 (level, low) -> IRQ 22
ehci_hcd 0000:00:1a.0: EHCI Host Controller
ehci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.0: debug port 2
ehci_hcd 0000:00:1a.0: irq 22, io mem 0xd0f20000
ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00
usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb1: Product: EHCI Host Controller
usb usb1: Manufacturer: Linux 2.6.32-642.6.1.el6_lustre.x86_64 ehci_hcd
usb usb1: SerialNumber: 0000:00:1a.0
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 2 ports detected
ehci_hcd 0000:00:1d.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
ehci_hcd 0000:00:1d.0: EHCI Host Controller
ehci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
Refined TSC clocksource calibration: 2693.508 MHz.
Switching to clocksource tsc
ehci_hcd 0000:00:1d.0: debug port 2
ehci_hcd 0000:00:1d.0: irq 20, io mem 0xd0f10000
ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00
usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
usb usb2: Product: EHCI Host Controller
usb usb2: Manufacturer: Linux 2.6.32-642.6.1.el6_lustre.x86_64 ehci_hcd
usb usb2: SerialNumber: 0000:00:1d.0
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 2 ports detected
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
uhci_hcd: USB Universal Host Controller Interface driver
PNP: No PS/2 controller found. Probing ports directly.
mice: PS/2 mouse device common for all mice
rtc_cmos 00:06: RTC can wake from S4
rtc_cmos 00:06: rtc core: registered rtc_cmos as rtc0
rtc0: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
cpuidle: using governor ladder
cpuidle: using governor menu
EFI Variables Facility v0.08 2004-May-17
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
GRE over IPv4 demultiplexor driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
rtc_cmos 00:06: setting system clock to 2016-10-20 17:45:55 UTC (1476985555)
Initalizing network drop monitor service
Freeing unused kernel memory: 1316k freed
Write protecting the kernel read-only data: 10240k
Freeing unused kernel memory: 664k freed
Freeing unused kernel memory: 1552k freed
rdac: device handler registered
dracut: dracut-004-388.el6
dracut: rd_NO_LUKS: removing cryptoluks activation
dracut: rd_NO_LVM: removing LVM activation
usb 1-1: new high speed USB device number 2 using ehci_hcd
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.33.1-ioctl (2015-8-18) initialised: dm-devel@redhat.com
udev: starting version 147
usb 1-1: New USB device found, idVendor=8087, idProduct=0024
usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 1-1: configuration #1 chosen from 1 choice
hub 1-1:1.0: USB hub found
hub 1-1:1.0: 6 ports detected
dracut: Starting plymouth daemon
dracut: rd_NO_DM: removing DM RAID activation
dracut: rd_NO_MD: removing MD RAID activation
usb 2-1: new high speed USB device number 2 using ehci_hcd
mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014)
mlx4_core: Initializing 0000:04:00.0
mlx4_core 0000:04:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32
usb 2-1: New USB device found, idVendor=8087, idProduct=0024
usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
usb 2-1: configuration #1 chosen from 1 choice
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 8 ports detected
usb 2-1.4: new full speed USB device number 3 using ehci_hcd
usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10
usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.4: Product: Virtual Keyboard and Mouse
usb 2-1.4: Manufacturer: American Megatrends Inc.
usb 2-1.4: SerialNumber: serial
usb 2-1.4: configuration #1 chosen from 1 choice
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input2
generic-usb 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input3
generic-usb 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
mlx4_core 0000:04:00.0: Old device ETS support detected
mlx4_core 0000:04:00.0: Consider upgrading device FW.
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014)
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
<mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014)
mpt2sas version 20.102.00.00 loaded
mpt2sas 0000:06:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32773556 kB)
mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1
mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 145
mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 146
mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 147
mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 148
mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 149
mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 150
mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 151
mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 152
mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffc90014a40000), size(65536)
mpt2sas_cm0: ioport(0x0000000000002000), size(256)
mpt2sas_cm0: sending message unit reset !!
mpt2sas_cm0: message unit reset: SUCCESS
mpt2sas_cm0: Allocated physical memory: size(17329 kB)
mpt2sas_cm0: Current Controller Queue Depth(9979),Max Controller Queue Depth(10240)
mpt2sas_cm0: Scatter Gather Elements per IO(128)
mpt2sas_cm0: overriding NVDATA EEDPTagMode setting
mpt2sas_cm0: LSISAS2308: FWVersion(15.00.00.00), ChipRevision(0x05), BiosVersion(07.29.00.00)
mpt2sas_cm0: Protocol=(
Initiator
,Target
), 
Capabilities=(
TLR
,EEDP
,Snapshot Buffer
,Diag Trace Buffer
,Task Set Full
,NCQ
)
scsi0 : Fusion MPT SAS Host
mpt2sas_cm0: sending port enable !!
mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6d910), phys(8)
mpt2sas_cm0: port enable: SUCCESS
scsi 0:0:0:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:41: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:41: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:42: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:42: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:43: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:43: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:44: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:44: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:45: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:45: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:0:46: SSP: handle(0x000a), sas_addr(0x50080e51ff0d0010), phy(4), device_name(0x50080e51ff0d0010)
scsi 0:0:0:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(4)
scsi 0:0:0:46: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:0: Direct-Access     LSI      INF-01-00        0786 PQ: 1 ANSI: 5
scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:7: Direct-Access     LSI      Universal Xport  0786 PQ: 0 ANSI: 5
scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:41: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:41: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:41: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:41: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:42: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:42: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:42: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:42: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:43: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:43: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:43: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:43: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:44: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:44: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:44: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:44: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:45: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:45: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:45: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:45: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:1:46: Direct-Access     LSI      INF-01-00        0786 PQ: 0 ANSI: 5
scsi 0:0:1:46: SSP: handle(0x0009), sas_addr(0x50080e51fedb8014), phy(0), device_name(0x50080e51fedb8014)
scsi 0:0:1:46: SSP: enclosure_logical_id(0x500605b005d6d910), slot(0)
scsi 0:0:1:46: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1)
scsi 0:0:0:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:0:41: rdac: LUN 41 (RDAC) (owned)
scsi 0:0:0:42: rdac: LUN 42 (RDAC) (unowned)
scsi 0:0:0:43: rdac: LUN 43 (RDAC) (owned)
scsi 0:0:0:44: rdac: LUN 44 (RDAC) (unowned)
scsi 0:0:0:45: rdac: LUN 45 (RDAC) (owned)
scsi 0:0:0:46: rdac: LUN 46 (RDAC) (unowned)
scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned)
scsi 0:0:1:41: rdac: LUN 41 (RDAC) (unowned)
scsi 0:0:1:42: rdac: LUN 42 (RDAC) (owned)
scsi 0:0:1:43: rdac: LUN 43 (RDAC) (unowned)
scsi 0:0:1:44: rdac: LUN 44 (RDAC) (owned)
scsi 0:0:1:45: rdac: LUN 45 (RDAC) (unowned)
scsi 0:0:1:46: rdac: LUN 46 (RDAC) (owned)
isci: Intel(R) C600 SAS Controller Driver - version 1.1.0-rh
isci 0000:07:00.0: driver configured for rev: 6 silicon
isci 0000:07:00.0: OEM parameter table found in OROM
isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform)
isci 0000:07:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short}
scsi1 : isci
ata1.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata1.00: configured for UDMA/133
scsi 1:0:0:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ata2.00: ATA-8: ST500NM0011, SN02, max UDMA/133
ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
ata2.00: configured for UDMA/133
scsi 1:0:1:0: Direct-Access     ATA      ST500NM0011      SN02 PQ: 0 ANSI: 5
ACPI: WMI: Mapper loaded
ahci 0000:00:1f.2: PCI INT B -> GSI 21 (level, low) -> IRQ 21
ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst 
scsi2 : ahci
scsi3 : ahci
scsi4 : ahci
scsi5 : ahci
scsi6 : ahci
scsi7 : ahci
ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 155
ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 155
ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 155
ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 155
ata7: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 155
ata8: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 155
ata6: SATA link down (SStatus 0 SControl 300)
ata8: SATA link down (SStatus 0 SControl 300)
ata5: SATA link down (SStatus 0 SControl 300)
ata7: SATA link down (SStatus 0 SControl 300)
ata4: SATA link down (SStatus 0 SControl 300)
ata3: SATA link down (SStatus 0 SControl 300)
%Gsd 0:0:0:7: [sda] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:0:42: [sdc] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:41: [sdb] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:43: [sdd] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:45: [sdf] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:42: [sdc] Write Protect is off
sd 0:0:0:44: [sde] Write Protect is off
sd 0:0:0:42: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:43: [sdd] Write Protect is off
sd 0:0:1:7: [sdh] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB)
sd 0:0:1:41: [sdi] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:44: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:43: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:41: [sdb] Write Protect is off
sd 0:0:0:45: [sdf] Write Protect is off
sd 0:0:1:42: [sdj] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:1:43: [sdk] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 0:0:0:41: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:41: [sdi] Write Protect is off
sd 0:0:1:44: [sdl] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 1:0:0:0: [sdo] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 0:0:0:46: [sdg] Write Protect is off
sd 0:0:0:45: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:45: [sdm] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 1:0:0:0: [sdo] Write Protect is off
sd 1:0:1:0: [sdp] 976773168 512-byte logical blocks: (500 GB/465 GiB)
sd 0:0:1:7: [sdh] Write Protect is off
sd 1:0:0:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 1:0:1:0: [sdp] Write Protect is off
sd 0:0:1:46: [sdn] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB)
sd 1:0:1:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 0:0:1:41: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:0:46: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:7: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:42: [sdj] Write Protect is off
 sdc:
sd 0:0:1:43: [sdk] Write Protect is off
sd 0:0:1:44: [sdl] Write Protect is off
sd 0:0:1:42: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdp:
sd 0:0:1:45: [sdm] Write Protect is off
Dev sdc: unable to read RDB block 0
 sde:
sd 0:0:1:46: [sdn] Write Protect is off
sd 0:0:1:43: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:44: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA
 unable to read partition table
sd 0:0:1:45: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA
sd 0:0:1:46: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA
 sdo:
sd 0:0:0:7: [sda] Write Protect is off
sd 0:0:0:7: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
Dev sde: unable to read RDB block 0
sd 0:0:0:42: [sdc] Attached SCSI disk
 unable to read partition table
 sdo1
sd 0:0:0:44: [sde] Attached SCSI disk
 sdo2
 sdd:
 sdf:
 sdb: unknown partition table
 unknown partition table
sd 0:0:0:43: [sdd] Attached SCSI disk
 sdg:
sd 1:0:0:0: [sdo] Attached SCSI disk
sd 0:0:0:41: [sdb] Attached SCSI disk
 sdi:
 sdj: unknown partition table
 sdl:
sd 0:0:0:45: [sdf] Attached SCSI disk
 unknown partition table
 sda:
sd 0:0:1:42: [sdj] Attached SCSI disk
 sdn: unknown partition table
 sdh:
sd 0:0:1:44: [sdl] Attached SCSI disk
 sdm: unknown partition table
 sdk:
sd 0:0:1:46: [sdn] Attached SCSI disk
Dev sdg: unable to read RDB block 0
Dev sdi: unable to read RDB block 0
Dev sdm: unable to read RDB block 0
Dev sdk: unable to read RDB block 0
 unable to read partition table
 unable to read partition table
sd 0:0:1:45: [sdm] Attached SCSI disk
 unable to read partition table
sd 0:0:1:43: [sdk] Attached SCSI disk
 unable to read partition table
sd 0:0:0:46: [sdg] Attached SCSI disk
 sdp1
sd 0:0:1:41: [sdi] Attached SCSI disk
 sdp9
sd 1:0:1:0: [sdp] Attached SCSI disk
 unknown partition table
sd 0:0:0:7: [sda] Attached SCSI disk
 unknown partition table
sd 0:0:1:7: [sdh] Attached SCSI disk
EXT3-fs (sdo1): recovery required on readonly filesystem
EXT3-fs (sdo1): write access will be enabled during recovery
kjournald starting.  Commit interval 5 seconds
EXT3-fs (sdo1): orphan cleanup on readonly fs
EXT3-fs (sdo1): 7 orphan inodes deleted
EXT3-fs (sdo1): recovery complete
EXT3-fs (sdo1): mounted filesystem with ordered data mode
dracut: Mounted root filesystem /dev/sdo1
SELinux:  Disabled at runtime.
type=1404 audit(1476985573.228:2): selinux=0 auid=4294967295 ses=4294967295
dracut: 
dracut: Switching root
cat: /proc/self/attr/current: Invalid argument

		Welcome to CentOS 

Starting udev: udev: starting version 147
dca service started, version 1.12.1
igb: Intel(R) Gigabit Ethernet Network Driver - version 5.3.0-k
igb: Copyright (c) 2007-2014 Intel Corporation.
igb 0000:02:00.0: PCI INT A -> GSI 27 (level, low) -> IRQ 27
igb 0000:02:00.0: added PHC on eth0
igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b3
igb 0000:02:00.0: eth0: PBA No: 100000-000
igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.1: PCI INT B -> GSI 30 (level, low) -> IRQ 30
igb 0000:02:00.1: added PHC on eth1
igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b4
igb 0000:02:00.1: eth1: PBA No: 100000-000
igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.2: PCI INT C -> GSI 28 (level, low) -> IRQ 28
igb 0000:02:00.2: added PHC on eth2
igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b5
igb 0000:02:00.2: eth2: PBA No: 100000-000
igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
igb 0000:02:00.3: PCI INT D -> GSI 29 (level, low) -> IRQ 29
igb 0000:02:00.3: added PHC on eth3
igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection
igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6d:25:b6
igb 0000:02:00.3: eth3: PBA No: 100000-000
igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
scsi 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:0:7: Attached scsi generic sg1 type 0
sd 0:0:0:41: Attached scsi generic sg2 type 0
sd 0:0:0:42: Attached scsi generic sg3 type 0
sd 0:0:0:43: Attached scsi generic sg4 type 0
sd 0:0:0:44: Attached scsi generic sg5 type 0
sd 0:0:0:45: Attached scsi generic sg6 type 0
sd 0:0:0:46: Attached scsi generic sg7 type 0
scsi 0:0:1:0: Attached scsi generic sg8 type 0
sd 0:0:1:7: Attached scsi generic sg9 type 0
sd 0:0:1:41: Attached scsi generic sg10 type 0
sd 0:0:1:42: Attached scsi generic sg11 type 0
sd 0:0:1:43: Attached scsi generic sg12 type 0
sd 0:0:1:44: Attached scsi generic sg13 type 0
sd 0:0:1:45: Attached scsi generic sg14 type 0
sd 0:0:1:46: Attached scsi generic sg15 type 0
sd 1:0:0:0: Attached scsi generic sg16 type 0
sd 1:0:1:0: Attached scsi generic sg17 type 0
ioatdma: Intel(R) QuickData Technology Driver 4.00
ioatdma 0000:00:04.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
igb 0000:02:00.0: DCA enabled
igb 0000:02:00.1: DCA enabled
ioatdma 0000:00:04.1: PCI INT B -> GSI 39 (level, low) -> IRQ 39
igb 0000:02:00.2: DCA enabled
igb 0000:02:00.3: DCA enabled
ioatdma 0000:00:04.2: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.3: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.4: PCI INT A -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.5: PCI INT B -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:00:04.6: PCI INT C -> GSI 31 (level, low) -> IRQ 31
ioatdma 0000:00:04.7: PCI INT D -> GSI 39 (level, low) -> IRQ 39
ioatdma 0000:80:04.0: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.1: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.2: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.3: PCI INT D -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.4: PCI INT A -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.5: PCI INT B -> GSI 63 (level, low) -> IRQ 63
ioatdma 0000:80:04.6: PCI INT C -> GSI 55 (level, low) -> IRQ 55
ioatdma 0000:80:04.7: PCI INT D -> GSI 63 (level, low) -> IRQ 63
i801_smbus 0000:00:1f.3: PCI INT C -> GSI 23 (level, low) -> IRQ 23
ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20090903/utaddress-254)
ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
i801_smbus 0000:07:00.3: PCI INT C -> GSI 18 (level, low) -> IRQ 18
i801_smbus 0000:07:00.3: Enabling SMBus device
i801_smbus 0000:07:00.3: SMBus using polling
EDAC MC: Ver: 2.1.0 Oct 19 2016
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca0
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3ca8
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3c71
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3caa
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cab
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cac
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cad
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cb8
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf4
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf6
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC sbridge: Seeking for: PCI ID 8086:3cf5
EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0
EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0
EDAC sbridge:  Ver: 1.1.1 
%Gzunicode: module license 'CDDL' taints kernel.
Disabling lock debugging due to kernel taint
SPL: Loaded module v0.6.5.7-1
ZFS: Loaded module v0.6.5.7-1, ZFS pool version 5000, ZFS filesystem version 5
iTCO_vendor_support: vendor-support=0
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11rh
iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x70d
platform microcode: firmware: requesting intel-ucode/06-2d-07
Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
microcode: CPU0 updated to revision 0x710, date = 2013-06-17 
microcode: CPU1 updated to revision 0x710, date = 2013-06-17 
microcode: CPU2 updated to revision 0x710, date = 2013-06-17 
microcode: CPU3 updated to revision 0x710, date = 2013-06-17 
microcode: CPU4 updated to revision 0x710, date = 2013-06-17 
microcode: CPU5 updated to revision 0x710, date = 2013-06-17 
microcode: CPU6 updated to revision 0x710, date = 2013-06-17 
microcode: CPU7 updated to revision 0x710, date = 2013-06-17 
microcode: CPU8 updated to revision 0x710, date = 2013-06-17 
microcode: CPU9 updated to revision 0x710, date = 2013-06-17 
microcode: CPU10 updated to revision 0x710, date = 2013-06-17 
microcode: CPU11 updated to revision 0x710, date = 2013-06-17 
microcode: CPU12 updated to revision 0x710, date = 2013-06-17 
microcode: CPU13 updated to revision 0x710, date = 2013-06-17 
microcode: CPU14 updated to revision 0x710, date = 2013-06-17 
microcode: CPU15 updated to revision 0x710, date = 2013-06-17 
microcode: CPU16 updated to revision 0x710, date = 2013-06-17 
microcode: CPU17 updated to revision 0x710, date = 2013-06-17 
microcode: CPU18 updated to revision 0x710, date = 2013-06-17 
microcode: CPU19 updated to revision 0x710, date = 2013-06-17 
microcode: CPU20 updated to revision 0x710, date = 2013-06-17 
microcode: CPU21 updated to revision 0x710, date = 2013-06-17 
microcode: CPU22 updated to revision 0x710, date = 2013-06-17 
microcode: CPU23 updated to revision 0x710, date = 2013-06-17 
microcode: CPU24 updated to revision 0x710, date = 2013-06-17 
microcode: CPU25 updated to revision 0x710, date = 2013-06-17 
microcode: CPU26 updated to revision 0x710, date = 2013-06-17 
microcode: CPU27 updated to revision 0x710, date = 2013-06-17 
microcode: CPU28 updated to revision 0x710, date = 2013-06-17 
microcode: CPU29 updated to revision 0x710, date = 2013-06-17 
microcode: CPU30 updated to revision 0x710, date = 2013-06-17 
microcode: CPU31 updated to revision 0x710, date = 2013-06-17 
[  OK  ]


Setting hostname lola-10.lola.whamcloud.com:  [  OK  ]


device-mapper: multipath: version 1.6.0 loaded
Oct 20 10:46:18 | ignoring extra data starting with 'udev_dir' on line 2 of /etc/multipath.conf

device-mapper: multipath round-robin: version 1.0.0 loaded
device-mapper: table: 253:5: multipath: error getting device
device-mapper: ioctl: error adding target to table
Add partition mappings:  [  OK  ]


ERROR: asr: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: ddf1: reading /dev/sdm[Input/output error]

ERROR: hpt37x: reading /dev/sdm[Input/output error]

ERROR: hpt45x: reading /dev/sdm[Input/output error]

ERROR: isw: reading /dev/sdm[Input/output error]

ERROR: jmicron: reading /dev/sdm[Input/output error]

ERROR: lsi: reading /dev/sdm[Input/output error]

ERROR: nvidia: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: pdc: reading /dev/sdm[Input/output error]

ERROR: sil: reading /dev/sdm[Input/output error]

ERROR: via: reading /dev/sdm[Input/output error]

ERROR: asr: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: ddf1: reading /dev/sdk[Input/output error]

ERROR: hpt37x: reading /dev/sdk[Input/output error]

ERROR: hpt45x: reading /dev/sdk[Input/output error]

ERROR: isw: reading /dev/sdk[Input/output error]

ERROR: jmicron: reading /dev/sdk[Input/output error]

ERROR: lsi: reading /dev/sdk[Input/output error]

ERROR: nvidia: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: pdc: reading /dev/sdk[Input/output error]

ERROR: sil: reading /dev/sdk[Input/output error]

ERROR: via: reading /dev/sdk[Input/output error]

ERROR: asr: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: ddf1: reading /dev/sdg[Input/output error]

ERROR: hpt37x: reading /dev/sdg[Input/output error]

ERROR: hpt45x: reading /dev/sdg[Input/output error]

ERROR: isw: reading /dev/sdg[Input/output error]

ERROR: jmicron: reading /dev/sdg[Input/output error]

ERROR: lsi: reading /dev/sdg[Input/output error]

ERROR: nvidia: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: pdc: reading /dev/sdg[Input/output error]

ERROR: sil: reading /dev/sdg[Input/output error]

ERROR: via: reading /dev/sdg[Input/output error]

ERROR: asr: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: ddf1: reading /dev/sdi[Input/output error]

ERROR: hpt37x: reading /dev/sdi[Input/output error]

ERROR: hpt45x: reading /dev/sdi[Input/output error]

ERROR: isw: reading /dev/sdi[Input/output error]

ERROR: jmicron: reading /dev/sdi[Input/output error]

ERROR: lsi: reading /dev/sdi[Input/output error]

ERROR: nvidia: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: pdc: reading /dev/sdi[Input/output error]

ERROR: sil: reading /dev/sdi[Input/output error]

ERROR: via: reading /dev/sdi[Input/output error]

ERROR: asr: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: ddf1: reading /dev/sde[Input/output error]

ERROR: hpt37x: reading /dev/sde[Input/output error]

ERROR: hpt45x: reading /dev/sde[Input/output error]

ERROR: isw: reading /dev/sde[Input/output error]

ERROR: jmicron: reading /dev/sde[Input/output error]

ERROR: lsi: reading /dev/sde[Input/output error]

ERROR: nvidia: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: pdc: reading /dev/sde[Input/output error]

ERROR: sil: reading /dev/sde[Input/output error]

ERROR: via: reading /dev/sde[Input/output error]

ERROR: asr: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: ddf1: reading /dev/sdc[Input/output error]

ERROR: hpt37x: reading /dev/sdc[Input/output error]

ERROR: hpt45x: reading /dev/sdc[Input/output error]

ERROR: isw: reading /dev/sdc[Input/output error]

ERROR: jmicron: reading /dev/sdc[Input/output error]

ERROR: lsi: reading /dev/sdc[Input/output error]

ERROR: nvidia: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: pdc: reading /dev/sdc[Input/output error]

ERROR: sil: reading /dev/sdc[Input/output error]

ERROR: via: reading /dev/sdc[Input/output error]

Setting up Logical Volume Management: [  OK  ]


Checking filesystems

Checking all file systems.

[/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/sdo1 

/dev/sdo1: clean, 133130/1310720 files, 3708271/5242880 blocks

[  OK  ]


RemEXT3-fs (sdo1): using internal journal
ounting root filesystem in read-write mode:  [  OK  ]


Mounting local filesystems:  [  OK  ]


Enabling local filesystem quotas:  [  OK  ]


Enabling /etc/fstab swaps:  Adding 16457724k swap on /dev/sdo2.  Priority:-1 extents:1 across:16457724k 
[  OK  ]


Entering non-interactive startup

Calling the system activity data collector (sadc)... 

Loading OpenIB kernel modules:[  OK  ]


Mounting ZFS filesystem(s)  [  OK  ]


ip6tables: No config file.[WARNING]


iptables: No config file.[WARNING]


Bringing up loopback interface:  [  OK  ]


Bringing up interface eth0:  ADDRCONF(NETDEV_UP): eth0: link is not ready
Determining if ip address 10.4.0.110 is already in use for device eth0...

igb 0000:02:00.0: eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[  OK  ]


Bringing up interface ib0:  ADDRCONF(NETDEV_UP): ib0: link is not ready
ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready
[  OK  ]


Bringing up interface ipmi:  Device ipmi does not seem to be present, delaying initialization.

[FAILED]


Starting auditd: type=1305 audit(1476985599.158:3): audit_pid=4481 old=0 auid=4294967295 ses=4294967295 res=1
[  OK  ]


Loading Lustre module stack...LNet: HW CPU cores: 32, npartitions: 4
alg: No test for adler32 (adler32-zlib)
alg: No test for crc32 (crc32-table)
alg: No test for crc32 (crc32-pclmul)
Lustre: Lustre: Build Version: 2.7.18.7--PRISTINE-2.6.32-642.6.1.el6_lustre.x86_64
LNet: Added LNI 192.168.1.110@o2ib10 [8/256/0/180]


Starting system logger: [  OK  ]


Enabling ondemand cpu frequency scaling: [  OK  ]


Starting irqbalance: [  OK  ]


Starting rpcbind: [  OK  ]


Starting NFS statd: [  OK  ]


Starting system message bus: [  OK  ]


Setting NIS domain: domain is 'lola.whamcloud.com'  [  OK  ]


Starting NIS service: [  OK  ]


Binding NIS service: .[  OK  ]


Starting ibacm daemon:[  OK  ]


NFS filesystems queued to be mounted

Mounting filesystems:  RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
Slow work thread pool: Starting up
Slow work thread pool: Ready
FS-Cache: Loaded
NFS: Registering the id_resolver key type
Key type id_resolver registered
FS-Cache: Netfs 'nfs' registered for caching
[  OK  ]


Starting acpi daemon: [  OK  ]


Starting HAL daemon: [  OK  ]


Retrigger failed udev events[  OK  ]


Starting ZFS Event Daemon  [  OK  ]
[  OK  ]


Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Starting NFS services:  [  OK  ]


Starting NFS quotas: [  OK  ]


Starting NFS mountd: [  OK  ]


Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
[  OK  ]


Starting RPC idmapd: [  OK  ]


Sharing ZFS filesystems  [  OK  ]


Starting MUNGE: munged[  OK  ]


No kdump initial ramdisk found.[WARNING]


Rebuilding /boot/initrd-2.6.32-642.6.1.el6_lustre.x86_64kdump.img

Warning: There might not be enough space to save a vmcore.

         The size of UUID=8736af49-40a5-4b86-86cd-33b04efb5df5 should be greater than 32773556 kilo bytes.

Starting kdump:[  OK  ]


Starting sshd: [  OK  ]


Starting xinetd: [  OK  ]


Starting ntpd: [  OK  ]


Starting GANGLIA gmond: [  OK  ]


Starting sendmail: [  OK  ]


Starting sm-client: [  OK  ]


Starting crond: [  OK  ]


802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
8021q: adding VLAN 0 to HW filter on device eth0
starting slurmd: [  OK  ]


Starting atd: [  OK  ]


Starting collectl: [  OK  ]



CentOS release 6.7 (Final)
Kernel 2.6.32-642.6.1.el6_lustre.x86_64 on an x86_64

lola-10.lola.whamcloud.com login: Oct 20 10:50:01 lola-10 TIME: Time stamp for console