ct 13 02:36:49 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 02:53:12 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 02:53:32 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 02:53:52 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 03:10:15 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 03:10:35 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 03:10:55 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 03:27:18 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 03:27:38 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 03:27:58 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 03:36:01 mds1 syslog-ng[2430]: Log statistics; processed='src.internal(s_sys#2)=153', stamp='src.internal(s_sys#2)=1444601161', processed='destination(d_ha)=132864', processed='destination(d_ha_useful)=72363', processed='destination(d_mesg)=33413', processed='destination(d_auth)=167', processed='source(s_sys)=203944', processed='global(payload_reallocs)=232', processed='destination(d_mail)=2', processed='destination(d_kern)=1983', processed='destination(d_mlal)=0', processed='global(msg_clones)=0', processed='destination(d_spol)=0', processed='destination(d_boot)=0', processed='global(sdata_updates)=0', processed='center(received)=0', processed='destination(d_cron)=36791', processed='center(queued)=0' Oct 13 03:44:21 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 03:44:41 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 03:45:01 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 04:01:24 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 04:01:44 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 04:02:04 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 04:18:27 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 04:18:47 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 04:19:07 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 04:35:30 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 04:35:50 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 04:36:10 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 04:52:33 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 04:52:53 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 04:53:13 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 05:09:36 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 05:09:56 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 05:10:16 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 05:26:39 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 05:26:59 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 05:27:19 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 05:43:42 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 05:44:02 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 05:44:22 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 06:00:45 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 06:01:05 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 06:01:25 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 06:17:48 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 06:18:08 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 06:18:28 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 06:34:51 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 06:35:11 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 06:35:31 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 06:51:54 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 06:52:14 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 06:52:34 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 07:08:57 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 07:09:17 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 07:09:37 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 07:26:00 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 07:26:20 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 07:26:40 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 07:43:03 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 07:43:23 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 07:43:43 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 08:00:06 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 08:00:26 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 08:00:46 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 08:17:09 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 08:17:29 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 08:17:49 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 08:34:12 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 08:34:32 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 08:34:52 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 08:51:15 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 08:51:35 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 08:51:55 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 09:08:18 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 09:08:38 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 09:08:58 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 09:25:21 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 09:25:41 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 09:26:01 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 09:42:24 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 09:42:44 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 09:43:04 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 09:59:27 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 09:59:47 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 10:00:07 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 10:16:30 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 10:16:50 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 10:17:10 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 10:30:58 mds1 kernel: : Lustre: 5659:0:(client.c:1869:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1444712451/real 0] req@ffff880b3f6ecc00 x1503486975158716/t0(0) o104->scratch-MDT0000@10.20.30.41@o2ib:15/16 lens 296/224 e 0 to 1 dl 1444712458 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Oct 13 10:30:58 mds1 kernel: : LustreError: 138-a: scratch-MDT0000: A client on nid 10.20.30.41@o2ib was evicted due to a lock blocking callback time out: rc -107 Oct 13 10:33:33 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 10:33:53 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 10:34:13 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 10:34:16 mds1 kernel: : Lustre: MGS: haven't heard from client da533c50-a280-d8b4-6b52-f5f2f81e5550 (at 10.20.30.41@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff8808627bac00, cur 1444712656 expire 1444712506 last 1444712429 Oct 13 10:34:28 mds1 kernel: : ib_send_cm_mra: cm_id_priv->id.state: 0x6 Oct 13 10:34:28 mds1 kernel: : LustreError: 137-5: scratch-OST0005_UUID: not available for connect from 10.20.30.41@o2ib (no target) Oct 13 10:34:28 mds1 kernel: : LustreError: Skipped 2 previous similar messages Oct 13 10:34:33 mds1 kernel: : Lustre: scratch-OST0001: haven't heard from client 49628f1f-dc9d-f93b-1178-45e0fc7cc42f (at 10.20.30.41@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff881041698000, cur 1444712673 expire 1444712523 last 1444712446 Oct 13 10:50:36 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 10:50:56 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 10:51:16 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 11:07:39 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 11:07:59 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 11:08:19 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 11:24:42 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 11:25:02 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 11:25:22 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 11:41:45 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 11:42:05 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 11:42:25 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 11:58:48 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 11:59:08 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 11:59:28 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 12:15:51 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 12:16:11 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 12:16:31 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 12:32:54 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 12:33:14 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 12:33:34 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 12:49:57 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 12:50:17 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 12:50:37 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org Oct 13 13:07:00 mds1 ntpd_initres[8533]: host name not found: 0.centos.pool.ntp.org Oct 13 13:07:20 mds1 ntpd_initres[8533]: host name not found: 1.centos.pool.ntp.org Oct 13 13:07:40 mds1 ntpd_initres[8533]: host name not found: 2.centos.pool.ntp.org [root@mds1 log]#