Feb 10 17:37:41 xfer01 kernel: Lustre: Build Version: jenkins-wc1-g171bd56-PRISTINE-2.6.18-348.3.1.el5_lustre.g171bd56
Feb 10 17:37:41 xfer01 kernel: Lustre: Added LNI 149.165.235.51@tcp [8/256/0/180]
Feb 10 17:37:41 xfer01 kernel: Lustre: Accept secure, port 988
Feb 10 17:37:42 xfer01 kernel: Lustre: Lustre Client File System; http://www.lustre.org/
Feb 10 17:37:56 xfer01 kernel: Lustre: MGC10.10.0.171@o2ib: Reactivating import
Feb 10 17:37:56 xfer01 kernel: Lustre: Server MGS version (2.1.6.0) is much newer than client version (1.8.9)
Feb 10 17:37:56 xfer01 kernel: Lustre: 13183:0:(obd_config.c:1130:class_config_llog_handler()) skipping 'lmv' config: cmd=cf001,clilmv:lmv
Feb 10 17:37:56 xfer01 kernel: Lustre: 13183:0:(obd_config.c:1130:class_config_llog_handler()) skipping 'lmv' config: cmd=cf003,clilmv:
Feb 10 17:37:57 xfer01 kernel: Lustre: Server dc2-MDT0000_UUID version (2.1.6.0) is much newer than client version (1.8.9)
Feb 10 17:37:57 xfer01 kernel: Lustre: client supports 64-bits dir hash/offset!
Feb 10 17:37:57 xfer01 kernel: Lustre: Client dc2-client(ffff810063082c00) mount complete
Feb 10 17:37:58 xfer01 kernel: Lustre: Server dc2-OST0094_UUID version (2.1.6.0) is much newer than client version (1.8.9)
Feb 10 17:37:58 xfer01 kernel: Lustre: Skipped 164 previous similar messages
Feb 10 17:59:58 xfer01 kernel: Lustre: 13191:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1459693143720578 sent from dc2-MDT0000-mdc-ffff810063082c00 to NID 10.10.0.171@o2ib 1282s ago has timed out (1282s prior to deadline).
Feb 10 17:59:58 xfer01 kernel: Lustre: dc2-MDT0000-mdc-ffff810063082c00: Connection to service dc2-MDT0000 via nid 10.10.0.171@o2ib was lost; in progress operations using this service will wait for recovery to complete.
Feb 10 17:59:58 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:00:05 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:00:47 xfer01 kernel: LustreError: Skipped 1 previous similar message
Feb 10 18:01:08 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:01:08 xfer01 kernel: LustreError: Skipped 2 previous similar messages
Feb 10 18:01:43 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:01:43 xfer01 kernel: LustreError: Skipped 4 previous similar messages
Feb 10 18:02:53 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:02:53 xfer01 kernel: LustreError: Skipped 9 previous similar messages
Feb 10 18:05:06 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:05:06 xfer01 kernel: LustreError: Skipped 18 previous similar messages
Feb 10 18:09:25 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:09:25 xfer01 kernel: LustreError: Skipped 36 previous similar messages
Feb 10 18:18:03 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:18:03 xfer01 kernel: LustreError: Skipped 73 previous similar messages
Feb 10 18:28:26 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:28:26 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 18:38:28 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:38:28 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 18:48:30 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:48:30 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 18:58:32 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 18:58:32 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 19:08:34 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 19:08:34 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 19:18:36 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 19:18:36 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 19:28:38 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 19:28:38 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 19:38:40 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 19:38:40 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 19:48:42 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 19:48:42 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 19:58:44 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 19:58:44 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 20:08:46 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 20:08:46 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 20:18:48 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 20:18:48 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 20:28:50 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 20:28:50 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 20:38:52 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 20:38:52 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 20:48:54 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 20:48:54 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 20:58:56 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 20:58:56 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 21:08:58 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 21:08:58 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 21:19:01 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 21:19:01 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 21:29:03 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 21:29:03 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 21:39:05 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 21:39:05 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 21:49:07 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 21:49:07 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 21:59:09 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 21:59:09 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 22:09:11 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 22:09:11 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 22:19:13 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 22:19:13 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 22:29:15 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 22:29:15 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 22:39:17 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 22:39:17 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 22:49:19 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 22:49:19 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 22:52:16 xfer01 kernel: Lustre: 13130:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1459693143899338 sent from dc2-OST0074-osc-ffff810063082c00 to NID 10.10.0.12@o2ib 17s ago has timed out (17s prior to deadline).
Feb 10 22:52:16 xfer01 kernel: Lustre: dc2-OST0074-osc-ffff810063082c00: Connection to service dc2-OST0074 via nid 10.10.0.12@o2ib was lost; in progress operations using this service will wait for recovery to complete.
Feb 10 22:52:16 xfer01 kernel: Lustre: 13130:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1459693143899342 sent from dc2-OST0078-osc-ffff810063082c00 to NID 10.10.0.12@o2ib 17s ago has timed out (17s prior to deadline).
Feb 10 22:52:16 xfer01 kernel: Lustre: dc2-OST0074-osc-ffff810063082c00: Connection restored to service dc2-OST0074 using nid 10.10.0.12@o2ib.
Feb 10 22:52:16 xfer01 kernel: Lustre: Server dc2-OST0074_UUID version (2.1.6.0) is much newer than client version (1.8.9)
Feb 10 22:52:16 xfer01 kernel: Lustre: Skipped 3 previous similar messages
Feb 10 22:52:16 xfer01 kernel: Lustre: dc2-OST0078-osc-ffff810063082c00: Connection to service dc2-OST0078 via nid 10.10.0.12@o2ib was lost; in progress operations using this service will wait for recovery to complete.
Feb 10 22:52:16 xfer01 kernel: Lustre: dc2-OST0079-osc-ffff810063082c00: Connection restored to service dc2-OST0079 using nid 10.10.0.12@o2ib.
Feb 10 22:59:21 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 22:59:21 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 23:09:23 xfer01 kernel: LustreError: 11-0: an error occurred while communicating with 10.10.0.171@o2ib. The mds_connect operation failed with -16
Feb 10 23:09:23 xfer01 kernel: LustreError: Skipped 85 previous similar messages
Feb 10 23:10:53 xfer01 kernel: LustreError: 13174:0:(ldlm_request.c:1039:ldlm_cli_cancel_req()) Got rc -11 from cancel RPC: canceling anyway
Feb 10 23:10:53 xfer01 kernel: LustreError: 13174:0:(ldlm_request.c:1597:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -11
Feb 10 23:12:39 xfer01 kernel: LustreError: 167-0: This client was evicted by dc2-MDT0000; in progress operations using this service will fail.
Feb 10 23:12:39 xfer01 kernel: Lustre: Server dc2-MDT0000_UUID version (2.1.6.0) is much newer than client version (1.8.9)
Feb 10 23:12:39 xfer01 kernel: Lustre: Skipped 3 previous similar messages
Feb 10 23:12:39 xfer01 kernel: LustreError: 13191:0:(mdc_locks.c:672:mdc_enqueue()) ldlm_cli_enqueue error: -4
Feb 10 23:12:39 xfer01 kernel: LustreError: 13191:0:(client.c:859:ptlrpc_import_delay_req()) @@@ IMP_INVALID  req@ffff81012e144400 x1459693143907855/t0 o101->dc2-MDT0000_UUID@10.10.0.171@o2ib:12/10 lens 568/4880 e 0 to 1 dl 0 ref 1 fl Rpc:/0/0 rc 0/0
Feb 10 23:12:39 xfer01 kernel: LustreError: 13191:0:(file.c:119:ll_close_inode_openhandle()) inode 144593035466996022 mdc close failed: rc = -108
Feb 10 23:12:39 xfer01 kernel: Lustre: dc2-MDT0000-mdc-ffff810063082c00: Connection restored to service dc2-MDT0000 using nid 10.10.0.171@o2ib.
Feb 10 23:12:39 xfer01 kernel: Lustre: Skipped 2 previous similar messages