=~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2012.12.01 22:37:00 =~=~=~=~=~=~=~=~=~=~=~= rg_control status -v cat /var/log/messages Nov 25 04:03:02 ALPL105 syslogd 1.4.1: restart. Nov 25 04:22:01 ALPL105 kernel: md: syncing RAID array md0 Nov 25 04:22:01 ALPL105 kernel: md: minimum _guaranteed_ reconstruction speed: 1000 KB/sec/disc. Nov 25 04:22:01 ALPL105 kernel: md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for reconstruction. Nov 25 04:22:01 ALPL105 kernel: md: using 128k window, over a total of 795072 blocks. Nov 25 04:22:01 ALPL105 kernel: md: delaying resync of md2 until md0 has finished resync (they share one or more physical units) Nov 25 04:22:09 ALPL105 kernel: md: md0: sync done. Nov 25 04:22:09 ALPL105 kernel: md: syncing RAID array md2 Nov 25 04:22:09 ALPL105 kernel: md: minimum _guaranteed_ reconstruction speed: 1000 KB/sec/disc. Nov 25 04:22:09 ALPL105 kernel: md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for reconstruction. Nov 25 04:22:09 ALPL105 kernel: md: using 128k window, over a total of 4192896 blocks. Nov 25 04:22:09 ALPL105 kernel: RAID1 conf printout: Nov 25 04:22:09 ALPL105 kernel: --- wd:2 rd:2 Nov 25 04:22:09 ALPL105 kernel: disk 0, wo:0, o:1, dev:sda1 Nov 25 04:22:09 ALPL105 kernel: disk 1, wo:0, o:1, dev:sdb1 Nov 25 04:23:35 ALPL105 kernel: md: md2: sync done. Nov 25 04:23:35 ALPL105 kernel: RAID1 conf printout: Nov 25 04:23:35 ALPL105 kernel: --- wd:2 rd:2 Nov 25 04:23:35 ALPL105 kernel: disk 0, wo:0, o:1, dev:sda3 Nov 25 04:23:35 ALPL105 kernel: disk 1, wo:0, o:1, dev:sdb3 Nov 25 04:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 05:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 06:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 07:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 08:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 09:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 10:03:55 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Nov 25 10:08:13 ALPL105 kernel: LustreError: 26683:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102c2f11c00 x1412507440447095/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1353809299 ref 1 fl Interpret:/0/0 rc 0/0 Nov 25 10:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 11:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 12:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 13:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 14:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 15:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 15:47:46 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Nov 25 16:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 17:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 18:07:43 ALPL105 kernel: LustreError: 26690:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff810631a28800 x1411574421683109/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1353838069 ref 1 fl Interpret:/0/0 rc 0/0 Nov 25 18:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 19:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 20:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 21:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 22:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 23:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 25 23:41:13 ALPL105 kernel: LustreError: 26679:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff81062feb3c00 x1412507446821186/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1353858079 ref 1 fl Interpret:/0/0 rc 0/0 Nov 26 00:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 01:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 02:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 03:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 03:43:40 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Nov 26 04:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 04:48:33 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Nov 26 05:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 06:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 07:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 08:12:28 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Nov 26 08:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 09:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 10:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 11:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 12:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 13:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 14:27:43 ALPL105 kernel: LustreError: 26699:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102e6905400 x1412507458244141/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1353911269 ref 1 fl Interpret:/0/0 rc 0/0 Nov 26 14:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 15:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 16:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 17:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 18:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 19:22:03 ALPL105 kernel: LustreError: 26692:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff81030b4eec50 x1411574458964069/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1353928929 ref 1 fl Interpret:/0/0 rc 0/0 Nov 26 19:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 20:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 20:59:07 ALPL105 kernel: LustreError: 26678:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102ce9ca000 x1412507472713341/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1353934753 ref 1 fl Interpret:/0/0 rc 0/0 Nov 26 21:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 22:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 26 23:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 00:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 01:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 02:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 03:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 04:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 05:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 06:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 07:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 07:54:07 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Nov 27 08:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 09:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 10:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 11:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 12:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 13:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 14:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 14:37:37 ALPL105 kernel: LustreError: 26695:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102c5171000 x1412507493518346/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1353998263 ref 1 fl Interpret:/0/0 rc 0/0 Nov 27 14:38:39 ALPL105 kernel: LustreError: 26699:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff810301e5b850 x1412507493546933/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1353998325 ref 1 fl Interpret:/0/0 rc 0/0 Nov 27 15:10:32 ALPL105 kernel: LustreError: 26696:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff81033fe12c00 x1412507494944476/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1354000238 ref 1 fl Interpret:/0/0 rc 0/0 Nov 27 15:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 15:40:42 ALPL105 kernel: LustreError: 26698:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102face9800 x1411574500483893/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1354002048 ref 1 fl Interpret:/0/0 rc 0/0 Nov 27 16:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 17:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 18:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 19:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 19:52:52 ALPL105 kernel: LustreError: 26672:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102cf27f400 x1411574509903290/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1354017178 ref 1 fl Interpret:/0/0 rc 0/0 Nov 27 20:04:47 ALPL105 kernel: LustreError: 26685:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102de12e000 x1412507506176387/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1354017893 ref 1 fl Interpret:/0/0 rc 0/0 Nov 27 20:05:05 ALPL105 kernel: LustreError: 26676:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102d2246800 x1412507506179657/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1354017911 ref 1 fl Interpret:/0/0 rc 0/0 Nov 27 20:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 21:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 21:52:11 ALPL105 kernel: LustreError: 26693:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff81031fbe3400 x1411574513369268/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1354024337 ref 1 fl Interpret:/0/0 rc 0/0 Nov 27 21:57:22 ALPL105 kernel: LustreError: 26696:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff81033fd0e800 x1412507508341104/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1354024648 ref 1 fl Interpret:/0/0 rc 0/0 Nov 27 22:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 27 23:25:07 ALPL105 kernel: LustreError: 26673:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102c2dc6c00 x1411574514226265/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1354029913 ref 1 fl Interpret:/0/0 rc 0/0 Nov 27 23:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 00:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 01:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 02:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 03:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 04:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 05:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 06:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 07:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 08:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 09:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 10:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 11:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 12:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 13:19:41 ALPL105 kernel: LustreError: 26693:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102be457c00 x1412507522207793/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1354079987 ref 1 fl Interpret:/0/0 rc 0/0 Nov 28 13:20:10 ALPL105 kernel: LustreError: 26689:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102fb200c00 x1412507522244013/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1354080016 ref 1 fl Interpret:/0/0 rc 0/0 Nov 28 13:20:33 ALPL105 kernel: LustreError: 26702:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff81033fe12c00 x1412507522262976/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1354080039 ref 1 fl Interpret:/0/0 rc 0/0 Nov 28 13:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 14:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 15:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 16:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 17:24:58 ALPL105 kernel: LustreError: 26677:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102fee62c00 x1411574530249323/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1354094704 ref 1 fl Interpret:/0/0 rc 0/0 Nov 28 17:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 18:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 19:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 20:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 21:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 22:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 28 23:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 00:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 01:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 02:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 03:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 04:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 05:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 06:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 07:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 08:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 09:29:27 ALPL105 kernel: LustreError: 26681:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff81063d375800 x1411574543873611/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1354152573 ref 1 fl Interpret:/0/0 rc 0/0 Nov 29 09:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 10:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 11:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 12:06:12 ALPL105 kernel: LustreError: 26678:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff81063ac84000 x1411574547563022/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1354161978 ref 1 fl Interpret:/0/0 rc 0/0 Nov 29 12:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 13:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 14:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 15:21:27 ALPL105 kernel: LustreError: 26678:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff81030f3e6c00 x1411574551508287/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1354173693 ref 1 fl Interpret:/0/0 rc 0/0 Nov 29 15:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 16:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 17:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 18:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 19:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 20:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 20:37:51 ALPL105 kernel: LustreError: 26693:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102fee62c00 x1412507541888059/t0 o49->7adb9a92-edd2-6f82-d092-144b41b0e385@NET_0x500000a030642_UUID:0/0 lens 440/0 e 0 to 0 dl 1354192677 ref 1 fl Interpret:/0/0 rc 0/0 Nov 29 21:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 21:46:02 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Nov 29 22:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 29 23:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 00:19:38 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Nov 30 00:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 01:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 02:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 02:42:15 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Nov 30 03:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 04:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 05:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 06:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 07:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 08:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 09:35:04 ALPL105 kernel: LustreError: 26691:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (-43) req@ffff8102de12e800 x1411574568840756/t0 o49->2b58fd7b-5a02-a7aa-e8cc-f01aa32477cd@NET_0x500000a030542_UUID:0/0 lens 440/0 e 0 to 0 dl 1354239310 ref 1 fl Interpret:/0/0 rc 0/0 Nov 30 09:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 10:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 11:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 12:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 13:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 14:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 15:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 16:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 17:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 18:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 19:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 20:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 21:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 22:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Nov 30 23:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 00:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 01:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 02:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 03:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 04:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 05:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 06:11:36 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Dec 1 06:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 07:24:09 ALPL105 kernel: Lustre: MGS: haven't heard from client 2f7d191f-cf9e-1e34-c1e2-d5786976a003 (at 10.3.6.5@o2ib) in 229 seconds. I think it's dead, and I am evicting it. Dec 1 07:24:09 ALPL105 kernel: Lustre: Skipped 1 previous similar message Dec 1 07:24:09 ALPL105 kernel: Lustre: LFS01-MDT0000: haven't heard from client 3342b48a-1b6d-7b8f-ee7f-280f17357095 (at 10.3.6.46@o2ib) in 213 seconds. I think it's dead, and I am evicting it. Dec 1 07:24:09 ALPL105 kernel: Lustre: Skipped 88 previous similar messages Dec 1 07:25:29 ALPL105 kernel: Lustre: MGS: haven't heard from client 6bf570fa-07c9-cde0-53e0-72a7b4fcfde8 (at 10.3.6.60@o2ib) in 230 seconds. I think it's dead, and I am evicting it. Dec 1 07:25:29 ALPL105 kernel: Lustre: Skipped 40 previous similar messages Dec 1 07:25:33 ALPL105 kernel: Lustre: LFS01-MDT0000: haven't heard from client 5645c59e-251b-4b62-3b93-18b8f1155aa8 (at 10.3.6.60@o2ib) in 234 seconds. I think it's dead, and I am evicting it. Dec 1 07:25:33 ALPL105 kernel: Lustre: Skipped 10 previous similar messages Dec 1 07:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 08:36:42 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 08:49:27 ALPL105 kernel: LustreError: 11-0: an error occurred while communicating with 10.3.1.68@o2ib. The obd_ping operation failed with -107 Dec 1 08:49:27 ALPL105 kernel: Lustre: LFS01-OST0000-osc: Connection to service LFS01-OST0000 via nid 10.3.1.68@o2ib was lost; in progress operations using this service will wait for recovery to complete. Dec 1 08:49:27 ALPL105 kernel: Lustre: Skipped 4 previous similar messages Dec 1 08:49:40 ALPL105 kernel: Lustre: 26501:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1411509784937010 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 6s ago has timed out (6s prior to deadline). Dec 1 08:49:40 ALPL105 kernel: req@ffff81033fe0ec00 x1411509784937010/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354322980 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 08:49:40 ALPL105 kernel: Lustre: 26501:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 9 previous similar messages Dec 1 08:49:41 ALPL105 kernel: Lustre: 26502:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 2s Dec 1 08:49:41 ALPL105 kernel: Lustre: 26502:0:(import.c:517:import_select_connection()) Skipped 4 previous similar messages Dec 1 08:49:44 ALPL105 kernel: Lustre: LFS01-OST000a-osc: Connection to service LFS01-OST000a via nid 10.3.1.70@o2ib was lost; in progress operations using this service will wait for recovery to complete. Dec 1 08:49:44 ALPL105 kernel: Lustre: Skipped 14 previous similar messages Dec 1 08:49:50 ALPL105 kernel: Lustre: 26501:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1411509784937040 sent from LFS01-OST000a-osc to NID 10.3.1.70@o2ib 6s ago has timed out (6s prior to deadline). Dec 1 08:49:50 ALPL105 kernel: req@ffff8102e8fca400 x1411509784937040/t0 o8->LFS01-OST000a_UUID@10.3.1.70@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354322990 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 08:49:50 ALPL105 kernel: Lustre: 26501:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 34 previous similar messages Dec 1 08:49:57 ALPL105 kernel: Lustre: 26502:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 3s Dec 1 08:49:57 ALPL105 kernel: Lustre: 26502:0:(import.c:517:import_select_connection()) Skipped 14 previous similar messages Dec 1 08:50:13 ALPL105 kernel: Lustre: 26501:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1411509784937096 sent from LFS01-OST000a-osc to NID 10.3.1.71@o2ib 7s ago has timed out (7s prior to deadline). Dec 1 08:50:13 ALPL105 kernel: req@ffff8102e8fcac00 x1411509784937096/t0 o8->LFS01-OST000a_UUID@10.3.1.71@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354323013 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 08:50:13 ALPL105 kernel: Lustre: 26501:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 44 previous similar messages Dec 1 08:50:14 ALPL105 kernel: Lustre: 26502:0:(import.c:517:import_select_connection()) LFS01-OST000a-osc: tried all connections, increasing latency to 3s Dec 1 08:50:14 ALPL105 kernel: Lustre: 26502:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 08:50:32 ALPL105 kernel: LustreError: 3499:0:(o2iblnd_cb.c:2534:kiblnd_rejected()) 10.3.1.70@o2ib rejected: o2iblnd fatal error Dec 1 08:50:36 ALPL105 kernel: LustreError: 3499:0:(o2iblnd_cb.c:2534:kiblnd_rejected()) 10.3.1.69@o2ib rejected: o2iblnd fatal error Dec 1 08:50:46 ALPL105 kernel: Lustre: 26501:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1411509784937152 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 10s ago has timed out (10s prior to deadline). Dec 1 08:50:46 ALPL105 kernel: req@ffff8102bff33400 x1411509784937152/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354323046 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 08:50:46 ALPL105 kernel: Lustre: 26501:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 79 previous similar messages Dec 1 08:50:47 ALPL105 kernel: LustreError: 3499:0:(o2iblnd_cb.c:2534:kiblnd_rejected()) 10.3.1.68@o2ib rejected: o2iblnd fatal error Dec 1 08:50:52 ALPL105 kernel: Lustre: 26502:0:(import.c:517:import_select_connection()) LFS01-OST000a-osc: tried all connections, increasing latency to 5s Dec 1 08:50:52 ALPL105 kernel: Lustre: 26502:0:(import.c:517:import_select_connection()) Skipped 39 previous similar messages Dec 1 08:51:51 ALPL105 kernel: Lustre: 26501:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1411509784937290 sent from LFS01-OST000a-osc to NID 10.3.1.71@o2ib 0s ago has failed due to network error (12s prior to deadline). Dec 1 08:51:51 ALPL105 kernel: req@ffff8102ce8d1000 x1411509784937290/t0 o8->LFS01-OST000a_UUID@10.3.1.71@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354323123 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 08:51:51 ALPL105 kernel: Lustre: 26501:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 119 previous similar messages Dec 1 08:52:04 ALPL105 kernel: Lustre: 26502:0:(import.c:517:import_select_connection()) LFS01-OST000a-osc: tried all connections, increasing latency to 8s Dec 1 08:52:04 ALPL105 kernel: Lustre: 26502:0:(import.c:517:import_select_connection()) Skipped 59 previous similar messages Dec 1 08:52:56 ALPL105 kernel: Lustre: Failing over LFS01-MDT0000 Dec 1 08:52:56 ALPL105 kernel: Lustre: Failing over LFS01-OST0013-osc Dec 1 08:52:56 ALPL105 kernel: Lustre: LFS01-MDT0000: shutting down for failover; client state will be preserved. Dec 1 08:52:56 ALPL105 kernel: Lustre: MDT LFS01-MDT0000 has stopped. Dec 1 08:52:56 ALPL105 kernel: LustreError: 17147:0:(ldlm_request.c:1039:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway Dec 1 08:52:56 ALPL105 kernel: LustreError: 17147:0:(ldlm_request.c:1597:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 Dec 1 08:52:56 ALPL105 kernel: Lustre: MGS has stopped. Dec 1 08:52:56 ALPL105 multipathd: dm-0: umount map (uevent) Dec 1 08:52:57 ALPL105 kernel: Lustre: server umount LFS01-MDT0000 complete Dec 1 08:53:24 ALPL105 kernel: Lustre: 17464:0:(o2iblnd.c:2325:kiblnd_shutdown()) 10.3.1.72@o2ib: waiting for 3 peers to disconnect Dec 1 08:53:28 ALPL105 kernel: Lustre: 17464:0:(o2iblnd.c:2325:kiblnd_shutdown()) 10.3.1.72@o2ib: waiting for 2 peers to disconnect Dec 1 08:53:36 ALPL105 kernel: Lustre: 17464:0:(o2iblnd.c:2325:kiblnd_shutdown()) 10.3.1.72@o2ib: waiting for 2 peers to disconnect Dec 1 08:53:40 ALPL105 kernel: Lustre: Removed LNI 10.3.1.72@o2ib Dec 1 08:53:44 ALPL105 shutdown[17630]: shutting down for system halt Dec 1 08:53:46 ALPL105 xinetd[4614]: Exiting... Dec 1 08:53:49 ALPL105 kernel: igb: eth2 NIC Link is Down Dec 1 08:53:50 ALPL105 ntpd[4469]: ntpd exiting on signal 15 Dec 1 08:53:50 ALPL105 rpc.statd[4309]: Caught signal 15, un-registering and exiting. Dec 1 08:53:50 ALPL105 multipathd: MDT: stop event checker thread Dec 1 08:53:50 ALPL105 multipathd: --------shut down------- Dec 1 08:53:50 ALPL105 auditd[4224]: The audit daemon is exiting. Dec 1 08:53:50 ALPL105 kernel: audit(1354323230.772:14954): audit_pid=0 old=4224 by auid=4294967295 Dec 1 08:53:50 ALPL105 kernel: Kernel logging (proc) stopped. Dec 1 08:53:50 ALPL105 kernel: Kernel log daemon terminating. Dec 1 08:53:51 ALPL105 exiting on signal 15 Dec 1 10:39:55 ALPL105 syslogd 1.4.1: restart. Dec 1 10:39:55 ALPL105 kernel: klogd 1.4.1, log source = /proc/kmsg started. Dec 1 10:39:55 ALPL105 kernel: Linux version 2.6.18-308.11.1.el5_lustre.g747d905P1 (root@s25) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-52)) #1 SMP Sat Aug 25 12:22:34 JST 2012 Dec 1 10:39:55 ALPL105 kernel: Command line: ro root=/dev/md1 rhgb quiet Dec 1 10:39:55 ALPL105 kernel: BIOS-provided physical RAM map: Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 0000000000010000 - 0000000000098400 (usable) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 0000000000098400 - 00000000000a0000 (reserved) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 0000000000100000 - 00000000bf780000 (usable) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 00000000bf78e000 - 00000000bf790000 type 9 Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 00000000bf790000 - 00000000bf79e000 (ACPI data) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 00000000bf7d0000 - 00000000bf7e0000 (reserved) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 00000000bf7ec000 - 00000000c0000000 (reserved) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 00000000fed20000 - 00000000fed40000 (reserved) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved) Dec 1 10:39:55 ALPL105 kernel: BIOS-e820: 0000000100000000 - 0000000c40000000 (usable) Dec 1 10:39:55 ALPL105 kernel: DMI present. Dec 1 10:39:55 ALPL105 kernel: SRAT: PXM 0 -> APIC 0 -> Node 0 Dec 1 10:39:55 ALPL105 kernel: SRAT: PXM 0 -> APIC 2 -> Node 0 Dec 1 10:39:55 ALPL105 kernel: SRAT: PXM 0 -> APIC 18 -> Node 0 Dec 1 10:39:55 ALPL105 kernel: SRAT: PXM 0 -> APIC 20 -> Node 0 Dec 1 10:39:55 ALPL105 kernel: SRAT: PXM 1 -> APIC 32 -> Node 1 Dec 1 10:39:55 ALPL105 kernel: SRAT: PXM 1 -> APIC 34 -> Node 1 Dec 1 10:39:55 ALPL105 kernel: SRAT: PXM 1 -> APIC 50 -> Node 1 Dec 1 10:39:55 ALPL105 kernel: SRAT: PXM 1 -> APIC 52 -> Node 1 Dec 1 10:39:55 ALPL105 kernel: SRAT: Node 0 PXM 0 0-a0000 Dec 1 10:39:55 ALPL105 kernel: SRAT: Node 0 PXM 0 0-c0000000 Dec 1 10:39:55 ALPL105 kernel: SRAT: Node 0 PXM 0 0-640000000 Dec 1 10:39:55 ALPL105 kernel: SRAT: Node 1 PXM 1 640000000-c40000000 Dec 1 10:39:55 ALPL105 kernel: Bootmem setup node 0 0000000000000000-0000000640000000 Dec 1 10:39:55 ALPL105 kernel: Bootmem setup node 1 0000000640000000-0000000c40000000 Dec 1 10:39:55 ALPL105 kernel: Memory for crash kernel (0x0 to 0x0) notwithin permissible range Dec 1 10:39:55 ALPL105 kernel: disabling kdump Dec 1 10:39:55 ALPL105 kernel: ACPI: PM-Timer IO Port: 0x808 Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled) Dec 1 10:39:55 ALPL105 kernel: Processor #0 6:12 APIC version 21 Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) Dec 1 10:39:55 ALPL105 kernel: Processor #2 6:12 APIC version 21 Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled) Dec 1 10:39:55 ALPL105 kernel: Processor #18 6:12 APIC version 21 Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x14] enabled) Dec 1 10:39:55 ALPL105 kernel: Processor #20 6:12 APIC version 21 Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id[0x20] enabled) Dec 1 10:39:55 ALPL105 kernel: Processor #32 6:12 APIC version 21 Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x22] enabled) Dec 1 10:39:55 ALPL105 kernel: Processor #34 6:12 APIC version 21 Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id[0x32] enabled) Dec 1 10:39:55 ALPL105 kernel: Processor #50 6:12 APIC version 21 Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x08] lapic_id[0x34] enabled) Dec 1 10:39:55 ALPL105 kernel: Processor #52 6:12 APIC version 21 Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x09] lapic_id[0x88] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x89] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x8a] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x8b] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x8c] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x8d] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x8e] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x10] lapic_id[0x8f] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x11] lapic_id[0x90] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x12] lapic_id[0x91] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x13] lapic_id[0x92] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x14] lapic_id[0x93] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x15] lapic_id[0x94] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x16] lapic_id[0x95] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x17] lapic_id[0x96] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC (acpi_id[0x18] lapic_id[0x97] disabled) Dec 1 10:39:55 ALPL105 kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Dec 1 10:39:55 ALPL105 kernel: ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0]) Dec 1 10:39:55 ALPL105 kernel: IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 Dec 1 10:39:55 ALPL105 kernel: ACPI: IOAPIC (id[0x03] address[0xfec8a000] gsi_base[24]) Dec 1 10:39:55 ALPL105 kernel: IOAPIC[1]: apic_id 3, version 32, address 0xfec8a000, GSI 24-47 Dec 1 10:39:55 ALPL105 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Dec 1 10:39:55 ALPL105 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Dec 1 10:39:55 ALPL105 kernel: Setting APIC routing to physical flat Dec 1 10:39:55 ALPL105 kernel: ACPI: HPET id: 0x8086a301 base: 0xfed00000 Dec 1 10:39:55 ALPL105 kernel: Using ACPI (MADT) for SMP configuration information Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 0000000000098000 - 0000000000099000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 0000000000099000 - 00000000000a0000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000000a0000 - 00000000000e0000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000000e0000 - 0000000000100000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000bf780000 - 00000000bf78e000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000bf78e000 - 00000000bf790000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000bf790000 - 00000000bf79e000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000bf79e000 - 00000000bf7d0000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000bf7d0000 - 00000000bf7e0000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000bf7e0000 - 00000000bf7ec000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000bf7ec000 - 00000000c0000000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000c0000000 - 00000000e0000000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000e0000000 - 00000000f0000000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000f0000000 - 00000000fed20000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000fed20000 - 00000000fed40000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000fed40000 - 00000000fee00000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000fee00000 - 00000000fee01000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000fee01000 - 00000000ffc00000 Dec 1 10:39:55 ALPL105 kernel: Nosave address range: 00000000ffc00000 - 0000000100000000 Dec 1 10:39:55 ALPL105 kernel: Allocating PCI resources starting at c2000000 (gap: c0000000:20000000) Dec 1 10:39:55 ALPL105 kernel: SMP: Allowing 24 CPUs, 16 hotplug CPUs Dec 1 10:39:55 ALPL105 kernel: Built 2 zonelists. Total pages: 12403452 Dec 1 10:39:55 ALPL105 kernel: Kernel command line: ro root=/dev/md1 rhgb quiet Dec 1 10:39:55 ALPL105 kernel: Initializing CPU#0 Dec 1 10:39:55 ALPL105 kernel: PID hash table entries: 4096 (order: 12, 32768 bytes) Dec 1 10:39:55 ALPL105 kernel: Console: colour VGA+ 80x25 Dec 1 10:39:55 ALPL105 kernel: Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes) Dec 1 10:39:55 ALPL105 kernel: Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes) Dec 1 10:39:55 ALPL105 kernel: Checking aperture... Dec 1 10:39:55 ALPL105 kernel: ACPI: DMAR not present Dec 1 10:39:55 ALPL105 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Dec 1 10:39:55 ALPL105 kernel: Placing software IO TLB between 0x707f000 - 0xb07f000 Dec 1 10:39:55 ALPL105 kernel: Memory: 49444924k/51380224k available (2618k kernel code, 877540k reserved, 1671k data, 224k init) Dec 1 10:39:55 ALPL105 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 4800.28 BogoMIPS (lpj=2400141) Dec 1 10:39:55 ALPL105 kernel: Security Framework v1.0.0 initialized Dec 1 10:39:55 ALPL105 kernel: SELinux: Initializing. Dec 1 10:39:55 ALPL105 kernel: selinux_register_security: Registering secondary module capability Dec 1 10:39:55 ALPL105 kernel: Capability LSM initialized as secondary Dec 1 10:39:55 ALPL105 kernel: Mount-cache hash table entries: 256 Dec 1 10:39:55 ALPL105 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Dec 1 10:39:55 ALPL105 kernel: CPU: L2 cache: 256K Dec 1 10:39:55 ALPL105 kernel: CPU: L3 cache: 12288K Dec 1 10:39:55 ALPL105 kernel: CPU 0/0 -> Node 0 Dec 1 10:39:55 ALPL105 kernel: using mwait in idle threads. Dec 1 10:39:55 ALPL105 kernel: CPU: Physical Processor ID: 0 Dec 1 10:39:55 ALPL105 kernel: CPU: Processor Core ID: 0 Dec 1 10:39:55 ALPL105 kernel: MCE: Machine Check Exception Reporting is disabled. Dec 1 10:39:55 ALPL105 kernel: SMP alternatives: switching to UP code Dec 1 10:39:55 ALPL105 kernel: ACPI: Core revision 20060707 Dec 1 10:39:55 ALPL105 kernel: Using local APIC timer interrupts. Dec 1 10:39:55 ALPL105 kernel: Detected 8.333 MHz APIC timer. Dec 1 10:39:55 ALPL105 kernel: SMP alternatives: switching to SMP code Dec 1 10:39:55 ALPL105 kernel: Booting processor 1/8 APIC 0x2 Dec 1 10:39:55 ALPL105 kernel: Initializing CPU#1 Dec 1 10:39:55 ALPL105 kernel: Calibrating delay using timer specific routine.. 4800.06 BogoMIPS (lpj=2400034) Dec 1 10:39:55 ALPL105 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Dec 1 10:39:55 ALPL105 kernel: CPU: L2 cache: 256K Dec 1 10:39:55 ALPL105 kernel: CPU: L3 cache: 12288K Dec 1 10:39:55 ALPL105 kernel: CPU 1/2 -> Node 0 Dec 1 10:39:55 ALPL105 kernel: CPU: Physical Processor ID: 0 Dec 1 10:39:55 ALPL105 kernel: CPU: Processor Core ID: 1 Dec 1 10:39:55 ALPL105 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Dec 1 10:39:55 ALPL105 kernel: SMP alternatives: switching to SMP code Dec 1 10:39:55 ALPL105 kernel: Booting processor 2/8 APIC 0x12 Dec 1 10:39:55 ALPL105 kernel: Initializing CPU#2 Dec 1 10:39:55 ALPL105 kernel: Calibrating delay using timer specific routine.. 4800.34 BogoMIPS (lpj=2400174) Dec 1 10:39:55 ALPL105 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Dec 1 10:39:55 ALPL105 kernel: CPU: L2 cache: 256K Dec 1 10:39:55 ALPL105 kernel: CPU: L3 cache: 12288K Dec 1 10:39:55 ALPL105 kernel: CPU 2/12 -> Node 0 Dec 1 10:39:55 ALPL105 kernel: CPU: Physical Processor ID: 0 Dec 1 10:39:55 ALPL105 kernel: CPU: Processor Core ID: 9 Dec 1 10:39:55 ALPL105 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Dec 1 10:39:55 ALPL105 kernel: SMP alternatives: switching to SMP code Dec 1 10:39:55 ALPL105 kernel: Booting processor 3/8 APIC 0x14 Dec 1 10:39:55 ALPL105 kernel: Initializing CPU#3 Dec 1 10:39:55 ALPL105 kernel: Calibrating delay using timer specific routine.. 4800.07 BogoMIPS (lpj=2400038) Dec 1 10:39:55 ALPL105 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Dec 1 10:39:55 ALPL105 kernel: CPU: L2 cache: 256K Dec 1 10:39:55 ALPL105 kernel: CPU: L3 cache: 12288K Dec 1 10:39:55 ALPL105 kernel: CPU 3/14 -> Node 0 Dec 1 10:39:55 ALPL105 kernel: CPU: Physical Processor ID: 0 Dec 1 10:39:55 ALPL105 kernel: CPU: Processor Core ID: 10 Dec 1 10:39:55 ALPL105 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Dec 1 10:39:55 ALPL105 kernel: SMP alternatives: switching to SMP code Dec 1 10:39:55 ALPL105 kernel: Booting processor 4/8 APIC 0x20 Dec 1 10:39:55 ALPL105 kernel: Initializing CPU#4 Dec 1 10:39:55 ALPL105 kernel: Calibrating delay using timer specific routine.. 4800.11 BogoMIPS (lpj=2400056) Dec 1 10:39:55 ALPL105 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Dec 1 10:39:55 ALPL105 kernel: CPU: L2 cache: 256K Dec 1 10:39:55 ALPL105 kernel: CPU: L3 cache: 12288K Dec 1 10:39:55 ALPL105 kernel: CPU 4/20 -> Node 1 Dec 1 10:39:55 ALPL105 kernel: CPU: Physical Processor ID: 1 Dec 1 10:39:55 ALPL105 kernel: CPU: Processor Core ID: 0 Dec 1 10:39:55 ALPL105 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Dec 1 10:39:55 ALPL105 kernel: SMP alternatives: switching to SMP code Dec 1 10:39:55 ALPL105 kernel: Booting processor 5/8 APIC 0x22 Dec 1 10:39:55 ALPL105 kernel: Initializing CPU#5 Dec 1 10:39:55 ALPL105 kernel: Calibrating delay using timer specific routine.. 4800.24 BogoMIPS (lpj=2400124) Dec 1 10:39:55 ALPL105 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Dec 1 10:39:55 ALPL105 kernel: CPU: L2 cache: 256K Dec 1 10:39:55 ALPL105 kernel: CPU: L3 cache: 12288K Dec 1 10:39:55 ALPL105 kernel: CPU 5/22 -> Node 1 Dec 1 10:39:55 ALPL105 kernel: CPU: Physical Processor ID: 1 Dec 1 10:39:55 ALPL105 kernel: CPU: Processor Core ID: 1 Dec 1 10:39:55 ALPL105 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Dec 1 10:39:55 ALPL105 kernel: SMP alternatives: switching to SMP code Dec 1 10:39:55 ALPL105 kernel: Booting processor 6/8 APIC 0x32 Dec 1 10:39:55 ALPL105 kernel: Initializing CPU#6 Dec 1 10:39:55 ALPL105 kernel: Calibrating delay using timer specific routine.. 4800.25 BogoMIPS (lpj=2400126) Dec 1 10:39:55 ALPL105 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Dec 1 10:39:55 ALPL105 kernel: CPU: L2 cache: 256K Dec 1 10:39:55 ALPL105 kernel: CPU: L3 cache: 12288K Dec 1 10:39:55 ALPL105 kernel: CPU 6/32 -> Node 1 Dec 1 10:39:55 ALPL105 kernel: CPU: Physical Processor ID: 1 Dec 1 10:39:55 ALPL105 rpc.statd[4469]: Version 1.0.9 Starting Dec 1 10:39:55 ALPL105 kernel: CPU: Processor Core ID: 9 Dec 1 10:39:55 ALPL105 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Dec 1 10:39:55 ALPL105 kernel: SMP alternatives: switching to SMP code Dec 1 10:39:55 ALPL105 kernel: Booting processor 7/8 APIC 0x34 Dec 1 10:39:55 ALPL105 kernel: Initializing CPU#7 Dec 1 10:39:55 ALPL105 kernel: Calibrating delay using timer specific routine.. 4800.11 BogoMIPS (lpj=2400056) Dec 1 10:39:55 ALPL105 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Dec 1 10:39:55 ALPL105 kernel: CPU: L2 cache: 256K Dec 1 10:39:55 ALPL105 kernel: CPU: L3 cache: 12288K Dec 1 10:39:55 ALPL105 kernel: CPU 7/34 -> Node 1 Dec 1 10:39:55 ALPL105 kernel: CPU: Physical Processor ID: 1 Dec 1 10:39:55 ALPL105 kernel: CPU: Processor Core ID: 10 Dec 1 10:39:55 ALPL105 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Dec 1 10:39:55 ALPL105 kernel: Brought up 8 CPUs Dec 1 10:39:55 ALPL105 rpc.statd[4469]: statd running as root. chown /var/lib/nfs/statd/sm to choose different user Dec 1 10:39:55 ALPL105 kernel: NMI watchdog testing PASSED. Dec 1 10:39:55 ALPL105 kernel: time.c: Using 14.318180 MHz WALL HPET GTOD HPET/TSC timer. Dec 1 10:39:55 ALPL105 kernel: time.c: Detected 2400.141 MHz processor. Dec 1 10:39:55 ALPL105 kernel: migration_cost=18,1435 Dec 1 10:39:55 ALPL105 kernel: checking if image is initramfs... it is Dec 1 10:39:55 ALPL105 kernel: Freeing initrd memory: 3285k freed Dec 1 10:39:55 ALPL105 kernel: NET: Registered protocol family 16 Dec 1 10:39:55 ALPL105 kernel: ACPI: bus type pci registered Dec 1 10:39:55 ALPL105 kernel: PCI: Using MMCONFIG at e0000000 Dec 1 10:39:55 ALPL105 kernel: ACPI: Interpreter enabled Dec 1 10:39:55 ALPL105 kernel: ACPI: Using IOAPIC for interrupt routing Dec 1 10:39:55 ALPL105 kernel: ACPI: No dock devices found. Dec 1 10:39:55 ALPL105 kernel: ACPI: PCI Root Bridge [PCI0] (0000:00) Dec 1 10:39:55 ALPL105 kernel: PCI: Transparent bridge - 0000:00:1e.0 Dec 1 10:39:55 ALPL105 kernel: bus 0 -> pxm 0 -> node 0 Dec 1 10:39:55 ALPL105 kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 6 7 *10 11 12 14 15) Dec 1 10:39:55 ALPL105 kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 6 7 10 11 12 14 *15) Dec 1 10:39:55 ALPL105 kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 6 7 10 *11 12 14 15) Dec 1 10:39:55 ALPL105 kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 6 7 10 11 12 *14 15) Dec 1 10:39:55 ALPL105 kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 6 7 10 11 12 14 15) *0, disabled. Dec 1 10:39:55 ALPL105 kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 6 *7 10 11 12 14 15) Dec 1 10:39:55 ALPL105 kernel: ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 6 7 10 11 12 14 15) *0, disabled. Dec 1 10:39:55 ALPL105 kernel: ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 *6 7 10 11 12 14 15) Dec 1 10:39:55 ALPL105 kernel: Linux Plug and Play Support v0.97 (c) Adam Belay Dec 1 10:39:55 ALPL105 kernel: pnp: PnP ACPI init Dec 1 10:39:55 ALPL105 kernel: pnp: PnP ACPI: found 14 devices Dec 1 10:39:55 ALPL105 kernel: usbcore: registered new driver usbfs Dec 1 10:39:55 ALPL105 kernel: usbcore: registered new driver hub Dec 1 10:39:55 ALPL105 kernel: PCI: Using ACPI for IRQ routing Dec 1 10:39:55 ALPL105 kernel: PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report Dec 1 10:39:55 ALPL105 kernel: NetLabel: Initializing Dec 1 10:39:55 ALPL105 kernel: NetLabel: domain hash size = 128 Dec 1 10:39:55 ALPL105 kernel: NetLabel: protocols = UNLABELED CIPSOv4 Dec 1 10:39:55 ALPL105 kernel: NetLabel: unlabeled traffic allowed by default Dec 1 10:39:55 ALPL105 kernel: hpet0: at MMIO 0xfed00000 (virtual 0xffffffffff5fe000), IRQs 2, 8, 0, 0 Dec 1 10:39:55 ALPL105 kernel: hpet0: 4 64-bit timers, 14318180 Hz Dec 1 10:39:55 ALPL105 kernel: ACPI: DMAR not present Dec 1 10:39:55 ALPL105 kernel: PCI-GART: No AMD northbridge found. Dec 1 10:39:55 ALPL105 kernel: pnp: 00:01: iomem range 0xfed1c000-0xfed1ffff has been reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:06: ioport range 0xa10-0xa1f has been reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:07: iomem range 0x400-0x4ff has been reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:07: iomem range 0xfed1c000-0xfed1ffff has been reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:07: iomem range 0xfed20000-0xfed3ffff has been reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:07: iomem range 0xfed40000-0xfed8ffff has been reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:09: iomem range 0xfec00000-0xfec00fff has been reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:09: iomem range 0xfee00000-0xfee00fff has been reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:0c: iomem range 0xe0000000-0xefffffff has been reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:0d: iomem range 0xc0000-0xcffff could not be reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:0d: iomem range 0xe0000-0xfffff could not be reserved Dec 1 10:39:55 ALPL105 kernel: pnp: 00:0d: iomem range 0xfed90000-0xffffffff could not be reserved Dec 1 10:39:55 ALPL105 kernel: PCI: Bridge: 0000:00:01.0 Dec 1 10:39:55 ALPL105 kernel: IO window: disabled. Dec 1 10:39:55 ALPL105 kernel: MEM window: disabled. Dec 1 10:39:55 ALPL105 kernel: PREFETCH window: disabled. Dec 1 10:39:55 ALPL105 kernel: PCI: Bridge: 0000:00:03.0 Dec 1 10:39:55 ALPL105 kernel: IO window: disabled. Dec 1 10:39:55 ALPL105 kernel: MEM window: f9f00000-fa3fffff Dec 1 10:39:55 ALPL105 kernel: PREFETCH window: disabled. Dec 1 10:39:55 ALPL105 kernel: PCI: Bridge: 0000:00:05.0 Dec 1 10:39:56 ALPL105 kernel: IO window: disabled. Dec 1 10:39:56 ALPL105 kernel: MEM window: disabled. Dec 1 10:39:56 ALPL105 kernel: PREFETCH window: disabled. Dec 1 10:39:56 ALPL105 kernel: PCI: Bridge: 0000:00:07.0 Dec 1 10:39:56 ALPL105 kernel: IO window: c000-cfff Dec 1 10:39:56 ALPL105 kernel: MEM window: fa700000-fabfffff Dec 1 10:39:56 ALPL105 kernel: PREFETCH window: disabled. Dec 1 10:39:56 ALPL105 kernel: PCI: Bridge: 0000:00:1c.0 Dec 1 10:39:56 ALPL105 kernel: IO window: e000-efff Dec 1 10:39:56 ALPL105 kernel: MEM window: fae00000-faffffff Dec 1 10:39:56 ALPL105 kernel: PREFETCH window: disabled. Dec 1 10:39:56 ALPL105 kernel: PCI: Bridge: 0000:00:1c.4 Dec 1 10:39:56 ALPL105 kernel: IO window: d000-dfff Dec 1 10:39:56 ALPL105 kernel: MEM window: fac00000-fadfffff Dec 1 10:39:56 ALPL105 kernel: PREFETCH window: disabled. Dec 1 10:39:56 ALPL105 kernel: PCI: Bridge: 0000:00:1e.0 Dec 1 10:39:56 ALPL105 kernel: IO window: disabled. Dec 1 10:39:56 ALPL105 kernel: MEM window: fb000000-fbefffff Dec 1 10:39:56 ALPL105 kernel: PREFETCH window 0x00000000f8000000-0x00000000f8ffffff Dec 1 10:39:56 ALPL105 kernel: GSI 16 sharing vector 0xA9 and IRQ 16 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 16 (level, low) -> IRQ 169 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1c.4[A] -> GSI 16 (level, low) -> IRQ 169 Dec 1 10:39:56 ALPL105 kernel: NET: Registered protocol family 2 Dec 1 10:39:56 ALPL105 kernel: IP route cache hash table entries: 524288 (order: 10, 4194304 bytes) Dec 1 10:39:56 ALPL105 kernel: TCP established hash table entries: 262144 (order: 10, 4194304 bytes) Dec 1 10:39:56 ALPL105 kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) Dec 1 10:39:56 ALPL105 kernel: TCP: Hash tables configured (established 262144 bind 65536) Dec 1 10:39:56 ALPL105 kernel: TCP reno registered Dec 1 10:39:56 ALPL105 kernel: audit: initializing netlink socket (disabled) Dec 1 10:39:56 ALPL105 kernel: type=2000 audit(1354358328.884:1): initialized Dec 1 10:39:56 ALPL105 kernel: Total HugeTLB memory allocated, 0 Dec 1 10:39:56 ALPL105 kernel: VFS: Disk quotas dquot_6.5.1 Dec 1 10:39:56 ALPL105 kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Dec 1 10:39:56 ALPL105 kernel: Initializing Cryptographic API Dec 1 10:39:56 ALPL105 kernel: alg: No test for crc32c (crc32c-generic) Dec 1 10:39:56 ALPL105 kernel: ksign: Installing public key data Dec 1 10:39:56 ALPL105 kernel: Loading keyring Dec 1 10:39:56 ALPL105 kernel: io scheduler noop registered Dec 1 10:39:56 ALPL105 kernel: io scheduler anticipatory registered Dec 1 10:39:56 ALPL105 kernel: io scheduler deadline registered (default) Dec 1 10:39:56 ALPL105 kernel: io scheduler cfq registered Dec 1 10:39:56 ALPL105 kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5 Dec 1 10:39:56 ALPL105 kernel: ACPI (exconfig-0456): Dynamic SSDT Load - OemId [DpgPmm] OemTableId [ P001Ist] [20060707] Dec 1 10:39:56 ALPL105 kernel: Real Time Clock Driver v1.12ac Dec 1 10:39:56 ALPL105 kernel: Non-volatile memory driver v1.2 Dec 1 10:39:56 ALPL105 kernel: Linux agpgart interface v0.101 (c) Dave Jones Dec 1 10:39:56 ALPL105 kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled Dec 1 10:39:56 ALPL105 kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A Dec 1 10:39:56 ALPL105 kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Dec 1 10:39:56 ALPL105 kernel: 00:0a: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A Dec 1 10:39:56 ALPL105 kernel: 00:0b: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Dec 1 10:39:56 ALPL105 kernel: brd: module loaded Dec 1 10:39:56 ALPL105 kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2 Dec 1 10:39:56 ALPL105 kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx Dec 1 10:39:56 ALPL105 kernel: ide-floppy driver 0.99.newide Dec 1 10:39:56 ALPL105 kernel: usbcore: registered new driver hiddev Dec 1 10:39:56 ALPL105 kernel: usbcore: registered new driver usbhid Dec 1 10:39:56 ALPL105 kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driver Dec 1 10:39:56 ALPL105 kernel: PNP: No PS/2 controller found. Probing ports directly. Dec 1 10:39:56 ALPL105 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 Dec 1 10:39:56 ALPL105 kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 Dec 1 10:39:56 ALPL105 kernel: mice: PS/2 mouse device common for all mice Dec 1 10:39:56 ALPL105 kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27 Dec 1 10:39:56 ALPL105 kernel: md: bitmap version 4.39 Dec 1 10:39:56 ALPL105 kernel: TCP bic registered Dec 1 10:39:56 ALPL105 kernel: Initializing IPsec netlink socket Dec 1 10:39:56 ALPL105 kernel: NET: Registered protocol family 1 Dec 1 10:39:56 ALPL105 kernel: NET: Registered protocol family 17 Dec 1 10:39:56 ALPL105 kernel: ACPI: (supports S0 S1 S4 S5) Dec 1 10:39:56 ALPL105 kernel: Initalizing network drop monitor service Dec 1 10:39:56 ALPL105 kernel: Freeing unused kernel memory: 224k freed Dec 1 10:39:56 ALPL105 kernel: Write protecting the kernel read-only data: 531k Dec 1 10:39:56 ALPL105 kernel: GSI 17 sharing vector 0xE9 and IRQ 17 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1a.7[C] -> GSI 18 (level, low) -> IRQ 233 Dec 1 10:39:56 ALPL105 kernel: ehci_hcd 0000:00:1a.7: EHCI Host Controller Dec 1 10:39:56 ALPL105 kernel: ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 1 Dec 1 10:39:56 ALPL105 kernel: ehci_hcd 0000:00:1a.7: debug port 1 Dec 1 10:39:56 ALPL105 kernel: ehci_hcd 0000:00:1a.7: irq 233, io mem 0xfa6de000 Dec 1 10:39:56 ALPL105 kernel: ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004 Dec 1 10:39:56 ALPL105 kernel: usb usb1: configuration #1 chosen from 1 choice Dec 1 10:39:56 ALPL105 kernel: hub 1-0:1.0: USB hub found Dec 1 10:39:56 ALPL105 kernel: hub 1-0:1.0: 6 ports detected Dec 1 10:39:56 ALPL105 kernel: GSI 18 sharing vector 0x32 and IRQ 18 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 23 (level, low) -> IRQ 50 Dec 1 10:39:56 ALPL105 kernel: ehci_hcd 0000:00:1d.7: EHCI Host Controller Dec 1 10:39:56 ALPL105 kernel: ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 2 Dec 1 10:39:56 ALPL105 kernel: ehci_hcd 0000:00:1d.7: debug port 1 Dec 1 10:39:56 ALPL105 kernel: ehci_hcd 0000:00:1d.7: irq 50, io mem 0xfa6dc000 Dec 1 10:39:56 ALPL105 kernel: ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004 Dec 1 10:39:56 ALPL105 kernel: usb usb2: configuration #1 chosen from 1 choice Dec 1 10:39:56 ALPL105 kernel: hub 2-0:1.0: USB hub found Dec 1 10:39:56 ALPL105 kernel: hub 2-0:1.0: 6 ports detected Dec 1 10:39:56 ALPL105 kernel: USB Universal Host Controller Interface driver v3.0 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1a.0[A] -> GSI 16 (level, low) -> IRQ 169 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1a.0: UHCI Host Controller Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1a.0: irq 169, io base 0x0000bc00 Dec 1 10:39:56 ALPL105 kernel: usb usb3: configuration #1 chosen from 1 choice Dec 1 10:39:56 ALPL105 kernel: hub 3-0:1.0: USB hub found Dec 1 10:39:56 ALPL105 kernel: hub 3-0:1.0: 2 ports detected Dec 1 10:39:56 ALPL105 kernel: GSI 19 sharing vector 0x3A and IRQ 19 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1a.1[B] -> GSI 21 (level, low) -> IRQ 58 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1a.1: UHCI Host Controller Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1a.1: irq 58, io base 0x0000b880 Dec 1 10:39:56 ALPL105 kernel: usb usb4: configuration #1 chosen from 1 choice Dec 1 10:39:56 ALPL105 kernel: hub 4-0:1.0: USB hub found Dec 1 10:39:56 ALPL105 kernel: hub 4-0:1.0: 2 ports detected Dec 1 10:39:56 ALPL105 kernel: GSI 20 sharing vector 0x42 and IRQ 20 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1a.2[D] -> GSI 19 (level, low) -> IRQ 66 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1a.2: UHCI Host Controller Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1a.2: new USB bus registered, assigned bus number 5 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1a.2: irq 66, io base 0x0000b800 Dec 1 10:39:56 ALPL105 kernel: usb usb5: configuration #1 chosen from 1 choice Dec 1 10:39:56 ALPL105 kernel: hub 5-0:1.0: USB hub found Dec 1 10:39:56 ALPL105 kernel: hub 5-0:1.0: 2 ports detected Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 23 (level, low) -> IRQ 50 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1d.0: UHCI Host Controller Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 6 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1d.0: irq 50, io base 0x0000b480 Dec 1 10:39:56 ALPL105 kernel: usb usb6: configuration #1 chosen from 1 choice Dec 1 10:39:56 ALPL105 kernel: hub 6-0:1.0: USB hub found Dec 1 10:39:56 ALPL105 kernel: hub 6-0:1.0: 2 ports detected Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 66 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1d.1: UHCI Host Controller Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 7 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1d.1: irq 66, io base 0x0000b400 Dec 1 10:39:56 ALPL105 kernel: usb usb7: configuration #1 chosen from 1 choice Dec 1 10:39:56 ALPL105 kernel: hub 7-0:1.0: USB hub found Dec 1 10:39:56 ALPL105 kernel: hub 7-0:1.0: 2 ports detected Dec 1 10:39:56 ALPL105 kernel: usb 4-1: new full speed USB device using uhci_hcd and address 2 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 233 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1d.2: UHCI Host Controller Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 8 Dec 1 10:39:56 ALPL105 kernel: uhci_hcd 0000:00:1d.2: irq 233, io base 0x0000b080 Dec 1 10:39:56 ALPL105 kernel: usb usb8: configuration #1 chosen from 1 choice Dec 1 10:39:56 ALPL105 kernel: hub 8-0:1.0: USB hub found Dec 1 10:39:56 ALPL105 kernel: hub 8-0:1.0: 2 ports detected Dec 1 10:39:56 ALPL105 kernel: usb 4-1: configuration #1 chosen from 1 choice Dec 1 10:39:56 ALPL105 kernel: input: Winbond Electronics Corp Hermon USB hidmouse Device as /class/input/input0 Dec 1 10:39:56 ALPL105 kernel: input,hidraw0: USB HID v1.00 Mouse [Winbond Electronics Corp Hermon USB hidmouse Device] on usb-0000:00:1a.1-1 Dec 1 10:39:56 ALPL105 kernel: input: Winbond Electronics Corp Hermon USB hidmouse Device as /class/input/input1 Dec 1 10:39:56 ALPL105 kernel: input,hidraw0: USB HID v1.00 Keyboard [Winbond Electronics Corp Hermon USB hidmouse Device] on usb-0000:00:1a.1-1 Dec 1 10:39:56 ALPL105 kernel: md: raid1 personality registered for level 1 Dec 1 10:39:56 ALPL105 kernel: SCSI subsystem initialized Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1f.2[B] -> GSI 19 (level, low) -> IRQ 66 Dec 1 10:39:56 ALPL105 kernel: ahci 0000:00:1f.2: AHCI 0001.0200 32 slots 6 ports 3 Gbps 0x3f impl SATA mode Dec 1 10:39:56 ALPL105 kernel: ahci 0000:00:1f.2: flags: 64bit ncq sntf stag pm led clo pio slum part ems Dec 1 10:39:56 ALPL105 kernel: scsi0 : ahci Dec 1 10:39:56 ALPL105 kernel: scsi1 : ahci Dec 1 10:39:56 ALPL105 kernel: scsi2 : ahci Dec 1 10:39:56 ALPL105 kernel: scsi3 : ahci Dec 1 10:39:56 ALPL105 kernel: scsi4 : ahci Dec 1 10:39:56 ALPL105 kernel: scsi5 : ahci Dec 1 10:39:56 ALPL105 kernel: ata1: SATA max UDMA/133 abar m2048@0xfa6da000 port 0xfa6da100 irq 74 Dec 1 10:39:56 ALPL105 kernel: ata2: SATA max UDMA/133 abar m2048@0xfa6da000 port 0xfa6da180 irq 74 Dec 1 10:39:56 ALPL105 kernel: ata3: SATA max UDMA/133 abar m2048@0xfa6da000 port 0xfa6da200 irq 74 Dec 1 10:39:56 ALPL105 kernel: ata4: SATA max UDMA/133 abar m2048@0xfa6da000 port 0xfa6da280 irq 74 Dec 1 10:39:56 ALPL105 kernel: ata5: SATA max UDMA/133 abar m2048@0xfa6da000 port 0xfa6da300 irq 74 Dec 1 10:39:56 ALPL105 kernel: ata6: SATA max UDMA/133 abar m2048@0xfa6da000 port 0xfa6da380 irq 74 Dec 1 10:39:56 ALPL105 kernel: ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300) Dec 1 10:39:56 ALPL105 kernel: ata1.00: ATA-8: ST9500530NS, SN04, max UDMA/133 Dec 1 10:39:56 ALPL105 kernel: ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) Dec 1 10:39:56 ALPL105 kernel: ata1.00: configured for UDMA/133 Dec 1 10:39:56 ALPL105 kernel: ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300) Dec 1 10:39:56 ALPL105 kernel: ata2.00: ATA-8: ST9500530NS, SN04, max UDMA/133 Dec 1 10:39:56 ALPL105 kernel: ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) Dec 1 10:39:56 ALPL105 kernel: ata2.00: configured for UDMA/133 Dec 1 10:39:56 ALPL105 kernel: ata3: SATA link down (SStatus 0 SControl 300) Dec 1 10:39:56 ALPL105 kernel: ata4: SATA link down (SStatus 0 SControl 300) Dec 1 10:39:56 ALPL105 kernel: ata5: SATA link down (SStatus 0 SControl 300) Dec 1 10:39:56 ALPL105 kernel: ata6: SATA link down (SStatus 0 SControl 300) Dec 1 10:39:56 ALPL105 kernel: Vendor: ATA Model: ST9500530NS Rev: SN04 Dec 1 10:39:56 ALPL105 kernel: Type: Direct-Access ANSI SCSI revision: 05 Dec 1 10:39:56 ALPL105 kernel: SCSI device sda: 976773168 512-byte hdwr sectors (500108 MB) Dec 1 10:39:56 ALPL105 kernel: sda: Write Protect is off Dec 1 10:39:56 ALPL105 kernel: SCSI device sda: drive cache: write back Dec 1 10:39:56 ALPL105 kernel: SCSI device sda: 976773168 512-byte hdwr sectors (500108 MB) Dec 1 10:39:56 ALPL105 kernel: sda: Write Protect is off Dec 1 10:39:56 ALPL105 kernel: SCSI device sda: drive cache: write back Dec 1 10:39:56 ALPL105 kernel: sda: sda1 sda2 sda3 Dec 1 10:39:56 ALPL105 kernel: sd 0:0:0:0: Attached scsi disk sda Dec 1 10:39:56 ALPL105 kernel: Vendor: ATA Model: ST9500530NS Rev: SN04 Dec 1 10:39:56 ALPL105 kernel: Type: Direct-Access ANSI SCSI revision: 05 Dec 1 10:39:56 ALPL105 kernel: SCSI device sdb: 976773168 512-byte hdwr sectors (500108 MB) Dec 1 10:39:56 ALPL105 kernel: sdb: Write Protect is off Dec 1 10:39:56 ALPL105 kernel: SCSI device sdb: drive cache: write back Dec 1 10:39:56 ALPL105 kernel: SCSI device sdb: 976773168 512-byte hdwr sectors (500108 MB) Dec 1 10:39:56 ALPL105 kernel: sdb: Write Protect is off Dec 1 10:39:56 ALPL105 kernel: SCSI device sdb: drive cache: write back Dec 1 10:39:56 ALPL105 kernel: sdb: sdb1 sdb2 sdb3 Dec 1 10:39:56 ALPL105 kernel: sd 1:0:0:0: Attached scsi disk sdb Dec 1 10:39:56 ALPL105 kernel: QLogic Fibre Channel HBA Driver Dec 1 10:39:56 ALPL105 kernel: GSI 21 sharing vector 0x52 and IRQ 21 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:04:00.0[A] -> GSI 30 (level, low) -> IRQ 82 Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.0: Found an ISP2532, irq 82, iobase 0xffffc2000007a000 Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.0: Configuring PCI space... Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.0: Configure NVRAM parameters... Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.0: Verifying loaded RISC code... Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.0: Allocated (64 KB) for EFT... Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.0: Allocated (1414 KB) for firmware dump... Dec 1 10:39:56 ALPL105 kernel: scsi6 : qla2xxx Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.0: Dec 1 10:39:56 ALPL105 kernel: QLogic Fibre Channel HBA Driver: 8.03.07.09.05.08-k Dec 1 10:39:56 ALPL105 kernel: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA Dec 1 10:39:56 ALPL105 kernel: ISP2532: PCIe (5.0Gb/s x4) @ 0000:04:00.0 hdma+, host#=6, fw=5.06.03 (90d5) Dec 1 10:39:56 ALPL105 kernel: GSI 22 sharing vector 0x6A and IRQ 22 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:04:00.1[B] -> GSI 37 (level, low) -> IRQ 106 Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.1: Found an ISP2532, irq 106, iobase 0xffffc2000007e000 Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.1: Configuring PCI space... Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.1: Configure NVRAM parameters... Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.1: Verifying loaded RISC code... Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.1: Allocated (64 KB) for EFT... Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.1: Allocated (1414 KB) for firmware dump... Dec 1 10:39:56 ALPL105 kernel: scsi7 : qla2xxx Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.1: Dec 1 10:39:56 ALPL105 kernel: QLogic Fibre Channel HBA Driver: 8.03.07.09.05.08-k Dec 1 10:39:56 ALPL105 kernel: QLogic QLE2562 - PCI-Express Dual Channel 8Gb Fibre Channel HBA Dec 1 10:39:56 ALPL105 kernel: ISP2532: PCIe (5.0Gb/s x4) @ 0000:04:00.1 hdma+, host#=7, fw=5.06.03 (90d5) Dec 1 10:39:56 ALPL105 kernel: Initializing USB Mass Storage driver... Dec 1 10:39:56 ALPL105 kernel: usbcore: registered new driver usb-storage Dec 1 10:39:56 ALPL105 kernel: USB Mass Storage support registered. Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.0: LIP reset occured (f8f7). Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.0: LIP occured (f8f7). Dec 1 10:39:56 ALPL105 kernel: qla2xxx 0000:04:00.0: LOOP UP detected (8 Gbps). Dec 1 10:39:56 ALPL105 kernel: Vendor: DotHill Model: DH3000 Rev: T201 Dec 1 10:39:56 ALPL105 kernel: Type: Direct-Access ANSI SCSI revision: 05 Dec 1 10:39:56 ALPL105 kernel: SCSI device sdc: 498046848 512-byte hdwr sectors (255000 MB) Dec 1 10:39:56 ALPL105 kernel: sdc: Write Protect is off Dec 1 10:39:56 ALPL105 kernel: SCSI device sdc: drive cache: write back Dec 1 10:39:56 ALPL105 kernel: SCSI device sdc: 498046848 512-byte hdwr sectors (255000 MB) Dec 1 10:39:56 ALPL105 kernel: sdc: Write Protect is off Dec 1 10:39:56 ALPL105 kernel: SCSI device sdc: drive cache: write back Dec 1 10:39:56 ALPL105 kernel: sdc: unknown partition table Dec 1 10:39:56 ALPL105 kernel: sd 6:0:0:0: Attached scsi disk sdc Dec 1 10:39:56 ALPL105 kernel: device-mapper: uevent: version 1.0.3 Dec 1 10:39:56 ALPL105 kernel: device-mapper: ioctl: 4.11.6-ioctl (2011-02-18) initialised: dm-devel@redhat.com Dec 1 10:39:56 ALPL105 kernel: device-mapper: dm-raid45: initialized v0.2594l Dec 1 10:39:56 ALPL105 kernel: md: Autodetecting RAID arrays. Dec 1 10:39:56 ALPL105 kernel: md: autorun ... Dec 1 10:39:56 ALPL105 kernel: md: considering sdb3 ... Dec 1 10:39:56 ALPL105 kernel: md: adding sdb3 ... Dec 1 10:39:56 ALPL105 kernel: md: sdb2 has different UUID to sdb3 Dec 1 10:39:56 ALPL105 kernel: md: sdb1 has different UUID to sdb3 Dec 1 10:39:56 ALPL105 kernel: md: adding sda3 ... Dec 1 10:39:56 ALPL105 kernel: md: sda2 has different UUID to sdb3 Dec 1 10:39:56 ALPL105 kernel: md: sda1 has different UUID to sdb3 Dec 1 10:39:56 ALPL105 kernel: md: created md2 Dec 1 10:39:56 ALPL105 kernel: md: bind Dec 1 10:39:56 ALPL105 kernel: md: bind Dec 1 10:39:56 ALPL105 kernel: md: running: Dec 1 10:39:56 ALPL105 kernel: raid1: raid set md2 active with 2 out of 2 mirrors Dec 1 10:39:56 ALPL105 kernel: md: considering sdb2 ... Dec 1 10:39:56 ALPL105 kernel: md: adding sdb2 ... Dec 1 10:39:56 ALPL105 kernel: md: sdb1 has different UUID to sdb2 Dec 1 10:39:56 ALPL105 kernel: md: adding sda2 ... Dec 1 10:39:56 ALPL105 kernel: md: sda1 has different UUID to sdb2 Dec 1 10:39:56 ALPL105 kernel: md: created md1 Dec 1 10:39:56 ALPL105 kernel: md: bind Dec 1 10:39:56 ALPL105 kernel: md: bind Dec 1 10:39:56 ALPL105 kernel: md: running: Dec 1 10:39:56 ALPL105 kernel: raid1: raid set md1 active with 2 out of 2 mirrors Dec 1 10:39:56 ALPL105 kernel: md: considering sdb1 ... Dec 1 10:39:56 ALPL105 kernel: md: adding sdb1 ... Dec 1 10:39:56 ALPL105 kernel: md: adding sda1 ... Dec 1 10:39:56 ALPL105 kernel: md: created md0 Dec 1 10:39:56 ALPL105 kernel: md: bind Dec 1 10:39:56 ALPL105 kernel: md: bind Dec 1 10:39:56 ALPL105 kernel: md: running: Dec 1 10:39:56 ALPL105 kernel: raid1: raid set md0 active with 2 out of 2 mirrors Dec 1 10:39:56 ALPL105 kernel: md: ... autorun DONE. Dec 1 10:39:56 ALPL105 kernel: md: Autodetecting RAID arrays. Dec 1 10:39:56 ALPL105 kernel: md: autorun ... Dec 1 10:39:56 ALPL105 kernel: md: ... autorun DONE. Dec 1 10:39:56 ALPL105 kernel: kjournald starting. Commit interval 5 seconds Dec 1 10:39:56 ALPL105 kernel: EXT3-fs: mounted filesystem with ordered data mode. Dec 1 10:39:56 ALPL105 kernel: SELinux: Disabled at runtime. Dec 1 10:39:56 ALPL105 kernel: type=1404 audit(1354358363.395:2): selinux=0 auid=4294967295 ses=4294967295 Dec 1 10:39:56 ALPL105 kernel: dca service started, version 1.8 Dec 1 10:39:56 ALPL105 kernel: 802.1Q VLAN Support v1.8 Ben Greear Dec 1 10:39:56 ALPL105 kernel: All bugs added by David S. Miller Dec 1 10:39:56 ALPL105 kernel: input: PC Speaker as /class/input/input2 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:00:1f.3[C] -> GSI 18 (level, low) -> IRQ 233 Dec 1 10:39:56 ALPL105 kernel: EDAC MC: Ver: 2.0.1 Aug 25 2012 Dec 1 10:39:56 ALPL105 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Dec 1 10:39:56 ALPL105 kernel: GSI 23 sharing vector 0x82 and IRQ 23 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 24 (level, low) -> IRQ 130 Dec 1 10:39:56 ALPL105 kernel: sd 0:0:0:0: Attached scsi generic sg0 type 0 Dec 1 10:39:56 ALPL105 kernel: sd 1:0:0:0: Attached scsi generic sg1 type 0 Dec 1 10:39:56 ALPL105 kernel: sd 6:0:0:0: Attached scsi generic sg2 type 0 Dec 1 10:39:56 ALPL105 kernel: Intel(R) Gigabit Ethernet Network Driver - version 3.0.6-k2-2 Dec 1 10:39:56 ALPL105 kernel: Copyright (c) 2007-2011 Intel Corporation. Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:07:00.0[A] -> GSI 16 (level, low) -> IRQ 169 Dec 1 10:39:56 ALPL105 kernel: igb 0000:07:00.0: 0 vfs allocated Dec 1 10:39:56 ALPL105 kernel: igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection Dec 1 10:39:56 ALPL105 kernel: igb 0000:07:00.0: eth0: (PCIe:2.5Gb/s:Width x4) 00:30:48:fd:a9:78 Dec 1 10:39:56 ALPL105 kernel: igb 0000:07:00.0: eth0: PBA No: FFFFFF-0FF Dec 1 10:39:56 ALPL105 kernel: igb 0000:07:00.0: Using MSI-X interrupts. 4 rx queue(s), 1 tx queue(s) Dec 1 10:39:56 ALPL105 kernel: GSI 24 sharing vector 0x33 and IRQ 24 Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:07:00.1[B] -> GSI 17 (level, low) -> IRQ 51 Dec 1 10:39:56 ALPL105 kernel: igb 0000:07:00.1: 0 vfs allocated Dec 1 10:39:56 ALPL105 kernel: igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection Dec 1 10:39:56 ALPL105 kernel: igb 0000:07:00.1: eth1: (PCIe:2.5Gb/s:Width x4) 00:30:48:fd:a9:79 Dec 1 10:39:56 ALPL105 kernel: igb 0000:07:00.1: eth1: PBA No: FFFFFF-0FF Dec 1 10:39:56 ALPL105 kernel: igb 0000:07:00.1: Using MSI-X interrupts. 4 rx queue(s), 1 tx queue(s) Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:05:00.0[A] -> GSI 16 (level, low) -> IRQ 169 Dec 1 10:39:56 ALPL105 kernel: igb 0000:05:00.0: 0 vfs allocated Dec 1 10:39:56 ALPL105 kernel: igb 0000:05:00.0: Intel(R) Gigabit Ethernet Network Connection Dec 1 10:39:56 ALPL105 kernel: igb 0000:05:00.0: eth2: (PCIe:2.5Gb/s:Width x2) 00:30:48:fd:a9:7a Dec 1 10:39:56 ALPL105 kernel: igb 0000:05:00.0: eth2: PBA No: FFFFFF-0FF Dec 1 10:39:56 ALPL105 kernel: igb 0000:05:00.0: Using MSI-X interrupts. 4 rx queue(s), 1 tx queue(s) Dec 1 10:39:56 ALPL105 kernel: ACPI: PCI Interrupt 0000:05:00.1[B] -> GSI 17 (level, low) -> IRQ 51 Dec 1 10:39:56 ALPL105 kernel: igb 0000:05:00.1: 0 vfs allocated Dec 1 10:39:56 ALPL105 kernel: igb 0000:05:00.1: Intel(R) Gigabit Ethernet Network Connection Dec 1 10:39:56 ALPL105 kernel: igb 0000:05:00.1: eth3: (PCIe:2.5Gb/s:Width x2) 00:30:48:fd:a9:7b Dec 1 10:39:56 ALPL105 kernel: igb 0000:05:00.1: eth3: PBA No: FFFFFF-0FF Dec 1 10:39:56 ALPL105 kernel: igb 0000:05:00.1: Using MSI-X interrupts. 4 rx queue(s), 1 tx queue(s) Dec 1 10:39:56 ALPL105 kernel: ib_qib 0000:02:00.0: IB0:1 got a lid: 0x3a Dec 1 10:39:56 ALPL105 kernel: floppy0: no floppy controllers found Dec 1 10:39:56 ALPL105 kernel: work still pending Dec 1 10:39:56 ALPL105 kernel: lp: driver loaded but no devices found Dec 1 10:39:56 ALPL105 kernel: NET: Registered protocol family 10 Dec 1 10:39:56 ALPL105 kernel: lo: Disabled Privacy Extensions Dec 1 10:39:56 ALPL105 kernel: IPv6 over IPv4 tunneling driver Dec 1 10:39:56 ALPL105 kernel: sit0: Disabled Privacy Extensions Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8000000,800000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8000000,1000000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8fe0000,10000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8fc0000,20000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8f80000,40000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8f00000,80000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8e00000,100000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8c00000,200000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8800000,400000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8000000,800000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8fe0000,10000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8fc0000,20000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8f80000,40000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8f00000,80000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8e00000,100000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8c00000,200000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8800000,400000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: mtrr: type mismatch for f8000000,800000 old: write-back new: write-combining Dec 1 10:39:56 ALPL105 kernel: ACPI: Power Button (FF) [PWRF] Dec 1 10:39:56 ALPL105 kernel: ACPI: Power Button (CM) [PWRB] Dec 1 10:39:56 ALPL105 kernel: ACPI: Mapper loaded Dec 1 10:39:56 ALPL105 kernel: dell-wmi: No known WMI GUID found Dec 1 10:39:56 ALPL105 kernel: md: Autodetecting RAID arrays. Dec 1 10:39:56 ALPL105 kernel: md: autorun ... Dec 1 10:39:56 ALPL105 kernel: md: ... autorun DONE. Dec 1 10:39:56 ALPL105 kernel: device-mapper: multipath: version 1.0.6 loaded Dec 1 10:39:56 ALPL105 kernel: device-mapper: multipath round-robin: version 1.0.0 loaded Dec 1 10:39:56 ALPL105 kernel: device-mapper: table: 253:0: multipath: error getting device Dec 1 10:39:56 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 10:39:56 ALPL105 kernel: device-mapper: table: 253:0: multipath: error getting device Dec 1 10:39:56 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 10:39:56 ALPL105 kernel: device-mapper: table: 253:0: multipath: error getting device Dec 1 10:39:56 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 10:39:56 ALPL105 kernel: device-mapper: table: 253:0: multipath: error getting device Dec 1 10:39:56 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 10:39:56 ALPL105 kernel: EXT3 FS on md1, internal journal Dec 1 10:39:56 ALPL105 kernel: kjournald starting. Commit interval 5 seconds Dec 1 10:39:56 ALPL105 kernel: EXT3 FS on md0, internal journal Dec 1 10:39:56 ALPL105 kernel: EXT3-fs: mounted filesystem with ordered data mode. Dec 1 10:39:56 ALPL105 kernel: Adding 4192888k swap on /dev/md2. Priority:-1 extents:1 across:4192888k Dec 1 10:39:56 ALPL105 kernel: IA-32 Microcode Update Driver: v1.14a Dec 1 10:39:56 ALPL105 kernel: ADDRCONF(NETDEV_UP): ib0: link is not ready Dec 1 10:39:56 ALPL105 kernel: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready Dec 1 10:39:56 ALPL105 kernel: ib0: enabling connected mode will cause multicast packet drops Dec 1 10:39:56 ALPL105 kernel: ib0: mtu > 2044 will cause multicast packet drops. Dec 1 10:39:56 ALPL105 kernel: ib0: mtu > 2044 will cause multicast packet drops. Dec 1 10:39:56 ALPL105 kernel: NET: Registered protocol family 21 Dec 1 10:39:56 ALPL105 kernel: Registered RDS/iwarp transport Dec 1 10:39:56 ALPL105 kernel: Registered RDS/infiniband transport Dec 1 10:39:56 ALPL105 kernel: Registered RDS/tcp transport Dec 1 10:39:56 ALPL105 kernel: 8021q: adding VLAN 0 to HW filter on device eth0 Dec 1 10:39:56 ALPL105 kernel: ADDRCONF(NETDEV_UP): eth0: link is not ready Dec 1 10:39:56 ALPL105 kernel: device-mapper: table: 253:1: multipath: error getting device Dec 1 10:39:56 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 10:39:56 ALPL105 kernel: device-mapper: table: 253:1: multipath: error getting device Dec 1 10:39:56 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 10:39:56 ALPL105 kernel: device-mapper: table: 253:1: multipath: error getting device Dec 1 10:39:56 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 10:39:56 ALPL105 kernel: device-mapper: table: 253:1: multipath: error getting device Dec 1 10:39:56 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 10:39:56 ALPL105 kernel: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX Dec 1 10:39:56 ALPL105 kernel: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Dec 1 10:39:56 ALPL105 kernel: 8021q: adding VLAN 0 to HW filter on device eth2 Dec 1 10:39:56 ALPL105 kernel: ADDRCONF(NETDEV_UP): eth2: link is not ready Dec 1 10:39:56 ALPL105 kernel: igb: eth2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX Dec 1 10:39:56 ALPL105 kernel: ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready Dec 1 10:39:56 ALPL105 kernel: igb: eth2 NIC Link is Down Dec 1 10:40:15 ALPL105 automount[4742]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master Dec 1 10:40:15 ALPL105 ntpd[4783]: ntpd 4.2.2p1@1.1570-o Sat Dec 19 00:56:13 UTC 2009 (1) Dec 1 10:40:15 ALPL105 ntpd[4784]: precision = 1.000 usec Dec 1 10:40:15 ALPL105 ntpd[4784]: Listening on interface wildcard, 0.0.0.0#123 Disabled Dec 1 10:40:15 ALPL105 ntpd[4784]: Listening on interface wildcard, ::#123 Disabled Dec 1 10:40:15 ALPL105 ntpd[4784]: Listening on interface eth2, fe80::230:48ff:fefd:a97a#123 Enabled Dec 1 10:40:15 ALPL105 ntpd[4784]: Listening on interface lo, ::1#123 Enabled Dec 1 10:40:15 ALPL105 ntpd[4784]: Listening on interface eth0, fe80::230:48ff:fefd:a978#123 Enabled Dec 1 10:40:15 ALPL105 ntpd[4784]: Listening on interface ib0, fe80::211:7500:78:3ac6#123 Enabled Dec 1 10:40:15 ALPL105 ntpd[4784]: Listening on interface lo, 127.0.0.1#123 Enabled Dec 1 10:40:15 ALPL105 ntpd[4784]: Listening on interface eth0, 10.2.1.72#123 Enabled Dec 1 10:40:15 ALPL105 ntpd[4784]: Listening on interface eth2, 192.168.1.72#123 Enabled Dec 1 10:40:15 ALPL105 ntpd[4784]: Listening on interface ib0, 10.3.1.72#123 Enabled Dec 1 10:40:15 ALPL105 ntpd[4784]: kernel time sync status 0040 Dec 1 10:40:15 ALPL105 ntpd[4784]: frequency initialized -16.825 PPM from /var/lib/ntp/drift Dec 1 10:40:15 ALPL105 xinetd[4772]: xinetd Version 2.3.14 started with libwrap loadavg labeled-networking options compiled in. Dec 1 10:40:15 ALPL105 xinetd[4772]: Started working: 0 available services Dec 1 10:40:22 ALPL105 kernel: igb: eth2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX Dec 1 10:42:30 ALPL105 kernel: Lustre: Build Version: v1_8_8_WC1_RC3-g747d905-CHANGED-2.6.18-308.11.1.el5_lustre.g747d905P1 Dec 1 10:42:31 ALPL105 kernel: Lustre: Listener bound to ib0:10.3.1.72:987:qib0 Dec 1 10:42:31 ALPL105 kernel: Lustre: Added LNI 10.3.1.72@o2ib [8/64/0/180] Dec 1 10:42:31 ALPL105 kernel: Lustre: Lustre Client File System; http://www.lustre.org/ Dec 1 10:42:31 ALPL105 kernel: init dynlocks cache Dec 1 10:42:31 ALPL105 kernel: ldiskfs created from ext4-2.6-rhel5 Dec 1 10:42:31 ALPL105 kernel: LDISKFS-fs (dm-0): mounted filesystem with ordered data mode Dec 1 10:42:31 ALPL105 multipathd: dm-0: umount map (uevent) Dec 1 10:42:31 ALPL105 kernel: JBD: barrier-based sync failed on dm-0-8 - disabling barriers Dec 1 10:42:31 ALPL105 kernel: LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended Dec 1 10:42:32 ALPL105 kernel: LDISKFS-fs (dm-0): mounted filesystem with ordered data mode Dec 1 10:42:32 ALPL105 kernel: Lustre: MGS MGS started Dec 1 10:42:32 ALPL105 kernel: Lustre: MGC10.3.1.72@o2ib: Reactivating import Dec 1 10:42:32 ALPL105 kernel: JBD: barrier-based sync failed on dm-0-8 - disabling barriers Dec 1 10:42:32 ALPL105 kernel: Lustre: Enabling user_xattr Dec 1 10:42:32 ALPL105 kernel: Lustre: Enabling ACL Dec 1 10:42:32 ALPL105 kernel: Lustre: 5519:0:(mds_fs.c:675:mds_init_server_data()) RECOVERY: service LFS01-MDT0000, 2 recoverable clients, 0 delayed clients, last_transno 38672353439 Dec 1 10:42:32 ALPL105 kernel: Lustre: LFS01-MDT0000: Now serving LFS01-MDT0000 on /dev/mpath/MDT with recovery enabled Dec 1 10:42:32 ALPL105 kernel: Lustre: LFS01-MDT0000: Will be in recovery for at least 5:00, or until 2 clients reconnect Dec 1 10:42:32 ALPL105 kernel: Lustre: 5519:0:(lproc_mds.c:271:lprocfs_wr_group_upcall()) LFS01-MDT0000: group upcall set to /usr/sbin/l_getgroups Dec 1 10:42:32 ALPL105 kernel: Lustre: 5519:0:(mds_lov.c:1155:mds_notify()) MDS LFS01-MDT0000: add target LFS01-OST0000_UUID Dec 1 10:42:32 ALPL105 kernel: Lustre: 5519:0:(mds_lov.c:1155:mds_notify()) MDS LFS01-MDT0000: add target LFS01-OST0001_UUID Dec 1 10:42:37 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117672984583 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 5s ago has timed out (5s prior to deadline). Dec 1 10:42:37 ALPL105 kernel: req@ffff810625f54400 x1420117672984583/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354329757 ref 2 fl Rpc:N/0/0 rc 0/0 Dec 1 10:42:45 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117672984607 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 5s ago has timed out (5s prior to deadline). Dec 1 10:42:45 ALPL105 kernel: req@ffff810c3e98b000 x1420117672984607/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354329765 ref 2 fl Rpc:N/0/0 rc 0/0 Dec 1 10:42:45 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 10:42:46 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 1s Dec 1 10:42:52 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117672984627 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 6s ago has timed out (6s prior to deadline). Dec 1 10:42:52 ALPL105 kernel: req@ffff810c3b9a7000 x1420117672984627/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354329772 ref 2 fl Rpc:N/0/0 rc 0/0 Dec 1 10:42:52 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 10:43:11 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117672984648 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 6s ago has timed out (6s prior to deadline). Dec 1 10:43:11 ALPL105 kernel: req@ffff810c3bffc000 x1420117672984648/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354329791 ref 2 fl Rpc:N/0/0 rc 0/0 Dec 1 10:43:11 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 10:43:12 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 2s Dec 1 10:43:12 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 10:43:17 ALPL105 kernel: mtrr: type mismatch for f8000000,800000 old: write-back new: write-combining Dec 1 10:43:17 ALPL105 kernel: mtrr: type mismatch for f8000000,1000000 old: write-back new: write-combining Dec 1 10:43:18 ALPL105 kernel: mtrr: type mismatch for f8fe0000,10000 old: write-back new: write-combining Dec 1 10:43:18 ALPL105 kernel: mtrr: type mismatch for f8fc0000,20000 old: write-back new: write-combining Dec 1 10:43:18 ALPL105 kernel: mtrr: type mismatch for f8f80000,40000 old: write-back new: write-combining Dec 1 10:43:18 ALPL105 kernel: mtrr: type mismatch for f8f00000,80000 old: write-back new: write-combining Dec 1 10:43:18 ALPL105 kernel: mtrr: type mismatch for f8e00000,100000 old: write-back new: write-combining Dec 1 10:43:18 ALPL105 kernel: mtrr: type mismatch for f8c00000,200000 old: write-back new: write-combining Dec 1 10:43:18 ALPL105 kernel: mtrr: type mismatch for f8800000,400000 old: write-back new: write-combining Dec 1 10:43:18 ALPL105 kernel: mtrr: type mismatch for f8000000,800000 old: write-back new: write-combining Dec 1 10:43:19 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117672984668 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 7s ago has timed out (7s prior to deadline). Dec 1 10:43:19 ALPL105 kernel: req@ffff810c3cf7c400 x1420117672984668/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354329799 ref 2 fl Rpc:N/0/0 rc 0/0 Dec 1 10:43:19 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 10:43:19 ALPL105 kernel: mtrr: type mismatch for f8fe0000,10000 old: write-back new: write-combining Dec 1 10:43:19 ALPL105 kernel: mtrr: type mismatch for f8fc0000,20000 old: write-back new: write-combining Dec 1 10:43:19 ALPL105 kernel: mtrr: type mismatch for f8f80000,40000 old: write-back new: write-combining Dec 1 10:43:19 ALPL105 kernel: mtrr: type mismatch for f8f00000,80000 old: write-back new: write-combining Dec 1 10:43:19 ALPL105 kernel: mtrr: type mismatch for f8e00000,100000 old: write-back new: write-combining Dec 1 10:43:19 ALPL105 kernel: mtrr: type mismatch for f8c00000,200000 old: write-back new: write-combining Dec 1 10:43:19 ALPL105 kernel: mtrr: type mismatch for f8800000,400000 old: write-back new: write-combining Dec 1 10:43:19 ALPL105 kernel: mtrr: type mismatch for f8000000,800000 old: write-back new: write-combining Dec 1 10:43:29 ALPL105 ntpd[4784]: synchronized to LOCAL(0), stratum 10 Dec 1 10:43:29 ALPL105 ntpd[4784]: kernel time sync enabled 0001 Dec 1 10:43:30 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117672984689 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (7s prior to deadline). Dec 1 10:43:30 ALPL105 kernel: req@ffff810c3d1cf400 x1420117672984689/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354329817 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 10:43:30 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 10:43:38 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 3s Dec 1 10:43:38 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 10:43:55 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117672984730 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (8s prior to deadline). Dec 1 10:43:55 ALPL105 kernel: req@ffff810c3e77f000 x1420117672984730/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354329843 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 10:43:55 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 39 previous similar messages Dec 1 10:44:04 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 4s Dec 1 10:44:04 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 10:44:20 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117672984771 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (9s prior to deadline). Dec 1 10:44:20 ALPL105 kernel: req@ffff810c3e5c3000 x1420117672984771/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354329869 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 10:44:20 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 39 previous similar messages Dec 1 10:44:30 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 5s Dec 1 10:44:30 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 10:44:35 ALPL105 ntpd[4784]: synchronized to 10.3.8.66, stratum 4 Dec 1 10:44:56 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 6s Dec 1 10:44:56 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 10:44:56 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117672984832 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (11s prior to deadline). Dec 1 10:44:56 ALPL105 kernel: req@ffff810c3d5d2000 x1420117672984832/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354329907 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 10:44:56 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 59 previous similar messages Dec 1 10:45:22 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 7s Dec 1 10:45:22 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 10:45:48 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 8s Dec 1 10:45:48 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 10:46:25 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117672984936 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (13s prior to deadline). Dec 1 10:46:25 ALPL105 kernel: req@ffff810655224000 x1420117672984936/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354329998 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 10:46:25 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 99 previous similar messages Dec 1 10:46:39 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 9s Dec 1 10:46:39 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 10:48:21 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 11s Dec 1 10:48:21 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 39 previous similar messages Dec 1 10:48:55 ALPL105 kernel: LustreError: 11-0: an error occurred while communicating with 10.3.1.69@o2ib. The ost_connect operation failed with -19 Dec 1 10:48:55 ALPL105 kernel: LustreError: 11-0: an error occurred while communicating with 10.3.1.71@o2ib. The ost_connect operation failed with -19 Dec 1 10:48:55 ALPL105 kernel: LustreError: Skipped 17 previous similar messages Dec 1 10:54:12 ALPL105 kernel: Lustre: 5267:0:(mds_lov.c:1191:mds_notify()) MDS LFS01-MDT0000: in recovery, not resetting orphans on LFS01-OST0007_UUID Dec 1 10:54:12 ALPL105 kernel: Lustre: LFS01-OST0007-osc: Connection restored to service LFS01-OST0007 using nid 10.3.1.69@o2ib. Dec 1 10:54:12 ALPL105 kernel: Lustre: 5267:0:(mds_lov.c:1191:mds_notify()) MDS LFS01-MDT0000: in recovery, not resetting orphans on LFS01-OST0009_UUID Dec 1 10:54:12 ALPL105 kernel: Lustre: LFS01-OST0009-osc: Connection restored to service LFS01-OST0009 using nid 10.3.1.69@o2ib. Dec 1 10:54:30 ALPL105 kernel: qla2xxx 0000:04:00.1: LIP reset occured (f8f7). Dec 1 10:54:32 ALPL105 kernel: qla2xxx 0000:04:00.1: LIP occured (f8f7). Dec 1 10:54:32 ALPL105 kernel: qla2xxx 0000:04:00.1: LOOP UP detected (8 Gbps). Dec 1 10:54:32 ALPL105 kernel: Vendor: DotHill Model: DH3000 Rev: T201 Dec 1 10:54:32 ALPL105 kernel: Type: Direct-Access ANSI SCSI revision: 05 Dec 1 10:54:32 ALPL105 kernel: SCSI device sdd: 498046848 512-byte hdwr sectors (255000 MB) Dec 1 10:54:32 ALPL105 kernel: sdd: Write Protect is off Dec 1 10:54:32 ALPL105 kernel: SCSI device sdd: drive cache: write back Dec 1 10:54:32 ALPL105 kernel: SCSI device sdd: 498046848 512-byte hdwr sectors (255000 MB) Dec 1 10:54:32 ALPL105 kernel: sdd: Write Protect is off Dec 1 10:54:32 ALPL105 kernel: SCSI device sdd: drive cache: write back Dec 1 10:54:32 ALPL105 kernel: sdd: unknown partition table Dec 1 10:54:32 ALPL105 kernel: sd 7:0:0:0: Attached scsi disk sdd Dec 1 10:54:32 ALPL105 kernel: sd 7:0:0:0: Attached scsi generic sg3 type 0 Dec 1 10:54:32 ALPL105 multipathd: sdd: add path (uevent) Dec 1 10:54:32 ALPL105 multipathd: MDT: load table [0 498046848 multipath 0 0 2 1 round-robin 0 1 1 8:32 1000 round-robin 0 1 1 8:48 1000] Dec 1 10:54:32 ALPL105 multipathd: dm-0: add map (uevent) Dec 1 10:54:32 ALPL105 multipathd: dm-0: devmap already registered Dec 1 11:03:00 ALPL105 ntpd[4784]: time reset -0.804085 s Dec 1 11:06:37 ALPL105 ntpd[4784]: synchronized to LOCAL(0), stratum 10 Dec 1 11:08:47 ALPL105 ntpd[4784]: synchronized to 10.3.8.66, stratum 4 Dec 1 11:43:18 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 12:43:17 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 13:43:17 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 14:12:25 ALPL105 kernel: device-mapper: table: 253:1: multipath: error getting device Dec 1 14:12:25 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 14:12:25 ALPL105 multipathd: dm-1: remove map (uevent) Dec 1 14:12:25 ALPL105 multipathd: dm-1: devmap not registered, can't remove Dec 1 14:12:25 ALPL105 kernel: device-mapper: table: 253:1: multipath: error getting device Dec 1 14:12:25 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 14:12:25 ALPL105 multipathd: dm-1: remove map (uevent) Dec 1 14:12:25 ALPL105 multipathd: dm-1: devmap not registered, can't remove Dec 1 14:12:25 ALPL105 kernel: device-mapper: table: 253:1: multipath: error getting device Dec 1 14:12:25 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 14:12:25 ALPL105 multipathd: dm-1: remove map (uevent) Dec 1 14:12:25 ALPL105 multipathd: dm-1: devmap not registered, can't remove Dec 1 14:12:25 ALPL105 kernel: device-mapper: table: 253:1: multipath: error getting device Dec 1 14:12:25 ALPL105 multipathd: dm-1: remove map (uevent) Dec 1 14:12:25 ALPL105 kernel: device-mapper: ioctl: error adding target to table Dec 1 14:12:25 ALPL105 multipathd: dm-1: devmap not registered, can't remove Dec 1 14:43:17 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 15:43:17 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 15:52:04 ALPL105 kernel: ib0: Completion received during destruction of connection. Waiting. Dec 1 16:43:17 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 16:50:33 ALPL105 kernel: LustreError: 3614:0:(o2iblnd_cb.c:2206:kiblnd_passive_connect()) Can't accept 10.3.9.34@o2ib(version 12): incompatible max_frags 256 (32 wanted) Dec 1 17:43:17 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 17:57:56 ALPL105 kernel: Lustre: 5266:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117673006528 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 17s ago has timed out (17s prior to deadline). Dec 1 17:57:56 ALPL105 kernel: req@ffff810655324800 x1420117673006528/t0 o400->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 192/384 e 0 to 1 dl 1354355876 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 17:57:56 ALPL105 kernel: Lustre: 5266:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 119 previous similar messages Dec 1 17:57:56 ALPL105 kernel: Lustre: LFS01-OST0000-osc: Connection to service LFS01-OST0000 via nid 10.3.1.68@o2ib was lost; in progress operations using this service will wait for recovery to complete. Dec 1 17:57:56 ALPL105 kernel: Lustre: LFS01-OST0004-osc: Connection to service LFS01-OST0004 via nid 10.3.1.68@o2ib was lost; in progress operations using this service will wait for recovery to complete. Dec 1 17:57:56 ALPL105 kernel: Lustre: Skipped 3 previous similar messages Dec 1 17:58:10 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 2s Dec 1 17:58:10 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 39 previous similar messages Dec 1 17:58:18 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117673006609 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (7s prior to deadline). Dec 1 17:58:18 ALPL105 kernel: req@ffff810c3df7a400 x1420117673006609/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354355905 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 17:58:18 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 79 previous similar messages Dec 1 17:58:26 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 3s Dec 1 17:58:26 ALPL105 kernel: Lustre: 5268:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 17:58:54 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420117673006691 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (9s prior to deadline). Dec 1 17:58:54 ALPL105 kernel: req@ffff810c3bd32800 x1420117673006691/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354355943 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 17:58:54 ALPL105 kernel: Lustre: 5267:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 79 previous similar messages Dec 1 17:58:54 ALPL105 kernel: Lustre: Failing over LFS01-MDT0000 Dec 1 17:58:54 ALPL105 kernel: Lustre: Failing over LFS01-OST0012-osc Dec 1 17:58:54 ALPL105 kernel: Lustre: Skipped 1 previous similar message Dec 1 17:58:54 ALPL105 kernel: Lustre: LFS01-MDT0000: shutting down for failover; client state will be preserved. Dec 1 17:58:54 ALPL105 kernel: Lustre: MDT LFS01-MDT0000 has stopped. Dec 1 17:58:54 ALPL105 kernel: LustreError: 473:0:(ldlm_request.c:1039:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway Dec 1 17:58:54 ALPL105 kernel: LustreError: 473:0:(ldlm_request.c:1597:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 Dec 1 17:58:54 ALPL105 kernel: Lustre: MGS has stopped. Dec 1 17:58:54 ALPL105 multipathd: dm-0: umount map (uevent) Dec 1 17:58:54 ALPL105 kernel: Lustre: server umount LFS01-MDT0000 complete Dec 1 17:59:24 ALPL105 kernel: Lustre: Removed LNI 10.3.1.72@o2ib Dec 1 18:01:38 ALPL105 kernel: Lustre: Build Version: v1_8_8_WC1_RC3-g747d905-CHANGED-2.6.18-308.11.1.el5_lustre.g747d905P1 Dec 1 18:01:38 ALPL105 kernel: Lustre: Listener bound to ib0:10.3.1.72:987:qib0 Dec 1 18:01:38 ALPL105 kernel: Lustre: Added LNI 10.3.1.72@o2ib [8/64/0/180] Dec 1 18:01:38 ALPL105 kernel: Lustre: Lustre Client File System; http://www.lustre.org/ Dec 1 18:01:38 ALPL105 kernel: init dynlocks cache Dec 1 18:01:38 ALPL105 kernel: ldiskfs created from ext4-2.6-rhel5 Dec 1 18:01:38 ALPL105 kernel: LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended Dec 1 18:01:38 ALPL105 kernel: LDISKFS-fs (dm-0): mounted filesystem with ordered data mode Dec 1 18:01:38 ALPL105 multipathd: dm-0: umount map (uevent) Dec 1 18:01:38 ALPL105 kernel: JBD: barrier-based sync failed on dm-0-8 - disabling barriers Dec 1 18:01:39 ALPL105 kernel: LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended Dec 1 18:01:39 ALPL105 kernel: LDISKFS-fs (dm-0): mounted filesystem with ordered data mode Dec 1 18:01:39 ALPL105 kernel: Lustre: MGS MGS started Dec 1 18:01:39 ALPL105 kernel: Lustre: MGC10.3.1.72@o2ib: Reactivating import Dec 1 18:01:39 ALPL105 kernel: JBD: barrier-based sync failed on dm-0-8 - disabling barriers Dec 1 18:01:39 ALPL105 kernel: Lustre: Enabling user_xattr Dec 1 18:01:39 ALPL105 kernel: Lustre: Enabling ACL Dec 1 18:01:39 ALPL105 kernel: Lustre: 1800:0:(mds_fs.c:675:mds_init_server_data()) RECOVERY: service LFS01-MDT0000, 2 recoverable clients, 0 delayed clients, last_transno 38672353439 Dec 1 18:01:39 ALPL105 kernel: Lustre: LFS01-MDT0000: Now serving LFS01-MDT0000 on /dev/mpath/MDT with recovery enabled Dec 1 18:01:39 ALPL105 kernel: Lustre: LFS01-MDT0000: Will be in recovery for at least 5:00, or until 2 clients reconnect Dec 1 18:01:39 ALPL105 kernel: Lustre: 1800:0:(lproc_mds.c:271:lprocfs_wr_group_upcall()) LFS01-MDT0000: group upcall set to /usr/sbin/l_getgroups Dec 1 18:01:39 ALPL105 kernel: Lustre: 1800:0:(mds_lov.c:1155:mds_notify()) MDS LFS01-MDT0000: add target LFS01-OST0000_UUID Dec 1 18:01:39 ALPL105 kernel: Lustre: 1800:0:(mds_lov.c:1155:mds_notify()) MDS LFS01-MDT0000: add target LFS01-OST0001_UUID Dec 1 18:01:39 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299816455 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (5s prior to deadline). Dec 1 18:01:39 ALPL105 kernel: req@ffff810626ba2000 x1420145299816455/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354356104 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 18:01:39 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299816461 sent from LFS01-OST0005-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (5s prior to deadline). Dec 1 18:01:39 ALPL105 kernel: req@ffff810627153000 x1420145299816461/t0 o8->LFS01-OST0005_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354356104 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 18:01:39 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 4 previous similar messages Dec 1 18:01:49 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299816479 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (5s prior to deadline). Dec 1 18:01:49 ALPL105 kernel: req@ffff810625efc400 x1420145299816479/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354356114 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 18:01:49 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 14 previous similar messages Dec 1 18:01:55 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 1s Dec 1 18:01:55 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299816499 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (6s prior to deadline). Dec 1 18:01:55 ALPL105 kernel: req@ffff81063fc50000 x1420145299816499/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354356121 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 18:01:55 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 18:02:14 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299816520 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (6s prior to deadline). Dec 1 18:02:14 ALPL105 kernel: req@ffff81062d9b1400 x1420145299816520/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354356140 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 18:02:14 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 18:02:21 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 2s Dec 1 18:02:21 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 18:02:21 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299816540 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (7s prior to deadline). Dec 1 18:02:21 ALPL105 kernel: req@ffff81062c920000 x1420145299816540/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354356148 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 18:02:21 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 18:02:39 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299816561 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (7s prior to deadline). Dec 1 18:02:39 ALPL105 kernel: req@ffff81062558e800 x1420145299816561/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354356166 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 18:02:39 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 18:02:47 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 3s Dec 1 18:02:47 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 18:03:04 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299816602 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (8s prior to deadline). Dec 1 18:03:04 ALPL105 kernel: req@ffff81063fc4a400 x1420145299816602/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354356192 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 18:03:04 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 39 previous similar messages Dec 1 18:03:13 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 4s Dec 1 18:03:13 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 18:03:39 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 5s Dec 1 18:03:39 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 18:03:39 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299816663 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (10s prior to deadline). Dec 1 18:03:39 ALPL105 kernel: req@ffff81062542a800 x1420145299816663/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354356229 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 18:03:39 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 59 previous similar messages Dec 1 18:04:05 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 6s Dec 1 18:04:05 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 18:04:19 ALPL105 kernel: LustreError: 11-0: an error occurred while communicating with 10.3.1.69@o2ib. The ost_connect operation failed with -19 Dec 1 18:04:31 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 7s Dec 1 18:04:31 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 18:04:31 ALPL105 kernel: Lustre: 1562:0:(mds_lov.c:1191:mds_notify()) MDS LFS01-MDT0000: in recovery, not resetting orphans on LFS01-OST0003_UUID Dec 1 18:04:31 ALPL105 kernel: Lustre: LFS01-OST0003-osc: Connection restored to service LFS01-OST0003 using nid 10.3.1.68@o2ib. Dec 1 18:04:31 ALPL105 kernel: Lustre: 1562:0:(mds_lov.c:1191:mds_notify()) MDS LFS01-MDT0000: in recovery, not resetting orphans on LFS01-OST0000_UUID Dec 1 18:04:31 ALPL105 kernel: Lustre: LFS01-OST0000-osc: Connection restored to service LFS01-OST0000 using nid 10.3.1.68@o2ib. Dec 1 18:43:17 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 19:27:39 ALPL105 kernel: LustreError: 11-0: an error occurred while communicating with 10.3.1.68@o2ib. The obd_ping operation failed with -107 Dec 1 19:27:39 ALPL105 kernel: LustreError: Skipped 19 previous similar messages Dec 1 19:27:39 ALPL105 kernel: Lustre: LFS01-OST0003-osc: Connection to service LFS01-OST0003 via nid 10.3.1.68@o2ib was lost; in progress operations using this service will wait for recovery to complete. Dec 1 19:27:52 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299821027 sent from LFS01-OST0009-osc to NID 10.3.1.68@o2ib 6s ago has timed out (6s prior to deadline). Dec 1 19:27:52 ALPL105 kernel: req@ffff810624d8cc00 x1420145299821027/t0 o8->LFS01-OST0009_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361272 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:27:52 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 59 previous similar messages Dec 1 19:27:53 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0003-osc: tried all connections, increasing latency to 2s Dec 1 19:27:53 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 19:28:08 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299821037 sent from LFS01-OST0003-osc to NID 10.3.1.69@o2ib 7s ago has timed out (7s prior to deadline). Dec 1 19:28:08 ALPL105 kernel: req@ffff810624d8c800 x1420145299821037/t0 o8->LFS01-OST0003_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361288 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:28:08 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 7 previous similar messages Dec 1 19:28:09 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0003-osc: tried all connections, increasing latency to 3s Dec 1 19:28:09 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 5 previous similar messages Dec 1 19:28:21 ALPL105 kernel: Lustre: LFS01-OST0000-osc: Connection to service LFS01-OST0000 via nid 10.3.1.68@o2ib was lost; in progress operations using this service will wait for recovery to complete. Dec 1 19:28:21 ALPL105 kernel: Lustre: Skipped 5 previous similar messages Dec 1 19:28:27 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0003-osc: tried all connections, increasing latency to 4s Dec 1 19:28:27 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 5 previous similar messages Dec 1 19:28:27 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299821084 sent from LFS01-OST0003-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (9s prior to deadline). Dec 1 19:28:27 ALPL105 kernel: req@ffff81062db03000 x1420145299821084/t0 o8->LFS01-OST0003_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361316 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:28:27 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 45 previous similar messages Dec 1 19:28:47 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0003-osc: tried all connections, increasing latency to 5s Dec 1 19:28:47 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 19:29:00 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420145299821166 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (8s prior to deadline). Dec 1 19:29:00 ALPL105 kernel: req@ffff8106253b7000 x1420145299821166/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361348 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:29:00 ALPL105 kernel: Lustre: 1562:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 79 previous similar messages Dec 1 19:29:09 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 4s Dec 1 19:29:09 ALPL105 kernel: Lustre: 1563:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 19:29:47 ALPL105 kernel: Lustre: Failing over LFS01-MDT0000 Dec 1 19:29:47 ALPL105 kernel: Lustre: Failing over LFS01-OST0013-osc Dec 1 19:29:47 ALPL105 kernel: Lustre: LFS01-MDT0000: shutting down for failover; client state will be preserved. Dec 1 19:29:47 ALPL105 kernel: Lustre: MDT LFS01-MDT0000 has stopped. Dec 1 19:29:47 ALPL105 kernel: LustreError: 7882:0:(ldlm_request.c:1039:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway Dec 1 19:29:47 ALPL105 kernel: LustreError: 7882:0:(ldlm_request.c:1597:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 Dec 1 19:29:47 ALPL105 kernel: Lustre: MGS has stopped. Dec 1 19:29:47 ALPL105 multipathd: dm-0: umount map (uevent) Dec 1 19:29:47 ALPL105 kernel: Lustre: server umount LFS01-MDT0000 complete Dec 1 19:30:24 ALPL105 kernel: Lustre: Removed LNI 10.3.1.72@o2ib Dec 1 19:34:13 ALPL105 kernel: Lustre: Build Version: v1_8_8_WC1_RC3-g747d905-CHANGED-2.6.18-308.11.1.el5_lustre.g747d905P1 Dec 1 19:34:13 ALPL105 kernel: Lustre: Listener bound to ib0:10.3.1.72:987:qib0 Dec 1 19:34:13 ALPL105 kernel: Lustre: Added LNI 10.3.1.72@o2ib [8/64/0/180] Dec 1 19:34:13 ALPL105 kernel: Lustre: Lustre Client File System; http://www.lustre.org/ Dec 1 19:34:13 ALPL105 kernel: init dynlocks cache Dec 1 19:34:13 ALPL105 kernel: ldiskfs created from ext4-2.6-rhel5 Dec 1 19:34:13 ALPL105 kernel: LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended Dec 1 19:34:13 ALPL105 kernel: LDISKFS-fs (dm-0): mounted filesystem with ordered data mode Dec 1 19:34:13 ALPL105 multipathd: dm-0: umount map (uevent) Dec 1 19:34:13 ALPL105 kernel: JBD: barrier-based sync failed on dm-0-8 - disabling barriers Dec 1 19:34:13 ALPL105 kernel: LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended Dec 1 19:34:13 ALPL105 kernel: LDISKFS-fs (dm-0): mounted filesystem with ordered data mode Dec 1 19:34:13 ALPL105 kernel: Lustre: MGS MGS started Dec 1 19:34:13 ALPL105 kernel: Lustre: MGC10.3.1.72@o2ib: Reactivating import Dec 1 19:34:13 ALPL105 kernel: JBD: barrier-based sync failed on dm-0-8 - disabling barriers Dec 1 19:34:13 ALPL105 kernel: Lustre: Enabling user_xattr Dec 1 19:34:13 ALPL105 kernel: Lustre: Enabling ACL Dec 1 19:34:13 ALPL105 kernel: Lustre: 8973:0:(mds_fs.c:675:mds_init_server_data()) RECOVERY: service LFS01-MDT0000, 2 recoverable clients, 0 delayed clients, last_transno 38672353439 Dec 1 19:34:13 ALPL105 kernel: Lustre: LFS01-MDT0000: Now serving LFS01-MDT0000 on /dev/mpath/MDT with recovery enabled Dec 1 19:34:13 ALPL105 kernel: Lustre: LFS01-MDT0000: Will be in recovery for at least 5:00, or until 2 clients reconnect Dec 1 19:34:13 ALPL105 kernel: Lustre: 8973:0:(lproc_mds.c:271:lprocfs_wr_group_upcall()) LFS01-MDT0000: group upcall set to /usr/sbin/l_getgroups Dec 1 19:34:13 ALPL105 kernel: Lustre: 8973:0:(mds_lov.c:1155:mds_notify()) MDS LFS01-MDT0000: add target LFS01-OST0000_UUID Dec 1 19:34:13 ALPL105 kernel: Lustre: 8973:0:(mds_lov.c:1155:mds_notify()) MDS LFS01-MDT0000: add target LFS01-OST0002_UUID Dec 1 19:34:13 ALPL105 kernel: Lustre: 8973:0:(mds_lov.c:1155:mds_notify()) Skipped 1 previous similar message Dec 1 19:34:13 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420151124656135 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (5s prior to deadline). Dec 1 19:34:13 ALPL105 kernel: req@ffff81062eda1000 x1420151124656135/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361658 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:34:13 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420151124656141 sent from LFS01-OST0005-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (5s prior to deadline). Dec 1 19:34:13 ALPL105 kernel: req@ffff810626959c00 x1420151124656141/t0 o8->LFS01-OST0005_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361658 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:34:13 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 4 previous similar messages Dec 1 19:34:44 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420151124656160 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (5s prior to deadline). Dec 1 19:34:44 ALPL105 kernel: req@ffff8106552f3400 x1420151124656160/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361689 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:34:44 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 14 previous similar messages Dec 1 19:34:50 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 1s Dec 1 19:34:50 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420151124656180 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (6s prior to deadline). Dec 1 19:34:50 ALPL105 kernel: req@ffff810c393fb800 x1420151124656180/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361696 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:34:50 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 19:35:09 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420151124656201 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (6s prior to deadline). Dec 1 19:35:09 ALPL105 kernel: req@ffff810c3ffa3000 x1420151124656201/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361715 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:35:09 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 19:35:16 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 2s Dec 1 19:35:16 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 19:35:16 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420151124656221 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (7s prior to deadline). Dec 1 19:35:16 ALPL105 kernel: req@ffff810c3e7c3800 x1420151124656221/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361723 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:35:16 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 19:35:34 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420151124656242 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (7s prior to deadline). Dec 1 19:35:34 ALPL105 kernel: req@ffff810c3d63ec00 x1420151124656242/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361741 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:35:34 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 19:35:42 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 3s Dec 1 19:35:42 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 19:35:59 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420151124656283 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (8s prior to deadline). Dec 1 19:35:59 ALPL105 kernel: req@ffff810c3f563800 x1420151124656283/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361767 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:35:59 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 39 previous similar messages Dec 1 19:36:08 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 4s Dec 1 19:36:08 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 19:36:34 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 5s Dec 1 19:36:34 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 19:36:34 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420151124656344 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (10s prior to deadline). Dec 1 19:36:34 ALPL105 kernel: req@ffff810c3e7c3800 x1420151124656344/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354361804 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 19:36:34 ALPL105 kernel: Lustre: 8736:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 59 previous similar messages Dec 1 19:37:00 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 6s Dec 1 19:37:00 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 19:37:26 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 7s Dec 1 19:37:26 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 19:37:39 ALPL105 kernel: LustreError: 11-0: an error occurred while communicating with 10.3.1.69@o2ib. The ost_connect operation failed with -19 Dec 1 19:37:52 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 8s Dec 1 19:37:52 ALPL105 kernel: Lustre: 8737:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 19:37:52 ALPL105 kernel: Lustre: 8736:0:(mds_lov.c:1191:mds_notify()) MDS LFS01-MDT0000: in recovery, not resetting orphans on LFS01-OST0010_UUID Dec 1 19:37:52 ALPL105 kernel: Lustre: LFS01-OST0010-osc: Connection restored to service LFS01-OST0010 using nid 10.3.1.71@o2ib. Dec 1 19:43:17 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 20:43:17 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base Dec 1 20:55:47 ALPL105 kernel: Lustre: Failing over LFS01-MDT0000 Dec 1 20:55:47 ALPL105 kernel: Lustre: Failing over LFS01-OST0013-osc Dec 1 20:55:47 ALPL105 kernel: Lustre: LFS01-MDT0000: shutting down for failover; client state will be preserved. Dec 1 20:55:47 ALPL105 kernel: Lustre: MDT LFS01-MDT0000 has stopped. Dec 1 20:55:47 ALPL105 kernel: LustreError: 2551:0:(ldlm_request.c:1039:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway Dec 1 20:55:47 ALPL105 kernel: LustreError: 2551:0:(ldlm_request.c:1597:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 Dec 1 20:55:47 ALPL105 kernel: Lustre: MGS has stopped. Dec 1 20:55:47 ALPL105 multipathd: dm-0: umount map (uevent) Dec 1 20:55:47 ALPL105 kernel: Lustre: server umount LFS01-MDT0000 complete Dec 1 20:56:46 ALPL105 kernel: Lustre: Removed LNI 10.3.1.72@o2ib Dec 1 21:01:17 ALPL105 kernel: Lustre: Build Version: v1_8_8_WC1_RC3-g747d905-CHANGED-2.6.18-308.11.1.el5_lustre.g747d905P1 Dec 1 21:01:17 ALPL105 kernel: Lustre: Listener bound to ib0:10.3.1.72:987:qib0 Dec 1 21:01:17 ALPL105 kernel: Lustre: Added LNI 10.3.1.72@o2ib [8/64/0/180] Dec 1 21:01:17 ALPL105 kernel: Lustre: Lustre Client File System; http://www.lustre.org/ Dec 1 21:01:17 ALPL105 kernel: init dynlocks cache Dec 1 21:01:17 ALPL105 kernel: ldiskfs created from ext4-2.6-rhel5 Dec 1 21:01:17 ALPL105 kernel: LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended Dec 1 21:01:17 ALPL105 kernel: LDISKFS-fs (dm-0): mounted filesystem with ordered data mode Dec 1 21:01:17 ALPL105 multipathd: dm-0: umount map (uevent) Dec 1 21:01:17 ALPL105 kernel: JBD: barrier-based sync failed on dm-0-8 - disabling barriers Dec 1 21:01:17 ALPL105 kernel: LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended Dec 1 21:01:17 ALPL105 kernel: LDISKFS-fs (dm-0): mounted filesystem with ordered data mode Dec 1 21:01:17 ALPL105 kernel: Lustre: MGS MGS started Dec 1 21:01:17 ALPL105 kernel: Lustre: MGC10.3.1.72@o2ib: Reactivating import Dec 1 21:01:17 ALPL105 kernel: JBD: barrier-based sync failed on dm-0-8 - disabling barriers Dec 1 21:01:17 ALPL105 kernel: Lustre: Enabling user_xattr Dec 1 21:01:17 ALPL105 kernel: Lustre: Enabling ACL Dec 1 21:01:17 ALPL105 kernel: Lustre: 3632:0:(mds_fs.c:675:mds_init_server_data()) RECOVERY: service LFS01-MDT0000, 2 recoverable clients, 0 delayed clients, last_transno 38672353439 Dec 1 21:01:17 ALPL105 kernel: Lustre: LFS01-MDT0000: Now serving LFS01-MDT0000 on /dev/mpath/MDT with recovery enabled Dec 1 21:01:17 ALPL105 kernel: Lustre: LFS01-MDT0000: Will be in recovery for at least 5:00, or until 2 clients reconnect Dec 1 21:01:17 ALPL105 kernel: Lustre: 3632:0:(lproc_mds.c:271:lprocfs_wr_group_upcall()) LFS01-MDT0000: group upcall set to /usr/sbin/l_getgroups Dec 1 21:01:17 ALPL105 kernel: Lustre: 3632:0:(mds_lov.c:1155:mds_notify()) MDS LFS01-MDT0000: add target LFS01-OST0000_UUID Dec 1 21:01:17 ALPL105 kernel: Lustre: 3632:0:(mds_lov.c:1155:mds_notify()) MDS LFS01-MDT0000: add target LFS01-OST0001_UUID Dec 1 21:01:17 ALPL105 kernel: Lustre: 3383:0:(mds_lov.c:1191:mds_notify()) MDS LFS01-MDT0000: in recovery, not resetting orphans on LFS01-OST0000_UUID Dec 1 21:01:17 ALPL105 kernel: Lustre: 3383:0:(mds_lov.c:1191:mds_notify()) MDS LFS01-MDT0000: in recovery, not resetting orphans on LFS01-OST0005_UUID Dec 1 21:01:17 ALPL105 kernel: Lustre: 3383:0:(mds_lov.c:1191:mds_notify()) Skipped 4 previous similar messages Dec 1 21:30:08 ALPL105 kernel: LustreError: 11-0: an error occurred while communicating with 10.3.1.68@o2ib. The obd_ping operation failed with -107 Dec 1 21:30:08 ALPL105 kernel: Lustre: LFS01-OST0003-osc: Connection to service LFS01-OST0003 via nid 10.3.1.68@o2ib was lost; in progress operations using this service will wait for recovery to complete. Dec 1 21:30:22 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) LFS01-OST0003-osc: tried all connections, increasing latency to 2s Dec 1 21:30:29 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420156602418680 sent from LFS01-OST0003-osc to NID 10.3.1.68@o2ib 7s ago has timed out (7s prior to deadline). Dec 1 21:30:29 ALPL105 kernel: req@ffff810c3d63ec00 x1420156602418680/t0 o8->LFS01-OST0003_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354368629 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:30:37 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420156602418684 sent from LFS01-OST0003-osc to NID 10.3.1.69@o2ib 7s ago has timed out (7s prior to deadline). Dec 1 21:30:37 ALPL105 kernel: req@ffff810c3fac9000 x1420156602418684/t0 o8->LFS01-OST0003_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354368637 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:30:37 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 3 previous similar messages Dec 1 21:30:38 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) LFS01-OST0003-osc: tried all connections, increasing latency to 3s Dec 1 21:30:38 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) Skipped 3 previous similar messages Dec 1 21:30:46 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420156602418705 sent from LFS01-OST0003-osc to NID 10.3.1.68@o2ib 8s ago has timed out (8s prior to deadline). Dec 1 21:30:46 ALPL105 kernel: req@ffff810c39c23400 x1420156602418705/t0 o8->LFS01-OST0003_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354368646 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:30:46 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 3 previous similar messages Dec 1 21:30:50 ALPL105 kernel: Lustre: 3382:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420156602418689 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 17s ago has timed out (17s prior to deadline). Dec 1 21:30:50 ALPL105 kernel: req@ffff8106552c9800 x1420156602418689/t0 o400->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 192/384 e 0 to 1 dl 1354368650 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:30:50 ALPL105 kernel: Lustre: 3382:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 3 previous similar messages Dec 1 21:30:50 ALPL105 kernel: Lustre: LFS01-OST0000-osc: Connection to service LFS01-OST0000 via nid 10.3.1.68@o2ib was lost; in progress operations using this service will wait for recovery to complete. Dec 1 21:30:50 ALPL105 kernel: Lustre: Skipped 3 previous similar messages Dec 1 21:30:55 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420156602418709 sent from LFS01-OST0003-osc to NID 10.3.1.69@o2ib 8s ago has timed out (8s prior to deadline). Dec 1 21:30:55 ALPL105 kernel: req@ffff810c3d63ec00 x1420156602418709/t0 o8->LFS01-OST0003_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354368655 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:30:55 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 31 previous similar messages Dec 1 21:30:56 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) LFS01-OST0003-osc: tried all connections, increasing latency to 4s Dec 1 21:30:56 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) Skipped 3 previous similar messages Dec 1 21:31:04 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 2s Dec 1 21:31:04 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) Skipped 3 previous similar messages Dec 1 21:31:04 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420156602418750 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (7s prior to deadline). Dec 1 21:31:04 ALPL105 kernel: req@ffff810655324800 x1420156602418750/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354368671 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:31:04 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 23 previous similar messages Dec 1 21:31:16 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) LFS01-OST0003-osc: tried all connections, increasing latency to 5s Dec 1 21:31:16 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) Skipped 15 previous similar messages Dec 1 21:31:16 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420156602418786 sent from LFS01-OST0003-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (10s prior to deadline). Dec 1 21:31:16 ALPL105 kernel: req@ffff810c394bb800 x1420156602418786/t0 o8->LFS01-OST0003_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354368686 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:31:16 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 35 previous similar messages Dec 1 21:31:38 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 4s Dec 1 21:31:38 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:31:38 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420156602418827 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (9s prior to deadline). Dec 1 21:31:38 ALPL105 kernel: req@ffff810c3fac9800 x1420156602418827/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354368707 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:31:38 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 39 previous similar messages Dec 1 21:31:58 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 5s Dec 1 21:31:58 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:32:15 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420156602418905 sent from LFS01-OST0003-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (12s prior to deadline). Dec 1 21:32:15 ALPL105 kernel: req@ffff810c38d70000 x1420156602418905/t0 o8->LFS01-OST0003_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354368747 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:32:15 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 75 previous similar messages Dec 1 21:32:20 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 6s Dec 1 21:32:20 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:32:56 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) LFS01-OST0003-osc: tried all connections, increasing latency to 9s Dec 1 21:32:56 ALPL105 kernel: Lustre: 3384:0:(import.c:517:import_select_connection()) Skipped 35 previous similar messages Dec 1 21:33:24 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420156602419007 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (13s prior to deadline). Dec 1 21:33:24 ALPL105 kernel: req@ffff810c3d949c00 x1420156602419007/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354368817 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:33:24 ALPL105 kernel: Lustre: 3383:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 99 previous similar messages Dec 1 21:33:31 ALPL105 kernel: Lustre: Failing over LFS01-MDT0000 Dec 1 21:33:31 ALPL105 kernel: Lustre: Failing over LFS01-OST0012-osc Dec 1 21:33:31 ALPL105 kernel: Lustre: Skipped 1 previous similar message Dec 1 21:33:31 ALPL105 kernel: Lustre: LFS01-MDT0000: shutting down for failover; client state will be preserved. Dec 1 21:33:31 ALPL105 kernel: Lustre: MDT LFS01-MDT0000 has stopped. Dec 1 21:33:31 ALPL105 kernel: LustreError: 5831:0:(ldlm_request.c:1039:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway Dec 1 21:33:31 ALPL105 kernel: LustreError: 5831:0:(ldlm_request.c:1597:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 Dec 1 21:33:31 ALPL105 kernel: Lustre: MGS has stopped. Dec 1 21:33:31 ALPL105 multipathd: dm-0: umount map (uevent) Dec 1 21:33:31 ALPL105 kernel: Lustre: server umount LFS01-MDT0000 complete Dec 1 21:34:14 ALPL105 kernel: Lustre: Removed LNI 10.3.1.72@o2ib Dec 1 21:36:36 ALPL105 kernel: Lustre: Build Version: v1_8_8_WC1_RC3-g747d905-CHANGED-2.6.18-308.11.1.el5_lustre.g747d905P1 Dec 1 21:36:36 ALPL105 kernel: Lustre: Listener bound to ib0:10.3.1.72:987:qib0 Dec 1 21:36:36 ALPL105 kernel: Lustre: Added LNI 10.3.1.72@o2ib [8/64/0/180] Dec 1 21:36:36 ALPL105 kernel: Lustre: Lustre Client File System; http://www.lustre.org/ Dec 1 21:36:36 ALPL105 kernel: init dynlocks cache Dec 1 21:36:36 ALPL105 kernel: ldiskfs created from ext4-2.6-rhel5 Dec 1 21:36:36 ALPL105 kernel: LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended Dec 1 21:36:37 ALPL105 kernel: LDISKFS-fs (dm-0): mounted filesystem with ordered data mode Dec 1 21:36:37 ALPL105 multipathd: dm-0: umount map (uevent) Dec 1 21:36:37 ALPL105 kernel: JBD: barrier-based sync failed on dm-0-8 - disabling barriers Dec 1 21:36:37 ALPL105 kernel: LDISKFS-fs (dm-0): warning: maximal mount count reached, running e2fsck is recommended Dec 1 21:36:37 ALPL105 kernel: LDISKFS-fs (dm-0): mounted filesystem with ordered data mode Dec 1 21:36:37 ALPL105 kernel: Lustre: MGS MGS started Dec 1 21:36:37 ALPL105 kernel: Lustre: MGC10.3.1.72@o2ib: Reactivating import Dec 1 21:36:37 ALPL105 kernel: JBD: barrier-based sync failed on dm-0-8 - disabling barriers Dec 1 21:36:37 ALPL105 kernel: Lustre: Enabling user_xattr Dec 1 21:36:37 ALPL105 kernel: Lustre: Enabling ACL Dec 1 21:36:37 ALPL105 kernel: Lustre: 6959:0:(mds_fs.c:675:mds_init_server_data()) RECOVERY: service LFS01-MDT0000, 2 recoverable clients, 0 delayed clients, last_transno 38672353439 Dec 1 21:36:37 ALPL105 kernel: Lustre: LFS01-MDT0000: Now serving LFS01-MDT0000 on /dev/mpath/MDT with recovery enabled Dec 1 21:36:37 ALPL105 kernel: Lustre: LFS01-MDT0000: Will be in recovery for at least 5:00, or until 2 clients reconnect Dec 1 21:36:37 ALPL105 kernel: Lustre: 6959:0:(lproc_mds.c:271:lprocfs_wr_group_upcall()) LFS01-MDT0000: group upcall set to /usr/sbin/l_getgroups Dec 1 21:36:37 ALPL105 kernel: Lustre: 6959:0:(mds_lov.c:1155:mds_notify()) MDS LFS01-MDT0000: add target LFS01-OST0000_UUID Dec 1 21:36:37 ALPL105 kernel: Lustre: 6959:0:(mds_lov.c:1155:mds_notify()) MDS LFS01-MDT0000: add target LFS01-OST0002_UUID Dec 1 21:36:37 ALPL105 kernel: Lustre: 6959:0:(mds_lov.c:1155:mds_notify()) Skipped 1 previous similar message Dec 1 21:36:37 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420158824349703 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (5s prior to deadline). Dec 1 21:36:37 ALPL105 kernel: req@ffff810625ed2c00 x1420158824349703/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354369002 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:36:37 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420158824349709 sent from LFS01-OST0005-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (5s prior to deadline). Dec 1 21:36:37 ALPL105 kernel: req@ffff81062b4a9800 x1420158824349709/t0 o8->LFS01-OST0005_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354369002 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:36:37 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 4 previous similar messages Dec 1 21:36:48 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420158824349727 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (5s prior to deadline). Dec 1 21:36:48 ALPL105 kernel: req@ffff810c38943400 x1420158824349727/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354369013 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:36:48 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 14 previous similar messages Dec 1 21:36:54 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 1s Dec 1 21:36:54 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420158824349747 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (6s prior to deadline). Dec 1 21:36:54 ALPL105 kernel: req@ffff810c3e77f400 x1420158824349747/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354369020 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:36:54 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 21:37:13 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420158824349768 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (6s prior to deadline). Dec 1 21:37:13 ALPL105 kernel: req@ffff8106552c9c00 x1420158824349768/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354369039 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:37:13 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 21:37:20 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 2s Dec 1 21:37:20 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:37:20 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420158824349788 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (7s prior to deadline). Dec 1 21:37:20 ALPL105 kernel: req@ffff810c3a55b000 x1420158824349788/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354369047 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:37:20 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 21:37:38 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420158824349809 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (7s prior to deadline). Dec 1 21:37:38 ALPL105 kernel: req@ffff810c3fac9000 x1420158824349809/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354369065 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:37:38 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Dec 1 21:37:46 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 3s Dec 1 21:37:46 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:38:03 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420158824349850 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (8s prior to deadline). Dec 1 21:38:03 ALPL105 kernel: req@ffff810c3b3ca400 x1420158824349850/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354369091 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:38:03 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 39 previous similar messages Dec 1 21:38:12 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 4s Dec 1 21:38:12 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:38:38 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 5s Dec 1 21:38:38 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:38:38 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420158824349911 sent from LFS01-OST0000-osc to NID 10.3.1.68@o2ib 0s ago has failed due to network error (10s prior to deadline). Dec 1 21:38:38 ALPL105 kernel: req@ffff810c3ffa3400 x1420158824349911/t0 o8->LFS01-OST0000_UUID@10.3.1.68@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354369128 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:38:38 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 59 previous similar messages Dec 1 21:39:04 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 6s Dec 1 21:39:04 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:39:30 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 7s Dec 1 21:39:30 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:39:43 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) @@@ Request x1420158824350014 sent from LFS01-OST0000-osc to NID 10.3.1.69@o2ib 0s ago has failed due to network error (12s prior to deadline). Dec 1 21:39:43 ALPL105 kernel: req@ffff810655260400 x1420158824350014/t0 o8->LFS01-OST0000_UUID@10.3.1.69@o2ib:28/4 lens 368/584 e 0 to 1 dl 1354369195 ref 1 fl Rpc:N/0/0 rc 0/0 Dec 1 21:39:43 ALPL105 kernel: Lustre: 6721:0:(client.c:1486:ptlrpc_expire_one_request()) Skipped 99 previous similar messages Dec 1 21:39:56 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 8s Dec 1 21:39:56 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:40:47 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) LFS01-OST0000-osc: tried all connections, increasing latency to 9s Dec 1 21:40:47 ALPL105 kernel: Lustre: 6722:0:(import.c:517:import_select_connection()) Skipped 19 previous similar messages Dec 1 21:41:23 ALPL105 kernel: LustreError: 11-0: an error occurred while communicating with 10.3.1.69@o2ib. The ost_connect operation failed with -19 Dec 1 21:41:23 ALPL105 kernel: LustreError: 11-0: an error occurred while communicating with 10.3.1.70@o2ib. The ost_connect operation failed with -19 Dec 1 21:41:23 ALPL105 kernel: LustreError: Skipped 18 previous similar messages Dec 1 21:41:38 ALPL105 kernel: Lustre: 6721:0:(mds_lov.c:1191:mds_notify()) MDS LFS01-MDT0000: in recovery, not resetting orphans on LFS01-OST0006_UUID Dec 1 21:41:38 ALPL105 kernel: Lustre: LFS01-OST0006-osc: Connection restored to service LFS01-OST0006 using nid 10.3.1.69@o2ib. Dec 1 21:43:17 ALPL105 : error getting update info: Cannot find a valid baseurl for repo: base [root@ALPL105 ~]#