[root@localhost ~]# tail -f /var/log/messages May 19 18:04:21 localhost dnsmasq[2937]: reading /etc/resolv.conf May 19 18:04:21 localhost dnsmasq[2937]: using nameserver 121.242.190.211#53 May 19 18:04:21 localhost dnsmasq[2937]: using nameserver 121.242.190.180#53 May 19 18:04:21 localhost dnsmasq[2937]: read /etc/hosts - 2 addresses May 19 18:04:21 localhost dnsmasq[2937]: read /var/lib/libvirt/dnsmasq/default.addnhosts - 0 addresses May 19 18:04:21 localhost dnsmasq[2937]: read /var/lib/libvirt/dnsmasq/default.hostsfile May 19 18:04:21 localhost kernel: Ebtables v2.0 registered May 19 18:04:23 localhost kernel: lo: Disabled Privacy Extensions May 19 18:04:27 localhost polkitd[3128]: started daemon version 0.96 using authority implementation `local' version `0.96' May 19 18:04:28 localhost rtkit-daemon[3140]: Sucessfully made thread 3138 of process 3138 (/usr/bin/pulseaudio) owned by '42' high priority at nice level -11. May 19 18:05:54 localhost kernel: LNet: HW CPU cores: 1, npartitions: 1 May 19 18:05:54 localhost kernel: alg: No test for adler32 (adler32-zlib) May 19 18:05:54 localhost kernel: alg: No test for crc32 (crc32-table) May 19 18:05:54 localhost kernel: alg: No test for crc32 (crc32-pclmul) May 19 18:05:58 localhost modprobe: FATAL: Error inserting padlock_sha (/lib/modules/2.6.32.431.5.1.el6_lustre/kernel/drivers/crypto/padlock-sha.ko): No such device May 19 18:05:58 localhost kernel: padlock: VIA PadLock Hash Engine not detected. May 19 18:06:02 localhost kernel: Lustre: Lustre: Build Version: 2.7.51-g26b8238-CHANGED-2.6.32.431.5.1.el6_lustre May 19 18:06:02 localhost kernel: LNet: Added LNI 192.168.102.13@tcp [8/256/0/180] May 19 18:06:02 localhost kernel: LNet: Accept all, port 988 May 19 18:06:03 localhost kernel: Lustre: Echo OBD driver; http://www.lustre.org/ May 19 18:06:05 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:06:05 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:06:06 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:06:07 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:06:07 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:06:07 localhost kernel: Lustre: Setting parameter lustre-MDT0000-mdtlov.lov.stripesize in log lustre-MDT0000 May 19 18:06:07 localhost kernel: Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space May 19 18:06:07 localhost kernel: Lustre: lustre-MDT0000: new disk, initializing May 19 18:06:08 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:06:08 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:06:08 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:06:08 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:06:08 localhost kernel: Lustre: lustre-OST0001: new disk, initializing May 19 18:06:08 localhost kernel: Lustre: Skipped 1 previous similar message May 19 18:06:08 localhost kernel: Lustre: srv-lustre-OST0001: No data found on store. Initialize space May 19 18:06:08 localhost kernel: Lustre: Skipped 2 previous similar messages May 19 18:06:20 localhost kernel: Lustre: client enabled MDS capability! May 19 18:06:20 localhost kernel: Lustre: client enabled OSS capability! May 19 18:06:21 localhost kernel: Lustre: Mounted lustre-client May 19 18:06:22 localhost kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 May 19 18:07:15 localhost kernel: Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400):0:mdt May 19 18:19:42 localhost seahorse-daemon[5462]: DNS-SD initialization failed: Daemon not running May 19 18:19:42 localhost seahorse-daemon[5462]: init gpgme version 1.1.8 May 19 18:19:43 localhost kernel: fuse init (API version 7.13) May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] Unable to locate theme engine in module_path: "clearlooks", May 19 18:19:53 localhost vmusr[5512]: [ warning] [Gtk] gtk_disable_setlocale() must be called before gtk_init() May 19 18:20:22 localhost kernel: Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request May 19 18:20:22 localhost kernel: Lustre: Fid capabilities renewed: 0 May 19 18:20:22 localhost kernel: Fid capabilities renewal ENOENT: 0 May 19 18:20:22 localhost kernel: Fid capabilities failed to renew: 0 May 19 18:20:22 localhost kernel: Fid capabilities renewal retries: 0 May 19 18:20:22 localhost kernel: Lustre: Unmounted lustre-client May 19 18:20:22 localhost kernel: LustreError: 3528:0:(client.c:1074:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88000fb89380 x1501601686724040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 May 19 18:20:22 localhost kernel: LustreError: 11-0: lustre-MDT0000-lwp-OST0000: operation obd_ping to node 0@lo failed: rc = -107 May 19 18:20:22 localhost kernel: Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete May 19 18:20:22 localhost kernel: Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) May 19 18:20:27 localhost kernel: Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) May 19 18:20:27 localhost kernel: Lustre: Skipped 1 previous similar message May 19 18:20:29 localhost kernel: Lustre: server umount lustre-MDT0000 complete May 19 18:20:35 localhost kernel: Lustre: server umount lustre-OST0000 complete May 19 18:20:39 localhost kernel: Lustre: 3527:0:(client.c:1939:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1432039832/real 1432039832] req@ffff8800118399c0 x1501601686724068/t0(0) o400->MGC192.168.102.13@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1432039839 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 May 19 18:20:39 localhost kernel: LustreError: 166-1: MGC192.168.102.13@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail May 19 18:20:41 localhost kernel: Lustre: server umount lustre-OST0001 complete May 19 18:20:46 localhost kernel: LNet: Removed LNI 192.168.102.13@tcp May 19 18:21:07 localhost kernel: LNet: HW CPU cores: 1, npartitions: 1 May 19 18:21:07 localhost kernel: alg: No test for adler32 (adler32-zlib) May 19 18:21:07 localhost kernel: alg: No test for crc32 (crc32-table) May 19 18:21:07 localhost kernel: alg: No test for crc32 (crc32-pclmul) May 19 18:21:15 localhost kernel: Lustre: Lustre: Build Version: 2.7.51-g26b8238-CHANGED-2.6.32.431.5.1.el6_lustre May 19 18:21:15 localhost kernel: LNet: Added LNI 192.168.102.13@tcp [8/256/0/180] May 19 18:21:15 localhost kernel: LNet: Accept all, port 988 May 19 18:21:16 localhost kernel: Lustre: Echo OBD driver; http://www.lustre.org/ May 19 18:21:18 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:21:19 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:21:19 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:21:21 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:21:21 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:21:21 localhost kernel: Lustre: Setting parameter lustre-MDT0000-mdtlov.lov.stripesize in log lustre-MDT0000 May 19 18:21:21 localhost kernel: Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space May 19 18:21:21 localhost kernel: Lustre: lustre-MDT0000: new disk, initializing May 19 18:21:22 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:21:22 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:21:23 localhost kernel: Lustre: lustre-OST0000: new disk, initializing May 19 18:21:23 localhost kernel: Lustre: srv-lustre-OST0000: No data found on store. Initialize space May 19 18:21:23 localhost kernel: Lustre: Skipped 1 previous similar message May 19 18:21:23 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:21:23 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:21:35 localhost kernel: Lustre: client enabled MDS capability! May 19 18:21:35 localhost kernel: Lustre: client enabled OSS capability! May 19 18:21:35 localhost kernel: Lustre: Mounted lustre-client May 19 18:21:37 localhost kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 May 19 18:21:56 localhost kernel: Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400):0:mdt May 19 18:25:59 localhost kernel: Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request May 19 18:25:59 localhost kernel: Lustre: Fid capabilities renewed: 0 May 19 18:25:59 localhost kernel: Fid capabilities renewal ENOENT: 0 May 19 18:25:59 localhost kernel: Fid capabilities failed to renew: 0 May 19 18:25:59 localhost kernel: Fid capabilities renewal retries: 0 May 19 18:25:59 localhost kernel: Lustre: Unmounted lustre-client May 19 18:26:00 localhost kernel: LustreError: 6526:0:(client.c:1074:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff880010162980 x1501602644039384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 May 19 18:26:00 localhost kernel: LustreError: 11-0: lustre-MDT0000-lwp-OST0000: operation obd_ping to node 0@lo failed: rc = -107 May 19 18:26:00 localhost kernel: Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete May 19 18:26:00 localhost kernel: Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) May 19 18:26:05 localhost kernel: Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) May 19 18:26:05 localhost kernel: Lustre: Skipped 1 previous similar message May 19 18:26:07 localhost kernel: Lustre: server umount lustre-MDT0000 complete May 19 18:26:14 localhost kernel: Lustre: server umount lustre-OST0000 complete May 19 18:26:17 localhost kernel: Lustre: 6526:0:(client.c:1939:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1432040170/real 1432040170] req@ffff8800094139c0 x1501602644039408/t0(0) o400->MGC192.168.102.13@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1432040177 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 May 19 18:26:17 localhost kernel: LustreError: 166-1: MGC192.168.102.13@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail May 19 18:26:20 localhost kernel: Lustre: server umount lustre-OST0001 complete May 19 18:26:25 localhost kernel: LNet: Removed LNI 192.168.102.13@tcp May 19 18:26:33 localhost kernel: LNet: HW CPU cores: 1, npartitions: 1 May 19 18:26:33 localhost kernel: alg: No test for adler32 (adler32-zlib) May 19 18:26:33 localhost kernel: alg: No test for crc32 (crc32-table) May 19 18:26:33 localhost kernel: alg: No test for crc32 (crc32-pclmul) May 19 18:26:41 localhost kernel: Lustre: Lustre: Build Version: 2.7.51-g26b8238-CHANGED-2.6.32.431.5.1.el6_lustre May 19 18:26:41 localhost kernel: LNet: Added LNI 192.168.102.13@tcp [8/256/0/180] May 19 18:26:41 localhost kernel: LNet: Accept all, port 988 May 19 18:26:41 localhost kernel: Lustre: Echo OBD driver; http://www.lustre.org/ May 19 18:26:44 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:26:45 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:26:46 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:26:48 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:26:48 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:26:48 localhost kernel: Lustre: Setting parameter lustre-MDT0000-mdtlov.lov.stripesize in log lustre-MDT0000 May 19 18:26:48 localhost kernel: Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space May 19 18:26:48 localhost kernel: Lustre: lustre-MDT0000: new disk, initializing May 19 18:26:49 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:26:49 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:26:49 localhost kernel: Lustre: srv-lustre-OST0000: No data found on store. Initialize space May 19 18:26:49 localhost kernel: Lustre: Skipped 1 previous similar message May 19 18:26:49 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:26:49 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:26:49 localhost kernel: Lustre: lustre-OST0001: new disk, initializing May 19 18:26:49 localhost kernel: Lustre: Skipped 1 previous similar message May 19 18:26:59 localhost kernel: Lustre: client enabled MDS capability! May 19 18:26:59 localhost kernel: Lustre: client enabled OSS capability! May 19 18:26:59 localhost kernel: Lustre: Mounted lustre-client May 19 18:27:00 localhost kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 May 19 18:27:55 localhost kernel: Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400):0:mdt May 19 18:30:11 localhost kernel: Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request May 19 18:30:11 localhost kernel: Lustre: 8949:0:(llite_lib.c:2689:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.102.13@tcp:/lustre/fid: [0x200000400:0x1:0x0]/ may get corrupted (rc -108) May 19 18:30:11 localhost kernel: Lustre: Fid capabilities renewed: 0 May 19 18:30:11 localhost kernel: Fid capabilities renewal ENOENT: 0 May 19 18:30:11 localhost kernel: Fid capabilities failed to renew: 0 May 19 18:30:11 localhost kernel: Fid capabilities renewal retries: 0 May 19 18:30:11 localhost kernel: Lustre: Unmounted lustre-client May 19 18:30:14 localhost kernel: LustreError: 11-0: lustre-MDT0000-lwp-OST0000: operation obd_ping to node 0@lo failed: rc = -107 May 19 18:30:14 localhost kernel: Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete May 19 18:30:14 localhost kernel: Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) May 19 18:30:15 localhost kernel: LustreError: 8949:0:(client.c:1074:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88000cf1ac80 x1501602985873608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 May 19 18:30:19 localhost kernel: Lustre: server umount lustre-MDT0000 complete May 19 18:30:25 localhost kernel: Lustre: server umount lustre-OST0000 complete May 19 18:30:26 localhost kernel: Lustre: 8950:0:(client.c:1939:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1432040419/real 1432040419] req@ffff88000fac59c0 x1501602985873616/t0(0) o400->MGC192.168.102.13@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1432040426 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 May 19 18:30:26 localhost kernel: LustreError: 166-1: MGC192.168.102.13@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail May 19 18:30:32 localhost kernel: Lustre: server umount lustre-OST0001 complete May 19 18:30:36 localhost kernel: LNet: Removed LNI 192.168.102.13@tcp May 19 18:31:03 localhost kernel: LNet: HW CPU cores: 1, npartitions: 1 May 19 18:31:03 localhost kernel: alg: No test for adler32 (adler32-zlib) May 19 18:31:03 localhost kernel: alg: No test for crc32 (crc32-table) May 19 18:31:03 localhost kernel: alg: No test for crc32 (crc32-pclmul) May 19 18:31:12 localhost kernel: Lustre: Lustre: Build Version: 2.7.51-g26b8238-CHANGED-2.6.32.431.5.1.el6_lustre May 19 18:31:12 localhost kernel: LNet: Added LNI 192.168.102.13@tcp [8/256/0/180] May 19 18:31:12 localhost kernel: LNet: Accept all, port 988 May 19 18:31:12 localhost kernel: Lustre: Echo OBD driver; http://www.lustre.org/ May 19 18:31:14 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:31:15 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:31:16 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:31:17 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:31:17 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:31:17 localhost kernel: Lustre: Setting parameter lustre-MDT0000-mdtlov.lov.stripesize in log lustre-MDT0000 May 19 18:31:17 localhost kernel: Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space May 19 18:31:17 localhost kernel: Lustre: lustre-MDT0000: new disk, initializing May 19 18:31:18 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:31:18 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:31:18 localhost kernel: Lustre: lustre-OST0000: new disk, initializing May 19 18:31:18 localhost kernel: Lustre: srv-lustre-OST0000: No data found on store. Initialize space May 19 18:31:18 localhost kernel: Lustre: Skipped 1 previous similar message May 19 18:31:18 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:31:19 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:31:28 localhost kernel: Lustre: client enabled MDS capability! May 19 18:31:28 localhost kernel: Lustre: client enabled OSS capability! May 19 18:31:28 localhost kernel: Lustre: Mounted lustre-client May 19 18:31:29 localhost kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 May 19 18:32:16 localhost kernel: Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400):0:mdt May 19 18:44:52 localhost kernel: Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request May 19 18:44:52 localhost kernel: Lustre: Fid capabilities renewed: 0 May 19 18:44:52 localhost kernel: Fid capabilities renewal ENOENT: 0 May 19 18:44:52 localhost kernel: Fid capabilities failed to renew: 0 May 19 18:44:52 localhost kernel: Fid capabilities renewal retries: 0 May 19 18:44:52 localhost kernel: Lustre: Unmounted lustre-client May 19 18:44:55 localhost kernel: LustreError: 11-0: lustre-MDT0000-lwp-OST0000: operation obd_ping to node 0@lo failed: rc = -107 May 19 18:44:55 localhost kernel: Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete May 19 18:44:55 localhost kernel: Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) May 19 18:44:55 localhost kernel: LustreError: 11388:0:(client.c:1074:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff880017c8d9c0 x1501603270025776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 May 19 18:45:00 localhost kernel: LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. May 19 18:45:00 localhost kernel: Lustre: server umount lustre-MDT0000 complete May 19 18:45:06 localhost kernel: Lustre: server umount lustre-OST0000 complete May 19 18:45:07 localhost kernel: Lustre: 11388:0:(client.c:1939:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1432041300/real 1432041300] req@ffff880017c8dcc0 x1501603270025784/t0(0) o400->MGC192.168.102.13@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1432041307 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 May 19 18:45:07 localhost kernel: LustreError: 166-1: MGC192.168.102.13@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail May 19 18:45:13 localhost kernel: Lustre: server umount lustre-OST0001 complete May 19 18:45:18 localhost kernel: LNet: Removed LNI 192.168.102.13@tcp May 19 18:47:20 localhost kernel: LNet: HW CPU cores: 1, npartitions: 1 May 19 18:47:20 localhost kernel: alg: No test for adler32 (adler32-zlib) May 19 18:47:20 localhost kernel: alg: No test for crc32 (crc32-table) May 19 18:47:20 localhost kernel: alg: No test for crc32 (crc32-pclmul) May 19 18:47:28 localhost kernel: Lustre: Lustre: Build Version: 2.7.51-g26b8238-CHANGED-2.6.32.431.5.1.el6_lustre May 19 18:47:28 localhost kernel: LNet: Added LNI 192.168.102.13@tcp [8/256/0/180] May 19 18:47:28 localhost kernel: LNet: Accept all, port 988 May 19 18:47:29 localhost kernel: Lustre: Echo OBD driver; http://www.lustre.org/ May 19 18:47:31 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:47:33 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:47:34 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:47:35 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:47:35 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:47:36 localhost kernel: Lustre: Setting parameter lustre-MDT0000-mdtlov.lov.stripesize in log lustre-MDT0000 May 19 18:47:36 localhost kernel: Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space May 19 18:47:36 localhost kernel: Lustre: lustre-MDT0000: new disk, initializing May 19 18:47:36 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:47:36 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:47:36 localhost kernel: Lustre: lustre-OST0000: new disk, initializing May 19 18:47:36 localhost kernel: Lustre: srv-lustre-OST0000: No data found on store. Initialize space May 19 18:47:36 localhost kernel: Lustre: Skipped 1 previous similar message May 19 18:47:37 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:47:37 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:47:48 localhost kernel: Lustre: client enabled MDS capability! May 19 18:47:48 localhost kernel: Lustre: client enabled OSS capability! May 19 18:47:48 localhost kernel: Lustre: Mounted lustre-client May 19 18:47:49 localhost kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 May 19 18:50:16 localhost kernel: LDISKFS-fs (loop7): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:50:59 localhost kernel: LDISKFS-fs (loop7): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:50:59 localhost kernel: LDISKFS-fs (loop7): mounted filesystem with ordered data mode. quota=on. Opts: May 19 18:50:59 localhost kernel: Lustre: srv-lustre-MDT0001: No data found on store. Initialize space May 19 18:50:59 localhost kernel: Lustre: Skipped 1 previous similar message May 19 18:50:59 localhost kernel: Lustre: lustre-MDT0001: new disk, initializing May 19 18:50:59 localhost kernel: Lustre: Skipped 1 previous similar message May 19 18:50:59 localhost kernel: Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400):0:ost May 19 18:50:59 localhost kernel: Lustre: cli-ffff88003d0b6184-su: Allocated super-sequence [0x0000000200000400-0x0000000240000400):0:ost] May 19 18:51:24 localhost kernel: Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400):0:mdt May 19 18:51:24 localhost kernel: Lustre: Skipped 1 previous similar message May 19 19:04:46 localhost kernel: Lustre: setting import lustre-MDT0000_UUID INACTIVE by administrator request May 19 19:04:46 localhost kernel: Lustre: Fid capabilities renewed: 0 May 19 19:04:46 localhost kernel: Fid capabilities renewal ENOENT: 0 May 19 19:04:46 localhost kernel: Fid capabilities failed to renew: 0 May 19 19:04:46 localhost kernel: Fid capabilities renewal retries: 0 May 19 19:04:46 localhost kernel: Lustre: Unmounted lustre-client May 19 19:04:48 localhost kernel: LustreError: 11-0: lustre-MDT0000-lwp-OST0000: operation obd_ping to node 0@lo failed: rc = -107 May 19 19:04:48 localhost kernel: Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete May 19 19:04:48 localhost kernel: Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) May 19 19:04:51 localhost kernel: LustreError: 13935:0:(client.c:1074:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88003a23d6c0 x1501604293473456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 May 19 19:04:53 localhost kernel: Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) May 19 19:04:53 localhost kernel: Lustre: Skipped 3 previous similar messages May 19 19:04:54 localhost kernel: Lustre: server umount lustre-MDT0000 complete May 19 19:04:56 localhost kernel: LustreError: 11-0: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 May 19 19:04:56 localhost kernel: LustreError: Skipped 3 previous similar messages May 19 19:04:56 localhost kernel: Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete May 19 19:04:56 localhost kernel: Lustre: Skipped 3 previous similar messages May 19 19:04:56 localhost kernel: Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) May 19 19:04:56 localhost kernel: Lustre: Skipped 3 previous similar messages May 19 19:04:58 localhost kernel: LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. May 19 19:05:01 localhost kernel: Lustre: server umount lustre-OST0000 complete May 19 19:05:03 localhost kernel: LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. May 19 19:05:03 localhost kernel: LustreError: Skipped 2 previous similar messages May 19 19:05:05 localhost kernel: Lustre: 13936:0:(client.c:1939:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1432042498/real 1432042498] req@ffff8800140cb0c0 x1501604293473516/t0(0) o400->MGC192.168.102.13@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1432042505 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 May 19 19:05:05 localhost kernel: LustreError: 166-1: MGC192.168.102.13@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail May 19 19:05:06 localhost kernel: LustreError: 11-0: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 May 19 19:05:06 localhost kernel: Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete May 19 19:05:06 localhost kernel: Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) May 19 19:05:08 localhost kernel: Lustre: server umount lustre-OST0001 complete May 19 19:05:10 localhost kernel: LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. May 19 19:05:10 localhost kernel: LustreError: Skipped 2 previous similar messages May 19 19:05:11 localhost kernel: Lustre: 13934:0:(client.c:1939:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1432042505/real 1432042505] req@ffff88003a23d9c0 x1501604293473560/t0(0) o250->MGC192.168.102.13@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1432042511 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 May 19 19:05:15 localhost kernel: LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. May 19 19:05:15 localhost kernel: LustreError: Skipped 1 previous similar message May 19 19:05:20 localhost kernel: LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. May 19 19:05:20 localhost kernel: LustreError: Skipped 1 previous similar message May 19 19:05:26 localhost kernel: Lustre: 13934:0:(client.c:1939:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1432042515/real 1432042515] req@ffff88003a23d9c0 x1501604293473584/t0(0) o250->MGC192.168.102.13@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1432042526 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 May 19 19:05:30 localhost kernel: LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. May 19 19:05:30 localhost kernel: LustreError: Skipped 3 previous similar messages May 19 19:05:40 localhost kernel: Lustre: Failing over lustre-MDT0001 May 19 19:05:40 localhost kernel: Lustre: server umount lustre-MDT0001 complete May 19 19:06:11 localhost kernel: ------------[ cut here ]------------ May 19 19:06:11 localhost kernel: WARNING: at fs/proc/generic.c:591 proc_register+0xb9/0x170() (Not tainted) May 19 19:06:11 localhost kernel: Hardware name: VMware Virtual Platform May 19 19:06:11 localhost kernel: proc_dir_entry 'lustre/osc' already registered May 19 19:06:11 localhost kernel: Modules linked in: osc(+)(U) mdc(U) lmv(U) ofd(U) osp(U) lod(U) mdt(U) mdd(U) osd_ldiskfs(U) ldiskfs(U) lquota(U) lfsck(U) mgc(U) fid(U) fld(U) ptlrpc(U) obdclass(U) ksocklnd(U) lnet(U) libcfs(U) fuse exportfs jbd sha512_generic sha256_generic crc32c_intel ebtable_nat ebtables ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 ipt_REJECT xt_CHECKSUM iptable_mangle iptable_filter ip_tables bridge stp llc autofs4 sunrpc ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter ip6_tables ipv6 vhost_net macvtap macvlan tun uinput microcode ppdev vmware_balloon parport_pc parport e1000 sg i2c_piix4 i2c_core shpchp ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom mptspi mptscsih mptbase scsi_transport_spi pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: lmv] May 19 19:06:11 localhost kernel: Pid: 18273, comm: modprobe Not tainted 2.6.32.431.5.1.el6_lustre #2 May 19 19:06:11 localhost kernel: Call Trace: May 19 19:06:11 localhost kernel: [] ? warn_slowpath_common+0x87/0xc0 May 19 19:06:11 localhost kernel: [] ? warn_slowpath_fmt+0x46/0x50 May 19 19:06:11 localhost kernel: [] ? proc_register+0xb9/0x170 May 19 19:06:11 localhost kernel: [] ? proc_mkdir_mode+0x42/0x60 May 19 19:06:11 localhost kernel: [] ? proc_mkdir+0x16/0x20 May 19 19:06:11 localhost kernel: [] ? lprocfs_register+0x1b/0x80 [obdclass] May 19 19:06:11 localhost kernel: [] ? class_register_type+0xb87/0xe50 [obdclass] May 19 19:06:11 localhost kernel: [] ? osc_init+0x0/0x1f7 [osc] May 19 19:06:11 localhost kernel: [] ? osc_init+0x9f/0x1f7 [osc] May 19 19:06:11 localhost kernel: [] ? do_one_initcall+0x3c/0x1d0 May 19 19:06:11 localhost kernel: [] ? sys_init_module+0xdf/0x250 May 19 19:06:11 localhost kernel: [] ? system_call_fastpath+0x16/0x1b May 19 19:06:11 localhost kernel: ---[ end trace efb3c0602d6827aa ]--- May 19 19:06:11 localhost kernel: ------------[ cut here ]------------ May 19 19:06:11 localhost kernel: WARNING: at fs/proc/generic.c:591 proc_register+0xb9/0x170() (Tainted: G W --------------- ) May 19 19:06:11 localhost kernel: Hardware name: VMware Virtual Platform May 19 19:06:11 localhost kernel: proc_dir_entry 'lustre/lov' already registered May 19 19:06:11 localhost kernel: Modules linked in: lov(+)(U) osc(U) mdc(U) lmv(U) ofd(U) osp(U) lod(U) mdt(U) mdd(U) osd_ldiskfs(U) ldiskfs(U) lquota(U) lfsck(U) mgc(U) fid(U) fld(U) ptlrpc(U) obdclass(U) ksocklnd(U) lnet(U) libcfs(U) fuse exportfs jbd sha512_generic sha256_generic crc32c_intel ebtable_nat ebtables ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 ipt_REJECT xt_CHECKSUM iptable_mangle iptable_filter ip_tables bridge stp llc autofs4 sunrpc ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter ip6_tables ipv6 vhost_net macvtap macvlan tun uinput microcode ppdev vmware_balloon parport_pc parport e1000 sg i2c_piix4 i2c_core shpchp ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom mptspi mptscsih mptbase scsi_transport_spi pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: lmv] May 19 19:06:11 localhost kernel: Pid: 18283, comm: modprobe Tainted: G W --------------- 2.6.32.431.5.1.el6_lustre #2 May 19 19:06:11 localhost kernel: Call Trace: May 19 19:06:11 localhost kernel: [] ? warn_slowpath_common+0x87/0xc0 May 19 19:06:11 localhost kernel: [] ? warn_slowpath_fmt+0x46/0x50 May 19 19:06:11 localhost kernel: [] ? proc_register+0xb9/0x170 May 19 19:06:11 localhost kernel: [] ? proc_mkdir_mode+0x42/0x60 May 19 19:06:11 localhost kernel: [] ? proc_mkdir+0x16/0x20 May 19 19:06:11 localhost kernel: [] ? lprocfs_register+0x1b/0x80 [obdclass] May 19 19:06:11 localhost kernel: [] ? class_register_type+0xb87/0xe50 [obdclass] May 19 19:06:11 localhost kernel: [] ? lov_init+0x0/0x1cf [lov] May 19 19:06:11 localhost kernel: [] ? lov_init+0xbe/0x1cf [lov] May 19 19:06:11 localhost kernel: [] ? do_one_initcall+0x3c/0x1d0 May 19 19:06:11 localhost kernel: [] ? sys_init_module+0xdf/0x250 May 19 19:06:11 localhost kernel: [] ? system_call_fastpath+0x16/0x1b May 19 19:06:11 localhost kernel: ---[ end trace efb3c0602d6827ab ]--- May 19 19:06:11 localhost kernel: Lustre: Echo OBD driver; http://www.lustre.org/ May 19 19:06:14 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 19:06:14 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 19:06:15 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 19:06:17 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 19:06:17 localhost kernel: LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=on. Opts: May 19 19:06:17 localhost kernel: Lustre: Setting parameter lustre-MDT0000-mdtlov.lov.stripesize in log lustre-MDT0000 May 19 19:06:17 localhost kernel: Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space May 19 19:06:17 localhost kernel: Lustre: lustre-MDT0000: new disk, initializing May 19 19:06:18 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 19:06:18 localhost kernel: LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=on. Opts: May 19 19:06:18 localhost kernel: Lustre: lustre-OST0000: new disk, initializing May 19 19:06:18 localhost kernel: Lustre: srv-lustre-OST0000: No data found on store. Initialize space May 19 19:06:18 localhost kernel: Lustre: Skipped 1 previous similar message May 19 19:06:18 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 19:06:18 localhost kernel: LDISKFS-fs (loop2): mounted filesystem with ordered data mode. quota=on. Opts: May 19 19:06:32 localhost kernel: Lustre: client enabled MDS capability! May 19 19:06:32 localhost kernel: Lustre: client enabled OSS capability! May 19 19:06:32 localhost kernel: Lustre: Mounted lustre-client May 19 19:06:34 localhost kernel: Lustre: DEBUG MARKER: Using TIMEOUT=20 ^C [root@localhost ~]# cat /etc/redhat-release Scientific Linux release 6.6 (Carbon) [root@localhost ~]# lfs --version lfs 2.7.51 [root@localhost ~]#