Details
-
Bug
-
Resolution: Cannot Reproduce
-
Major
-
None
-
Lustre 2.4.0
-
None
-
3
-
5593
Description
This issue was created by maloo for Li Wei <liwei@whamcloud.com>
This issue relates to the following test suite run: https://maloo.whamcloud.com/test_sets/4a0bf3d6-2f9a-11e2-bd52-52540035b04c.
The sub-test test_8b failed with the following error:
test_8b failed with 1
From the test log:
== replay-ost-single test 8b: Verify redo io: redo io should success after recovery == 02:13:49 (1352715229)
CMD: c10 /usr/sbin/lctl get_param -n version
1280+0 records in
1280+0 records out
5242880 bytes (5.2 MB) copied, 0.699096 s, 7.5 MB/s
CMD: c04 lctl set_param fail_loc=0x230
fail_loc=0x230
Failing ost1 on node c04
CMD: c04 grep -c /mnt/ost1' ' /proc/mounts
Stopping /mnt/ost1 (opts:) on c04
CMD: c04 umount -d /mnt/ost1
CMD: c04 lsmod | grep lnet > /dev/null && lctl dl | grep ' ST '
affected facets: ost1
CMD: c04 cp /etc/zfs/zpool.cache /tmp/zpool.cache.back
CMD: c04 zpool export lustre-ost1
CMD: c04 zpool import -f -c /tmp/zpool.cache.back lustre-ost1
Failover ost1 to c04
02:14:25 (1352715265) waiting for c04 network 900 secs ...
02:14:25 (1352715265) network interface is UP
CMD: c04 hostname
Starting ost1: lustre-ost1/ost1 /mnt/ost1
CMD: c04 mkdir -p /mnt/ost1; mount -t lustre lustre-ost1/ost1 /mnt/ost1
CMD: c04 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/openmpi/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin: NAME=autotest_config sh rpc.sh set_default_debug \"0x33f0404\" \" 0xffb7e3ff\" 32
dd: writing `/mnt/lustre/d0.replay-ost-single/f.replay-ost-single.8b': Input/output error
1+0 records in
0+0 records out
0 bytes (0 B) copied, 36.6623 s, 0.0 kB/s
CMD: c04 zfs get -H -o value lustre:svname lustre-ost1/ost1 2>/dev/null
Started lustre-OST0000
CMD: c04 lctl set_param fail_loc=0
fail_loc=0
replay-ost-single test_8b: @@@@@@ FAIL: test_8b failed with 1
Trace dump:
= /usr/lib64/lustre/tests/test-framework.sh:3865:error_noexit()
= /usr/lib64/lustre/tests/test-framework.sh:3888:error()
= /usr/lib64/lustre/tests/test-framework.sh:4143:run_one()
= /usr/lib64/lustre/tests/test-framework.sh:4173:run_one_logged()
= /usr/lib64/lustre/tests/test-framework.sh:4031:run_test()
= /usr/lib64/lustre/tests/replay-ost-single.sh:293:main()
Dumping lctl log to /logdir/test_logs/2012-11-11/lustre-master-el6-x86_64-zfs__10378__-69821878305700-212321/replay-ost-single.test_8b.*.1352715329.log
CMD: c04,c10,c15,c20 /usr/sbin/lctl dk > /logdir/test_logs/2012-11-11/lustre-master-el6-x86_64-zfs__10378__-69821878305700-212321/replay-ost-single.test_8b.debug_log.\$(hostname -s).1352715329.log;
dmesg > /logdir/test_logs/2012-11-11/lustre-master-el6-x86_64-zfs__10378__-69821878305700-212321/replay-ost-single.test_8b.dmesg.\$(hostname -s).1352715329.log
Info required for matching: replay-ost-single 8b