[LU-3562] Test failure on test suite insanity, subtest test_1

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.5.0
• Fix Version/s: Lustre 2.5.0
• Type: Bug
• Priority: Minor
• Reporter: Maloo
• Assignee: Nathaniel Clark
• Resolution: Fixed
• Labels: dne, review-dne-zfs, zfs
• Severity: 3

Description

This issue was created by maloo for girish <[e-mail]>

This issue relates to the following test suite run: http://maloo.whamcloud.com/test_sets/77d44438-e62b-11e2-af1b-52540035b04c.

The sub-test test_1 failed with the following error:

test failed to respond and timed out

Info required for matching: insanity 1

Issue Links

• duplicates: LU-2059 mgc to backup configuration on osd-ba...

Comments

[Andreas Dilger]

Girish, when you file a bug, please include done detail about what the failure actually is. "subtest 1 timed out" doesn't really describe what failed.

[Girish Shilamkar (Inactive)]

mdt could not be mounted and hence the testcase failed. test_1 tests MDS failover.
wtm-27vm7: mount.lustre: mount lustre-mdt2/mdt2 at /mnt/mds2 failed: Input/output error
wtm-27vm7: Is the MGS running?
Start of lustre-mdt2/mdt2 on mds2 failed 5
insanity test_1: @@@@@@ FAIL: test_1 failed with 2
Trace dump:
= /usr/lib64/lustre/tests/test-framework.sh:4066:error_noexit()
= /usr/lib64/lustre/tests/test-framework.sh:4093:error()
= /usr/lib64/lustre/tests/test-framework.sh:4347:run_one()
= /usr/lib64/lustre/tests/test-framework.sh:4380:run_one_logged()
= /usr/lib64/lustre/tests/test-framework.sh:4235:run_test()
= /usr/lib64/lustre/tests/insanity.sh:204:main()
Dumping lctl log to /logdir/test_logs/2013-07-05/lustre-reviews-el6-x86_64-review-dne-zfs-1_1_1_16444_-70021528749020-062820/insanity.test_1.*.1373065388.log
CMD: wtm-27vm1,wtm-27vm2,wtm-27vm3,wtm-27vm4,wtm-27vm5,wtm-27vm6.rosso.whamcloud.com,wtm-27vm7,wtm-27vm8 /usr/sbin/lctl dk > /logdir/test_logs/2013-07-05/lustre-reviews-el6-x86_64-review-dne-zfs-1_1_1_16444_-70021528749020-062820/insanity.test_1.debug_log.\$(hostname -s).1373065388.log;
dmesg > /logdir/test_logs/2013-07-05/lustre-reviews-el6-x86_64-review-dne-zfs-1_1_1_16444_-70021528749020-062820/insanity.test_1.dmesg.\$(hostname -s).1373065388.log

[Jodi Levi (Inactive)]

Nathaniel,
Could you please look into this one?
thank you!

[Nathaniel Clark]

This has never passed on zfs as far as I can tell. I believe this is another case of LU-2059 and I'll EXCEPT it for zfs.

[Nathaniel Clark]

I'm incorrect, this is dne specific (though it hasn't passed on zfs since the end of 2012).

[Nathaniel Clark]

MDS2 syslog while trying to come up without mgs (on MDS1) present.

6:02:55:LustreError: 15c-8: MGC10.10.17.15@tcp: The configuration from log 'lustre-MDT0001' failed (-5). This may be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information.
16:02:55:LustreError: 12402:0:(obd_mount_server.c:1256:server_start_targets()) failed to start server lustre-MDT0001: -5
16:02:55:LustreError: 12402:0:(obd_mount_server.c:1698:server_fill_super()) Unable to start targets: -5
16:02:55:LustreError: 12402:0:(obd_mount_server.c:843:lustre_disconnect_lwp()) lustre-MDT0000-lwp-MDT0001: Can't end config log lustre-client.
16:02:55:LustreError: 12402:0:(obd_mount_server.c:1425:server_put_super()) lustre-MDT0001: failed to disconnect lwp. (rc=-2)

Actually checked back at "passing" ZFS test, it was a place holder. I believe this is will be addressed by LU-2059.

[Nathaniel Clark]

http://review.whamcloud.com/6965