[LU-7161] Failover: replay-single test_93: import is not in FULL state

Wed, 16 Sep 2015 16:52:47 +0000

This issue was created by maloo for Saurabh Tandan <saurabh.tandan@intel.com>

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/47cfcf92-52de-11e5-b61c-5254006e85c2.

The sub-test test_93 failed with the following error:

import is not in FULL state

Test Logs:

Started lustre-OST0006
CMD: shadow-16vm5,shadow-16vm6,shadow-16vm9 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/mpi/gcc/openmpi/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/bin:/bin:/usr/sbin:/sbin::/sbin:/bin:/usr/sbin: NAME=autotest_config sh rpc.sh wait_import_state_mount FULL osc.lustre-OST0000-osc-*.ost_server_uuid,osc.lustre-OST0001-osc-*.ost_server_uuid,osc.lustre-OST0002-osc-*.ost_server_uuid,osc.lustre-OST0003-osc-*.ost_server_uuid,osc.lustre-OST0004-osc-*.ost_server_uuid,osc.lustre-OST0005-osc-*.ost_server_uuid,osc.lustre-OST0006-osc-*.ost_server_uuid 
shadow-16vm9: CMD: shadow-16vm9 lctl get_param -n at_max
shadow-16vm6: CMD: shadow-16vm6 lctl get_param -n at_max
shadow-16vm6: osc.lustre-OST0000-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm5: CMD: shadow-16vm5 lctl get_param -n at_max
shadow-16vm5: osc.lustre-OST0000-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm5: osc.lustre-OST0001-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm6: osc.lustre-OST0001-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm5: osc.lustre-OST0002-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm6: osc.lustre-OST0002-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm5: osc.lustre-OST0003-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm6: osc.lustre-OST0003-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm5: osc.lustre-OST0004-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm6: osc.lustre-OST0004-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm5: osc.lustre-OST0005-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm6: osc.lustre-OST0005-osc-*.ost_server_uuid in FULL state after 0 sec
shadow-16vm5: osc.lustre-OST0006-osc-*.ost_server_uuid in FULL state after 27 sec
shadow-16vm6: osc.lustre-OST0006-osc-*.ost_server_uuid in FULL state after 27 sec
shadow-16vm9:  rpc : @@@@@@ FAIL: can't put import for osc.lustre-OST0000-osc-*.ost_server_uuid into FULL state after 1475 sec, have CONNECTING 
shadow-16vm9:   Trace dump:
shadow-16vm9:   = /usr/lib64/lustre/tests/test-framework.sh:4748:error_noexit()
shadow-16vm9:   = /usr/lib64/lustre/tests/test-framework.sh:4779:error()
shadow-16vm9:   = /usr/lib64/lustre/tests/test-framework.sh:5837:_wait_import_state()
shadow-16vm9:   = /usr/lib64/lustre/tests/test-framework.sh:5856:wait_import_state()
shadow-16vm9:   = /usr/lib64/lustre/tests/test-framework.sh:5865:wait_import_state_mount()
shadow-16vm9:   = rpc.sh:20:main()
shadow-16vm9: CMD: shadow-16vm5,shadow-16vm6,shadow-16vm7,shadow-16vm8,shadow-16vm9 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:./../utils:/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/mpi/gcc/openmpi/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/bin:/bin:/usr/sbin:/sbin::/sbin:/bin:/usr/sbin::/sbin:/bin:/usr/sbin: NAME=autotest_config sh rpc.sh check_logdir /tmp/test_logs/1441336611 
shadow-16vm9: CMD: shadow-16vm5 uname -n
shadow-16vm9: Dumping lctl log to /tmp/test_logs/1441336611/rpc..*.1441338097.log
shadow-16vm9: CMD: shadow-16vm5,shadow-16vm6,shadow-16vm7,shadow-16vm8,shadow-16vm9 /usr/sbin/lctl dk > /tmp/test_logs/1441336611/rpc..debug_log.\$(hostname -s).1441338097.log;
shadow-16vm9:          dmesg > /tmp/test_logs/1441336611/rpc..dmesg.\$(hostname -s).1441338097.log
shadow-16vm9: CMD: shadow-16vm5,shadow-16vm6,shadow-16vm7,shadow-16vm8,shadow-16vm9 rsync -az /tmp/test_logs/1441336611/rpc..*.1441338097.log shadow-16vm9:/tmp/test_logs/1441336611
 replay-single test_93: @@@@@@ FAIL: import is not in FULL state

MDS1- dmesg:

[  767.211669] LustreError: 1733:0:(osp_precreate.c:899:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: cannot cleanup orphans: rc = -22

Whamcloud Community JIRA

[LU-7161] Failover: replay-single test_93: import is not in FULL state