[LU-8563] conf-sanity test_56: import is not in FULL state

• Status: Open
• Project: Lustre
• Affects Version/s: Lustre 2.10.0, Lustre 2.11.0
• Type: Bug
• Priority: Minor
• Reporter: Maloo
• Assignee: WC Triage
• Resolution: Unresolved

Environment

master

• Severity: 3

Description

This issue was created by maloo for Saurabh Tandan <[e-mail]>

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/70e2554c-6d3d-11e6-8a8c-5254006e85c2.

The sub-test test_56 failed with the following error:

import is not in FULL state

test logs:

Starting client: onyx-66.onyx.hpdd.intel.com:  -o user_xattr,flock onyx-64@o2ib:/lustre /mnt/lustre
CMD: onyx-66.onyx.hpdd.intel.com mkdir -p /mnt/lustre
CMD: onyx-66.onyx.hpdd.intel.com mount -t lustre -o user_xattr,flock onyx-64@o2ib:/lustre /mnt/lustre
ok
OBDS:
1000: lustre-OST03e8_UUID ACTIVE
10000: lustre-OST2710_UUID ACTIVE
CMD: onyx-64 lctl list_param osc.lustre-OST*-osc             > /dev/null 2>&1
CMD: onyx-64 lctl get_param -n at_min
CMD: onyx-64 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/qt-3.3/bin:/usr/lib64/compat-openmpi16/bin:/usr/bin:/bin:/usr/sbin:/sbin::/sbin:/bin:/usr/sbin: NAME=autotest_config sh rpc.sh wait_import_state FULL osc.lustre-OST2710-osc-MDT0000.ost_server_uuid 40 
onyx-64:  rpc : @@@@@@ FAIL: can't put import for osc.lustre-OST2710-osc-MDT0000.ost_server_uuid into FULL state after 40 sec, have  
onyx-64:   Trace dump:
onyx-64:   = /usr/lib64/lustre/tests/test-framework.sh:4819:error()
onyx-64:   = /usr/lib64/lustre/tests/test-framework.sh:5895:_wait_import_state()
onyx-64:   = /usr/lib64/lustre/tests/test-framework.sh:5917:wait_import_state()
onyx-64:   = rpc.sh:20:main()
onyx-64: CMD: onyx-64,onyx-64.onyx.hpdd.intel.com,onyx-65,onyx-67 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:./../utils:/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/qt-3.3/bin:/usr/lib64/compat-openmpi16/bin:/usr/bin:/bin:/usr/sbin:/sbin::/sbin:/bin:/usr/sbin::/sbin:/bin:/usr/sbin: NAME=autotest_config sh rpc.sh check_logdir /tmp/test_logs/1472391902 
onyx-64: CMD: onyx-64 uname -n
onyx-64: CMD: onyx-64.onyx.hpdd.intel.com uname -n
onyx-64: Dumping lctl log to /tmp/test_logs/1472391902/rpc..*.1472391944.log
onyx-64: CMD: onyx-64,onyx-64.onyx.hpdd.intel.com,onyx-65,onyx-67 /usr/sbin/lctl dk > /tmp/test_logs/1472391902/rpc..debug_log.\$(hostname -s).1472391944.log;
onyx-64:          dmesg > /tmp/test_logs/1472391902/rpc..dmesg.\$(hostname -s).1472391944.log
onyx-64: onyx-67: invalid parameter 'dump_kernel'
onyx-64: onyx-67: open(dump_kernel) failed: No such file or directory
onyx-64: CMD: onyx-64,onyx-64.onyx.hpdd.intel.com,onyx-65,onyx-67 rsync -az /tmp/test_logs/1472391902/rpc..*.1472391944.log onyx-64.onyx.hpdd.intel.com:/tmp/test_logs/1472391902
onyx-64: CMD: onyx-64,onyx-65 /usr/sbin/lctl set_param debug=\"\"
onyx-64: onyx-64: error: set_param: setting debug: no value
onyx-64: onyx-65: error: set_param: setting debug: no value
onyx-64: CMD: onyx-64,onyx-64.onyx.hpdd.intel.com,onyx-65,onyx-67 lctl set_param -n fail_loc=0 	    fail_val=0 2>/dev/null
onyx-64: Resetting fail_loc on all nodes...done.
 conf-sanity test_56: @@@@@@ FAIL: import is not in FULL state 

Can be related to LU-5905
This issue has occurred around 13 times in past 2 months.