Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-8563

conf-sanity test_56: import is not in FULL state

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Minor
    • None
    • Lustre 2.10.0, Lustre 2.11.0
    • None
    • master
    • 3
    • 9223372036854775807

    Description

      This issue was created by maloo for Saurabh Tandan <saurabh.tandan@intel.com>

      This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/70e2554c-6d3d-11e6-8a8c-5254006e85c2.

      The sub-test test_56 failed with the following error:

      import is not in FULL state
      

      test logs:

      Starting client: onyx-66.onyx.hpdd.intel.com:  -o user_xattr,flock onyx-64@o2ib:/lustre /mnt/lustre
      CMD: onyx-66.onyx.hpdd.intel.com mkdir -p /mnt/lustre
      CMD: onyx-66.onyx.hpdd.intel.com mount -t lustre -o user_xattr,flock onyx-64@o2ib:/lustre /mnt/lustre
      ok
      OBDS:
      1000: lustre-OST03e8_UUID ACTIVE
      10000: lustre-OST2710_UUID ACTIVE
      CMD: onyx-64 lctl list_param osc.lustre-OST*-osc             > /dev/null 2>&1
      CMD: onyx-64 lctl get_param -n at_min
      CMD: onyx-64 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/qt-3.3/bin:/usr/lib64/compat-openmpi16/bin:/usr/bin:/bin:/usr/sbin:/sbin::/sbin:/bin:/usr/sbin: NAME=autotest_config sh rpc.sh wait_import_state FULL osc.lustre-OST2710-osc-MDT0000.ost_server_uuid 40 
      onyx-64:  rpc : @@@@@@ FAIL: can't put import for osc.lustre-OST2710-osc-MDT0000.ost_server_uuid into FULL state after 40 sec, have  
      onyx-64:   Trace dump:
      onyx-64:   = /usr/lib64/lustre/tests/test-framework.sh:4819:error()
      onyx-64:   = /usr/lib64/lustre/tests/test-framework.sh:5895:_wait_import_state()
      onyx-64:   = /usr/lib64/lustre/tests/test-framework.sh:5917:wait_import_state()
      onyx-64:   = rpc.sh:20:main()
      onyx-64: CMD: onyx-64,onyx-64.onyx.hpdd.intel.com,onyx-65,onyx-67 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:./../utils:/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/qt-3.3/bin:/usr/lib64/compat-openmpi16/bin:/usr/bin:/bin:/usr/sbin:/sbin::/sbin:/bin:/usr/sbin::/sbin:/bin:/usr/sbin: NAME=autotest_config sh rpc.sh check_logdir /tmp/test_logs/1472391902 
      onyx-64: CMD: onyx-64 uname -n
      onyx-64: CMD: onyx-64.onyx.hpdd.intel.com uname -n
      onyx-64: Dumping lctl log to /tmp/test_logs/1472391902/rpc..*.1472391944.log
      onyx-64: CMD: onyx-64,onyx-64.onyx.hpdd.intel.com,onyx-65,onyx-67 /usr/sbin/lctl dk > /tmp/test_logs/1472391902/rpc..debug_log.\$(hostname -s).1472391944.log;
      onyx-64:          dmesg > /tmp/test_logs/1472391902/rpc..dmesg.\$(hostname -s).1472391944.log
      onyx-64: onyx-67: invalid parameter 'dump_kernel'
      onyx-64: onyx-67: open(dump_kernel) failed: No such file or directory
      onyx-64: CMD: onyx-64,onyx-64.onyx.hpdd.intel.com,onyx-65,onyx-67 rsync -az /tmp/test_logs/1472391902/rpc..*.1472391944.log onyx-64.onyx.hpdd.intel.com:/tmp/test_logs/1472391902
      onyx-64: CMD: onyx-64,onyx-65 /usr/sbin/lctl set_param debug=\"\"
      onyx-64: onyx-64: error: set_param: setting debug: no value
      onyx-64: onyx-65: error: set_param: setting debug: no value
      onyx-64: CMD: onyx-64,onyx-64.onyx.hpdd.intel.com,onyx-65,onyx-67 lctl set_param -n fail_loc=0 	    fail_val=0 2>/dev/null
      onyx-64: Resetting fail_loc on all nodes...done.
       conf-sanity test_56: @@@@@@ FAIL: import is not in FULL state 
      

      Can be related to LU-5905
      This issue has occurred around 13 times in past 2 months.

      Attachments

        Issue Links

          Activity

            People

              wc-triage WC Triage
              maloo Maloo
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: