Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-9968

sanity test 300g fails with 'create dir2 fails'

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • Lustre 2.11.0
    • Lustre 2.10.1, Lustre 2.11.0
    • 3
    • 9223372036854775807

    Description

      sanity test_300g fails with the following lines from the test_log output

      == sanity test 300g: check default striped directory for normal directory ============================ 17:47:37 (1504806457)
      CMD: onyx-40vm7 /usr/sbin/lctl get_param -n version 2>/dev/null ||
      				/usr/sbin/lctl lustre_build_version 2>/dev/null ||
      				/usr/sbin/lctl --version 2>/dev/null | cut -d' ' -f2
      error on LL_IOC_LMV_SETSTRIPE '/mnt/lustre/d300g.sanity/striped_dir/dir2' (3): No such device
      /usr/bin/lfs setdirstripe: cannot create stripe dir '/mnt/lustre/d300g.sanity/striped_dir/dir2': No such device
       sanity test_300g: @@@@@@ FAIL: create dir2 fails 
      

      The problem is in the test at

      15297         $LFS setdirstripe -i2 $DIR/$tdir/striped_dir/dir2 ||
      15298                 error "create dir2 fails"
      15299         stripe_index=$($LFS getdirstripe -i $DIR/$tdir/striped_dir/dir2)
      15300         [ $stripe_index -eq 2 ] ||
      15301                 error "dir2 expect 2 got $stripe_index"
      

      The test checks that there are at least two MDTs (we need to stop using MDSCOUNT as MDTCOUNT, but that’s for a different ticket) and then creates two directories with ‘lfs setdirstripe –iN …’, with N = 1 and 2, striping directories at MDT index 1 and MDT index 2.

      The problem here is that, with only two MDTs, creating a directory that starts with MDT index 1 works as expected, but creating a directory that starts at index 2 fails because MDT indexes are zero based and we only have two MDTs with indexes 0 and 1.

      This test has passed review-dne-part-* testing because typical DNE testing creates two MDSs with two MDTs each and a MDT starting index of 2 is valid.

      There are at least two ways to fix this issue; make sure you have three or more MDTs for this test or just create directories that have starting index 0 and 1.

      Logs for sanity test 300g failures are at
      https://testing.hpdd.intel.com/test_sets/01353734-7efb-11e7-bbc6-5254006e85c2
      https://testing.hpdd.intel.com/test_sets/dfb54824-9291-11e7-b72d-5254006e85c2
      https://testing.hpdd.intel.com/test_sets/874485f2-942f-11e7-b722-5254006e85c2

      I will create a patch for this issue.

      Attachments

        Activity

          [LU-9968] sanity test 300g fails with 'create dir2 fails'
          pjones Peter Jones made changes -
          Fix Version/s New: Lustre 2.11.0 [ 13091 ]
          Resolution New: Fixed [ 1 ]
          Status Original: Open [ 1 ] New: Resolved [ 5 ]
          pjones Peter Jones added a comment -

          Landed for 2.11

          pjones Peter Jones added a comment - Landed for 2.11

          Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/28935/
          Subject: LU-9968 tests: correct stripe index sanity 300g
          Project: fs/lustre-release
          Branch: master
          Current Patch Set:
          Commit: 52a1befd75087190ff23c0750b85bb632f772474

          gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/28935/ Subject: LU-9968 tests: correct stripe index sanity 300g Project: fs/lustre-release Branch: master Current Patch Set: Commit: 52a1befd75087190ff23c0750b85bb632f772474

          James Nunez (james.a.nunez@intel.com) uploaded a new patch: https://review.whamcloud.com/28935
          Subject: LU-9968 tests: correct stripe index sanity 300g
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: 24c2175d84835c093ed331ce3a6f498c382f7606

          gerrit Gerrit Updater added a comment - James Nunez (james.a.nunez@intel.com) uploaded a new patch: https://review.whamcloud.com/28935 Subject: LU-9968 tests: correct stripe index sanity 300g Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 24c2175d84835c093ed331ce3a6f498c382f7606
          jamesanunez James Nunez (Inactive) made changes -
          Description Original: sanity test_300g fails with the following lines from the test_log output
          {noformat}
          == sanity test 300g: check default striped directory for normal directory ============================ 17:47:37 (1504806457)
          CMD: onyx-40vm7 /usr/sbin/lctl get_param -n version 2>/dev/null ||
          /usr/sbin/lctl lustre_build_version 2>/dev/null ||
          /usr/sbin/lctl --version 2>/dev/null | cut -d' ' -f2
          error on LL_IOC_LMV_SETSTRIPE '/mnt/lustre/d300g.sanity/striped_dir/dir2' (3): No such device
          /usr/bin/lfs setdirstripe: cannot create stripe dir '/mnt/lustre/d300g.sanity/striped_dir/dir2': No such device
           sanity test_300g: @@@@@@ FAIL: create dir2 fails
          {noformat}

          The problem is in the test at
          {code}
          15297 $LFS setdirstripe -i2 $DIR/$tdir/striped_dir/dir2 ||
          15298 error "create dir2 fails"
          15299 stripe_index=$($LFS getdirstripe -i $DIR/$tdir/striped_dir/dir2)
          15300 [ $stripe_index -eq 2 ] ||
          15301 error "dir2 expect 2 got $stripe_index"
          {code}

          The test checks that there are at least two MDSs (it should check the number of MDTs, but that’s for a different ticket) and, thus, at least two MDTs. Then test 300g creates two directories with ‘lfs setdirstripe –iN …’, with N = 1 and 2, striping directories at MDT index 1 and MDT index 2.

          The problem here is that, with only two MDTs, creating a directory that starts with MDT index 1 works as expected, but creating a directory that starts at index 2 fails because MDT indexes are zero based and we only have two MDTs with indexes 0 and 1.

          This test has passed review-dne-part-* testing because typical DNE testing creates two MDSs with two MDTs each and a MDT starting index of 2 is valid.

          There are at least two ways to fix this issue; make sure you have three or more MDTs for this test or just create directories that have starting index 0 and 1.

          Logs for sanity test 300g failures are at
          https://testing.hpdd.intel.com/test_sets/01353734-7efb-11e7-bbc6-5254006e85c2
          https://testing.hpdd.intel.com/test_sets/dfb54824-9291-11e7-b72d-5254006e85c2
          https://testing.hpdd.intel.com/test_sets/874485f2-942f-11e7-b722-5254006e85c2

          I will create a patch for this issue.
          New: sanity test_300g fails with the following lines from the test_log output
          {noformat}
          == sanity test 300g: check default striped directory for normal directory ============================ 17:47:37 (1504806457)
          CMD: onyx-40vm7 /usr/sbin/lctl get_param -n version 2>/dev/null ||
          /usr/sbin/lctl lustre_build_version 2>/dev/null ||
          /usr/sbin/lctl --version 2>/dev/null | cut -d' ' -f2
          error on LL_IOC_LMV_SETSTRIPE '/mnt/lustre/d300g.sanity/striped_dir/dir2' (3): No such device
          /usr/bin/lfs setdirstripe: cannot create stripe dir '/mnt/lustre/d300g.sanity/striped_dir/dir2': No such device
           sanity test_300g: @@@@@@ FAIL: create dir2 fails
          {noformat}

          The problem is in the test at
          {code}
          15297 $LFS setdirstripe -i2 $DIR/$tdir/striped_dir/dir2 ||
          15298 error "create dir2 fails"
          15299 stripe_index=$($LFS getdirstripe -i $DIR/$tdir/striped_dir/dir2)
          15300 [ $stripe_index -eq 2 ] ||
          15301 error "dir2 expect 2 got $stripe_index"
          {code}

          The test checks that there are at least two MDTs (we need to stop using MDSCOUNT as MDTCOUNT, but that’s for a different ticket) and then creates two directories with ‘lfs setdirstripe –iN …’, with N = 1 and 2, striping directories at MDT index 1 and MDT index 2.

          The problem here is that, with only two MDTs, creating a directory that starts with MDT index 1 works as expected, but creating a directory that starts at index 2 fails because MDT indexes are zero based and we only have two MDTs with indexes 0 and 1.

          This test has passed review-dne-part-* testing because typical DNE testing creates two MDSs with two MDTs each and a MDT starting index of 2 is valid.

          There are at least two ways to fix this issue; make sure you have three or more MDTs for this test or just create directories that have starting index 0 and 1.

          Logs for sanity test 300g failures are at
          https://testing.hpdd.intel.com/test_sets/01353734-7efb-11e7-bbc6-5254006e85c2
          https://testing.hpdd.intel.com/test_sets/dfb54824-9291-11e7-b72d-5254006e85c2
          https://testing.hpdd.intel.com/test_sets/874485f2-942f-11e7-b722-5254006e85c2

          I will create a patch for this issue.
          jamesanunez James Nunez (Inactive) created issue -

          People

            jamesanunez James Nunez (Inactive)
            jamesanunez James Nunez (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: