Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-11987

sanity test 59 fails with “test_59 failed with 1”

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: Lustre 2.13.0, Lustre 2.12.1, Lustre 2.12.2, Lustre 2.14.0
    • Fix Version/s: None
    • Labels:
      None
    • Environment:
      DNE/ZFS
    • Severity:
      3
    • Rank (Obsolete):
      9223372036854775807

      Description

      sanity test_59 fails in wait_delete_completed_mds() with “test_59 failed with 1” for review-dne-zfs-part-1 only.

      sanity test 59 is a simple test that creates 130 files, unlinks the files and waits for 20 seconds, by default, until all osc.*MDT*.sync_* parameters are zero.

      Looking at the suite_log for https://testing.whamcloud.com/test_sets/299f3fba-358b-11e9-ae87-52540065bddc , we see that the sync parameters are not all zero for all MDSs within 28 seconds; some parameters that are zero are removed from the following output and replaced with “…”

      Delete is not completed in 28 seconds
      CMD: trevis-33vm4,trevis-33vm5 /usr/sbin/lctl get_param osc.*MDT*.sync_*
      …
      osc.lustre-OST0001-osc-MDT0000.sync_changes=0
      osc.lustre-OST0001-osc-MDT0000.sync_in_flight=0
      osc.lustre-OST0001-osc-MDT0000.sync_in_progress=16
      …
      osc.lustre-OST0002-osc-MDT0000.sync_changes=0
      osc.lustre-OST0002-osc-MDT0000.sync_in_flight=0
      osc.lustre-OST0002-osc-MDT0000.sync_in_progress=16
      …
      osc.lustre-OST0003-osc-MDT0000.sync_changes=0
      osc.lustre-OST0003-osc-MDT0000.sync_in_flight=0
      osc.lustre-OST0003-osc-MDT0000.sync_in_progress=17
      …
      osc.lustre-OST0004-osc-MDT0000.sync_changes=0
      osc.lustre-OST0004-osc-MDT0000.sync_in_flight=0
      osc.lustre-OST0004-osc-MDT0000.sync_in_progress=16
      …
      osc.lustre-OST0005-osc-MDT0000.sync_changes=0
      osc.lustre-OST0005-osc-MDT0000.sync_in_flight=0
      osc.lustre-OST0005-osc-MDT0000.sync_in_progress=16
      …
      osc.lustre-OST0007-osc-MDT0000.sync_changes=0
      osc.lustre-OST0007-osc-MDT0000.sync_in_flight=0
      osc.lustre-OST0007-osc-MDT0000.sync_in_progress=16
      …
       sanity test_59: @@@@@@ FAIL: test_59 failed with 1 
      

      There are no errors or other indication of a problem in the console logs.

      Note: We should check the return code of wait_delete_completed() and call error() when the return code is anything other than 0 to make the error message more descriptive/helpful.

      Logs for more failures are at:
      https://testing.whamcloud.com/test_sets/57398b58-2d41-11e9-90fb-52540065bddc
      https://testing.whamcloud.com/test_sets/42fcf44c-25a6-11e9-b901-52540065bddc
      https://testing.whamcloud.com/test_sets/455c7bc2-2574-11e9-b54c-52540065bddc

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              wc-triage WC Triage
              Reporter:
              jamesanunez James Nunez
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated: