Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-18366

interop: sanity-flr test_0g: FAIL: error resync-ing file '/mnt/lustre/f0g.sanity-flr'

Details

    • Bug
    • Resolution: Duplicate
    • Blocker
    • None
    • Lustre 2.16.0
    • 3
    • 9223372036854775807

    Description

      This issue was created by maloo for jianyu <yujian@whamcloud.com>

      This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/0be154b6-6f0c-43fd-bf39-98965995eb91

      test_0g failed with the following error:

      lfs mirror mirror: fail to pread 0-4096 of mirror 1: Invalid argument (22)
lfs mirror mirror: error reading bytes 0-4096 of mirror 1: Invalid argument (22)
lfs mirror mirror: fail to mirror resync '/mnt/lustre/f0g.sanity-flr': Invalid argument (22)
 sanity-flr test_0g: @@@@@@ FAIL: error resync-ing file '/mnt/lustre/f0g.sanity-flr'

      Test session details:
      clients: https://build.whamcloud.com/job/lustre-master/4584 - 4.18.0-553.16.1.el8_10.x86_64
      servers: https://build.whamcloud.com/job/lustre-b2_15/94 - 4.18.0-553.5.1.el8_lustre.x86_64

      <<Please provide additional information about the failure here>>

      VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV
      sanity-flr test_0g - error resync-ing file '/mnt/lustre/f0g.sanity-flr'

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-17525 Unaligned DIO interop with different page sizes fails

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          mentioned in

          [Whamcloud Community Wiki] Page Page No Confluence page found with the given URL.

          [Whamcloud Community Wiki] Page Page No Confluence page found with the given URL.

          [Whamcloud Community Wiki] Page Page No Confluence page found with the given URL.

          [Whamcloud Community Wiki] Page Page No Confluence page found with the given URL.

          Page Loading...

          Page Loading...

          Activity

            [LU-18366] interop: sanity-flr test_0g: FAIL: error resync-ing file '/mnt/lustre/f0g.sanity-flr'
            tappro Mikhail Pershin added a comment -

            well, good to know it is not LU-17906 after all

            tappro Mikhail Pershin added a comment - well, good to know it is not LU-17906 after all
            yujian Jian Yu added a comment -

            The same failures occurred in Lustre 2.16.0 RC4:
            https://testing.whamcloud.com/test_sets/5e973afb-d35a-46df-91ea-c6c8d1410c47

            sanity-sec: FAIL: test_52 could not resync mirror
sanity-sec: FAIL: test_59a verifying mirror failed (1)
sanity-sec: FAIL: test_59b verifying mirror failed (1)

            sanity-flr: FAIL: test_0g error resync-ing file '/mnt/lustre/f0g.sanity-flr'
sanity-flr: FAIL: test_0h error resync-ing file '/mnt/lustre/d0h.sanity-flr/f0h.sanity-flr'
sanity-flr: FAIL: test_0j resync /mnt/lustre/f0j.sanity-flr failed
sanity-flr: FAIL: test_37 1: mismatch: \'04d8acaa945a97ef3137c142bb27db92  -\' vs. \'7736938e3332e9479f34deacfc298d68  -\'
sanity-flr: FAIL: test_42 resync /mnt/lustre/d42.sanity-flr/f42.sanity-flr-1 failed
sanity-flr: FAIL: test_50b data mismatch: \'1e70156068f9c8a0e53b1f91fe3ae737  -\' vs. \'d41d8cd98f00b204e9800998ecf8427e  -\'
sanity-flr: FAIL: test_50d data mismatch: \'ebec484d45a1e0611b3100548350e382  -\' vs. \'d41d8cd98f00b204e9800998ecf8427e  -\'
sanity-flr: FAIL: test_61a cannot migrate /mnt/lustre/d61a.sanity-flr/f61a.sanity-flr
sanity-flr: FAIL: test_61c cannot resync mirror /mnt/lustre/d61c.sanity-flr/f61c.sanity-flr
sanity-flr: FAIL: test_70a fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed
sanity-flr: FAIL: test_200a final resync failed
sanity-flr: FAIL: test_200b final resync failed
            yujian Jian Yu added a comment - The same failures occurred in Lustre 2.16.0 RC4: https://testing.whamcloud.com/test_sets/5e973afb-d35a-46df-91ea-c6c8d1410c47 sanity-sec: FAIL: test_52 could not resync mirror sanity-sec: FAIL: test_59a verifying mirror failed (1) sanity-sec: FAIL: test_59b verifying mirror failed (1) sanity-flr: FAIL: test_0g error resync-ing file '/mnt/lustre/f0g.sanity-flr' sanity-flr: FAIL: test_0h error resync-ing file '/mnt/lustre/d0h.sanity-flr/f0h.sanity-flr' sanity-flr: FAIL: test_0j resync /mnt/lustre/f0j.sanity-flr failed sanity-flr: FAIL: test_37 1: mismatch: \'04d8acaa945a97ef3137c142bb27db92 -\' vs. \'7736938e3332e9479f34deacfc298d68 -\' sanity-flr: FAIL: test_42 resync /mnt/lustre/d42.sanity-flr/f42.sanity-flr-1 failed sanity-flr: FAIL: test_50b data mismatch: \'1e70156068f9c8a0e53b1f91fe3ae737 -\' vs. \'d41d8cd98f00b204e9800998ecf8427e -\' sanity-flr: FAIL: test_50d data mismatch: \'ebec484d45a1e0611b3100548350e382 -\' vs. \'d41d8cd98f00b204e9800998ecf8427e -\' sanity-flr: FAIL: test_61a cannot migrate /mnt/lustre/d61a.sanity-flr/f61a.sanity-flr sanity-flr: FAIL: test_61c cannot resync mirror /mnt/lustre/d61c.sanity-flr/f61c.sanity-flr sanity-flr: FAIL: test_70a fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed sanity-flr: FAIL: test_200a final resync failed sanity-flr: FAIL: test_200b final resync failed
            yujian Jian Yu added a comment - - edited

            The same failures occurred in Lustre 2.16.0 RC3:
            https://testing.whamcloud.com/test_sets/93c3c173-4e95-4731-9a34-f2d23c9368d7
            https://testing.whamcloud.com/test_sets/3f4c06f7-76c6-4447-bbd8-42f84620c3c5
            https://testing.whamcloud.com/test_sets/476e39bd-ecc0-496f-aa6e-f7bf05acee9c

            yujian Jian Yu added a comment - - edited The same failures occurred in Lustre 2.16.0 RC3: https://testing.whamcloud.com/test_sets/93c3c173-4e95-4731-9a34-f2d23c9368d7 https://testing.whamcloud.com/test_sets/3f4c06f7-76c6-4447-bbd8-42f84620c3c5 https://testing.whamcloud.com/test_sets/476e39bd-ecc0-496f-aa6e-f7bf05acee9c
            pjones Peter Jones added a comment -

            tappro is this another side-effect of LU-17906?

            pjones Peter Jones added a comment - tappro is this another side-effect of LU-17906 ?
            yujian Jian Yu added a comment -

            More regression failures:

            sanity-sec: FAIL: test_52 could not resync mirror
sanity-sec: FAIL: test_59a verifying mirror failed (1)
sanity-sec: FAIL: test_59b verifying mirror failed (1)

            https://testing.whamcloud.com/test_sets/377539bb-0ea3-473a-a252-06f7b8ee1dea

            yujian Jian Yu added a comment - More regression failures: sanity-sec: FAIL: test_52 could not resync mirror sanity-sec: FAIL: test_59a verifying mirror failed (1) sanity-sec: FAIL: test_59b verifying mirror failed (1) https://testing.whamcloud.com/test_sets/377539bb-0ea3-473a-a252-06f7b8ee1dea
            yujian Jian Yu added a comment -

            More sanity regression failures:

            sanity: FAIL: test_56x migrate failed rc = 22
sanity: FAIL: test_56xa migrate failed rc = 22
sanity: FAIL: test_56xc unexpected stripe count 1 != 2
sanity: FAIL: test_56ej migrate remote dir error /mnt/lustre/d56ej.sanity.src /mnt/lustre/d56ej.sanity.dest/f56ej.sanity.mgrt
sanity: FAIL: test_398o bad KMS
sanity: FAIL: test_398s mirror resync failed

            https://testing.whamcloud.com/test_sets/31f28c42-129d-4424-8b1a-ab02ec26cc05

            yujian Jian Yu added a comment - More sanity regression failures: sanity: FAIL: test_56x migrate failed rc = 22 sanity: FAIL: test_56xa migrate failed rc = 22 sanity: FAIL: test_56xc unexpected stripe count 1 != 2 sanity: FAIL: test_56ej migrate remote dir error /mnt/lustre/d56ej.sanity.src /mnt/lustre/d56ej.sanity.dest/f56ej.sanity.mgrt sanity: FAIL: test_398o bad KMS sanity: FAIL: test_398s mirror resync failed https://testing.whamcloud.com/test_sets/31f28c42-129d-4424-8b1a-ab02ec26cc05
            yujian Jian Yu added a comment - - edited

            More sanity-flr subtests failed with the similar issue:

            == sanity-flr test complete, duration 1770 sec =========== 03:51:13 (1728791473)
sanity-flr: FAIL: test_0g error resync-ing file '/mnt/lustre/f0g.sanity-flr'
sanity-flr: FAIL: test_0h error resync-ing file '/mnt/lustre/d0h.sanity-flr/f0h.sanity-flr'
sanity-flr: FAIL: test_0j resync /mnt/lustre/f0j.sanity-flr failed
sanity-flr: FAIL: test_37 1: mismatch: \'ec71c760694ca69c598ae00189683df8  -\' vs. \'9ef5b1d2eb35e01fc7ce02893d77ff4a  -\'
sanity-flr: FAIL: test_38 valid mirror doesn't exist
sanity-flr: FAIL: test_42 resync /mnt/lustre/d42.sanity-flr/f42.sanity-flr-1 failed
sanity-flr: FAIL: test_50a data mismatch: \'e7785df2c515c75dd9d743d8adea5918  -\' vs. \'d41d8cd98f00b204e9800998ecf8427e  -\'
sanity-flr: FAIL: test_50b data mismatch: \'267cb9cb0da2c81ebefa760cd599c5d0  -\' vs. \'d41d8cd98f00b204e9800998ecf8427e  -\'
sanity-flr: FAIL: test_50d data mismatch: \'bcdb34bd846d5427496c6bc82f219a33  -\' vs. \'d41d8cd98f00b204e9800998ecf8427e  -\'
sanity-flr: FAIL: test_61a cannot migrate /mnt/lustre/d61a.sanity-flr/f61a.sanity-flr
sanity-flr: FAIL: test_61c cannot resync mirror /mnt/lustre/d61c.sanity-flr/f61c.sanity-flr
sanity-flr: FAIL: test_70a fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed
sanity-flr: FAIL: test_200a final resync failed
sanity-flr: FAIL: test_200b final resync failed
=== sanity-flr: start cleanup 03:51:13 (1728791473) ===

            lfs mirror mirror: fail to pread 0-4096 of mirror 1: Invalid argument (22)
lfs mirror mirror: error reading bytes 0-4096 of mirror 1: Invalid argument (22)
            yujian Jian Yu added a comment - - edited More sanity-flr subtests failed with the similar issue: == sanity-flr test complete, duration 1770 sec =========== 03:51:13 (1728791473) sanity-flr: FAIL: test_0g error resync-ing file '/mnt/lustre/f0g.sanity-flr' sanity-flr: FAIL: test_0h error resync-ing file '/mnt/lustre/d0h.sanity-flr/f0h.sanity-flr' sanity-flr: FAIL: test_0j resync /mnt/lustre/f0j.sanity-flr failed sanity-flr: FAIL: test_37 1: mismatch: \'ec71c760694ca69c598ae00189683df8 -\' vs. \'9ef5b1d2eb35e01fc7ce02893d77ff4a -\' sanity-flr: FAIL: test_38 valid mirror doesn't exist sanity-flr: FAIL: test_42 resync /mnt/lustre/d42.sanity-flr/f42.sanity-flr-1 failed sanity-flr: FAIL: test_50a data mismatch: \'e7785df2c515c75dd9d743d8adea5918 -\' vs. \'d41d8cd98f00b204e9800998ecf8427e -\' sanity-flr: FAIL: test_50b data mismatch: \'267cb9cb0da2c81ebefa760cd599c5d0 -\' vs. \'d41d8cd98f00b204e9800998ecf8427e -\' sanity-flr: FAIL: test_50d data mismatch: \'bcdb34bd846d5427496c6bc82f219a33 -\' vs. \'d41d8cd98f00b204e9800998ecf8427e -\' sanity-flr: FAIL: test_61a cannot migrate /mnt/lustre/d61a.sanity-flr/f61a.sanity-flr sanity-flr: FAIL: test_61c cannot resync mirror /mnt/lustre/d61c.sanity-flr/f61c.sanity-flr sanity-flr: FAIL: test_70a fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed sanity-flr: FAIL: test_200a final resync failed sanity-flr: FAIL: test_200b final resync failed === sanity-flr: start cleanup 03:51:13 (1728791473) === lfs mirror mirror: fail to pread 0-4096 of mirror 1: Invalid argument (22) lfs mirror mirror: error reading bytes 0-4096 of mirror 1: Invalid argument (22)
            yujian Jian Yu added a comment -

            This is a regression failure in Lustre 2.16.0 RC2.
            sanity-flr test 0h and 0j failed with the same error.
             

            yujian Jian Yu added a comment - This is a regression failure in Lustre 2.16.0 RC2. sanity-flr test 0h and 0j failed with the same error.  

            People

              tappro Mikhail Pershin
              maloo Maloo
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: