https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-4256 Lustre <p>This issue was created by maloo for sarah &lt;sarah@whamcloud.com&gt;</p> <p>This issue relates to the following test suite run: <a href="http://maloo.whamcloud.com/test_sets/45f323be-49e3-11e3-8efa-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">http://maloo.whamcloud.com/test_sets/45f323be-49e3-11e3-8efa-52540035b04c</a>.</p> <p>The sub-test test_2b failed with the following error:</p> <blockquote> <p>test failed to respond and timed out</p></blockquote> <p>test log shows:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>lustre_rsync took 22 seconds Changelog records consumed: 926 Only in /mnt/lustre/d0.lustre-rsync-test/d2/clients/client0/~dmtmp/WORDPRO: BENCHS1A.PRN lustre-rsync-test test_2b: @@@@@@ FAIL: Failure in replication; differences found. </pre> </div></div> server: lustre-master build # 1752 RHEL6 ldiskfs<br/> client: 2.5.0 RHEL6 ldiskfs<br/> <br/> Also seen in review-dne with both server and client are RHEL6 ldiskfs LU-4256

lustre-rsync-test test_2b: Failure in replication; differences found

Bug Minor Open Unresolved WC Triage Maloo always_except Fri, 15 Nov 2013 04:38:34 +0000 Tue, 4 Sep 2018 19:05:06 +0000 Lustre 2.6.0 Lustre 2.8.0 Lustre 2.12.0 0 16 <p>I found the same failure under non interoperability mode.<br/> <a href="https://maloo.whamcloud.com/test_sets/f0019a40-7682-11e3-bf7d-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/f0019a40-7682-11e3-bf7d-52540035b04c</a><br/> <a href="https://maloo.whamcloud.com/test_sets/ec956efe-76a5-11e3-8c14-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/ec956efe-76a5-11e3-8c14-52540035b04c</a></p> <p>also seen in lustre-master build #1876<br/> server: RHEL6 ldiskfs<br/> client: SLES11 SP3 ldiskfs</p> <p><a href="https://maloo.whamcloud.com/test_sets/7edd3618-90d0-11e3-91ee-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/7edd3618-90d0-11e3-91ee-52540035b04c</a></p> <p>This is related to, but looks different than, <a href="https://jira.whamcloud.com/browse/LU-4781" title="lustre-rsync-test test_2b: Replication of operation failed(-17)" class="issue-link" data-issue-key="LU-4781"><del>LU-4781</del></a>. This bug just reports a replication difference, while <a href="https://jira.whamcloud.com/browse/LU-4781" title="lustre-rsync-test test_2b: Replication of operation failed(-17)" class="issue-link" data-issue-key="LU-4781"><del>LU-4781</del></a> reports errors during replication.</p> <p>Another failure instance:</p> <p><a href="https://maloo.whamcloud.com/test_sets/24f9ee20-cc4e-11e3-bda1-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/24f9ee20-cc4e-11e3-bda1-52540035b04c</a></p> <p>I think this is another:<br/> <a href="https://testing.hpdd.intel.com/test_sets/3efa00dc-6fdf-11e4-85fc-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/3efa00dc-6fdf-11e4-85fc-5254006e85c2</a></p> <p>It reports as a TIMEOUT, not a FAIL, but the test log says:</p> <p>Only in /mnt/lustre/d2b.lustre-rsync-test/clients/client1/~dmtmp/PARADOX: __QB4.MB<br/> lustre-rsync-test test_2b: @@@@@@ FAIL: Failure in replication; differences found.</p> <p>A few more recent occurrences (non-interop, review-dne-part-1):<br/> 2015-07-21 03:39:41 - <a href="https://testing.hpdd.intel.com/test_sets/36ca7078-2f69-11e5-ad00-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/36ca7078-2f69-11e5-ad00-5254006e85c2</a><br/> 2015-07-21 14:18:36 - <a href="https://testing.hpdd.intel.com/test_sets/1ede63bc-2fc2-11e5-ad00-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/1ede63bc-2fc2-11e5-ad00-5254006e85c2</a><br/> 2015-10-25 19:49:39 - <a href="https://testing.hpdd.intel.com/test_sets/b915e5c6-7b5e-11e5-9ee6-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/b915e5c6-7b5e-11e5-9ee6-5254006e85c2</a><br/> 2016-02-03 14:36:57 - <a href="https://testing.hpdd.intel.com/test_sets/d0a0de2c-ca90-11e5-9609-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/d0a0de2c-ca90-11e5-9609-5254006e85c2</a></p> <p>Another instance found for interop tag 2.7.66 -2.5.5 Server/EL6.7 Client, build# 3316<br/> <a href="https://testing.hpdd.intel.com/test_sets/2f54e8ae-ccf9-11e5-b1fa-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/2f54e8ae-ccf9-11e5-b1fa-5254006e85c2</a></p> <p>+1 on master review: <a href="https://testing.hpdd.intel.com/test_sets/3c38bf1a-7f4f-11e6-8a8c-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/3c38bf1a-7f4f-11e6-8a8c-5254006e85c2</a></p> <p>+1 on master:<br/> <a href="https://testing.hpdd.intel.com/test_logs/1161528c-4a2a-11e8-95c0-52540065bddc/show_text" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_logs/1161528c-4a2a-11e8-95c0-52540065bddc/show_text</a></p> <p>+1 on master<br/> <a href="https://testing.hpdd.intel.com/test_sets/7c5aead0-6262-11e8-b303-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/7c5aead0-6262-11e8-b303-52540065bddc</a></p> <p>on master:<br/> <a href="https://testing.whamcloud.com/test_sets/a76a4428-9025-11e8-a9f7-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/a76a4428-9025-11e8-a9f7-52540065bddc</a></p> <p>John L. Hammond (jhammond@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/33006" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33006</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-4256" title="lustre-rsync-test test_2b: Failure in replication; differences found" class="issue-link" data-issue-key="LU-4256">LU-4256</a> test: add lustre-rsync-test 2b to ALWAYS_EXCEPT<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 2e8251b3b66c98c539a2fcbaf3c4b7da7fdfd81d</p> <p>This failed about 11x per week for the past 4 weeks.</p> <p>I suspect the test timeout is because the <tt>cleanup_src_tgt</tt> step is taking a long time to do <tt>rm -rf $DIR/$tdir</tt> after running dbench, though that doesn't absolve the original error. At least there aren't any Lustre errors in the console logs for any of the nodes. </p> <p>The recent failures have a lot of the following errors, though I'm not sure if these are new or not:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Error replicating xattr for /tmp/target/d2b.lustre-rsync-test/clients/client0/~dmtmp/WORD/TIPS.DOC: 2 Error replicating xattr for /tmp/target/d2b.lustre-rsync-test/clients/client0/~dmtmp/WORD/TIPS.DOC: 2 Error replicating xattr for /tmp/target/d2b.lustre-rsync-test/clients/client0/~dmtmp/WORD/TIPS.DOC: 2 </pre> </div></div> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/33006/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33006/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-4256" title="lustre-rsync-test test_2b: Failure in replication; differences found" class="issue-link" data-issue-key="LU-4256">LU-4256</a> test: add lustre-rsync-test 2b to ALWAYS_EXCEPT<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: e253179a26f48716702891208772543142579ce1</p> Duplicate LU-4978 Related LU-4781 Development Rank 1|hzw8z3: Rank (Obsolete) 11613 Severity