https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-10978 Lustre <p>In lustre-rsync-test test_1A, we do some file system operations including creating a hard link, call lustre_rsync, do more operations and call lustre_rsync again using the log (-l option) from the first call to lustre_rsync. On the second lustre_rsync, we can see in the client test_log that we get an error:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Replication #2 Replication of operation failed(-1): 25 HLINK (3) [0x200012ce9:0x1c:0x0] [0x200012ce9:0x12:0x0] link2 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl1 Starting changelog record: 0 Clear changelog after use: no Errors: 1 </pre> </div></div> <p>In the debug log, we see that there is no issue with replicating the hard link the first time we call lustre_rsync:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>***** Start 25 HLINK (3) [0x200012ce9:0x1c:0x0] [0x200012ce9:0x12:0x0] link2 ***** parent fid2path d1A.lustre-rsync-test/d1, link2, rc=0 link destination is /tmp/target/d1A.lustre-rsync-test/d1/link2 fid2path d1A.lustre-rsync-test/d1/link1, link2, 0 rc=0 link source is /tmp/target/d1A.lustre-rsync-test/d1/link1 link: /tmp/target/d1A.lustre-rsync-test/d1/link1 [to] /tmp/target/d1A.lustre-rsync-test/d1/link2; rc1=0 Success parent fid2path d1A.lustre-rsync-test/d1, link2, rc=0 link destination is /tmp/target2/d1A.lustre-rsync-test/d1/link2 fid2path d1A.lustre-rsync-test/d1/link1, link2, 0 rc=0 link source is /tmp/target2/d1A.lustre-rsync-test/d1/link1 link: /tmp/target2/d1A.lustre-rsync-test/d1/link1 [to] /tmp/target2/d1A.lustre-rsync-test/d1/link2; rc1=0 Success ##### End 25 HLINK (3) [0x200012ce9:0x1c:0x0] [0x200012ce9:0x12:0x0] link2 rc=0 ##### </pre> </div></div> <p>We get a failure on the second call to lustre_rsync</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>***** Start 25 HLINK (3) [0x200012ce9:0x1c:0x0] [0x200012ce9:0x12:0x0] link2 ***** parent fid2path d1A.lustre-rsync-test/d1, link2, rc=0 link destination is /tmp/target/d1A.lustre-rsync-test/d1/link2 fid2path d1A.lustre-rsync-test/d1/link1, link2, 0 rc=0 link source is /tmp/target/d1A.lustre-rsync-test/d1/link1 link: /tmp/target/d1A.lustre-rsync-test/d1/link1 [to] /tmp/target/d1A.lustre-rsync-test/d1/link2; rc1=-1 File exists parent fid2path d1A.lustre-rsync-test/d1, link2, rc=0 link destination is /tmp/target2/d1A.lustre-rsync-test/d1/link2 fid2path d1A.lustre-rsync-test/d1/link1, link2, 0 rc=0 link source is /tmp/target2/d1A.lustre-rsync-test/d1/link1 link: /tmp/target2/d1A.lustre-rsync-test/d1/link1 [to] /tmp/target2/d1A.lustre-rsync-test/d1/link2; rc1=-1 File exists ##### End 25 HLINK (3) [0x200012ce9:0x1c:0x0] [0x200012ce9:0x12:0x0] link2 rc=-1 ##### </pre> </div></div> <p>It is true that the file exists. </p> <p>Unfortunately, we don’t check the “Errors” line from the output of lustre_rsync. So, test 1A does not fail. </p> <p>Here is a link to a test session where we get errors on the second replication<br/> <a href="https://testing.hpdd.intel.com/test_sets/d4f17fde-4d03-11e8-b45c-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/d4f17fde-4d03-11e8-b45c-52540065bddc</a></p> LU-10978

lustre-rsync-test test 1A cannot replicate a hard link because file exists

Bug Minor Resolved Fixed John Hammond James Nunez Tue, 1 May 2018 14:35:49 +0000 Tue, 18 Dec 2018 23:59:54 +0000 Thu, 17 May 2018 03:11:04 +0000 Lustre 2.11.0 Lustre 2.12.0 Lustre 2.12.0 0 4 <p>It looks like this is due to a bug that goes back to when lustre_rsync was first written.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"><span class="code-object">int</span> lr_replicate() ... <span class="code-keyword">if</span> (debug) { bzero(info, sizeof(struct lr_info)); bzero(ext, sizeof(struct lr_info)); } } llapi_changelog_fini(&amp;changelog_priv); <span class="code-keyword">if</span> (errors || verbose) printf(<span class="code-quote">"Errors: %d\n"</span>, errors); <span class="code-comment">/* Clear changelog records used so far */</span> lr_clear_cl(info, 1); ... </pre> </div></div> <p>If debugging is set then we zero-out info which prevents us from clearing the changelog properly on exit.</p> <p>John L. Hammond (john.hammond@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/32246" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/32246</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-10978" title="lustre-rsync-test test 1A cannot replicate a hard link because file exists" class="issue-link" data-issue-key="LU-10978"><del>LU-10978</del></a> utils: preserve lustre_rsync state<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 16c6185336aa6b08f877d9e095b540b89b146435</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="https://review.whamcloud.com/32246/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/32246/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-10978" title="lustre-rsync-test test 1A cannot replicate a hard link because file exists" class="issue-link" data-issue-key="LU-10978"><del>LU-10978</del></a> utils: preserve lustre_rsync state<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 75c0f9c701a7a5f1e9caeee1a6cd7164e6635dfb</p> <p>Landed for 2.12</p> Development Rank 1|hzzwlz: Rank (Obsolete) 9223372036854775807 Severity