https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-8030 Lustre <p>It is possible to insert duplicate HSM requests in the actions list:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre># cd /mnt/lustre # cp /bin/ls . # cp /bin/ls ls2 # lfs hsm_archive ls2 ls2 ls2 ls2 # cat /proc/fs/lustre/mdt/lustre-MDT0000/hsm/actions lrh=[type=10680000 len=136 idx=1/2] fid=[0x200000401:0x2:0x0] dfid=[0x200000401:0x2:0x0] compound/cookie=0x571142b4/0x571142af action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=1/3] fid=[0x200000401:0x2:0x0] dfid=[0x200000401:0x2:0x0] compound/cookie=0x571142b4/0x571142b0 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=1/4] fid=[0x200000401:0x2:0x0] dfid=[0x200000401:0x2:0x0] compound/cookie=0x571142b4/0x571142b1 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] lrh=[type=10680000 len=136 idx=1/5] fid=[0x200000401:0x2:0x0] dfid=[0x200000401:0x2:0x0] compound/cookie=0x571142b4/0x571142b2 action=ARCHIVE archive#=1 flags=0x0 extent=0x0-0xffffffffffffffff gid=0x0 datalen=0 status=WAITING data=[] </pre> </div></div> <p>The copytool then successfully archives the same file 4 times.</p> <p>The bug likely comes from mdt_hsm_add_actions() where duplicates are searched for between the already queued actions and the new ones in the HAL, but not between the actions in the HAL itself.</p> LU-8030

hsm: inserting duplicate requests

Bug Minor Resolved Fixed WC Triage Frank Zago Fri, 15 Apr 2016 19:43:25 +0000 Wed, 1 Jun 2016 20:32:38 +0000 Wed, 1 Jun 2016 20:32:38 +0000 Lustre 2.9.0 0 7 <p>Restoring is a bit different. The first call works, and the file is restored once. A second call is locking up lustre. ls /mnt/lustre hangs too.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre># cp /bin/ls ls2 # lfs hsm_archive ls2 # lfs hsm_release ls2 # lfs hsm_restore ls2 ls2 ls2 ls2 # lfs hsm_restore ls2 ls2 ls2 ls2 &lt;hang&gt; </pre> </div></div> <p>with the following stack trace in the kernel log:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[ 482.344410] INFO: task lfs:8517 blocked for more than 120 seconds. [ 482.346511] "echo 0 &gt; /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 482.348516] lfs D ffff88032deb9770 0 8517 2733 0x00000080 [ 482.350453] ffff880627973bd8 0000000000000046 ffff88062b550000 ffff880627973fd8 [ 482.352449] ffff880627973fd8 ffff880627973fd8 ffff88062b550000 ffff8805d5760218 [ 482.354414] ffff8805d5760900 ffff8805d5760908 0000000000000246 ffff88062b550000 [ 482.356353] Call Trace: [ 482.357761] [&lt;ffffffff81662d39&gt;] schedule_preempt_disabled+0x29/0x70 [ 482.358795] [&lt;ffffffff8166075b&gt;] mutex_lock_nested+0x18b/0x4b0 [ 482.359860] [&lt;ffffffffa115799c&gt;] ? ll_layout_refresh+0x1ac/0x290 [lustre] [ 482.360898] [&lt;ffffffffa115799c&gt;] ? ll_layout_refresh+0x1ac/0x290 [lustre] [ 482.361901] [&lt;ffffffffa115799c&gt;] ll_layout_refresh+0x1ac/0x290 [lustre] [ 482.362915] [&lt;ffffffffa119e03f&gt;] vvp_io_init+0x3df/0x4c0 [lustre] [ 482.363967] [&lt;ffffffffa07382a8&gt;] cl_io_init0.isra.15+0x88/0x160 [obdclass] [ 482.364955] [&lt;ffffffffa1194915&gt;] ? cl_glimpse_size0+0x125/0x2b0 [lustre] [ 482.365937] [&lt;ffffffffa0738475&gt;] cl_io_init+0x55/0xd0 [obdclass] [ 482.366901] [&lt;ffffffffa11949bc&gt;] cl_glimpse_size0+0x1cc/0x2b0 [lustre] [ 482.367852] [&lt;ffffffffa11556a9&gt;] ll_getattr+0x539/0x7c0 [lustre] [ 482.368770] [&lt;ffffffff8101cd35&gt;] ? native_sched_clock+0x35/0x80 [ 482.369667] [&lt;ffffffff811ef736&gt;] vfs_getattr+0x46/0x80 [ 482.370531] [&lt;ffffffff811ef865&gt;] vfs_fstatat+0x75/0xc0 [ 482.371345] [&lt;ffffffff811efe21&gt;] SYSC_newlstat+0x31/0x60 [ 482.372135] [&lt;ffffffff81314fd6&gt;] ? lockdep_sys_exit_thunk+0x35/0x67 [ 482.372944] [&lt;ffffffff816650ea&gt;] ? error_exit+0x6a/0xb0 [ 482.373727] [&lt;ffffffff811f00ae&gt;] SyS_newlstat+0xe/0x10 [ 482.374493] [&lt;ffffffff8166d589&gt;] system_call_fastpath+0x16/0x1b [ 482.375181] 2 locks held by lfs/8517: [ 482.375912] #0: (&amp;lli-&gt;lli_glimpse_sem){......}, at: [&lt;ffffffffa115569f&gt;] ll_getattr+0x52f/0x7c0 [lustre] [ 482.377354] #1: (&amp;lli-&gt;lli_layout_mutex){......}, at: [&lt;ffffffffa115799c&gt;] ll_layout_refresh+0x1ac/0x290 [lustre] </pre> </div></div> <p>Frank Zago (fzago@cray.com) uploaded a new patch: <a href="http://review.whamcloud.com/19635" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/19635</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8030" title="hsm: inserting duplicate requests" class="issue-link" data-issue-key="LU-8030"><del>LU-8030</del></a> hsm: prevent duplicated HSM requests<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: c87677412ac3a73dc5638b759d9738f0657ca027</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/19635/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/19635/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8030" title="hsm: inserting duplicate requests" class="issue-link" data-issue-key="LU-8030"><del>LU-8030</del></a> hsm: prevent duplicated HSM requests<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 62e93ef9a29341091c49d66a1535ea243ea950be</p> <p>Landed to master for 2.9.0</p> Development Rank 1|hzy89r: Rank (Obsolete) 9223372036854775807 Severity