https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12321 Lustre <p>In DoM configuration, unlink speed is much slower (~35%) than Non-DOM configuration.<br/> Here is test resutls with DNE2 with/without DoM.<br/> Number of MDT and OST are four each. So, in theory, unlink speed in DoM configuration can be same as non-DOM configuration or even faster.<br/> Here is test resutls.</p> <p>DNE2(4xMDS/4MDT) without DOM, 4 x OSS(4xOST) and 32 clients</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[root@c01 ~]# lfs setdirstripe -c 4 /cache1/out [root@c01 ~]# lfs setdirstripe -c 4 -D /cache1/out [root@c01 ~]# salloc --nodes=32 --ntasks-per-node=24 mpirun --allow-run-as-root /work/tools/bin/mdtest -F -n 2000 -u -d /cache1/out -vv -C -r -i 3 -p 10 SUMMARY rate: (of 3 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 155882.494 129033.204 140708.430 11235.756 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 240765.928 202754.538 226744.942 17032.855 Tree creation : 6.561 1.119 3.005 2.516 Tree removal : 5.832 5.215 5.600 0.274 </pre> </div></div> <p>DNE2(4xMDS/4MDT) with DOM, 4 x OSS(4xOST) and 32 clients</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[root@c01 ~]# lfs setdirstripe -c 4 /cache1/out [root@c01 ~]# lfs setdirstripe -c 4 -D /cache1/out [root@c01 ~]# lfs setstripe -L mdt -E 1M /cache1/out [root@c01 ~]# salloc --nodes=32 --ntasks-per-node=24 mpirun --allow-run-as-root /work/tools/bin/mdtest -F -n 2000 -u -d /cache1/out -vv -C -r -i 3 -p 10 SUMMARY rate: (of 3 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 142402.513 128265.451 135515.522 5739.604 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 149165.342 140330.903 144402.349 3595.289 Tree creation : 11.520 2.585 5.571 4.206 Tree removal : 5.491 4.100 4.606 0.628 </pre> </div></div> LU-12321

Unlink speed needs to be improved in DoM configuration

Bug Major Resolved Fixed Mikhail Pershin Shuichi Ihara Tue, 21 May 2019 02:18:00 +0000 Wed, 25 Mar 2020 09:20:52 +0000 Fri, 14 Feb 2020 13:32:06 +0000 Lustre 2.13.0 Lustre 2.14.0 0 6 <p>whether DoM files were empty?</p> <p>Alex, yes, DoM files were empty. Mike advised me this is related to <a href="https://jira.whamcloud.com/browse/LU-12124" title="slower unlinks with DOM files due to disabled ELC" class="issue-link" data-issue-key="LU-12124"><del>LU-12124</del></a> and <a href="https://jira.whamcloud.com/browse/LU-11359" title="racer test 1 times out with client hung in dir_create.sh, ls, … and MDS in ldlm_completion_ast()" class="issue-link" data-issue-key="LU-11359"><del>LU-11359</del></a>. I'm going to test <a href="https://review.whamcloud.com/#/c/34071/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/34071/</a> if unlink speed improves.</p> <p>Changed test enviroment a bit and re-run with/without DoM and patch.</p> <p>Baseline No-DOM</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>SUMMARY rate: (of 3 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 159607.234 125369.863 141195.699 14082.427 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 294886.243 282798.922 288348.055 4935.056 Tree creation : 13.224 1.082 8.957 5.575 Tree removal : 6.167 5.097 5.693 0.445 </pre> </div></div> <p>DOM</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>SUMMARY rate: (of 3 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 261609.857 251431.584 256138.911 4045.382 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 161622.879 157116.547 159685.163 1885.747 Tree creation : 11.129 1.798 6.683 3.822 Tree removal : 6.530 3.377 5.251 1.354 </pre> </div></div> <p>DoM with patch 34071 (<a href="https://review.whamcloud.com/#/c/34071/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/34071/</a>)</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>SUMMARY rate: (of 3 iterations) Operation Max Min Mean Std Dev --------- --- --- ---- ------- File creation : 260525.295 254664.889 258414.166 2447.162 File stat : 0.000 0.000 0.000 0.000 File read : 0.000 0.000 0.000 0.000 File removal : 155803.951 153195.917 154248.451 1112.790 Tree creation : 12.622 4.922 7.634 3.531 Tree removal : 6.490 5.904 6.106 0.271 </pre> </div></div> <p>I didn't see any improvements from patch 34071 for unlink operatios with DoM.</p> <p>Might also try <a href="https://review.whamcloud.com/#/c/34736/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/34736/</a> , which isn't directly unlink, but improves lock management</p> <p>Mike Pershin (mpershin@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/36442" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36442</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12321" title="Unlink speed needs to be improved in DoM configuration" class="issue-link" data-issue-key="LU-12321"><del>LU-12321</del></a> mdc: allow ELC for DOM file unlink<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 6fce9bde176337036e8fb256ef1a56439ff87f30</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/36442/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36442/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12321" title="Unlink speed needs to be improved in DoM configuration" class="issue-link" data-issue-key="LU-12321"><del>LU-12321</del></a> mdc: allow ELC for DOM file unlink<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: e07d4a58206756252c28b51048057c87a7cdb3c6</p> <p>Landed for 2.14</p> Related LU-11359 LU-12124 LU-10894 LU-11276 Development Rank 1|i00glz: Rank (Obsolete) 9223372036854775807 Severity