https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-1030 Lustre <p>Target of new IO engine:<br/> 1. support new grant parameter<br/> 2. generate better IO RPC<br/> 3. if a page has been set for writeback, and if the covering lock is being canceled, raise prio of writeback page<br/> 4. ...</p> LU-1030

new IO engine

New Feature Minor Resolved Fixed Jinshan Xiong Jinshan Xiong Wed, 25 Jan 2012 00:20:21 +0000 Thu, 4 Apr 2013 17:44:24 +0000 Tue, 19 Jun 2012 22:33:59 +0000 Lustre 2.3.0 Lustre 2.3.0 0 4 <p>current status of new io engine.</p> <p>write performance benchmark result.</p> <p>patch list: <a href="http://review.whamcloud.com/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/</a></p> {2009,2460,2270} <p>and this one is proven to reduce memory usage a lot: <a href="http://review.whamcloud.com/2514" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/2514</a></p> <p>It appears this may be causing replay-dual.sh test failures that are NOT <a href="https://jira.whamcloud.com/browse/LU-482" title="Test failure on test suite replay-dual, subtest test_0a" class="issue-link" data-issue-key="LU-482"><del>LU-482</del></a> related:</p> <p><a href="https://maloo.whamcloud.com/test_sets/9a9540c6-a964-11e1-ab65-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/9a9540c6-a964-11e1-ab65-52540035b04c</a></p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Waiting for orphan cleanup... Waiting 0 secs for mds-ost sync done. Waiting 2 secs for mds-ost sync done. Waiting for destroy to be done... before 717896, after 717896 </pre> </div></div> <p>However, it isn't 100% clear that this patch is causing the problem, or only coincidental that Chris was testing for <a href="https://jira.whamcloud.com/browse/LU-482" title="Test failure on test suite replay-dual, subtest test_0a" class="issue-link" data-issue-key="LU-482"><del>LU-482</del></a> repeatedly using this patch. In any case, I don't see any similar problems on master, though ORI-396 at least looks similar.</p> <p>Hi Andreas, the patch you're referring to is Chris' testing patch. The original patch is at 2009 and it doesn't change any functionality but move some functions into osc_cache.c; I don't think Chris changed the code instead of adding some test stuff.</p> <p>all patches have been landed.</p> <p>Testing for b2_3, results file attached. The new curve from 2.3 client/servers looks similar but slightly better than the b2_2+rpc curve in the old results, especially at the mid-range of numbers of thread (4-8). Please note that due to lack of resource I had to slightly reduce the number of OSTs in the tests. With no nodes &gt;16Gb trying to put 2 8G ramdisk OSTs on a node led to lots of OOM. When consulted Jinshan said that numbers from only 15 OSTs were probably good enough for comparison.</p> <p>Bob, unfortunately, it doesn't look like we have apples to apples here, but the &gt; 15 thread I/O seems a lot worse with b2_3 (around 400 MB/s). Was there an explanation? Granted, we should focus on b2_4 now.</p> Development Rank 1|hzv6hj: Rank (Obsolete) 4585