https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-9841 Lustre <p>Lustre 2.10 on the server, single OST, brw_size=16<br/> Lustre 2.10 clients, max_rpcs_in_flight=64, max_dirty_mb=256, max_pages_per_rpc=4096 <br/> 40 IOR jobs, File-per-process, transfer size 64m, file size 256g, stonewall 120 sec</p> <p>============================<br/> lctl set_param llite.*.pio=0<br/> ============================</p> <p>DIO write then read<br/> -------------------</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> read | write pages per bulk r/w rpcs % cum % | rpcs % cum % 256: 343872 100 100 | 220928 100 100 read | write discontiguous pages rpcs % cum % | rpcs % cum % 0: 343872 100 100 | 220928 100 100 </pre> </div></div> <p>--------------<br/> POSIX buffered<br/> --------------</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> read | write pages per bulk r/w rpcs % cum % | rpcs % cum % 256: 0 0 0 | 44 0 0 512: 0 0 0 | 43 0 0 1K: 0 0 0 | 63 0 0 2K: 0 0 0 | 107 0 0 4K: 40960 100 100 | 68017 99 100 read | writ​e​ discontiguous pages rpcs % cum % | rpcs ​​ % cum % 0: 40960 100 100 | 65412 95 95 1: 0 0 100 | 2862 4 100 </pre> </div></div> <p>============================<br/> lctl set_param llite.*.pio=1<br/> ============================</p> <p>DIO write then read<br/> -------------------</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> read | write pages per bulk r/w rpcs % cum % | rpcs % cum % 256: 352337 79 79 | 259706 80 80 512: 69745 15 94 | 49782 15 95 1K: 20035 4 99 | 12087 3 99 2K: 2357 0 100 | 1283 0 100 read | write discontiguous pages rpcs % cum % | rpcs % cum % 0: 387211 87 87 | 286802 88 88 1: 50221 11 98 | 32161 9 98 2: 6541 1 99 | 3670 1 99 3: 485 0 99 | 222 0 99 4: 16 0 100 | 3 0 100 </pre> </div></div> <p>--------------<br/> POSIX buffered<br/> --------------</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> read | write pages per bulk r/w rpcs % cum % | rpcs % cum % 1: 109334 19 19 | 0 0 0 2: 9844 1 20 | 1 0 0 4: 2482 0 21 | 0 0 0 8: 375 0 21 | 0 0 0 16: 0 0 21 | 1 0 0 32: 0 0 21 | 1 0 0 64: 0 0 21 | 2 0 0 128: 3 0 21 | 10 0 0 256: 398187 70 91 | 153 0 0 512: 34233 6 97 | 244 0 0 1K: 8819 1 99 | 377 0 1 2K: 2322 0 99 | 1004 1 2 4K: 2136 0 100 | 65289 97 100 read | write discontiguous pages rpcs % cum % | rpcs % cum % 0: 516948 91 91 | 56943 84 84 1: 42268 7 98 | 2582 3 88 2: 6384 1 99 | 2100 3 91 3: 1523 0 99 | 1288 1 93 4: 365 0 99 | 988 1 95 5: 97 0 99 | 774 1 96 </pre> </div></div> <p>​Same test setup on the server, IEEL clients</p> <p>--------------------------<br/> ​DIO write​ followed by rea​​d<br/> ------------------<del>​</del>------​</p> <p> read | write<br/> pages per bulk r/w rpcs % cum % | rpcs % cum %<br/> 4K: 40960 100 100 | 46224 100 100</p> <p> read | write<br/> discontiguous pages rpcs % cum % | rpcs % cum %<br/> 0: 40960 100 100 | 46224 100 100</p> <p>--------------</p> <p>POSIX buffered</p> <p>--------------</p> <p> read | write<br/> pages per bulk r/w rpcs % cum % | rpcs % cum %<br/> 4K: 40960 100 100 | 66976 100 100</p> <p> read | write<br/> discontiguous pages rpcs % cum % | rpcs % cum %<br/> 0: 40960 100 100 | 66976 100 100</p> LU-9841

2.10 don't use 4-16MB rpc at all

Bug Critical Resolved Fixed Jinshan Xiong Alexey Lyashkov Mon, 7 Aug 2017 10:49:48 +0000 Thu, 14 Sep 2017 20:36:11 +0000 Mon, 28 Aug 2017 14:48:31 +0000 Lustre 2.10.1 Lustre 2.11.0 0 8 <p>Jinshan</p> <p>Could you please advuse on this one?</p> <p>Thanks</p> <p>Peter</p> <p>It seems like this bug is introduced by <a href="https://jira.whamcloud.com/browse/LU-8964" title="use parallel I/O to improve performance on machines with slow single thread performance" class="issue-link" data-issue-key="LU-8964"><del>LU-8964</del></a>, where even I/O to single striped is split by stripe size that is 1M by default. Patch will be pushed soon.</p> <p>Jinshan Xiong (jinshan.xiong@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/28451" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/28451</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9841" title="2.10 don&#39;t use 4-16MB rpc at all" class="issue-link" data-issue-key="LU-9841"><del>LU-9841</del></a> lov: do not split IO for single striped file<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: f35de0b73cd42ead2b3eb609ffeb167c7b8504b5</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="https://review.whamcloud.com/28451/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/28451/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9841" title="2.10 don&#39;t use 4-16MB rpc at all" class="issue-link" data-issue-key="LU-9841"><del>LU-9841</del></a> lov: do not split IO for single striped file<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 078a099d26ef7f5d26131c0e18615855a39f341d</p> <p>Landed for 2.11</p> <p>Minh Diep (minh.diep@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/28760" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/28760</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9841" title="2.10 don&#39;t use 4-16MB rpc at all" class="issue-link" data-issue-key="LU-9841"><del>LU-9841</del></a> lov: do not split IO for single striped file<br/> Project: fs/lustre-release<br/> Branch: b2_10<br/> Current Patch Set: 1<br/> Commit: 8a7a89b7032d35246a234642fb8f7c3f14f8ad24</p> <p>John L. Hammond (john.hammond@intel.com) merged in patch <a href="https://review.whamcloud.com/28760/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/28760/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9841" title="2.10 don&#39;t use 4-16MB rpc at all" class="issue-link" data-issue-key="LU-9841"><del>LU-9841</del></a> lov: do not split IO for single striped file<br/> Project: fs/lustre-release<br/> Branch: b2_10<br/> Current Patch Set: <br/> Commit: e2e67f2c31c5539c852f60124a2ae4b397bf8004</p> Development Rank 1|hzzhwf: Rank (Obsolete) 9223372036854775807 Severity