https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-6864 Lustre <p>This feature is a complement to the <a href="https://jira.whamcloud.com/browse/LU-5319" title="Support multiple slots per client in last_rcvd file" class="issue-link" data-issue-key="LU-5319"><del>LU-5319</del></a> that implements the support of multiple modify RPCs in flight for MDC-MDT connection.</p> <p>It will improve the performance of modify metadata cross-MDT operations, while ensuring the correctness of recovery handling (request resend, and MDT recovery).</p> LU-6864

DNE3: Support multiple modify RPCs in flight for MDT-MDT connection

Technical task LU-14146 Minor Resolved Fixed Hongchao Zhang Gregoire Pichon dne3 patch performance recovery Fri, 17 Jul 2015 07:50:36 +0000 Tue, 30 Aug 2022 13:26:57 +0000 Mon, 6 Jun 2022 14:10:30 +0000 Lustre 2.16.0 0 15 <p>I have updated the patch <a href="http://review.whamcloud.com/#/c/14375/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/14375/</a> to implement this feature.</p> <p>Thanks Gregoire. This work is queued up for 2.9</p> <p>Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/32412" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/32412</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6864" title="DNE3: Support multiple modify RPCs in flight for MDT-MDT connection" class="issue-link" data-issue-key="LU-6864"><del>LU-6864</del></a> mdc: move RPC semaphore code to lustre/osp<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 4ba17e20f890b52141bc742500199da3c682c8bd</p> <p>Note that the above patch is not a replacement for Grégoire's patch. It is a code cleanup to move the MDC semaphore to the lustre/osp directory, and when <a href="http://review.whamcloud.com/14375" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/14375</a> is updated that code should probably be removed. In the meantime we avoid allocating the <tt>mdc_rpc_lock</tt> for each client-&gt;MDT connection.</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/32412/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/32412/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6864" title="DNE3: Support multiple modify RPCs in flight for MDT-MDT connection" class="issue-link" data-issue-key="LU-6864"><del>LU-6864</del></a> mdc: move RPC semaphore code to lustre/osp<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 040ca57f2ebd46b3a50bbec279839286ff20bffc</p> <p>The 14375 patch has been revived. Currently I'm collecting data to see if it helps with DNE2 scaling issues.</p> <p><a href="https://www.opensfs.org/wp-content/uploads/Evaluation-of-DoM-SNE-scaling_Simmons_revised051821.pdf" class="external-link" target="_blank" rel="nofollow noopener">https://www.opensfs.org/wp-content/uploads/Evaluation-of-DoM-SNE-scaling_Simmons_revised051821.pdf</a></p> <p>Looking at the data compared to my LUG talk since it is the same hardware we see improvements in file removals and stats. I do see a regression in reads of small files. I don't know if that is due to recent changes or the patch itself at this point. This is using the new default settings of max_mod_rpcs_in_flight = 8. I need to bump it up to see if I can get more out of it.</p> <p>James, thanks for testing this out. The graphs would be much easier to compare if they had the before/after results for the same tests on a single graph.</p> <p>As for <tt>max_mod_rpcs_in_flight</tt> for the MDS, I think it is totally reasonable to increase this higher than 8, since we don't want clients to bottleneck on the MDSes if they are busy handling lots of client requests. The MDS has <tt>max_rpcs_in_flight=512</tt>, so it wouldn't be unreasonable to have the MDS tune this to match <tt>mds.MDS.mdt_out.threads_max</tt>.</p> <p>"Lai Siyao &lt;lai.siyao@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/46735" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/46735</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6864" title="DNE3: Support multiple modify RPCs in flight for MDT-MDT connection" class="issue-link" data-issue-key="LU-6864"><del>LU-6864</del></a> osp: manage number of modify RPCs in flight<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: dce4b2800030f981b91249227daee40966ae4afd</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/14375/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/14375/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6864" title="DNE3: Support multiple modify RPCs in flight for MDT-MDT connection" class="issue-link" data-issue-key="LU-6864"><del>LU-6864</del></a> osp: manage number of modify RPCs in flight<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 23028efcae01bf1274a68fd2dd379fbb33300e82</p> <p>"Andreas Dilger &lt;adilger@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/47656" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/47656</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6864" title="DNE3: Support multiple modify RPCs in flight for MDT-MDT connection" class="issue-link" data-issue-key="LU-6864"><del>LU-6864</del></a> tests: properly skip sanity/245b in interop<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 91fa883754380b935b92d6e01fe5b1063483cc0c</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/47656/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/47656/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6864" title="DNE3: Support multiple modify RPCs in flight for MDT-MDT connection" class="issue-link" data-issue-key="LU-6864"><del>LU-6864</del></a> tests: properly skip sanity/245b in interop<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: c4ebdc96061ae9c24ac471b2866f2087bc3e98d4</p> Related LU-14761 LU-16065 LU-16126 LU-5319 LU-9436 LU-11999 LU-6753 LU-12125 Development End date Fri, 17 Jul 2015 07:50:36 +0000 Rank 1|hzxien: Rank (Obsolete) 9223372036854775807 Start date Fri, 17 Jul 2015 07:50:36 +0000