https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-3184 Lustre <p><span class="error">&#91;Andreas writing with James&#39; account&#93;</span></p> <p>The client max_rpcs_in_flight parameter is often tuned to try and get better performance from clients with large bandwidth-delay products. Unfortunately, people are less familiar with tuning the LNET peer credits values, and this results in the Lustre layer trying to send RPCs concurrently that will never go on the wire at the same time.</p> <p>It would make sense to increase the LNET peer credits when the max_rpcs_in_flight is increased above the current value, so that users get the behaviour that they expect.</p> LU-3184

link max_rpcs_in_flight to peer credits

Bug Minor Open Unresolved WC Triage Andreas Dilger Wed, 17 Apr 2013 18:56:33 +0000 Sun, 21 Feb 2016 22:51:22 +0000 Lustre 2.5.0 0 7 <p>I don't think they can be linked:</p> <ul class="alternate" type="square"> <li>max_rpcs_in_flight is end-to-end, while LNET peer credits is not. For example, with peer credits 8 and 100 available routers, a client would be able to have at most 800 messages in flight to a server via the routers, in which case you surely don't want to limit max_rpcs_in_flight to be only 8.</li> <li>when max_rpcs_in_flight is known, LNET has already initialized and the peer credits can't be changed dynamically.</li> </ul> <p>You might not be able to tie max_rpcs_in_flight to ni credits either, but it would be easier than peer_credits alone. Maybe this just turns into an LUDOC bug where the guidance on tuning is updated then?</p> <p>What are your thoughts about linking (in some way, not necessarily rigidly) max_rpcs_in_flight and max_dirty_mb?</p> <p>If you don't think that there should be a link in the code between <tt>max_rpcs_in_flight</tt> and peer credits/NI credits, could you please submit a patch to the Lustre User Manual to link places that discuss tuning max_rpcs_in_flight to the relevant sections that describe tuning peer credits/NI credits, and how they interact. I still see many places where people advocate increasing max_rpcs_in_flight, but this may not help if there are not enough peer credits.</p> Development Rank 1|hzvoef: Rank (Obsolete) 7772 Severity