https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-10149 Lustre <p>This issue was created by maloo for jianyu &lt;jian.yu@intel.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://testing.hpdd.intel.com/test_sets/99cbc9cc-b407-11e7-9eee-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/99cbc9cc-b407-11e7-9eee-5254006e85c2</a>.</p> <p>The sub-test test_23 failed with the following error:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Timeout occurred after 151 mins, last suite running was sanityn, restarting cluster to continue tests </pre> </div></div> <p>Please provide additional information about the failure here.</p> <p>Info required for matching: sanityn 23</p> LU-10149

sanityn test_23: timeout after test_18 mmap_sanity takes thousands of seconds

Bug Minor Resolved Fixed Bruno Faccini Maloo Mon, 23 Oct 2017 07:28:20 +0000 Fri, 26 Jan 2018 20:15:54 +0000 Fri, 26 Jan 2018 20:15:54 +0000 Lustre 2.11.0 Lustre 2.11.0 0 7 <p>More failure instance on master branch:<br/> <a href="https://testing.hpdd.intel.com/test_sets/3c3a6f64-b58f-11e7-8afb-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/3c3a6f64-b58f-11e7-8afb-52540065bddc</a></p> <p>Faccini Bruno (bruno.faccini@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/29715" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/29715</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-10149" title="sanityn test_23: timeout after test_18 mmap_sanity takes thousands of seconds" class="issue-link" data-issue-key="LU-10149"><del>LU-10149</del></a> tests: avoid live-lock with concurrent memsets<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 6679ad023c6c63bb9495eed570e8dd9ad06f3e9a</p> <p>Change #29175 is an attempt to split and delay concurrent memsets to reduce the execution time of auto-tests using mmap_sanity, due to some possible live-lock situation likely to occur.</p> <p>While this is a workaround for the test failures (which should land, don't get me wrong), it would be better to have some way to ensure that the client is at least making some forward progress when faulting in pages, so that applications using mmap don't fall over so badly.</p> <p>One option would be to use a delay mechanism in the DLM lock cancellation, so that mmap locks cannot be cancelled within, say, 10ms of being granted or last modified. Secondly, in the two-node mmap case (and in other DLM lock ping-pong cases, we should look at reducing extent lock expansion (e.g. to 1MB) so that multiple writers are not causing needless lock contention. That would allow one node to get some work done, and hopefully move out of the IO range of the other node so they can work independently.</p> <p>Andreas,<br/> As per my heavy testing results, my current fix attempt (by splitting and delaying concurrent memsets) in change #29175 is not a 100% workaround.<br/> Thus I was already trying to find a more definitive way to fix, and delay DLM lock cancelation had also appeared a good way to me. I should push a new patch to implement this soon.<br/> I will also investigate the way of extent lock expansion reduction that you have pointed, thanks.</p> <p>More failure instances on master branch:<br/> <a href="https://testing.hpdd.intel.com/test_sets/b059527a-ce17-11e7-9c63-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/b059527a-ce17-11e7-9c63-52540065bddc</a><br/> <a href="https://testing.hpdd.intel.com/test_sets/6ddc3400-ce74-11e7-9c63-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/6ddc3400-ce74-11e7-9c63-52540065bddc</a><br/> <a href="https://testing.hpdd.intel.com/test_sets/cae1c010-cbc3-11e7-a066-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/cae1c010-cbc3-11e7-a066-52540065bddc</a></p> <p>Faccini Bruno (bruno.faccini@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/30465" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/30465</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-10149" title="sanityn test_23: timeout after test_18 mmap_sanity takes thousands of seconds" class="issue-link" data-issue-key="LU-10149"><del>LU-10149</del></a> llite: avoid live-lock when concurrent mmap()s<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 783df45c6faf25c51add9d2965604599ead6f0d5</p> <p>Change #30465 is an attempt to fix in a more generic way the live-lock upon concurrent mmap()s situation.</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="https://review.whamcloud.com/30465/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/30465/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-10149" title="sanityn test_23: timeout after test_18 mmap_sanity takes thousands of seconds" class="issue-link" data-issue-key="LU-10149"><del>LU-10149</del></a> llite: avoid live-lock when concurrent mmap()s<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: cd793b4067b62862185f481cfef7b779927b801f</p> <p>Change #29715 has been abandoned in favor of more generic change #30465.</p> Duplicate LU-10184 Related LU-1205 Development Rank 1|hzzmb3: Rank (Obsolete) 9223372036854775807 Severity