https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-16540 Lustre <p>Moving ll_get_user_pages from the top level to running in the ptlrpcd context has the potential to significantly improve DIO performance (10% or more).  This requires some code reorganization and some careful handling of vmpage assignment, etc.</p> LU-16540

move ll_get_user_pages to ptlrpcd threads

Improvement Minor Resolved Won't Do Patrick Farrell Patrick Farrell Wed, 8 Feb 2023 20:23:48 +0000 Fri, 1 Sep 2023 01:38:30 +0000 Thu, 27 Apr 2023 23:06:39 +0000 0 4 <p>"Patrick Farrell &lt;pfarrell@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49948" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49948</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16540" title="move ll_get_user_pages to ptlrpcd threads" class="issue-link" data-issue-key="LU-16540"><del>LU-16540</del></a> llite: move ll_get_user_pages to ptlrpcd<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 1abf8e9026cd4354c03dcd74669b6f766d3a362c</p> <p>"Patrick Farrell &lt;pfarrell@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49973" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49973</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16540" title="move ll_get_user_pages to ptlrpcd threads" class="issue-link" data-issue-key="LU-16540"><del>LU-16540</del></a> llite: DIO submit parallelism<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 2ce89f1de0a51a781e37020671a870bcefae9cda</p> <p>"Patrick Farrell &lt;pfarrell@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49974" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49974</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16540" title="move ll_get_user_pages to ptlrpcd threads" class="issue-link" data-issue-key="LU-16540"><del>LU-16540</del></a> lov: Add noalloc to lov_sub_get<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: d9ac30b9c33d5d5d2ea086d43d06fd558d31f787</p> <p>"Patrick Farrell &lt;pfarrell@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49975" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49975</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16540" title="move ll_get_user_pages to ptlrpcd threads" class="issue-link" data-issue-key="LU-16540"><del>LU-16540</del></a> clio: Add anchor to cl_page_find<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 5e76f748ce63ba7f9c4e388a3c3fa51334158882</p> <p>"Patrick Farrell &lt;pfarrell@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49976" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49976</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16540" title="move ll_get_user_pages to ptlrpcd threads" class="issue-link" data-issue-key="LU-16540"><del>LU-16540</del></a> lov: Move lov entry caching to cl_sub_dio<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: b18dbd317b9ea75f0eb91896d39c7d7506f899b6</p> <p>"Patrick Farrell &lt;pfarrell@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49978" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49978</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16540" title="move ll_get_user_pages to ptlrpcd threads" class="issue-link" data-issue-key="LU-16540"><del>LU-16540</del></a> clio: Remove env from cl_sync_io_wait<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 059085a5610868be56cb1fd5bcf940211dd6ce96</p> <p><del>"Patrick Farrell &lt;pfarrell@whamcloud.com&gt;" uploaded a new patch:</del> <a href="https://review.whamcloud.com/c/fs/lustre-release/+/50125" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/50125</a><br/> <del>Subject: <a href="https://jira.whamcloud.com/browse/LU-16540" title="move ll_get_user_pages to ptlrpcd threads" class="issue-link" data-issue-key="LU-16540"><del>LU-16540</del></a> clio: Make owner_set match owner_clear</del><br/> <del>Project: fs/lustre-release</del><br/> <del>Branch: master</del><br/> <del>Current Patch Set: 1</del><br/> <del>Commit: 69bb7aa4377c0e98388bac88a45d6287bdd72578</del></p> <p>"Patrick Farrell &lt;pfarrell@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/50126" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/50126</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16540" title="move ll_get_user_pages to ptlrpcd threads" class="issue-link" data-issue-key="LU-16540"><del>LU-16540</del></a> llite: Add parent env and io to sdio<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: f4cced62432cd94425f1b6c7836ee1c76ec4de12</p> <p>"Patrick Farrell &lt;pfarrell@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/50141" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/50141</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16540" title="move ll_get_user_pages to ptlrpcd threads" class="issue-link" data-issue-key="LU-16540"><del>LU-16540</del></a> clio: Don't count owned DIO pages<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 89380f6ccc260f9bf396d9fa8e22d4a52963d93e</p> <p>"Patrick Farrell &lt;pfarrell@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/50229" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/50229</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16540" title="move ll_get_user_pages to ptlrpcd threads" class="issue-link" data-issue-key="LU-16540"><del>LU-16540</del></a> llite: Remove env from cl2*_io<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 49b70fe7c9d95ebf73dfd561f36350b6780bbcc5</p> <p>So, I've realized this approach is unworkable, and I'm abandoning it in favor of:<br/> <a href="https://jira.whamcloud.com/browse/LU-16640" title="parallellize generic I/O" class="issue-link" data-issue-key="LU-16640">LU-16640</a></p> <p>I'll abandon the various patches later.</p> <p>Replaced by <a href="https://jira.whamcloud.com/browse/LU-16640" title="parallellize generic I/O" class="issue-link" data-issue-key="LU-16640">LU-16640</a></p> <p>Reopening temporarily to change to Resolved status instead of Closed.</p> Related LU-16640 Development Rank 1|i03cdj: Rank (Obsolete) 9223372036854775807