[LU-16540] move ll_get_user_pages to ptlrpcd threads

• Status: Resolved
• Project: Lustre
• Type: Improvement
• Priority: Minor
• Reporter: Patrick Farrell
• Assignee: Patrick Farrell
• Resolution: Won't Do

Description

Moving ll_get_user_pages from the top level to running in the ptlrpcd context has the potential to significantly improve DIO performance (10% or more).  This requires some code reorganization and some careful handling of vmpage assignment, etc.

Issue Links

• is related to: LU-16640 parallellize generic I/O

Comments

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49948
Subject: LU-16540 llite: move ll_get_user_pages to ptlrpcd
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 1abf8e9026cd4354c03dcd74669b6f766d3a362c

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49973
Subject: LU-16540 llite: DIO submit parallelism
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 2ce89f1de0a51a781e37020671a870bcefae9cda

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49974
Subject: LU-16540 lov: Add noalloc to lov_sub_get
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: d9ac30b9c33d5d5d2ea086d43d06fd558d31f787

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49975
Subject: LU-16540 clio: Add anchor to cl_page_find
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 5e76f748ce63ba7f9c4e388a3c3fa51334158882

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49976
Subject: LU-16540 lov: Move lov entry caching to cl_sub_dio
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: b18dbd317b9ea75f0eb91896d39c7d7506f899b6

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49978
Subject: LU-16540 clio: Remove env from cl_sync_io_wait
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 059085a5610868be56cb1fd5bcf940211dd6ce96

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50125
Subject: LU-16540 clio: Make owner_set match owner_clear
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 69bb7aa4377c0e98388bac88a45d6287bdd72578

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50126
Subject: LU-16540 llite: Add parent env and io to sdio
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: f4cced62432cd94425f1b6c7836ee1c76ec4de12

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50141
Subject: LU-16540 clio: Don't count owned DIO pages
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 89380f6ccc260f9bf396d9fa8e22d4a52963d93e

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50229
Subject: LU-16540 llite: Remove env from cl2*_io
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 49b70fe7c9d95ebf73dfd561f36350b6780bbcc5

[Patrick Farrell]

So, I've realized this approach is unworkable, and I'm abandoning it in favor of:
LU-16640

I'll abandon the various patches later.

[Patrick Farrell]

Replaced by LU-16640

[Andreas Dilger]

Reopening temporarily to change to Resolved status instead of Closed.