[LU-17885] use transfer page arrays for DIO RPCs

• Type: Improvement
• Resolution: Unresolved
• Priority: Major
• Severity: 3
• Assignee: Patrick Farrell
• Reporter: Patrick Farrell (Inactive)

Description

This is a follow on to LU-13814, and so it won't be landable until all of that code has landed.

Once cl_page usage for DIO has been replaced with the OSC transfer page, there are further improvements available in memory usage and efficiency.

OSC transfer pages are still placed on lists to go in BRW RPCs, but this is not required for DIO and can be replaced with an array.  This allows the removal of several lists and significant reductions in the size of the OSC transfer page.  This should provide significant performance boosts beyond those in LU-13814, allowing us to hit >100 GiB/s from one thread doing DIO.

Issue Links

• is related to: LU-13814 DIO performance: cl_page struct removal for DIO path

Comments

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56870
Subject: LU-17885 osc: remove otp2osc
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: b89703e17bfdc2fda36a5baba8aed18fca90f830

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56869
Subject: LU-17885 osc: remove otp2cl_page
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: a7cbb430475ea8d0f9c724070c554f3d56a50251

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56868
Subject: LU-17885 osc: remove otp_index and otp2osc_page
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 1a8fcfb514356073d53e1a659cd953cbcb61a8d8

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56867
Subject: LU-17885 osc: remove functions
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 5343594fbbded9d7507ef149766978afb9427815

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56866
Subject: LU-17885 osc: remove otp_obj_off macro
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 9a044e8e19b885fc40372286aaeec6113e4ab011

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56865
Subject: LU-17885 osc: remove otp_count macro
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 7adc85d43dd3be257f59e081c18db0da92fd3518

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56864
Subject: LU-17885 osc: remove otp_page and otp_flags macros
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: eb2d4e18f7998e7cd5ab070b126444c404e45469

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56860
Subject: LU-17885 osc: remove otp flags
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 012f1ecf326811b79ae8b09ba118b65da3187206

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56859
Subject: LU-17885 osc: begin move to brw_page only
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 078140e5068ae58abfe6c7033780ca5d387c0915

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56858
Subject: LU-17885 osc: convert cdp_page_count to int
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 4327401c1ebe6b23659a2e0355d937355a0490d0

[Gerrit Updater]

"Patrick Farrell <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56857
Subject: LU-17885 osc: inline osc_transfer_page_init
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 693e2233d8ed981b8696042905834d60d230e59c