[LU-13258] Bind linux workqueues to specific core

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.14.0
• Affects Version/s: Lustre 2.14.0
• Assignee: James A Simmons
• Reporter: James A Simmons

Description

Recently Lustre has moved to using work queue but the trade off is that the work queues can run on any core. This will introduce noise which on clients means it has an performance impact on users application runs. The linux kernel offers a way to make binding to specific core possible with the function apply_workqueue_attrs() which can be passed a cpumask.

 

Issue Links

• is related to: LU-12748 parallel readahead needs to be optimized at high number of process
• is related to: LU-9441 Use kernel threads in predictable fashion to confine OS noise
• is related to: LU-9859 libcfs simplification
• is related to: LU-12043 improve Lustre single thread read performances

Comments

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/38212/
Subject: LU-13258 obdclass: bind zombie export cleanup workqueue
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 76b602c2bfe9d1b0ddaa14997a3056b19b3e90aa

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/38091/
Subject: LU-13258 ptlrpc: bind pinger workqueue to CPT set
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 8a43201a2f35f6210d7feb7fd02b79233dd6da6b

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38212
Subject: LU-13258 obdclass: bind zombie export cleanup workqueue
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 92efb9c6b6af6366110cf2fae9852fb64ec525e0

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/37717/
Subject: LU-13258 llite: bind readahead workqueue to CPT set
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 21ccfd99de46e1ca1572b16db0d3cef9cd805f4f

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38091
Subject: LU-13258 ptlrpc: bind pinger workqueue to CPT set
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 74307004eebc61d622001b89352d7145ed2181f8

[James A Simmons]

more patches coming

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/37727/
Subject: LU-13258 libcfs: fixes for cfs_arch_init()
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 0fcf9378b524ded3ad260f3b655671c541e5a0b2

[Gerrit Updater]

Neil Brown ([e-mail]) uploaded a new patch: https://review.whamcloud.com/37727
Subject: LU-13258 libcfs: fixes for cfs_arch_init()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 55b95eadabfb4079fcd41906f2638abce7bcaca4

[James A Simmons]

More work. The patch that landed was the base patch.

[Peter Jones]

Landed for 2.14