[LU-13258] Bind linux workqueues to specific core

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.14.0
• Affects Version/s: Lustre 2.14.0
• Assignee: James A Simmons
• Reporter: James A Simmons

Description

Recently Lustre has moved to using work queue but the trade off is that the work queues can run on any core. This will introduce noise which on clients means it has an performance impact on users application runs. The linux kernel offers a way to make binding to specific core possible with the function apply_workqueue_attrs() which can be passed a cpumask.

 

Issue Links

• is related to: LU-12748 parallel readahead needs to be optimized at high number of process
• is related to: LU-9441 Use kernel threads in predictable fashion to confine OS noise
• is related to: LU-9859 libcfs simplification
• is related to: LU-12043 improve Lustre single thread read performances

Comments

[James A Simmons]

more patches coming

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/37727/
Subject: LU-13258 libcfs: fixes for cfs_arch_init()
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 0fcf9378b524ded3ad260f3b655671c541e5a0b2

[Gerrit Updater]

Neil Brown ([e-mail]) uploaded a new patch: https://review.whamcloud.com/37727
Subject: LU-13258 libcfs: fixes for cfs_arch_init()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 55b95eadabfb4079fcd41906f2638abce7bcaca4

[James A Simmons]

More work. The patch that landed was the base patch.

[Peter Jones]

Landed for 2.14

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/37717
Subject: LU-13258 llite: bind readahead workqueue to CPT set
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 2a2918a6fedd80b5fe0c2745777f73ff68a31a3c

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/37613/
Subject: LU-13258 libcfs: make apply_workqueue_attrs() available for Lustre
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 3453c95f513cd9d65f8e74e64d10d8942d934f01

[James A Simmons]

Both the read-ahead queue and the ptlrpc pinger would be good to bind to cores laid out by CPT handling. Their is also obd zombie cleanup but that I'm not so sure about.

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/37613
Subject: LU-13258 libcfs: make apply_workqueue_attrs() available for Lustre
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 3b6469dfb8d9ade856abd3f429f32abed64023e3