[LU-9121] Multi-Rail: User Defined Selection Policy Created: 14/Feb/17 Updated: 14/Oct/23 Resolved: 26/Feb/21 |
|
| Status: | Resolved |
| Project: | Lustre |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | Lustre 2.15.0 |
| Type: | New Feature | Priority: | Minor |
| Reporter: | Amir Shehata (Inactive) | Assignee: | Amir Shehata (Inactive) |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Issue Links: |
|
||||||||||||
| Sub-Tasks: |
|
||||||||||||
| Rank (Obsolete): | 9223372036854775807 | ||||||||||||
| Description |
|
It is sometimes desirable to fine tune the selection of local/remote NIs used for communication. For example currently if there are two networks an o2ib and a tcp network, both will be used. Especially if the traffic volume is low the credits criteria will be equivalent between the nodes, and both networks will be used in round robin. However, the user might want to use one network for all traffic and keep the other network free unless the other network goes down. User Defined Selection Policies (UDSP) will allow this type of control. UDSPs are configured from lnetctl via either command line or YAML config files and then passed to the kernel. Policies are applied to all local networks and remote peers then stored in the kernel. Whenever new peers/peer_nis/local networks/local nis are added they are matched against the rules. |
| Comments |
| Comment by Aurelien Degremont (Inactive) [ 25/Apr/18 ] |
|
This feature looks very nice. We are interesting in using something very similar to select LNET routers based on peer NIDs. It could be nice if we can prioritize how LNET routers are picked when sending messages to remote peers using this kind of feature. |
| Comment by Mahmoud Hanafi [ 01/Oct/18 ] |
|
It would also be desirable to assign interfaces to targets. For example if there is MDT and OST running on a single host one may want to assign one interface to the MDT and one to the OST. As in https://jira.whamcloud.com/browse/LU-11447 |
| Comment by Gerrit Updater [ 14/Feb/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34253 |
| Comment by Gerrit Updater [ 14/Feb/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34254 |
| Comment by Gerrit Updater [ 01/Mar/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34351 |
| Comment by Gerrit Updater [ 01/Mar/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34353 |
| Comment by Gerrit Updater [ 01/Mar/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34355 |
| Comment by Gerrit Updater [ 01/Mar/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34350 |
| Comment by Gerrit Updater [ 01/Mar/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34352 |
| Comment by Gerrit Updater [ 01/Mar/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34354 |
| Comment by Gerrit Updater [ 01/Mar/19 ] |
|
Sonia Sharma (sharmaso@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34362 |
| Comment by Gerrit Updater [ 12/Mar/19 ] |
|
Sonia Sharma (sharmaso@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34403 |
| Comment by Gerrit Updater [ 13/Mar/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34409 |
| Comment by Gerrit Updater [ 22/Mar/19 ] |
|
Sonia Sharma (sharmaso@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34488 |
| Comment by Gerrit Updater [ 25/Mar/19 ] |
|
Sonia Sharma (sharmaso@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34501 |
| Comment by Gerrit Updater [ 26/Mar/19 ] |
|
Sonia Sharma (sharmaso@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34513 |
| Comment by Gerrit Updater [ 26/Mar/19 ] |
|
Sonia Sharma (sharmaso@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34514 |
| Comment by Gerrit Updater [ 26/Mar/19 ] |
|
Sonia Sharma (sharmaso@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34512 |
| Comment by Gerrit Updater [ 28/Mar/19 ] |
|
Sonia Sharma (sharmaso@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34529 |
| Comment by Gerrit Updater [ 30/Mar/19 ] |
|
Sonia Sharma (sharmaso@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34552 |
| Comment by Gerrit Updater [ 31/Mar/19 ] |
|
Sonia Sharma (sharmaso@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34553 |
| Comment by Gerrit Updater [ 03/Apr/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34579 |
| Comment by Gerrit Updater [ 03/Apr/19 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34580 |
| Comment by Gerrit Updater [ 06/Dec/19 ] |
|
Serguei Smirnov (ssmirnov@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/36945 |
| Comment by Gerrit Updater [ 22/May/20 ] |
|
Serguei Smirnov (ssmirnov@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/38698 |
| Comment by Olaf Faaland [ 01/Jun/20 ] |
|
Why was 0 chosen as the "highest" priority, and 255 chosen as the "lowest" priority? I think that will result in misconfigurations. Am I the only one that thinks that? |
| Comment by Amir Shehata (Inactive) [ 02/Jun/20 ] |
|
This is consistent with how priority is defined in other parts of LNet. For example routing. priority 0 is highest. So it seems like it's a good idea to remain consistent. |
| Comment by Gerrit Updater [ 17/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34253/ |
| Comment by Gerrit Updater [ 17/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34254/ |
| Comment by Gerrit Updater [ 17/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34350/ |
| Comment by Gerrit Updater [ 17/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34353/ |
| Comment by Gerrit Updater [ 17/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34351/ |
| Comment by Gerrit Updater [ 17/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34352/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34354/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34355/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34403/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34488/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34514/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34552/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34579/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34501/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34513/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34529/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34553/ |
| Comment by Gerrit Updater [ 18/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/34580/ |
| Comment by Gerrit Updater [ 26/Jun/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) merged in patch https://review.whamcloud.com/38698/ |
| Comment by Gerrit Updater [ 26/Jun/20 ] |
|
Serguei Smirnov (ssmirnov@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/39192 |
| Comment by Gerrit Updater [ 11/Jul/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/39339 |
| Comment by Gerrit Updater [ 21/Jul/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/39479 |
| Comment by Gerrit Updater [ 12/Aug/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/39651 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40195 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40197 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40191 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40194 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40183 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40193 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40199 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40198 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40196 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40184 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40185 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40188 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40186 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40192 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40187 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40190 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40189 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40201 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40200 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40202 |
| Comment by Gerrit Updater [ 08/Oct/20 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40203 |
| Comment by Gerrit Updater [ 22/Feb/21 ] |
|
Amir Shehata (ashehata@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/41718 |
| Comment by Gerrit Updater [ 26/Feb/21 ] |
|
Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/41718/ |
| Comment by Peter Jones [ 26/Feb/21 ] |
|
Landed for 2.15 |