[LU-17006] socklnd: modify ksocklnd-config Created: 31/Jul/23  Updated: 05/Nov/23  Resolved: 31/Aug/23

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.16.0

Type: Bug Priority: Minor
Reporter: Serguei Smirnov Assignee: Serguei Smirnov
Resolution: Fixed Votes: 0
Labels: config, socklnd

Issue Links:
Related
Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

To accomodate the topologies where the destination NID may be on a different subnet, it is proposed to setup linux routing as follows:

"10 ens3f0np0" >> /etc/iproute2/rt_tables
"20 ens3f1np1" >> /etc/iproute2/rt_tables
ip rule add from 10.85.160.146 table ens3f0np0
ip rule add from 10.85.160.147 table ens3f1np1
ip route add default via 10.85.160.1 dev ens3f0np0 table ens3f0np0
ip route add default via 10.85.160.1 dev ens3f1np1 table ens3f1np1

The difference between the above and what ksocklnd-config is setting up is in the "ip route add" command. ksocklnd-config script currently does this instead: 

ip route add 10.85.160.0/24 dev ens3f0np0 proto kernel scope link src 10.85.160.146 table ens3f0np0

This command is fine for making sure that traffic to destinations on the same subnet as the source goes out the specified interface, but doesn't cover the case when the destination happens to be on a different subnet. The proposed change makes sure that packets with 10.85.160.146 source IP always use ens3f0np0 no matter what the destination IP is.



 Comments   
Comment by Gerrit Updater [ 11/Aug/23 ]

"Serguei Smirnov <ssmirnov@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51921
Subject: LU-17006 lnet: set up routes for going across subnets
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 5b459642e81b498c46a2340ac9abf9a5f534c998

Comment by Gerrit Updater [ 31/Aug/23 ]

"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51921/
Subject: LU-17006 lnet: set up routes for going across subnets
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 7f60b2b5580f67ca55e53a78dbaf7d50b5b7ab47

Comment by Peter Jones [ 31/Aug/23 ]

Landed for 2.16

Generated at Sat Feb 10 03:31:49 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.