[LU-10153] route via two different networks not supported

Duplicate — Wed, 24 Jul 2019 16:37:24 +0000

We were trying to setup routers between EDR storage fabrics and an FDR client fabric.

The idea was to have two independent, redundant EDR storage fabrics - o2ib8 and o2ib9 - with routers and servers having interfaces on both fabrics. The routers would have two ports on the single FDR fabric - o2ib3 - with clients having a single port on the FDR fabric.

To do this in a way that uses the route checker to balance between client and router ports we were going to setup:
Clients with two routes from the FDR network (o2ib3) to each EDR network (o2ib8 & o2ib9), one via each of the router's interfaces on the FDR network.
Servers with with two routes, one from each EDR fabric to the FDR network via the two EDR ports on the router.

But ran into a problem configuring servers:
60258.285963] LNetError: 70723:0:(router.c:489:lnet_check_routes()) Routes to o2ib3 via 10.112.5.108@o2ib9 and 10.112.1.88@o2ib8 not supported

Everyone I have asked doubts that this restriction was ever necessary, and it almost certainly does not make sense now.

Whamcloud Community JIRA

[LU-10153] route via two different networks not supported