Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-10153

route via two different networks not supported

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • Lustre 2.13.0
    • Lustre 2.10.1
    • 3
    • 9223372036854775807

    Description

      We were trying to setup routers between EDR storage fabrics and an FDR client fabric.

      The idea was to have two independent, redundant EDR storage fabrics - o2ib8 and o2ib9 - with routers and servers having interfaces on both fabrics. The routers would have two ports on the single FDR fabric - o2ib3 - with clients having a single port on the FDR fabric.

      To do this in a way that uses the route checker to balance between client and router ports we were going to setup:
      Clients with two routes from the FDR network (o2ib3) to each EDR network (o2ib8 & o2ib9), one via each of the router's interfaces on the FDR network.
      Servers with with two routes, one from each EDR fabric to the FDR network via the two EDR ports on the router.

      But ran into a problem configuring servers:
      60258.285963] LNetError: 70723:0:(router.c:489:lnet_check_routes()) Routes to o2ib3 via 10.112.5.108@o2ib9 and 10.112.1.88@o2ib8 not supported

      Everyone I have asked doubts that this restriction was ever necessary, and it almost certainly does not make sense now.

      Attachments

        Activity

          People

            ashehata Amir Shehata (Inactive)
            schamp Stephen Champion
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: