Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-14555

lnet_check_route_inconsistency() complains when hops == -1

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • Lustre 2.16.0
    • Lustre 2.14.0
    • RHEL 8
      multi-hop network
      hops not set
    • 3
    • 9223372036854775807

    Description

      We have the following configuration:

      2.14_servers == o2ib100 == 2.12_routers == tcp129 == 2.12_routers == o2ib18 == 2.12_clients

      Discovery is disabled, and the routes are configured statically, on all the systems.

      This causes LNet to complain vociferously on the console from lnet_check_route_inconsistency()

      LNet: 29144:0:(router.c:384:lnet_check_route_inconsistency()) route o2ib18->172.19.1.54@o2ib100 is detected to be multi-hop but hop count is set to -1

      If LNet is configured so that there is only one route to any given endpoint, even on a multi-hop network, there is no value to spending sysadmin time determining and setting the hop counts as far as I can tell.  And setting hops is optional according to the Lustre Operations Manual.

      Is hop count actually required in 2.14 due to LU-13029 and LU-13785?

      Attachments

        Activity

          [LU-14555] lnet_check_route_inconsistency() complains when hops == -1
          pjones Peter Jones made changes -
          Resolution New: Fixed [ 1 ]
          Status Original: Reopened [ 4 ] New: Resolved [ 5 ]
          pjones Peter Jones added a comment -

          Landed for 2.16

          pjones Peter Jones added a comment - Landed for 2.16

          "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49352/
          Subject: LU-14555 lnet: asym route inconsistency warning
          Project: fs/lustre-release
          Branch: master
          Current Patch Set:
          Commit: 6aed5df1771c299b527251b0e18ff9f6cb95dd75

          gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49352/ Subject: LU-14555 lnet: asym route inconsistency warning Project: fs/lustre-release Branch: master Current Patch Set: Commit: 6aed5df1771c299b527251b0e18ff9f6cb95dd75

          "Gian-Carlo DeFazio <defazio1@llnl.gov>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49352
          Subject: LU-14555 lnet: asym route inconsistency warning
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: af572e46f883f8736af8055a2030eb640792130c

          gerrit Gerrit Updater added a comment - "Gian-Carlo DeFazio <defazio1@llnl.gov>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49352 Subject: LU-14555 lnet: asym route inconsistency warning Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: af572e46f883f8736af8055a2030eb640792130c
          defazio Gian-Carlo Defazio made changes -
          Resolution Original: Fixed [ 1 ]
          Status Original: Resolved [ 5 ] New: Reopened [ 4 ]

          Just adding the requirement that avoid_asym_router_failure be true doesn't prevent the warning from beaing logged because we have avoid_asym_router_failure=1.

          However, due to changes in the code since ticket was made, I've made a change which further reduces the conditions in which the warning is logged: having hops undefined for a multi-hop route is no longer considered an inconsistent configuration.

          defazio Gian-Carlo Defazio added a comment - Just adding the requirement that avoid_asym_router_failure be true doesn't prevent the warning from beaing logged because we have avoid_asym_router_failure=1. However, due to changes in the code since ticket was made, I've made a change which further reduces the conditions in which the warning is logged: having hops undefined for a multi-hop route is no longer considered an inconsistent configuration.
          pjones Peter Jones made changes -
          Fix Version/s New: Lustre 2.16.0 [ 15190 ]
          Assignee Original: Serguei Smirnov [ ssmirnov ] New: Gian-Carlo Defazio [ defazio ]
          Resolution New: Fixed [ 1 ]
          Status Original: Open [ 1 ] New: Resolved [ 5 ]
          pjones Peter Jones added a comment -

          Landed for 2.16

          pjones Peter Jones added a comment - Landed for 2.16

          "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/46918/
          Subject: LU-14555 lnet: asym route inconsistency warning
          Project: fs/lustre-release
          Branch: master
          Current Patch Set:
          Commit: 6ab060e58e6b3f38b0c8d57b56fec887c6fe9fb6

          gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/46918/ Subject: LU-14555 lnet: asym route inconsistency warning Project: fs/lustre-release Branch: master Current Patch Set: Commit: 6ab060e58e6b3f38b0c8d57b56fec887c6fe9fb6

          "Gian-Carlo DeFazio <defazio1@llnl.gov>" uploaded a new patch: https://review.whamcloud.com/46918
          Subject: LU-14555 lnet: change route inconsistency warnings
          Project: fs/lustre-release
          Branch: master
          Current Patch Set: 1
          Commit: 572b52a488ac7a186be2f808668e163e9ac850b2

          gerrit Gerrit Updater added a comment - "Gian-Carlo DeFazio <defazio1@llnl.gov>" uploaded a new patch: https://review.whamcloud.com/46918 Subject: LU-14555 lnet: change route inconsistency warnings Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 572b52a488ac7a186be2f808668e163e9ac850b2

          People

            defazio Gian-Carlo Defazio
            ofaaland Olaf Faaland
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: