[LU-17889] Autotest nodes should not use 'fe80:' link local (loopback) IPv6 address

• Type: Bug
• Resolution: Fixed
• Priority: Critical
• Affects Version/s: Lustre 2.16.0
• Environment: Maloo test bed nodes
• Severity: 3
• Assignee: Michael Kvardakov
• Reporter: James A Simmons

Description

Pushing patches to run sanity-lnet test with IPv6 which are working locally for me to maloo revealed that the IPv6 address setup is only local link (fe80:.....). These addresses are only visible to the local node so the more complex LNet test can't run. Also LNet ignores these addresses. Proper IPv6 addresses need to be setup.

Issue Links

• is related to: LU-17367 Failover on master: Invalid NID string
• is related to: LU-16822 test IPv6 NIDs in sanity-lnet.sh

Comments

[Peter Jones]

Excellent news - thanks for the update James!

[James A Simmons]

Just pushed the patch and its looking good with maloo. I do see one test failing which is valid. Just need to figure out a solution.

[Andreas Dilger]

I've asked that a more clear error message is added to mount.lustre when a link-local fe80: address is used, but something should likely be added into lnetctl or similar to print a very clear message like "Unsupported link-local IPv6 NID type 'fe80:...'" instead of just returning "-22" in that case, so this can be caught very early during configuration instead of later on when these addresses are being used.

[Michael Kvardakov]

simmonsja

[root@onyx-79vm20 ~]# ip a          
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
    link/ether 52:54:00:ce:6b:b5 brd ff:ff:ff:ff:ff:ff
    altname enp0s3f0
    altname ens3f0
    inet 10.240.26.175/20 brd 10.240.31.255 scope global noprefixroute eth0
       valid_lft forever preferred_lft forever
    inet6 fd33:3981:3213:f010:0:5254:ce:6bb5/64 scope global noprefixroute 
       valid_lft forever preferred_lft forever
    inet6 fe80::5054:ff:fece:6bb5/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever
[root@onyx-79vm20 ~]# lctl net up -l
Writer error: failed to resolve Netlink family id
LNET configure error 22: (null)
[root@onyx-79vm20 ~]# lnetctl lnet configure -l
Writer error: failed to resolve Netlink family id
---
configure:
-     lnet:
      errno: 0
      descr: ! "LNet configure error: (null)"
...

[James A Simmons]

LU-16822 hasn't landed yet so no IPv6 by default. You can do lnetctl lnet configure -l or lctl net up -l to see if fd33:XXX ends up in lnetctl net  show

[Charlie Olmstead]

Michael pushed a patch to correct the IPV6 issue (https://review.whamcloud.com/#/c/private/lab/+/55584/)

I retested one of the sessions from patch https://review.whamcloud.com/#/c/fs/lustre-release/+/55435/3 and the fd33 address is now listed:

/usr/sbin/lnetctl net show
net:
-     net type: lo
      local NI(s):
      -     nid: 0@lo
            status: up
-     net type: tcp
      local NI(s):
      -     nid: 10.240.24.248@tcp
            status: up
            interfaces:
                  0: eth0
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
    link/ether 52:54:00:72:a5:1e brd ff:ff:ff:ff:ff:ff
    altname enp0s3f0
    altname ens3f0
    inet 10.240.24.248/20 brd 10.240.31.255 scope global noprefixroute eth0
       valid_lft forever preferred_lft forever
    inet6 fd33:3981:3213:f010:0:5254:72:a51e/64 scope global noprefixroute 
       valid_lft forever preferred_lft forever
    inet6 fe80::5054:ff:fe72:a51e/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever
3: test1pl@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 3e:a2:28:ad:93:2b brd ff:ff:ff:ff:ff:ff link-netns test_ns
    inet6 fe80::3ca2:28ff:fead:932b/64 scope link tentative 
       valid_lft forever preferred_lft forever