[LU-12381] o2iblnd uses wrong IB interface

• Type: Bug
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.13.0, Lustre 2.12.3
• Environment: master
• Severity: 3
• Assignee: James A Simmons
• Reporter: Shuichi Ihara

Description

Somehow, o2iblnd in latest master branch (225e7b8) is looking for wrong IB interface.

# cat /etc/modprobe.d/lustre.conf 
options lnet networks="o2ib0(ib0)"

# modprobe lustre
modprobe: ERROR: could not insert 'lustre': Network is down

they are trying to use 'eth0' insetad of ib0. eth0 is notihng configured for o2iblnd though.

Jun  4 03:10:10 sv160 kernel: LNet: HW NUMA nodes: 1, HW CPU cores: 16, npartitions: 4
Jun  4 03:10:10 sv160 kernel: alg: No test for adler32 (adler32-zlib)
Jun  4 03:10:11 sv160 kernel: Lustre: Lustre: Build Version: 2.12.53_117_g20fe8e6_dirty
Jun  4 03:10:11 sv160 kernel: LNetError: 3057:0:(o2iblnd.c:2892:kiblnd_create_dev()) Can't query IPoIB interface eth0: it's down
Jun  4 03:10:11 sv160 kernel: LNetError: 3057:0:(o2iblnd.c:2944:kiblnd_create_dev()) LIBCFS: free NULL 'dev' (352 bytes) at /tmp/rpmbuild-lustre-root-KMkogdPP/BUILD/lustre-2.12.53_117_g20fe8e6_dirty/lnet/klnds/o2iblnd/o2iblnd.c:2944
Jun  4 03:10:12 sv160 kernel: LNetError: 105-4: Error -100 starting up LNI o2ib
Jun  4 03:10:12 sv160 kernel: LustreError: 3057:0:(events.c:625:ptlrpc_init_portals()) network initialisation failed

Issue Links

• is duplicated by: LU-12413 Lustre don't able to start if one interface down.
• is related to: LU-11893 doesn't handle logical network interface properly.

Comments

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/35249/
Subject: LU-12381 ko2iblnd: ignore down interfaces
Project: fs/lustre-release
Branch: b2_12
Current Patch Set:
Commit: 707a350138976a588edfa1250d368b328465c619

[Gerrit Updater]

Jian Yu ([e-mail]) uploaded a new patch: https://review.whamcloud.com/35249
Subject: LU-12381 ko2iblnd: ignore down interfaces
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: 3ba56d464e2f784ad18a518f10dd14eb3cd5ab7d

[James A Simmons]

Fixed.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/35098/
Subject: LU-12381 ko2iblnd: ignore down interfaces
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 1dea5aac9d9be99c4b317a491f308872b97bf0e6

[Peter Jones]

Thanks James!

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/35098
Subject: LU-12381 ko2iblnd: ignore non IB devices
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: a28aa551ddc39a52d73cff4383b10471c528dbaa

[James A Simmons]

Actually I can push a one line change to fix this if this is needed.

[Peter Jones]

Can we revert the broken patch in the meantime?

[James A Simmons]

Just master but we need a bunch of fixes for 2.12 for proper IP alias support.

[Peter Jones]

Of course you can take the ticket! Do you know how long this has been broken? Is it only master broken or does this impact b2_12 at all?