[LU-537] LNET fails to start with aliased interface in configuration

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.0.0
• Fix Version/s: Lustre 2.2.0
• Type: Improvement
• Priority: Minor
• Reporter: Cliff White (Inactive)
• Assignee: Liang Zhen (Inactive)
• Resolution: Fixed

Environment

LLNL hyperion

Description

When specifying ip2nets, this syntax works:
o2ib0(ib0) 192.168.[112-127].* ; \
adding an alias to the string causes a failure:
o2ib0(ib0:0) 192.168.[112-127].* ;
Result:
LustreError: 14206:0:(o2iblnd.c:2594:kiblnd_create_dev()) Can't find netdev of IF: ib0:0

Either ip2nets should not use the hardware designation (ibx) or it should parse the alias properly and yield a better error message.

Comments

[Liang Zhen (Inactive)]

it's because kiblnd_create_dev() doesn't allow to dev_get_by_name() to return NULL (we add this for supporting failover of ib-bonding), but this can happen for aliased interface, we can fix this by simply remove the limitation and set kib_dev_t::ibd_can_failover to 0 for aliased interface.

[Liang Zhen (Inactive)]

patch is here
http://review.whamcloud.com/#change,1148

[Isaac Huang (Inactive)]

Cliff, I wonder why you'd need to use "o2ib0(ib0:0)" in the first place. Can you please elaborate a bit?

[Liang Zhen (Inactive)]

Isaac, one reason I want to have this patch is because we didn't use to have this limitation before we adding ib-bonding failover, so if some users had a modprobe.conf which used aliased interface, they can't use it anymore, although I don't know any strong reason of keeping use it, .

Thanks for review!
Liang

[Isaac Huang (Inactive)]

Actually there is one good reason why o2iblnd must support aliased interfaces. See:
http://lists.lustre.org/pipermail/lustre-discuss/2009-June/010922.html
https://bugzilla.lustre.org/show_bug.cgi?id=18602

[Minh Diep]

One of the issue I have seen is for a config that have bonding of two 10G tcp between a lnet router and servers. We never be able to use both links in write since the tcp session choose only 1 at a time. The solution could be is to split the osts to two different interfaces on top of the bonding. We never tried this but could use alias on top of the bond to achieve this.

Not sure if it makes sense

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,ofa #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.h
• lnet/klnds/o2iblnd/o2iblnd.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el6,inkernel #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.h
• lnet/klnds/o2iblnd/o2iblnd.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,inkernel #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.c
• lnet/klnds/o2iblnd/o2iblnd.h

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,inkernel #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.h
• lnet/klnds/o2iblnd/o2iblnd.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,ofa #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.h
• lnet/klnds/o2iblnd/o2iblnd.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,inkernel #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.h
• lnet/klnds/o2iblnd/o2iblnd.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,sles11,inkernel #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.c
• lnet/klnds/o2iblnd/o2iblnd.h

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el6,inkernel #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.h
• lnet/klnds/o2iblnd/o2iblnd.c

[Peter Jones]

Landed for 2.2

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,inkernel #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.h
• lnet/klnds/o2iblnd/o2iblnd.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,ofa #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.c
• lnet/klnds/o2iblnd/o2iblnd.h

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el6,inkernel #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.c
• lnet/klnds/o2iblnd/o2iblnd.h

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.c
• lnet/klnds/o2iblnd/o2iblnd.h

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,ofa #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.h
• lnet/klnds/o2iblnd/o2iblnd.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,inkernel #384
LU-537 o2iblnd: support aliased interface (Revision 8053e1507683f8731f97e6ae4a6fce90293fdbaf)

Result = SUCCESS
Oleg Drokin : 8053e1507683f8731f97e6ae4a6fce90293fdbaf
Files :

• lnet/klnds/o2iblnd/o2iblnd.h
• lnet/klnds/o2iblnd/o2iblnd.c

[Wojciech Turek (Inactive)]

Could this be also added to 2.1.x and 2.4.x tree?