[LU-165] o2iblnd driver should use and require privileged ports Created: 25/Mar/11  Updated: 13/Jun/11  Resolved: 13/Jun/11

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.1.0
Fix Version/s: None

Type: Bug Priority: Minor
Reporter: Christopher Morrone Assignee: Liang Zhen (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Severity: 3
Rank (Obsolete): 4998

 Description   

The o2iblnd should really use and require privileged ports in the IB connection manager code. I will attach a patch that implements that.

I enabled the new requirement by default, and that might be a bit controversial. I felt that it was the best that it be enabled by default, and only disabled manually if there was a really good reason (during rolling upgrades, until all peers are upgraded to support use of privileged ports).

Another issue is the use of rdma_set_reuse(), which is not widely available in IB stacks. Availability of rdma_set_resuse() is detected at configure time, but without it there is the risk that privileged ports will be exhausted. I believe that the port space in IB is separate from normal TCP space, so you may be able to have on the order of 900 peers before this becomes a problem.

 Comments   
Comment by Christopher Morrone [ 25/Mar/11 ]

http://review.whamcloud.com/366

Comment by Build Master (Inactive) [ 25/Mar/11 ]

Integrated in reviews-centos5 #574
LU-165 Use privileged ports in the o2iblnd driver.

Christopher J. Morrone : 8d9c606e3248884a5216252416815b64f427f977
Files :

  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/klnds/o2iblnd/o2iblnd.h
Comment by Liang Zhen (Inactive) [ 17/May/11 ]

patch reviewed, will test & land soon

Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » x86_64,client,el5,inkernel #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/klnds/o2iblnd/o2iblnd.h
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » x86_64,client,sles11,inkernel #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd.h
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » i686,client,el5,inkernel #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/autoconf/ofed.m4
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » i686,client,el5,ofa #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » x86_64,client,el6,inkernel #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd.h
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » x86_64,server,el5,inkernel #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » i686,client,el6,inkernel #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » x86_64,client,ubuntu1004,ofa #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/autoconf/ofed.m4
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » i686,server,el5,inkernel #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » i686,server,el5,ofa #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/autoconf/ofed.m4
Comment by Build Master (Inactive) [ 06/Jun/11 ]

Integrated in lustre-master » x86_64,server,el6,inkernel #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
Comment by Build Master (Inactive) [ 07/Jun/11 ]

Integrated in lustre-master » x86_64,client,el5,ofa #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
Comment by Build Master (Inactive) [ 07/Jun/11 ]

Integrated in lustre-master » i686,server,el6,inkernel #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/klnds/o2iblnd/o2iblnd.h
Comment by Build Master (Inactive) [ 07/Jun/11 ]

Integrated in lustre-master » x86_64,server,el5,ofa #156
LU-165: Support privileged ports in the o2iblnd driver.

Oleg Drokin : daee9d5d61fb14cf998a3444ed33152cfc27fab5
Files :

  • lnet/klnds/o2iblnd/o2iblnd_cb.c
  • lnet/klnds/o2iblnd/o2iblnd.h
  • lnet/autoconf/ofed.m4
  • lnet/klnds/o2iblnd/o2iblnd_modparams.c
Comment by Peter Jones [ 13/Jun/11 ]

Patch landed for 2.1

Generated at Sat Feb 10 01:04:23 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.