Details
-
Bug
-
Resolution: Fixed
-
Minor
-
None
-
Lustre 2.1.0
-
None
-
3
-
4998
Description
The o2iblnd should really use and require privileged ports in the IB connection manager code. I will attach a patch that implements that.
I enabled the new requirement by default, and that might be a bit controversial. I felt that it was the best that it be enabled by default, and only disabled manually if there was a really good reason (during rolling upgrades, until all peers are upgraded to support use of privileged ports).
Another issue is the use of rdma_set_reuse(), which is not widely available in IB stacks. Availability of rdma_set_resuse() is detected at configure time, but without it there is the risk that privileged ports will be exhausted. I believe that the port space in IB is separate from normal TCP space, so you may be able to have on the order of 900 peers before this becomes a problem.