I am testing the performance under the Lustre version 2.10.55, CentOS7.3 with the Lnet_selftest tool. I found some issue:
Client - A
Server - B,C
Testing Lnet_selftest between A and B, using Infiniband network, the bandwidth is 2GB/s. Monitoring the IB bandwidth, A and B are 2GB/S.
Testing Lnet_selftest between A and B,C, also using Infiniband network, the bandwidth is 1GB/s, and Monitoring the IB bandwidth, A and B is 2GB/s,C is 0 GB/s. Swop the B and C location in the lent test group, C's bandwidth is 2GB/s and B is 0 GB/s.
How is this happen ? The Lnet_self test script can be seen in the attachment. Thanks for anyone can help!