export LST_SESSION=48831; lst end_session Clients 110 and 90 use eth2 for reads and writes. Clients 109 and 89 useseth3 for reads and writes. Nothing magic about the names, those are the last octet of the IP address, and the mapping is due to the hashing algorithm. ================================================ Starting read test to clients [89,90,109,110] Concurrency = 4 ================================================ SESSION: read4clients FEATURES: 1 TIMEOUT: 300 FORCE: No 192.168.95.158@tcp are added to session 192.168.123.[89,90,109,110]@tcp are added to session Test was added successfully bulk_rw is running now [LNet Rates of clients] [R] Avg: 2965 RPC/s Min: 2867 RPC/s Max: 3019 RPC/s [W] Avg: 1482 RPC/s Min: 1433 RPC/s Max: 1509 RPC/s [LNet Bandwidth of clients] [R] Avg: 1482.58 MB/s Min: 1433.73 MB/s Max: 1509.73 MB/s [W] Avg: 0.23 MB/s Min: 0.22 MB/s Max: 0.23 MB/s [LNet Rates of clients] [R] Avg: 2948 RPC/s Min: 2838 RPC/s Max: 2997 RPC/s [W] Avg: 1474 RPC/s Min: 1419 RPC/s Max: 1499 RPC/s [LNet Bandwidth of clients] [R] Avg: 1474.23 MB/s Min: 1419.13 MB/s Max: 1498.73 MB/s [W] Avg: 0.22 MB/s Min: 0.22 MB/s Max: 0.23 MB/s [LNet Rates of clients] [R] Avg: 2914 RPC/s Min: 2761 RPC/s Max: 2996 RPC/s [W] Avg: 1457 RPC/s Min: 1381 RPC/s Max: 1498 RPC/s [LNet Bandwidth of clients] [R] Avg: 1457.28 MB/s Min: 1380.71 MB/s Max: 1498.33 MB/s [W] Avg: 0.22 MB/s Min: 0.21 MB/s Max: 0.23 MB/s [LNet Rates of clients] [R] Avg: 2914 RPC/s Min: 2786 RPC/s Max: 3019 RPC/s [W] Avg: 1459 RPC/s Min: 1395 RPC/s Max: 1511 RPC/s [LNet Bandwidth of clients] [R] Avg: 1455.11 MB/s Min: 1391.13 MB/s Max: 1507.63 MB/s [W] Avg: 0.22 MB/s Min: 0.21 MB/s Max: 0.23 MB/s [LNet Rates of clients] [R] Avg: 2959 RPC/s Min: 2886 RPC/s Max: 3010 RPC/s [W] Avg: 1480 RPC/s Min: 1443 RPC/s Max: 1506 RPC/s [LNet Bandwidth of clients] [R] Avg: 1479.70 MB/s Min: 1443.07 MB/s Max: 1505.33 MB/s [W] Avg: 0.23 MB/s Min: 0.22 MB/s Max: 0.23 MB/s session is ended ./lnet-bandwidth-cdev-8.sh: line 18: 48838 Terminated lst stat clients ================================================ Starting write test to clients [89,90,109,110] Concurrency = 4 ================================================ SESSION: write4clients FEATURES: 1 TIMEOUT: 300 FORCE: No 192.168.95.158@tcp are added to session 192.168.123.[89,90,109,110]@tcp are added to session Test was added successfully bulk_rw is running now [LNet Rates of clients] [R] Avg: 3041 RPC/s Min: 3029 RPC/s Max: 3061 RPC/s [W] Avg: 3041 RPC/s Min: 3029 RPC/s Max: 3061 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.23 MB/s [W] Avg: 1520.70 MB/s Min: 1514.63 MB/s Max: 1530.53 MB/s [LNet Rates of clients] [R] Avg: 3037 RPC/s Min: 3024 RPC/s Max: 3050 RPC/s [W] Avg: 3037 RPC/s Min: 3024 RPC/s Max: 3050 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.23 MB/s [W] Avg: 1518.47 MB/s Min: 1512.03 MB/s Max: 1525.02 MB/s [LNet Rates of clients] [R] Avg: 3042 RPC/s Min: 3032 RPC/s Max: 3059 RPC/s [W] Avg: 3042 RPC/s Min: 3032 RPC/s Max: 3059 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.23 MB/s [W] Avg: 1519.18 MB/s Min: 1514.03 MB/s Max: 1527.53 MB/s [LNet Rates of clients] [R] Avg: 3040 RPC/s Min: 3034 RPC/s Max: 3050 RPC/s [W] Avg: 3040 RPC/s Min: 3034 RPC/s Max: 3050 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.23 MB/s [W] Avg: 1519.95 MB/s Min: 1517.33 MB/s Max: 1525.13 MB/s [LNet Rates of clients] [R] Avg: 3035 RPC/s Min: 3021 RPC/s Max: 3057 RPC/s [W] Avg: 3035 RPC/s Min: 3021 RPC/s Max: 3057 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.23 MB/s [W] Avg: 1517.85 MB/s Min: 1510.53 MB/s Max: 1528.62 MB/s session is ended ./lnet-bandwidth-cdev-8.sh: line 18: 48847 Terminated lst stat clients ================================================ Starting read test to clients [89,90,109,110] Concurrency = 8 ================================================ SESSION: read4clients FEATURES: 1 TIMEOUT: 300 FORCE: No 192.168.95.158@tcp are added to session 192.168.123.[89,90,109,110]@tcp are added to session Test was added successfully bulk_rw is running now [LNet Rates of clients] [R] Avg: 3473 RPC/s Min: 3391 RPC/s Max: 3538 RPC/s [W] Avg: 1736 RPC/s Min: 1694 RPC/s Max: 1769 RPC/s [LNet Bandwidth of clients] [R] Avg: 1736.72 MB/s Min: 1695.42 MB/s Max: 1769.21 MB/s [W] Avg: 0.26 MB/s Min: 0.26 MB/s Max: 0.27 MB/s [LNet Rates of clients] [R] Avg: 3462 RPC/s Min: 3387 RPC/s Max: 3510 RPC/s [W] Avg: 1733 RPC/s Min: 1697 RPC/s Max: 1756 RPC/s [LNet Bandwidth of clients] [R] Avg: 1729.08 MB/s Min: 1691.77 MB/s Max: 1753.41 MB/s [W] Avg: 0.26 MB/s Min: 0.26 MB/s Max: 0.27 MB/s [LNet Rates of clients] [R] Avg: 3478 RPC/s Min: 3412 RPC/s Max: 3514 RPC/s [W] Avg: 1739 RPC/s Min: 1706 RPC/s Max: 1757 RPC/s [LNet Bandwidth of clients] [R] Avg: 1739.31 MB/s Min: 1706.30 MB/s Max: 1757.37 MB/s [W] Avg: 0.27 MB/s Min: 0.26 MB/s Max: 0.27 MB/s [LNet Rates of clients] [R] Avg: 3484 RPC/s Min: 3415 RPC/s Max: 3530 RPC/s [W] Avg: 1742 RPC/s Min: 1707 RPC/s Max: 1764 RPC/s [LNet Bandwidth of clients] [R] Avg: 1742.12 MB/s Min: 1707.49 MB/s Max: 1765.00 MB/s [W] Avg: 0.27 MB/s Min: 0.26 MB/s Max: 0.27 MB/s [LNet Rates of clients] [R] Avg: 3467 RPC/s Min: 3409 RPC/s Max: 3511 RPC/s [W] Avg: 1734 RPC/s Min: 1705 RPC/s Max: 1756 RPC/s [LNet Bandwidth of clients] [R] Avg: 1733.65 MB/s Min: 1704.90 MB/s Max: 1755.81 MB/s [W] Avg: 0.26 MB/s Min: 0.26 MB/s Max: 0.27 MB/s session is ended ./lnet-bandwidth-cdev-8.sh: line 18: 48858 Terminated lst stat clients ================================================ Starting write test to clients [89,90,109,110] Concurrency = 8 ================================================ SESSION: write4clients FEATURES: 1 TIMEOUT: 300 FORCE: No 192.168.95.158@tcp are added to session 192.168.123.[89,90,109,110]@tcp are added to session Test was added successfully bulk_rw is running now [LNet Rates of clients] [R] Avg: 2988 RPC/s Min: 2977 RPC/s Max: 3011 RPC/s [W] Avg: 2988 RPC/s Min: 2977 RPC/s Max: 3011 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.23 MB/s [W] Avg: 1492.63 MB/s Min: 1486.74 MB/s Max: 1505.63 MB/s [LNet Rates of clients] [R] Avg: 2983 RPC/s Min: 2907 RPC/s Max: 3058 RPC/s [W] Avg: 2983 RPC/s Min: 2907 RPC/s Max: 3058 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.22 MB/s Max: 0.23 MB/s [W] Avg: 1491.49 MB/s Min: 1453.66 MB/s Max: 1528.92 MB/s [LNet Rates of clients] [R] Avg: 2980 RPC/s Min: 2932 RPC/s Max: 3008 RPC/s [W] Avg: 2980 RPC/s Min: 2932 RPC/s Max: 3008 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.22 MB/s Max: 0.23 MB/s [W] Avg: 1490.01 MB/s Min: 1466.45 MB/s Max: 1504.23 MB/s [LNet Rates of clients] [R] Avg: 2993 RPC/s Min: 2952 RPC/s Max: 3040 RPC/s [W] Avg: 2993 RPC/s Min: 2951 RPC/s Max: 3040 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.23 MB/s [W] Avg: 1496.70 MB/s Min: 1476.04 MB/s Max: 1520.42 MB/s [LNet Rates of clients] [R] Avg: 2990 RPC/s Min: 2957 RPC/s Max: 3022 RPC/s [W] Avg: 2990 RPC/s Min: 2958 RPC/s Max: 3023 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.23 MB/s [W] Avg: 1494.66 MB/s Min: 1479.14 MB/s Max: 1510.13 MB/s session is ended ./lnet-bandwidth-cdev-8.sh: line 18: 48868 Terminated lst stat clients ================================================ Starting read test to clients [89,90,109,110] Concurrency = 16 ================================================ SESSION: read4clients FEATURES: 1 TIMEOUT: 300 FORCE: No 192.168.95.158@tcp are added to session 192.168.123.[89,90,109,110]@tcp are added to session Test was added successfully bulk_rw is running now [LNet Rates of clients] [R] Avg: 4665 RPC/s Min: 4656 RPC/s Max: 4677 RPC/s [W] Avg: 2333 RPC/s Min: 2329 RPC/s Max: 2339 RPC/s [LNet Bandwidth of clients] [R] Avg: 2332.81 MB/s Min: 2328.36 MB/s Max: 2338.56 MB/s [W] Avg: 0.36 MB/s Min: 0.36 MB/s Max: 0.36 MB/s [LNet Rates of clients] [R] Avg: 4666 RPC/s Min: 4666 RPC/s Max: 4667 RPC/s [W] Avg: 2333 RPC/s Min: 2333 RPC/s Max: 2333 RPC/s [LNet Bandwidth of clients] [R] Avg: 2333.47 MB/s Min: 2333.42 MB/s Max: 2333.62 MB/s [W] Avg: 0.36 MB/s Min: 0.36 MB/s Max: 0.36 MB/s [LNet Rates of clients] [R] Avg: 4666 RPC/s Min: 4666 RPC/s Max: 4667 RPC/s [W] Avg: 2333 RPC/s Min: 2333 RPC/s Max: 2333 RPC/s [LNet Bandwidth of clients] [R] Avg: 2333.47 MB/s Min: 2333.42 MB/s Max: 2333.62 MB/s [W] Avg: 0.36 MB/s Min: 0.36 MB/s Max: 0.36 MB/s [LNet Rates of clients] [R] Avg: 4667 RPC/s Min: 4666 RPC/s Max: 4669 RPC/s [W] Avg: 2334 RPC/s Min: 2333 RPC/s Max: 2337 RPC/s [LNet Bandwidth of clients] [R] Avg: 2333.07 MB/s Min: 2332.76 MB/s Max: 2333.62 MB/s [W] Avg: 0.36 MB/s Min: 0.36 MB/s Max: 0.36 MB/s [LNet Rates of clients] [R] Avg: 4669 RPC/s Min: 4667 RPC/s Max: 4671 RPC/s [W] Avg: 2336 RPC/s Min: 2333 RPC/s Max: 2337 RPC/s [LNet Bandwidth of clients] [R] Avg: 2333.42 MB/s Min: 2333.22 MB/s Max: 2333.62 MB/s [W] Avg: 0.36 MB/s Min: 0.36 MB/s Max: 0.36 MB/s session is ended ./lnet-bandwidth-cdev-8.sh: line 18: 48877 Terminated lst stat clients ================================================ Starting write test to clients [89,90,109,110] Concurrency = 16 ================================================ SESSION: write4clients FEATURES: 1 TIMEOUT: 300 FORCE: No 192.168.95.158@tcp are added to session 192.168.123.[89,90,109,110]@tcp are added to session Test was added successfully bulk_rw is running now [LNet Rates of clients] [R] Avg: 3047 RPC/s Min: 2957 RPC/s Max: 3083 RPC/s [W] Avg: 3047 RPC/s Min: 2957 RPC/s Max: 3083 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.24 MB/s [W] Avg: 1523.72 MB/s Min: 1478.83 MB/s Max: 1541.80 MB/s [LNet Rates of clients] [R] Avg: 3049 RPC/s Min: 3035 RPC/s Max: 3065 RPC/s [W] Avg: 3049 RPC/s Min: 3036 RPC/s Max: 3066 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.23 MB/s [W] Avg: 1524.72 MB/s Min: 1517.81 MB/s Max: 1532.50 MB/s [LNet Rates of clients] [R] Avg: 3053 RPC/s Min: 3001 RPC/s Max: 3104 RPC/s [W] Avg: 3053 RPC/s Min: 3001 RPC/s Max: 3104 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.24 MB/s [W] Avg: 1526.06 MB/s Min: 1498.63 MB/s Max: 1551.95 MB/s [LNet Rates of clients] [R] Avg: 3060 RPC/s Min: 3026 RPC/s Max: 3103 RPC/s [W] Avg: 3060 RPC/s Min: 3026 RPC/s Max: 3103 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.24 MB/s [W] Avg: 1528.50 MB/s Min: 1510.92 MB/s Max: 1549.78 MB/s [LNet Rates of clients] [R] Avg: 3050 RPC/s Min: 3029 RPC/s Max: 3077 RPC/s [W] Avg: 3050 RPC/s Min: 3029 RPC/s Max: 3077 RPC/s [LNet Bandwidth of clients] [R] Avg: 0.23 MB/s Min: 0.23 MB/s Max: 0.23 MB/s [W] Avg: 1525.17 MB/s Min: 1514.41 MB/s Max: 1538.97 MB/s session is ended ./lnet-bandwidth-cdev-8.sh: line 18: 48937 Terminated lst stat clients