Details
-
Bug
-
Resolution: Unresolved
-
Major
-
None
-
Lustre 2.13.0, Lustre 2.14.0
-
None
-
RHEL7 running the latest master.
-
3
-
9223372036854775807
Description
While comparing the results of Lustre 2.12 LTS and the latest master version of Lustre a noticeable decrease of performance was seen with mdtest. I did a git bisected to discover the source of this regression to be https://review.whamcloud.com/#/c/35825. The results are as follows before and after the patch landed:
mdtest-3.4.0+dev was launched with 54 total task(s) on 9 node(s)
Command line used: /lustre/crius/stf008/scratch/jsimmons/x86_64/mdtest '-n' '1000' '-p' '10' '-e' '4096' '-w' '4096' '-i' '5' '-z' '2' '-d' '/lustre/crius/stf008/scratch/jsimmons/test_mdtest'
Path: /lustre/crius/stf008/scratch/jsimmons
FS: 806.0 TiB Used FS: 0.0% Inodes: 4298.4 Mi Used Inodes: 0.0%
Nodemap: 111111000000000000000000000000000000000000000000000000
54 tasks, 53946 files/directories
SUMMARY rate: (of 5 iterations)
Operation Max Min Mean Std Dev
--------- --- — ---- -------
Directory creation : 10929.296 10229.518 10551.707 269.772
Directory stat : 45397.727 44566.564 45101.666 285.915
Directory removal : 14509.663 13822.493 14198.406 282.821
File creation : 6180.597 6097.217 6142.435 30.776
File stat : 43473.036 31895.809 37446.331 4316.809
File read : 18142.575 16228.362 17383.867 750.963
File removal : 7412.350 7061.313 7227.328 118.574
Tree creation : 3478.676 2899.108 3328.345 219.993
Tree removal : 764.549 583.999 672.962 59.213
– finished at 11/20/2020 10:55:32 –
And after landing the patch:
mdtest-3.4.0+dev was launched with 54 total task(s) on 9 node(s)
Command line used: /lustre/crius/stf008/scratch/jsimmons/x86_64/mdtest '-n' '1000' '-p' '10' '-e' '4096' '-w' '4096' '-i' '5' '-z' '2' '-d' '/lustre/crius/stf008/scratch/jsimmons/test_mdtest'
Path: /lustre/crius/stf008/scratch/jsimmons
FS: 806.0 TiB Used FS: 0.0% Inodes: 4667.2 Mi Used Inodes: 0.0%
Nodemap: 111111000000000000000000000000000000000000000000000000
54 tasks, 53946 files/directories
SUMMARY rate: (of 5 iterations)
Operation Max Min Mean Std Dev
--------- --- — ---- -------
Directory creation : 1823.563 1497.613 1687.840 105.551
Directory stat : 26132.733 18515.334 23994.365 2847.665
Directory removal : 2721.120 1783.451 2383.377 329.561
File creation : 6880.575 6428.112 6702.467 153.483
File stat : 44519.556 38352.962 42705.219 2270.727
File read : 19180.528 18379.633 18696.723 276.664
File removal : 9229.889 8597.003 8889.050 222.742
Tree creation : 48.123 42.574 46.095 1.908
Tree removal : 39.628 10.159 28.961 9.911
– finished at 11/20/2020 10:18:56 –
