Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-8641

speedup run_metabech () : make cleanup optional

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • Lustre 2.10.0
    • Lustre 2.8.0
    • 9223372036854775807

    Description

      1
      on real HW clusters we run metabench with parameters :

      mbench_NFILES=50000
      mbench_THREADS=16
      + /test-tools/mpich2/metabench/src/metabench -w /mnt/fs1/d0.metabench -c 50000 -C -S -k -p /test-tools/mpich2/metabench/dictionary
      + chmod 0777 /mnt/fs1
      drwxrwxrwx 5 root root 270336 Apr 25 10:02 /mnt/fs1
      + su mpiuser sh -c "/usr/bin/mpirun      -np 112 /test-tools/mpich2/metabench/src/metabench -w /mnt/fs1/d0.metabench -c 50000 -C -S -k -p /test-tools/mpich2/metabench/dictionary "
      

      test itself comleted in 20 minutes with creation rate :

      ------------- ------------ ---------- ---------- ----------
      Total                         5600000   1112.045   5035.769
      Elapsed                       5600000   1112.047   5035.758
      ------------- ------------ ---------- ---------- ----------
      Average                         50000   1097.669     45.556
      Std Dev                                   11.592      0.489 (   1.06%) (   1.07%)
      
      [2016-04-0025 10:21:30] Leaving par_create_multidir
      

      then test runs rm -rf <dir> with 5 millions file and can not be completed in 1.5 hours.

      2. On real cluster it makes sense to leave files not deleted, so total number of files would grow with time.

      Attachments

        Issue Links

          Activity

            People

              wc-triage WC Triage
              egryaznova Elena Gryaznova
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: