Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-15546

Shared Directory File Creates regression seen in 2.15 when comparing to 2.12.6

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • Lustre 2.15.0
    • Lustre 2.15.0
    • None
    • 3
    • 9223372036854775807

    Description

      When testing mdtest 2.15 (2.14.57) and comparing to 2.12.6, I see a large 25% regression with Shared Directory File Creates. Perf traces (attached) show a lot of extra ldlm overhead.

      #!/bin/bash
      
      NODES=21
      PPN=16
      PROCS=$(( $NODES * $PPN ))
      MDT_COUNT=1
      PAUSED=120
      
      srun -N $NODES --ntasks-per-node $PPN ~bloewe/benchmarks/ior-3.3.0-CentOS-8.2/install/bin/mdtest -v -i 5 -p $PAUSED -C -E -T -r -n $(( $MDT_COUNT * 1048576 / $PROCS )) -d /mnt/kjlmo2/pkoutoupis/mdt0/test.`date +"%Y%m%d.%H%M%S"` 2>&1 |& tee f_mdt0_0k_ost_shared.out
      
      srun -N $NODES --ntasks-per-node $PPN ~bloewe/benchmarks/ior-3.3.0-CentOS-8.2/install/bin/mdtest -v -i 5 -p $PAUSED -C -w 32768 -E -e 32768 -T -r -n $(( $MDT_COUNT * 1048576 / $PROCS )) -d /mnt/kjlmo2/pkoutoupis/mdt0/test.`date +"%Y%m%d.%H%M%S"` 2>&1 |& tee f_mdt0_32k_ost_shared.out
      

      Attachments

        Issue Links

          Activity

            [LU-15546] Shared Directory File Creates regression seen in 2.15 when comparing to 2.12.6
            pjones Peter Jones made changes -
            Link New: This issue is related to DDN-3129 [ DDN-3129 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-15720 [ LU-15720 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-15692 [ LU-15692 ]
            pjones Peter Jones made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: Open [ 1 ] New: Resolved [ 5 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-10262 [ LU-10262 ]
            pjones Peter Jones made changes -
            Assignee Original: WC Triage [ wc-triage ] New: Etienne Aujames [ eaujames ]
            koutoupis Petros Koutoupis made changes -
            koutoupis Petros Koutoupis made changes -
            Attachment Original: LUS-10749-perf-results.tar.gz [ 42312 ]
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.15.0 [ 14791 ]
            koutoupis Petros Koutoupis made changes -
            Summary Original: Shared Directory File Creates regression seen in 2.15 when comparing to 2.12.66.1 New: Shared Directory File Creates regression seen in 2.15 when comparing to 2.12.6
            koutoupis Petros Koutoupis created issue -

            People

              eaujames Etienne Aujames
              koutoupis Petros Koutoupis
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: