Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-6663

DNE2 directories has very very bad performance

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Not a Bug
    • Affects Version/s: Lustre 2.8.0
    • Fix Version/s: None
    • Labels:
    • Environment:
      The problem only happens with the contents in an DNE2 directory
    • Severity:
      2
    • Rank (Obsolete):
      9223372036854775807

      Description

      With my DNE2 setup I attempted to start some jobs on our test cluster and the job got stuck for hours attempting to run. So I did testing to see what was breaking. A simple md5sum on files showed the problem very easily. For normal directories md5sum on a file came back very fast.

      [root@ninja06 johndoe]# date;md5sum ior;date
      Fri May 29 10:08:24 EDT 2015
      4ba1b26f0a4b71dccb237d3fd25f3b67 ior
      Fri May 29 10:08:24 EDT 2015

      But for DNE2 directories I saw this:

      [root@ninja06 jsimmons]# date;md5sum simul;date
      Fri May 29 10:08:38 EDT 2015
      9fef8669fb0e6669ac646d69062521d3 simul
      Fri May 29 10:09:59 EDT 2015

      This is not a issue for stats. So it only appears when accessing data from a file. An ls -al on the file simul comes back very fast. I did this test without the work from LU-3534 and the problem still exist.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                di.wang Di Wang
                Reporter:
                simmonsja James A Simmons
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: