Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-5726

MDS buffer not freed when deleting files

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • Lustre 2.7.0, Lustre 2.5.4
    • Lustre 2.4.3
    • None
    • CentOS 6.5
      Kernel 2.6.32-358.23.2
    • 3
    • 16083

    Description

      When deleting large numbers of files, memory usage on the MDS server grows significantly. Attempts to reclaim memory by dropping caches only results in some of the memory being freed. The buffer usage continues to grow until eventually the MDS server starts OOMing.

      The rate at which the buffer usage grows seems to vary but looks like it might be based on the number of clients that are deleting files and the speed at which the files are deleted.

      Attachments

        1. lustre-debug-malloc.gz
          0.2 kB
        2. mds-crash-log-20140913
          47 kB
        3. meminfo.after
          1 kB
        4. meminfo.before
          1 kB
        5. slabinfo.after
          26 kB
        6. slabinfo.before
          26 kB

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-5333 rm cause MDS to complain hung tasks and disconnecting clients

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-5841 Lustre 2.4.2 MDS, hitting OOM errors

          • Major - Major loss of function.
          • Resolved

          Activity

            [LU-5726] MDS buffer not freed when deleting files
            pjones Peter Jones made changes -
            Labels Original: 22i mq414
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.7.0 [ 10631 ]
            Fix Version/s New: Lustre 2.5.4 [ 11190 ]
            Resolution New: Fixed [ 1 ]
            Status Original: Open [ 1 ] New: Resolved [ 5 ]
            jlevi Jodi Levi (Inactive) made changes -
            Fix Version/s Original: Lustre 2.7.0 [ 10631 ]
            pjones Peter Jones made changes -
            Labels New: 22i mq414
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-5841 [ LU-5841 ]
            rmohr Rick Mohr made changes -
            Attachment New: mds-crash-log-20140913 [ 16276 ]
            niu Niu Yawei (Inactive) made changes -
            Link Original: This issue is related to LU-5077 [ LU-5077 ]
            niu Niu Yawei (Inactive) made changes -
            Link New: This issue is related to LU-5333 [ LU-5333 ]
            jlevi Jodi Levi (Inactive) made changes -
            Assignee Original: WC Triage [ wc-triage ] New: Niu Yawei [ niu ]
            jlevi Jodi Levi (Inactive) made changes -
            Priority Original: Major [ 3 ] New: Blocker [ 1 ]

            People

              niu Niu Yawei (Inactive)
              rmohr Rick Mohr
              Votes:
              0 Vote for this issue
              Watchers:
              22 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: