Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-2924

shrink ldlm_poold workload

Details

    • Improvement
    • Resolution: Fixed
    • Major
    • Lustre 2.5.0
    • Lustre 2.5.0
    • None
    • 7025

    Description

      ldlm_poold wakes every second currently and walk list of all namespaces in the system doing some bookkeeping.
      On systems with a lot of servers this client list gets quite large and it makes no sense to visit every namespace in the list if some of them don't actually have any locks.

      As such I think it makes sense to only get ldlm_poold to iterate over non-empty client namespaces.
      Estimates from Fujitsu indicate that on a system with 2000 OSTs just the list iteration (i.e. empty namespaces) takes 2ms which is probably excessive.

      Attachments

        1. nopatch-idle-data
          0.4 kB
        2. patch-idle-5624-data
          0.3 kB
        3. patch-idle-5793-data
          0.3 kB

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-5415 High ldlm_poold load on client

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-1376 ldlm_poold noise on clients significantly reduces applification performance

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-1128 Complete investigation of the LDLM pool shrinker and SLV handling

          • Major - Major loss of function.
          • Resolved

          Activity

            [LU-2924] shrink ldlm_poold workload
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-5415 [ LU-5415 ]
            jlevi Jodi Levi (Inactive) made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: In Progress [ 3 ] New: Resolved [ 5 ]
            jlevi Jodi Levi (Inactive) made changes -
            Fix Version/s New: Lustre 2.5.0 [ 10295 ]
            green Oleg Drokin made changes -
            Status Original: Open [ 1 ] New: In Progress [ 3 ]
            jlevi Jodi Levi (Inactive) made changes -
            Affects Version/s New: Lustre 2.5.0 [ 10295 ]
            morrone Christopher Morrone (Inactive) made changes -
            Link New: This issue is related to LU-1376 [ LU-1376 ]
            niu Niu Yawei (Inactive) made changes -
            Link New: This issue is related to LU-1128 [ LU-1128 ]
            simmonsja James A Simmons made changes -
            Attachment New: nopatch-idle-data [ 12502 ]
            Attachment New: patch-idle-5793-data [ 12503 ]
            Attachment New: patch-idle-5624-data [ 12504 ]
            green Oleg Drokin made changes -
            Affects Version/s Original: Lustre 2.4.0 [ 10154 ]
            Labels Original: LB
            Priority Original: Blocker [ 1 ] New: Major [ 3 ]
            pjones Peter Jones made changes -
            Assignee Original: WC Triage [ wc-triage ] New: Oleg Drokin [ green ]

            People

              green Oleg Drokin
              green Oleg Drokin
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: