Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-23

Improve performance for traversing large directory with readdir+

Details

    • New Feature
    • Resolution: Won't Do
    • Minor
    • None
    • None
    • None
    • 17,845
    • 10513

    Description

      Currently, we have statahead to improve the performance of traversing large directory, but it is not enough, especially under high network latency environment, we need reduce RPC count under such case. Both aggregate_stat (IT_5) and readdir+ are candidate for that, maybe need to be combined together.

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. LU-14139 batched statahead processing

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-14380 Make statahead better support Breadth First Search (BFS) or Depth First Search (DFS)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            [LU-23] Improve performance for traversing large directory with readdir+
            adilger Andreas Dilger made changes -
            Resolution New: Won't Do [ 10200 ]
            Status Original: In Progress [ 3 ] New: Resolved [ 5 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-14380 [ LU-14380 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-14139 [ LU-14139 ]
            adilger Andreas Dilger made changes -
            Assignee Original: nasf [ yong.fan ] New: WC Triage [ wc-triage ]
            yong.fan nasf (Inactive) made changes -
            Priority Original: Major [ 3 ] New: Minor [ 4 ]
            yong.fan nasf (Inactive) made changes -
            Status Original: Open [ 1 ] New: In Progress [ 3 ]
            yong.fan nasf (Inactive) created issue -

            People

              wc-triage WC Triage
              yong.fan nasf (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: