Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-15058

replace critical vmalloc allocations with kernel APIs to improve performance

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • None
    • Lustre 2.15.0
    • None
    • Any client or server running Lustre.
    • 9223372036854775807

    Description

      When memory allocation grow top large the method of allocation moves from kmalloc to vmalloc. Using vmalloc() uses global locking which greatly degrades performance. For ORNL we ended up preventing users form creating files stripped greater than 512. This problem impact very large RPC and other components of Lustre. The solution is to use the generic_radix work present in newer kernel developed for this very issue.

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. LU-15606 sanity-quota test_8: osc_brw_prep_request()) ASSERTION( i == 0 || pg->off > pg_prev->off ) failed

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. LU-17916 Enable folio allocation support on the buffed io read/write path (BIO)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-14469 lmv_rmfid() does 128K kmalloc()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-13212 Lustre client hangs machine under memory pressure

          • Major - Major loss of function.
          • Resolved

          Activity

            [LU-15058] replace critical vmalloc allocations with kernel APIs to improve performance
            simmonsja James A Simmons made changes -
            Link New: This issue is related to LU-17916 [ LU-17916 ]
            simmonsja James A Simmons made changes -
            Summary Original: replace critical vmalloc allocations with genradix New: replace critical vmalloc allocations with kernel APIs to improve performance
            adilger Andreas Dilger made changes -
            Link New: This issue is duplicated by LU-15606 [ LU-15606 ]
            simmonsja James A Simmons made changes -
            Link New: This issue is related to LU-14469 [ LU-14469 ]
            simmonsja James A Simmons made changes -
            Assignee Original: WC Triage [ wc-triage ] New: James A Simmons [ simmonsja ]
            simmonsja James A Simmons made changes -
            Link New: This issue is related to LU-13212 [ LU-13212 ]
            simmonsja James A Simmons created issue -

            People

              simmonsja James A Simmons
              simmonsja James A Simmons
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: