Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-4793

CLIO per-page allocations use size-1024 slab

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • Lustre 2.6.0
    • None
    • None
    • 3
    • 13192

    Description

      Running some simple read and write tests using "dd" to large files I see a huge amount of memory allocated by the size-1024 slab - about 1/4 if all RAM of the system.

      The size of the per-page allocation must be reduced in some manner, since this is far to much memory wasted for CLIO overhead.

      Attachments

        Activity

          [LU-4793] CLIO per-page allocations use size-1024 slab
          jlevi Jodi Levi (Inactive) added a comment -

          Patch landed to Master.

          jlevi Jodi Levi (Inactive) added a comment - Patch landed to Master.
          adilger Andreas Dilger added a comment -

          Increase priority to critical so that patch will be tracked for landing in 2.6.0.

          adilger Andreas Dilger added a comment - Increase priority to critical so that patch will be tracked for landing in 2.6.0.
          jay Jinshan Xiong (Inactive) added a comment -

          patch is at: http://review.whamcloud.com/10070

          jay Jinshan Xiong (Inactive) added a comment - patch is at: http://review.whamcloud.com/10070
          jay Jinshan Xiong (Inactive) added a comment -

          The size of cl_page is now 584 bytes. A cl_page is composed of the following sub pages: ccc_page(88 bytes), lov_page(56 bytes), lovsub_page(48 bytes), and osc_page(232 bytes). In osc_page, it has an embedded osc_async_page which is 120 bytes.

          I think the short term target is to shrink the cl_page down to below 512 bytes so that it can fit into size-512 slab.

          jay Jinshan Xiong (Inactive) added a comment - The size of cl_page is now 584 bytes. A cl_page is composed of the following sub pages: ccc_page(88 bytes), lov_page(56 bytes), lovsub_page(48 bytes), and osc_page(232 bytes). In osc_page, it has an embedded osc_async_page which is 120 bytes. I think the short term target is to shrink the cl_page down to below 512 bytes so that it can fit into size-512 slab.

          People

            jay Jinshan Xiong (Inactive)
            adilger Andreas Dilger
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: