Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-14958

configurable hash table size for jbd2

XMLWordPrintable

    • Icon: Improvement Improvement
    • Resolution: Fixed
    • Icon: Minor Minor
    • Lustre 2.16.0, Lustre 2.15.3
    • None
    • None
    • 9223372036854775807

      revoke hash table can be enourmous with multi-GB journal. this may result in millions of revoke records which are loaded and inserted into specific hashtable during journal replay.
      currently the revoke hashtable's size is hard-coded as 256, thus every slot may get too many records.

      a simple benchmark of that code:
      1048576 - 95 seconds
      2097152 - 580 seconds
      in the fields it can be upto 30M records to find/insert.

      with 8192 buckets in the hash table:
      4194304 - 59 seconds
      8388608 - 247 seconds

        1. dumpe2fs.txt
          2 kB
        2. jbd2_debugfs.gz
          106.24 MB

            bzzz Alex Zhuravlev
            bzzz Alex Zhuravlev
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

              Created:
              Updated:
              Resolved: