Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-11190

LSOM size/age accounting histogram

XMLWordPrintable

    • Icon: Improvement Improvement
    • Resolution: Duplicate
    • Icon: Minor Minor
    • None
    • Lustre 2.12.0
    • None
    • 9223372036854775807

      With LSOM data being available on the MDT, it would be possible to automatically create a histogram of file sizes on the MDT. This would be useful for things like DoM planning, and other performance planning.

      As each file's size is recorded, a counter in the matching power-of-two histogram bucket would be incremented, and a flag set in the LMA xattr. When a file with the LMA flag is deleted or the LSOM size is changed to a new bucket, the appropriate histogram bucket would be decremented.

      It would be possible to do the same with other inode attributes (e.g. atime/mtime/ctime age histogram).

      The question would be how useful it is to keep these metrics updated on every inode update vs. scanning periodically (e.g. daily or weekly) to get the information only when it is needed.

      User/Group/Project quota can already track UID/GID/PRJID inode and space usage distribution.

            wc-triage WC Triage
            adilger Andreas Dilger
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: