Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-11407

Improve stats data

XMLWordPrintable

    • Icon: Improvement Improvement
    • Resolution: Fixed
    • Icon: Minor Minor
    • Lustre 2.16.0, Lustre 2.15.2
    • None
    • None
    • 9223372036854775807

      It would be useful to store and report the "job start" time for the JobStats. Currently we show in the obdfilter.*.job_stats file:

      - job_id:          mythbackend.0
        snapshot_time:   1537384753
        read_bytes:      { samples:         321, unit: bytes, min:    4096, max: 4194304, sum:      1025404928 }
        write_bytes:     { samples:       12656, unit: bytes, min:   22028, max:  919476, sum:      5413800656 }
        sync:            { samples:       11168, unit:  reqs }
        statfs:          { samples:       31249, unit:  reqs }
      

      but this doesn't tell us anything about when this job started, so we can't find the throughput or IOPS rates. It should be simple to store the first time this job reported IO so that we can have some idea about the rate.

      A further enhancement would be to store the full brw_stats into the job_stats file, but that is a more complex change.

            adilger Andreas Dilger
            adilger Andreas Dilger
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

              Created:
              Updated:
              Resolved: