Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-20914

LOD OST and MDT statfs updates share one age, so either can delay the other

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Medium Medium
    • None
    • None
    • None
    • 3
    • 9223372036854775807

      lod_qos_statfs_update() refreshes the statfs data of all the targets in a table (lod_ost_descs or lod_mdt_descs) at most every 2 * qos_maxage of that table, but it checks and sets the age in lod2obd(lod)->obd_osfs_age, which both tables share.

      A striped mkdir with the default stripe offset, or a directory split, runs lod_qos_statfs_update(lod_mdt_descs), which refreshes obd_osfs_age without refreshing any OST statfs. The next file create then skips lod_qos_statfs_update(lod_ost_descs) because the age looks recent. With frequent striped mkdirs, and in particular with mdt_qos_maxage lower than qos_maxage, the OST statfs data used for QoS weights and the OST active checks can go unrefreshed indefinitely. File creates likewise delay the MDT statfs refresh for striped directories.

      This matters more once inactive OSTs are left out of the round-robin array (LU-8933), since the periodic statfs update is then what notices that an OST is usable again.

      Fix: keep a separate statfs age per target table, in struct lu_qos.

            wc-triage WC Triage
            adilger Andreas Dilger
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: