Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-20462 Lustre Find Utility (LFU)
  3. LU-21154

LFU: lfu-resync, a daemon that resyncs and adds FLR mirrors by policy

XMLWordPrintable

    • Icon: Technical task Technical task
    • Resolution: Unresolved
    • Icon: Medium Medium
    • None
    • None
    • None
    • 3
    • 9223372036854775807

      FLR mirrors made stale by writes stay stale until someone runs lfs mirror resync, and nothing adds mirrors by policy, for example a capacity mirror for files written to a Tiered Lustre Cache pool.

      Add lfu-resync, as described in the lfu-resync HLD by Andreas:

      • A scanner, one per MDT, finds files to resync or extend. It reads the MDT changelog as a registered user and scans the MDT device at a limited rate for what the changelog missed. Each file waits until it has been idle for its class's resync delay.
      • Policy classes use lfs find predicates, and say whether to resync and which pool to add a mirror in. Free space limits stop adding mirrors to a pool that is filling up.
      • The copies are done by agents on clients. The scanner queues a new HSM coordinator action, HSMA_RESYNC, which agents register for by archive id, like a copytool. It does not use or change the HSM state of the file.
      • lfu-resync --fid resyncs one file by hand.
      • systemd units for the scanner and the agent, YAML statistics on SIGUSR1, reload on SIGHUP.

      The agent needs two pieces that are static in lfs.c now, so they move to the library:

      • llapi_mirror_resync_file(), the lease and resync sequence of lfs mirror resync. This also fixes lfs mirror resync reporting success when the lease is lost.
      • llapi_mirror_extend(), which adds a stale mirror without copying data (on top of LU-17531 --no-resync).

      Phase 1 of the HLD: the scanner needs a client mount on the MDS. EC and compressed mirrors, and client mode, come later.

            hnishida Hiroshi Nishida
            hnishida Hiroshi Nishida
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: