Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-7207

HSM: Add Archive UUID to delete changelog records

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None
    • Severity:
      3
    • Rank (Obsolete):
      9223372036854775807

      Description

      HSM tools currently store an external identifier (such as a UUID) in EA when a file is archived. The identifier is used to identify the file in the backend archive, and there may be more than one identifier if the file has been archived to multiple backends. Currently different tools are doing this independently and are not coordinating their EA names or formats.

      When a file is deleted, the EA is no longer available, so it would be helpful include the identifier(s) in the Delete changelog record. I suggest we define a standard name and format HSM archive EA, and this data should be included as is in the delete changelog record.

      One possible format would be to use JSON to encode a list of endpoint and archive id. Here is a strawman example to begin the discussion:

      {
        "replicas": [
          {
            "endpoint" : "s3://my-bucket/archve",
            "id": "UUID"
           },
          { 
            "endpoint" : "wos://address",
            "id": OID
          }
        ]
      }
      

      Alternatively, to save space the endpoint could just be an index that refers to a specific endpoint in the local configuration.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                wc-triage WC Triage
                Reporter:
                rread Robert Read (Inactive)
              • Votes:
                0 Vote for this issue
                Watchers:
                19 Start watching this issue

                Dates

                • Created:
                  Updated: