[LU-7207] HSM: Add Archive UUID to delete changelog records

Related — Thu, 25 Apr 2019 17:06:24 +0000

HSM tools currently store an external identifier (such as a UUID) in EA when a file is archived. The identifier is used to identify the file in the backend archive, and there may be more than one identifier if the file has been archived to multiple backends. Currently different tools are doing this independently and are not coordinating their EA names or formats.

When a file is deleted, the EA is no longer available, so it would be helpful include the identifier(s) in the Delete changelog record. I suggest we define a standard name and format HSM archive EA, and this data should be included as is in the delete changelog record.

One possible format would be to use JSON to encode a list of endpoint and archive id. Here is a strawman example to begin the discussion:

{
  "replicas": [
    {
      "endpoint" : "s3://my-bucket/archve",
      "id": "UUID"
     },
    { 
      "endpoint" : "wos://address",
      "id": OID
    }
  ]
}

Alternatively, to save space the endpoint could just be an index that refers to a specific endpoint in the local configuration.

Whamcloud Community JIRA

[LU-7207] HSM: Add Archive UUID to delete changelog records