[LU-10383] deprecate HSM compound_id

• Type: Bug
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.12.0
• Labels: hsm
• Severity: 3
• Assignee: John Hammond
• Reporter: John Hammond

Description

Incoming HSM requests (as HALs == HSM action lists) are assigned a compound id in the MDS_HSM_REQUEST handler. Then when the CDT builds scans for actions send to the CT it will only put actions with the same compound_id in an outgoing HAL. The use case for the compound_id is not so clear and honoring it in this way inhibits batching of actions into HALs. (RBH uses only one action per HAL when it issues HSM requests.)

Issue Links

• is related to: LU-10699 replace HSM actions llog with an index

Comments

[Peter Jones]

Landed for 2.12

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/30949/
Subject: LU-10383 hsm: ignore compound_id
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 9ee81f920bb3f032e9b3e63bc93cd4d776396059

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/31235/
Subject: LU-10383 hsm: add action count to hsm scan data
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: da69045f49e8e6e07c0b150ab8913c24756dcddb

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/31234/
Subject: LU-10383 hsm: remove struct hsm_thread_data
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 8f8e99e322d292e61f3822ba6d23c5dae2af6b6b

[Quentin Bouget (Inactive)]

Requests created by a single command line will still be grouped together.

Worst case scenario, what was once grouped as a single batch will be grouped as two separate batches because the first one is full.

[Thomas Leibovici]

The main use-case of compounds is for staging (RESTORE operations): the goal is to make it possible to pass a list of files to be staged to the copytool as a single batch, so the copytool can read files in the right order to optimize tape mounts.

[Gerrit Updater]

John L. Hammond ([e-mail]) uploaded a new patch: https://review.whamcloud.com/31235
Subject: LU-10383 hsm: add action count to hsm scan data
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 71772c5661dacdc8fb4f0bce9a21807ddd287d0f

[Gerrit Updater]

John L. Hammond ([e-mail]) uploaded a new patch: https://review.whamcloud.com/31234
Subject: LU-10383 hsm: remove struct hsm_thread_data
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 5cb1d854dd438bfde343fe350a25b84a0702352f

[John Hammond]

This is still in progress.

[Gerrit Updater]

Minh Diep ([e-mail]) uploaded a new patch: https://review.whamcloud.com/31021
Subject: LU-10383 hsm: flatten mdt_cdt_started_cb()
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: 40d47b0e56d5184bde9048007f51c8a634e7c36d