[LU-10383] deprecate HSM compound_id Created: 14/Dec/17  Updated: 10/Apr/18  Resolved: 09/Apr/18

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.12.0

Type: Bug Priority: Minor
Reporter: John Hammond Assignee: John Hammond
Resolution: Fixed Votes: 0
Labels: hsm

Issue Links:
Related
is related to LU-10699 replace HSM actions llog with an index Resolved
Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

Incoming HSM requests (as HALs == HSM action lists) are assigned a compound id in the MDS_HSM_REQUEST handler. Then when the CDT builds scans for actions send to the CT it will only put actions with the same compound_id in an outgoing HAL. The use case for the compound_id is not so clear and honoring it in this way inhibits batching of actions into HALs. (RBH uses only one action per HAL when it issues HSM requests.)



 Comments   
Comment by Gerrit Updater [ 15/Dec/17 ]

John L. Hammond (john.hammond@intel.com) uploaded a new patch: https://review.whamcloud.com/30552
Subject: LU-10383 hsm: refactor mdt_coordinator_cb()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 1d71757b85a825391b5f9246141bb8c6d46274d2

Comment by Gerrit Updater [ 15/Dec/17 ]

John L. Hammond (john.hammond@intel.com) uploaded a new patch: https://review.whamcloud.com/30557
Subject: LU-10383 hsm: consolidate CDT restore handle handling
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 2379e06128687961f5e41763a7b2c56989a1fb3f

Comment by Gerrit Updater [ 15/Dec/17 ]

John L. Hammond (john.hammond@intel.com) uploaded a new patch: https://review.whamcloud.com/30561
Subject: LU-10383 hsm: flatten mdt_cdt_started_cb()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 86cdb1523250268eea7c2024d044c65b4e3083b7

Comment by Gerrit Updater [ 14/Jan/18 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/30552/
Subject: LU-10383 hsm: refactor mdt_coordinator_cb()
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 75358628445eca5030b3e2bbec5d02d25fa0ed21

Comment by Gerrit Updater [ 14/Jan/18 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/30557/
Subject: LU-10383 hsm: consolidate CDT restore handle handling
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 5d58d8a88bbeff676c8c115382dd2570e79eba41

Comment by Gerrit Updater [ 14/Jan/18 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/30561/
Subject: LU-10383 hsm: flatten mdt_cdt_started_cb()
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: a49d7f0f782a2bd1383d66f155b61f1571690be8

Comment by Peter Jones [ 14/Jan/18 ]

Landed for 2.11

Comment by Gerrit Updater [ 17/Jan/18 ]

Minh Diep (minh.diep@intel.com) uploaded a new patch: https://review.whamcloud.com/30898
Subject: LU-10383 hsm: refactor mdt_coordinator_cb()
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: e545b110b0001eb3acf0a355e8cb2a168744ce01

Comment by Gerrit Updater [ 19/Jan/18 ]

John L. Hammond (john.hammond@intel.com) uploaded a new patch: https://review.whamcloud.com/30949
Subject: LU-10383 hsm: ignore compound_id
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 09687190bece67740fc290f5deaf6eb8c70385b4

Comment by Gerrit Updater [ 25/Jan/18 ]

Minh Diep (minh.diep@intel.com) uploaded a new patch: https://review.whamcloud.com/31020
Subject: LU-10383 hsm: consolidate CDT restore handle handling
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: 7258757c6514bb0eec667af4e86030f31d9fa42d

Comment by Gerrit Updater [ 25/Jan/18 ]

Minh Diep (minh.diep@intel.com) uploaded a new patch: https://review.whamcloud.com/31021
Subject: LU-10383 hsm: flatten mdt_cdt_started_cb()
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: 40d47b0e56d5184bde9048007f51c8a634e7c36d

Comment by John Hammond [ 29/Jan/18 ]

This is still in progress.

Comment by Gerrit Updater [ 08/Feb/18 ]

John L. Hammond (john.hammond@intel.com) uploaded a new patch: https://review.whamcloud.com/31234
Subject: LU-10383 hsm: remove struct hsm_thread_data
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 5cb1d854dd438bfde343fe350a25b84a0702352f

Comment by Gerrit Updater [ 08/Feb/18 ]

John L. Hammond (john.hammond@intel.com) uploaded a new patch: https://review.whamcloud.com/31235
Subject: LU-10383 hsm: add action count to hsm scan data
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 71772c5661dacdc8fb4f0bce9a21807ddd287d0f

Comment by Thomas Leibovici [ 04/Apr/18 ]

The main use-case of compounds is for staging (RESTORE operations): the goal is to make it possible to pass a list of files to be staged to the copytool as a single batch, so the copytool can read files in the right order to optimize tape mounts.

Comment by Quentin Bouget [ 04/Apr/18 ]

Requests created by a single command line will still be grouped together.

Worst case scenario, what was once grouped as a single batch will be grouped as two separate batches because the first one is full.

Comment by Gerrit Updater [ 09/Apr/18 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/31234/
Subject: LU-10383 hsm: remove struct hsm_thread_data
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 8f8e99e322d292e61f3822ba6d23c5dae2af6b6b

Comment by Gerrit Updater [ 09/Apr/18 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/31235/
Subject: LU-10383 hsm: add action count to hsm scan data
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: da69045f49e8e6e07c0b150ab8913c24756dcddb

Comment by Gerrit Updater [ 09/Apr/18 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/30949/
Subject: LU-10383 hsm: ignore compound_id
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 9ee81f920bb3f032e9b3e63bc93cd4d776396059

Comment by Peter Jones [ 09/Apr/18 ]

Landed for 2.12

Generated at Sat Feb 10 02:34:34 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.