[LU-15481] speedup "lfs changelog" with a startrec Created: 26/Jan/22  Updated: 02/Aug/23  Resolved: 11/Jul/22

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.16.0, Lustre 2.15.4

Type: Improvement Priority: Minor
Reporter: Etienne Aujames Assignee: Etienne Aujames
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Gantt End to Start
Rank (Obsolete): 9223372036854775807

 Description   

Accessing a changelog record at the end of a catalog could be really slow if there is a lot of "idle records" or if difference of indexes between changelog users is important.
In all cases, changelog llog callback (chlg_read_cat_process_cb) is called for each changelog records.

We could easily determine the number of record to skip based on internal changelog indexes. This enable to conditionally skip an entire llog plain file (64k records) (see LU-14688).



 Comments   
Comment by Gerrit Updater [ 26/Jan/22 ]

"Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/46310
Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: ed27f38c4f163701571a99dae1f34766fdd3e5a8

Comment by Gerrit Updater [ 11/Jul/22 ]

"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/46310/
Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: aa22a6826ee521ab14994a4533b0dbffb529aab0

Comment by Peter Jones [ 11/Jul/22 ]

Landed for 2.16

Comment by Gerrit Updater [ 31/Aug/22 ]

"Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/48396
Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: 6ff3e31e14b99e0aac680fa7bdb04d96ce09ecd6

Comment by Gerrit Updater [ 05/Oct/22 ]

"Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/48771
Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain
Project: fs/lustre-release
Branch: b2_15
Current Patch Set: 1
Commit: 478e5782ee0956443f01585203a23602282abf6d

Comment by Gerrit Updater [ 02/Aug/23 ]

"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/48771/
Subject: LU-15481 llog: Add LLOG_SKIP_PLAIN to skip llog plain
Project: fs/lustre-release
Branch: b2_15
Current Patch Set:
Commit: 053ab4a47a3391ff2b3b252b649b88e4579ab88f

Generated at Sat Feb 10 03:18:41 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.