[LU-6714] llog_process_thread() may use wrong offset for the next block Created: 12/Jun/15  Updated: 10/Apr/17  Resolved: 11/Aug/15

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.8.0

Type: Bug Priority: Minor
Reporter: Mikhail Pershin Assignee: Mikhail Pershin
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Related
is related to LU-5635 (llog.c:310:llog_process_thread()) AS... Resolved
is related to LU-6944 LBUG: (osp_sync.c:1139:osp_sync_threa... Resolved
is related to LU-9312 HSM coordinator llog scalability Resolved
Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

the llog_process_thread() save curent offset in last_offset variable before getting the new block of data, and uses it as the beginning of that block later. That can be wrong because new block can be read from different offset, depending on index being searched. We need to use the value returned by llog_next_block() call.



 Comments   
Comment by Mikhail Pershin [ 12/Jun/15 ]

It worths also to modify llog processing for the llog with fixed size records. For such llogs needed records can be accessed by index like in array, so we have file offset of record just by index, no need to search it going through whole llog.

Comment by Mikhail Pershin [ 14/Jun/15 ]

Link LU-5635 here as well to fix it properly

Comment by Gerrit Updater [ 16/Jun/15 ]

Mike Pershin (mike.pershin@intel.com) uploaded a new patch: http://review.whamcloud.com/15316
Subject: LU-6714 llog: fix wrong offset in llog_process_thread()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 6a18e003fd97fb360a4a94d347895b1392d3022f

Comment by Gerrit Updater [ 10/Jul/15 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/15316/
Subject: LU-6714 llog: fix wrong offset in llog_process_thread()
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: df45994ddcf5e6fdc379b3e1d43f1d26ba321a0e

Comment by Peter Jones [ 10/Jul/15 ]

Landed for 2.8

Comment by Gerrit Updater [ 03/Aug/15 ]

Mike Pershin (mike.pershin@intel.com) uploaded a new patch: http://review.whamcloud.com/15835
Subject: LU-6714 llog: test plain llog more throughly
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 1ed810ab336dad8881eb3507353697958ec4a708

Comment by Gerrit Updater [ 04/Aug/15 ]

Mike Pershin (mike.pershin@intel.com) uploaded a new patch: http://review.whamcloud.com/15841
Subject: LU-6714 llog: fix the llog_cat_set_first_idx()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 116467aac55d9cbf55633b85915511c0c9256f55

Comment by Andreas Dilger [ 04/Aug/15 ]

Looks like the http://review.whamcloud.com/15841 patch is not landed yet.

Comment by Gerrit Updater [ 09/Aug/15 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/15841/
Subject: LU-6714 llog: fix the llog_cat_set_first_idx()
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: a830c06c612125cf517c66823078364c0c509de9

Comment by Mikhail Pershin [ 11/Aug/15 ]

fix was landed

Comment by Peter Jones [ 12/Aug/15 ]

Mike

Doesn't this ticket need to remain open until http://review.whamcloud.com/#/c/15835/ lands? Or can this work be abandoned or tracked under another ticket #?

Peter

Comment by Mikhail Pershin [ 14/Aug/15 ]

this ticket can be closed, the patch you mentioned is under different ticket already

Comment by Gerrit Updater [ 18/Aug/15 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/15835/
Subject: LU-6714 llog: test plain llog more throughly
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: f17796cf08df5004fa68b9b4a9b0e221559389dc

Comment by Gerrit Updater [ 07/Sep/15 ]

Mike Pershin (mike.pershin@intel.com) uploaded a new patch: http://review.whamcloud.com/16287
Subject: LU-6714 llog: test on-disk llog header values
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 74e9220de55d8bd2eb5560d26c53a48684bbc66b

Comment by Gerrit Updater [ 07/Sep/15 ]

Mike Pershin (mike.pershin@intel.com) uploaded a new patch: http://review.whamcloud.com/16288
Subject: LU-6714 llog: add test for llh_cat_idx checking
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: dcebb42f60abd1741b68ec7f35226c1680b83ee9

Comment by Gerrit Updater [ 13/Dec/15 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16287/
Subject: LU-6714 llog: test on-disk llog header values
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: e667cd00c8312258453f0a081c51cf2e6233999a

Generated at Sat Feb 10 02:02:36 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.