https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12526 Lustre <p>PCC uses the layout lock to protect the cache validity. Currently PCC only supports auto attach at the next open. However, the layout lock can be revoked at any time by LRU/manual lock shrinking or lock conflict callback.</p> <p>For example, the layout lock can be revoked when perform I/Os after open the file. At this time, the cached file will be detached involuntary. The I/O originally directed into PCC will redirect to OSTs after the data restore into OSTs' objects. This cost of this unwilling behavior may be expensive.</p> <p>To avoid this problem, it is necessary to implement auto attach for PCC even during IOs (not only at the open time).</p> <p>And auto attach should be enabled by default.</p> LU-12526

Auto attach for PCC during IO

Technical task LU-12714 Minor Resolved Fixed Qian Yingjin Qian Yingjin Tue, 9 Jul 2019 14:01:49 +0000 Sun, 27 Oct 2019 13:34:58 +0000 Sun, 27 Oct 2019 13:34:58 +0000 Lustre 2.13.0 0 4 <p>I thought Oleg's suggestion was for the PCC case to hold the layout lock during I/O - Is that not practical?</p> <p>Currently the layout locks are maintained in a LRU way. They can be shrinking at any time according to the client or server lock load...</p> <p> If keep holding the layout lock during I/O like the lease lock (not in lock LRU list),  even only for PCC case, it may cause many locks caching on the clients and servers, which will result in memory pressure.</p> <p>And Current problem is that many other ibits locks (PERM and UPDATE) are binding with the layout lock. The can cancellation of other ibits lock may revoke the layout lock also.</p> <p>Hmm, but I'm basically just suggesting you hold it during I/O.  Not all the time.  If you're doing I/O to a file, it's not unreasonable to have a lock on it nor is it wasteful of memory.</p> <p>In order to do I/O in the normal Lustre path, you have to take the layout lock for read before doing I/O.  You don't hold it across the I/O (and you can't do so safely because your I/O might cause layout changes, requiring the lock).  But PCC doesn't cause those kinds of layout changes (which are FLR/PFL layout updates, basically), I think?</p> <p>So you could take the layout lock for read before I/O, and hold it across I/O.  If the other bits conflict, then the lock will be cancelled once your I/O is over, and you will ask for a new lock on the next I/O, with just the layout bit in it.  You will have to be careful about it, but it seems simpler than implementing attach during I/O.</p> <p>Maybe I am wrong - I can't see how attach during I/O would work, but I assume you have a plan.  Perhaps it is simpler than it sounds?</p> <p>Yingjin Qian (qian@ddn.com) uploaded a new patch: <a href="https://review.whamcloud.com/35468" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35468</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12526" title="Auto attach for PCC during IO" class="issue-link" data-issue-key="LU-12526"><del>LU-12526</del></a> pcc: Auto attach for PCC during IO<br/> Project: fs/lustre-release<br/> Branch: pcc<br/> Current Patch Set: 1<br/> Commit: 5c969003b6899f2449095f321715cad1b1d98918</p> <p>Hi Patrick,</p> <p>Implementing attach during IO is not very hard, please see the patch above.</p> <p>Yingjin Qian (qian@ddn.com) uploaded a new patch: <a href="https://review.whamcloud.com/36005" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36005</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12526" title="Auto attach for PCC during IO" class="issue-link" data-issue-key="LU-12526"><del>LU-12526</del></a> pcc: Auto attach for PCC during IO<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 5a87571254c5ed4515a5971a583a5c90502980a5</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/36005/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36005/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12526" title="Auto attach for PCC during IO" class="issue-link" data-issue-key="LU-12526"><del>LU-12526</del></a> pcc: Auto attach for PCC during IO<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: a120bb13525727654713f008ffcaf0e3aec7cb65</p> <p>Landed for 2.13</p> Development Rank 1|i00jdr: Rank (Obsolete) 9223372036854775807