https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-13032 Lustre <p>If there is a "kept" file on PCC, but the file was modified in Lustre after data restore, then we need to ensure that the stale PCC copy is removed from cache.</p> <p>Usually there is a daemon running on the PCC client, monitoring the space usage of the PCC device, scanning the PCC device, doing some actions accordingly, which can be used to remove this kind of PCC copies.<br/> We could add some lctl pcc commands or llapi interface as follows:</p> <ol> <li>lctl pcc clean $MNTPT $PCCPATH<br/> The command above can be used to clean up the stale invalid PCC copies out from PCC to free up space.</li> <li>lctl pcc uncache $MNTPT $PCCPATH<br/> This command will restore all data back to Lustre OSTs, and then remove the PCC copies, similar with lctl pcc del, but does not delete the PCC backend from the client.</li> <li>lctl pcc revalidate $MNTPT $PCCPATH<br/> This command will try to attach the PCC copies again if it is still valid.<br/> First, if the Layout generation is consistent, we can attach it directly;<br/> Otherwise, compare the data version between the value in HSM attrs and the one of the file in Lustre, if they are same, we can also revalidate the PCC cache.</li> </ol> LU-13032

Add lctl cleanup|uncache|revalidate commands for PCC

Technical task LU-12714 Minor Open Unresolved Qian Yingjin Qian Yingjin Fri, 29 Nov 2019 03:10:54 +0000 Fri, 29 Nov 2019 09:27:30 +0000 0 2 <p>wasn't there already a patch in the PCC branch that did this - sync the PCC cache with Lustre at unmount time? I think that adding commands to do this manually might help, but I think it is more important that this be handled as automatically as much as possible. Options include to resync idle PCC files to Lustre periodically so that they can be released from PCC quickly if needed, and to reduce the delay at unmount time. </p> <p>No. We do not have such a patch in the PCC branch to sync the PCC cache with Lustre at unmount time.<br/> As these commands above are all implemented in the user space, there are some complex to sync at unmount time in the kernel...<br/> I agree that we should add an option to determine whether to sync the PCC cache at unmount time for better support for disconnected operation with WBC on PCC, i.e. dedicated for a mobile device which may go offline manually.</p> <p>I was thinking about patch <a href="https://review.whamcloud.com/35230" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35230</a> "<tt><a href="https://jira.whamcloud.com/browse/LU-12373" title="detach and delete the PCC cached files when remove a PCC backend from a client" class="issue-link" data-issue-key="LU-12373">LU-12373</a> pcc: uncache the pcc copies when remove a PCC backend</tt>" to prevent the PCC cache filesystem from holding dirty files.</p> <p>I think we are still a long way away from disconnected client operations like CODA/Intermezzo. I'm not against that at some point in the future (I actually worked on Intermezzo to have disconnected clients at the same time I first worked on Lustre) but we have to have our cache file management/resync <b>much</b> better than it is today before this would be practical to deploy.</p> Development Rank 1|i00q6f: Rank (Obsolete) 9223372036854775807