https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12056 Lustre <p>tar is not able to keep project id and it won't work for file backup/restart with project id.<br/> This is not only lustre problem, but also same problem in ldiskfs. If MDT needs to be migration from old MDT to new MDT, tar discards project id.<br/> There was discussion on <a href="https://jira.whamcloud.com/browse/LU-4017" title="Add project quota support feature" class="issue-link" data-issue-key="LU-4017"><del>LU-4017</del></a>, I think we need to address this problem.</p> master LU-12056

tar doesn't support project id

Bug Critical Resolved Fixed Dongyang Li Shuichi Ihara ldiskfs Sun, 10 Mar 2019 17:06:07 +0000 Mon, 5 Dec 2022 21:26:08 +0000 Thu, 6 Jan 2022 23:05:23 +0000 Lustre 2.15.0 0 6 <p>Probably it makes sense for Shilong to raise this issue on linux-fsdevel and bug-tar mailing lists to see if there is a preferred solution to saving/restoring the projid. I think that since the ioctl() interface is existingfor all filesystems using projid that it makes sense for tar to use this interface, but it would mean we need to patch tar until it is accepted into upstream versions/distros.</p> <p>Providing an xattr to get/set the projid would be more compatible with other tools (even symlinks, I think), but it would mean changes to all filesystems using projid. </p> <p>Currently, I think solution might be to use get ioctl to grab project of directories and files and to use<br/> set ioctl to set it, this won't work for symlink files until project ID for symlink files support landed.</p> <p>I would think it makes more sense to add complete support to tar after symlink files support land too.</p> <p>I think it would be relatively straight forward to expose a <b>virtual</b> xattr <tt>trusted.projid</tt> that returns only the ASCII-formatted projid value from <tt>i_projid</tt> in the inode, or nothing if it is zero. When written, it will convert the ASCII number to binary and store it in <tt>i_projid</tt> in the inode, similar to what <tt>FS_IOC_FSGETXATTR</tt> does.</p> <p>This would immediately work with all backup tools, and would not need much code in ldiskfs, and would likely be accepted upstream as well.</p> <p>It may also make sense to expose the inode flags via <tt>trusted.attrflags</tt> so that they are reliably backed up and restored as well. </p> <p>Yup, acutally, i've made this similar idea patch long time ago, but not push it out.<img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p>Shilong, you mentioned here that you have a patch that presents the projid as a virtual xattr to userspace. Do you still have that patch?</p> <p>Hi Dongyang,<br/> could you please look into an <b>ldiskfs</b> patch to expose the projid as a virtual <tt>trusted.projid</tt> that contains the ASCII project ID, so that normal tools like tar and rsync can backup and restore it. The use of <tt>trusted</tt> should limit this access to the root user, which is fine for us, and avoids the issue of non-root users using <tt>setfattr</tt> to set the projid on a file.</p> <p>If ldiskfs is exposing the <tt>trusted.projid</tt> xattr in the xattr list, then this should also be visible to root at the client without any need for changes.</p> <p>"Li Dongyang &lt;dongyangli@ddn.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/45679" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/45679</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12056" title="tar doesn&#39;t support project id" class="issue-link" data-issue-key="LU-12056"><del>LU-12056</del></a> ldiskfs: add trusted.projid virtual xattr<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 34a9711a083a0d8a311b7caf2aaf444568eb6f83</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/45679/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/45679/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12056" title="tar doesn&#39;t support project id" class="issue-link" data-issue-key="LU-12056"><del>LU-12056</del></a> ldiskfs: add trusted.projid virtual xattr<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 665383d3a1f4d1dc7f404301039432271ad85eaf</p> <p>Landed for 2.15</p> <p>"Li Dongyang &lt;dongyangli@ddn.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/46295" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/46295</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12056" title="tar doesn&#39;t support project id" class="issue-link" data-issue-key="LU-12056"><del>LU-12056</del></a> ldiskfs: add ext4-projid-xattrs.patch for Linux 5.10<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 4086dcc2cd0757b3738cf32972020c6a54f1486d</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/46295/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/46295/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12056" title="tar doesn&#39;t support project id" class="issue-link" data-issue-key="LU-12056"><del>LU-12056</del></a> ldiskfs: add ext4-projid-xattrs.patch for Linux 5.10<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 46a28ae19f38f8959986dcce2b331ac7e48886fc</p> Related LU-4017 LU-11872 LU-12480 LU-13335 LU-15372 Development Rank 1|i00czj: Rank (Obsolete) 9223372036854775807 Severity