https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-10378 Lustre <p>It would be useful to be able to add the "<tt>&#45;ls</tt>" option to "<tt>lfs find</tt>" to print out file attributes.</p> <p>Even better would be if <tt>&#45;ls</tt> was implemented as a fixed-format option of the "<tt>&#45;&#45;printf</tt>" command, which could print out POSIX and Lustre-specific attributes such as OST/MDT indices for stripes, MDT inode index, etc. similar to <tt>find(1)</tt> and <tt>stat(1)</tt>. </p> <p>Unfortunately, the <tt>%</tt> options used by <tt>find(1)</tt> and <tt>stat(1)</tt> are not consistent. In case of disagreement, the <tt>find(1)</tt> options should be used. Thankfully, it appears that "<tt>%L</tt>" is not used for <tt>&#45;&#45;printf</tt> by either <tt>find(1)</tt> or <tt>stat(1)</tt>, so it could be used to print out the Lustre-specific options, for example "<tt>%Li</tt>" for starting OST index, "<tt>%Lo</tt>" for all OST indices, "<tt>%Lc</tt>" for stripe count, "<tt>%LS</tt>" for stripe size, "<tt>%Lp</tt>" for pool, etc., with the second letter matching the short options used by <tt>lfs getstripe</tt>. </p> <p>It would also be useful to add <tt>&#45;&#45;printf</tt> to "<tt>lfs getstripe</tt>" as well.</p> LU-10378

"lfs find" is missing "-printf" support

Improvement Minor Resolved Fixed Anjus George Andreas Dilger medium Wed, 13 Dec 2017 22:23:04 +0000 Wed, 15 Feb 2023 21:21:53 +0000 Wed, 26 Jan 2022 14:20:23 +0000 Lustre 2.10.0 Lustre 2.15.0 0 6 <p>Myself and a colleague are working on implementing a feature to "lfs find" that would print additional information about files beyond just the filename.  Initially, we are looking to add a new option (maybe something like --print-all) that would print most (if not all) information about matching files, like stripe count, layout info, timestamps, etc. in some form of structured output suitable for parsing by other programs.  The plan is to use this as a foundation for later adding a --printf option that would allow users to specify what subset of information they want and the format they want it in.</p> <p>Would Whamcloud be open to accepting a feature like --print-all with the expectation that future patches would implement the --printf option?</p> <p>I'm reluctant to give a "yes, I will accept anything" approval in advance of seeing the patch, or at least some inclination what the "structured output" would look like. However, I'm be generally in favor of something like this, e.g. "<tt>&#45;&#45;print&#45;yaml</tt>" that used an extensible basic YAML format. I'd be less keen on something like "<tt>&#45;&#45;print&#45;csv</tt>" or colon-separated values that are positional, because adding new fields in the future would be difficult.</p> <p>Given that we already have "<tt>lfs getstripe &#45;&#45;yaml</tt>" for printing the <tt>trusted.lov</tt> (<tt>lustre.lov</tt>) xattr, and that might be considered part of "all" inode attributes, then it makes sense to be able encapsulate that (and other xattrs) into the output in the future, rather than print all of the fields separately (and which only make sense for plain layouts). </p> <p>I wasn't necessarily looking for an unconditional "yes", but I just wanted to make sure it wasn't going to be an unconditional "no".</p> <p>YAML is one format we are considering since that would be consistent with "<tt>lfs getstripe --yaml</tt>" as you mentioned.  We had considered just trying to convert the structures to yaml format to print them out, but now we are thinking that might print out more info than we actually need.   Plus, some info (like project id) does not appear to be contained in structures like lov_user_mds_data anyway.</p> <p>So we're looking into compiling a list of the values that we might be interested in printing using a printf syntax and also creating an initial list of the format specifiers (like %Lo) that would go with each one (to prepare for eventual printf implementation).    Then perhaps the --print-all option could just be a shortcut for something like --printf "stripe_count: %Lc \n stripe_size: %Ls \n ...".</p> <p>(I am just using --print-all as a placeholder for whatever name we choose, not as a final design decision.  And I can absolutely assure you the format will not be CSV <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/wink.png" height="16" width="16" align="absmiddle" alt="" border="0"/>)</p> <p><del>"Anjus George &lt;georgea@ornl.gov&gt;" uploaded a new patch:</del> <a href="https://review.whamcloud.com/44929" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/44929</a><br/> <del>Subject: <a href="https://jira.whamcloud.com/browse/LU-10378" title="&quot;lfs find&quot; is missing &quot;-printf&quot; support" class="issue-link" data-issue-key="LU-10378"><del>LU-10378</del></a> utils: add formatted printf to lfs find</del><br/> <del>Project: fs/lustre-release</del><br/> <del>Branch: master</del><br/> <del>Current Patch Set: 1</del><br/> <del>Commit: 46e2503acbf86649f0e88c7b13b012677e5aac3b</del></p> <p>"Anjus George &lt;georgea@ornl.gov&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/45136" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/45136</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-10378" title="&quot;lfs find&quot; is missing &quot;-printf&quot; support" class="issue-link" data-issue-key="LU-10378"><del>LU-10378</del></a> utils: add formatted printf to lfs find<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 8c6526f39abfcb2625c51f9cf098b8c73a2e0dda</p> <p>Assign to Anjus who is working on a patch for "<tt>lfs find -printf</tt>".</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/45136/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/45136/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-10378" title="&quot;lfs find&quot; is missing &quot;-printf&quot; support" class="issue-link" data-issue-key="LU-10378"><del>LU-10378</del></a> utils: add formatted printf to lfs find<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 6b8e97b76c472068e7d6bc792e4f202b2f70ca67</p> <p>Landed for 2.15</p> <p>The landed patch added "<tt>-printf</tt>" support, but not "<tt>-ls</tt>". I'll clone this to add a separate LU ticket for "<tt>-ls</tt>". </p> Cloners LU-15504 Duplicate LU-9689 Related LU-5170 LU-7495 LU-16560 LU-15837 LU-15276 LU-9537 Development Rank 1|hzzpav: Rank (Obsolete) 9223372036854775807