https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LUDOC-148 Lustre Documentation <p>Currently both ext4 and ldiskfs provide /proc/fs/</p> {ext4 | ldiskfs} <p>/&lt;dev&gt;/mb_groups output. This file is referenced in many kernel documents however other than noting that it's providing data on buddy group cache info, it doesn't bother documenting any further.</p> <p>Below is sample output from this file, it would be extremely useful for this to be fully documented and understood.</p> <p>#0 : 23147 1 9280 [ 1 1 0 1 0 1 1 0 0 1 0 1 1 2 ]<br/> #1 : 1156 41 1025 [ 42 15 5 3 3 3 2 2 2 0 0 0 0 0 ]<br/> #2 : 782 46 8194 [ 38 28 10 5 4 3 1 1 1 0 0 0 0 0 ]<br/> #3 : 624 7 1025 [ 10 9 5 4 2 2 1 1 1 0 0 0 0 0 ]<br/> #4 : 1065 6 12802 [ 3 5 3 2 2 1 1 1 1 1 0 0 0 0 ]<br/> #5 : 1023 1 1025 [ 1 1 1 1 1 1 1 1 1 1 0 0 0 0 ]<br/> #6 : 0 0 32768 [ 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ]<br/> #7 : 1023 1 1025 [ 1 1 1 1 1 1 1 1 1 1 0 0 0 0 ]<br/> #8 : 1022 1 19458 [ 0 1 1 1 1 1 1 1 1 1 0 0 0 0 ]<br/> #9 : 1784 4 1025 [ 2 3 2 3 3 3 1 2 1 2 0 0 0 0 ]</p> LUDOC-148

Please document mb_groups buddy cache proc output

Task Major Resolved Fixed Linda Bebernes Colin Faber [X] QContent Tue, 21 May 2013 20:45:07 +0000 Tue, 24 Sep 2013 15:54:28 +0000 Tue, 24 Sep 2013 15:54:28 +0000 0 4 <p>On 2013-05-20, at 16:41, "Colin Faber" &lt;cfaber@gmail.com&gt; wrote:<br/> &gt; I'm hoping you might be able to answer a question about /proc/fs/<b>/</b>/mb_groups. I looked over the code and that in it self wasn't obvious what the meaning of these columns is.<br/> &gt;<br/> &gt; So I'm hoping that you might be able to answer this as the documentation is seriously lacking in this area =)</p> <p>Hi Colin,<br/> This should probably be addressed as an LUDOC bug and patch, so that the documentation is permanently improved for everyone.</p> <p>&gt; The output format looks like:<br/> &gt;<br/> &gt; #group: free frags first [ 2^0 2^1 2^2 2^3 2^4 2^5 2^6 2^7 2^8 2^9 2^10 2^11 2^12 2^13 ]<br/> &gt; #0 : 4703 5 9376 [ 3 6 4 4 4 1 1 1 1 0 2 1 0 0 ]<br/> &gt; #1 : 1992 12 1144 [ 6 5 6 4 4 4 1 1 2 0 1 0 0 0 ]<br/> &gt; #2 : 2915 5 6688 [ 5 3 2 2 4 4 4 3 4 0 1 0 0 0 ]<br/> &gt; #3 : 2135 5 1025 [ 3 4 3 4 2 4 4 1 2 2 0 0 0 0 ]<br/> &gt;<br/> &gt; some of those entries are obvious however the others aren't, and whether they're showing a count (say for fragmentation) or percentage.</p> <p>My guess is that these stats are the dump of the mballoc buddy bitmap table showing for each group in the filesystem:</p> <ul class="alternate" type="square"> <li>number of free blocks</li> <li>number of chunks of free space</li> <li>offset of first free block in group</li> <li>count of free chunks of specified size (in 2^n blocks)</li> </ul> <p>Could you please file an LUDOC ticket in Jira with these comments, so they can go into the manual after 31.2.11, and hopefully they can be vetted by Alex (who wrote this code).</p> <p>Cheers, Andreas</p> <p>Hi John!<br/> Would you be able to complete this documentation?</p> <p>Hi,</p> <p>Bzzz is probably the right person to comment here as he wrote the code.</p> <p>-cf</p> <p>hm, I actually see slightly different format in the master branch:</p> <ol> <li>cat /proc/fs/ldiskfs/loop0/mb_groups<br/> #group: free free frags first pa [ 2^0 2^1 2^2 2^3 2^4 2^5 2^6 2^7 2^8 2^9 2^10 2^11 2^12 2^13 ]<br/> #0 : 2936 2936 1 42 0 [ 0 0 0 1 1 1 1 2 0 1 2 0 0 0 ]</li> </ol> <p>where columns are:</p> <ul> <li>#group number</li> <li>available blocks in the group</li> <li>blocks free on a disk</li> <li>number of free fragments</li> <li>the very first free block in the group</li> <li>number of preallocated chunks (not blocks)</li> <li>a series of available chunks of different sizes</li> </ul> <p>Alex - Thanks for the column definitions. Should mb_groups be documented as an option in the table in Section 31.2 "Tuning Multi-Block Alocation (mballoc)? Or does it go somewhere else?<br/> <a href="http://build.whamcloud.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml#idp8394512" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml#idp8394512</a></p> <p>well, this isn't an option. this is stats available to the users/administrators/developers so they can see/analyze on-disk fragmentation. not to be used often, I guess.</p> <p>Change pushed to gerrit for review <a href="http://review.whamcloud.com/#/c/7728/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/7728/</a></p> <p>Approved and merged. Marking this resolved.</p> Business Value 20.0 Development Rank 1|hzvriv: Rank (Obsolete) 8350