https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-16087 Lustre <p>JOBSTSTS has been very useful to understand what type of IO is coming from application per JOBID/UID and GID, but it also would be nice to have more stats (e.g. like RPC size, discontiguous pages, etc that is covered by "brw_stats" today) into JOBSTATS to understand detail IO workload/size per JOBID.<br/> The other hand, the hybrid system with SSD and HDD (with/without same namespace) is naturally coming and those new stats allow let administrator or users know more guideline/information e.g. which OST devices are preferred by each application.</p> <p><a href="https://jira.whamcloud.com/browse/LU-12872" title="Adding more stats into JOBSTATS" class="issue-link" data-issue-key="LU-12872"><del>LU-12872</del></a> is used to track the requirement of adding more stats.</p> <p><a href="https://jira.whamcloud.com/browse/LU-16087" title="show distribution information of jobstats" class="issue-link" data-issue-key="LU-16087"><del>LU-16087</del></a> is used to track the requirement of show distribution information of jobstats.</p> LU-16087

show distribution information of jobstats

Improvement Minor Resolved Fixed Feng Lei Feng Lei Thu, 11 Aug 2022 01:07:46 +0000 Thu, 11 May 2023 00:42:58 +0000 Tue, 6 Dec 2022 04:25:05 +0000 Lustre 2.16.0 0 4 <p>Copy from <a href="https://jira.whamcloud.com/browse/LU-12872" title="Adding more stats into JOBSTATS" class="issue-link" data-issue-key="LU-12872"><del>LU-12872</del></a>:</p> <p>I'm going to add:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-cpp"> <span class="code-keyword">enum</span> { LPROCFS_CNTR_EXTERNALLOCK = 0x0001, LPROCFS_CNTR_AVGMINMAX = 0x0002, LPROCFS_CNTR_STDDEV = 0x0004, LPROCFS_CNTR_HISTOGRAM = 0x0008, ... LPROCFS_TYPE_BYTES_FULL_HISTOGRAM = LPROCFS_TYPE_BYTES_FULL | LPROCFS_CNTR_HISTOGRAM,</pre> </div></div> <p>The output may be like:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> read_pages: { samples: 0, unit: pages, min: 0, max: 0, sum: 0, sumsq: 0, histgram: {1: xxx, 2: yyy, 4: zzz, ...} } </pre> </div></div> <p>"Feng, Lei &lt;flei@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/48278" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/48278</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16087" title="show distribution information of jobstats" class="issue-link" data-issue-key="LU-16087"><del>LU-16087</del></a> lprocfs: add histogram to stats counter<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: b2af413b9a03a96105a6e9a12e47acf98cc17b64</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/c/fs/lustre-release/+/48278/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/48278/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16087" title="show distribution information of jobstats" class="issue-link" data-issue-key="LU-16087"><del>LU-16087</del></a> lprocfs: add histogram to stats counter<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: fde40ce32c91c804cb85be085f2aaf06170047b6</p> <p>Landed for 2.16</p> Related LU-12872 Development Rank 1|i02wu7: Rank (Obsolete) 9223372036854775807