https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12631 Lustre <p>Add statistics on the client to measure and report latency of operations. </p> <p>The current <tt>llite.&#42;.stats</tt> file only reports the operation counts, not the time taken for each one. It should be simple to add stats to measure min/max/sum/sumsq for these metrics, including new <tt>read</tt> and <tt>write</tt> operations for the latency, as currently it reports <tt>read_bytes</tt> and <tt>write_bytes</tt>, which should also be kept. It <em>might</em> make sense to report sync writes separately as <tt>write_sync</tt> (with <tt>file-&gt;f_flags &amp; (O_DIRECT | O_SYNC)</tt> set) since the latency profile will be quite different compared to cached writes. </p> LU-12631

Report latency of client operations

Improvement Minor Resolved Fixed Andreas Dilger Andreas Dilger LTS12 Tue, 6 Aug 2019 16:11:37 +0000 Fri, 28 Oct 2022 15:57:48 +0000 Tue, 12 Nov 2019 06:33:58 +0000 Lustre 2.14.0 0 7 <p>The place that this should be done is <tt>llite_opcode_table</tt> and add <tt>LPROCFS_CNTR_AVGMINMAX</tt> to all of the fields there, and maybe <tt>LPROCFS_CNTR_STDDEV</tt> to the main ones that correspond to actual userspace VFS operations, not necessarily the "internal" stats like <tt>LPROC_LL_ALLOC_INODE</tt>, <tt>LPROC_LL_GETXATTR_HITS</tt>, and <tt>LPROC_LL_INODE_PERM</tt>. The <tt>LPROCFS_TYPE_REGS</tt> type can be changed to <tt>LPROCFS_TYPE_USEC</tt> for the "<tt>usec</tt>" units since it isn't used anywhere.</p> <p>We need to record the start and end time for each operation using <tt>ktime_get()</tt> and only convert the times to usec units only when printed.</p> <p>Jian</p> <p>Could you please assist with this?</p> <p>Thanks</p> <p>Peter</p> <p>Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/36078" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36078</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12631" title="Report latency of client operations" class="issue-link" data-issue-key="LU-12631"><del>LU-12631</del></a> llite: report latency for filesystem ops<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: c2acdf859997d91efbedfbfc80ece00323ee636e</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/36078/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36078/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-12631" title="Report latency of client operations" class="issue-link" data-issue-key="LU-12631"><del>LU-12631</del></a> llite: report latency for filesystem ops<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: ea58c4cfb0fc255befbbb7754bd4ed71704a2a2c</p> <p>Landed for 2.14</p> Related LU-13733 LU-13597 Development Rank 1|i00kqf: Rank (Obsolete) 9223372036854775807