https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-334 Lustre <p>The Lustre client has a cache. File reads may be serviced by this<br/> cache, or the may need to be completed by the backend filesystem (a<br/> cache miss). It is possible to discover if a cache miss has taken<br/> place on the client, but it is time consuming and subject to race<br/> conditions.</p> LU-334

Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses.

Improvement Minor Resolved Fixed Robert Read Richard Henwood Tue, 17 May 2011 07:54:05 +0000 Tue, 27 Mar 2012 17:21:16 +0000 Wed, 2 Nov 2011 11:21:49 +0000 0 4 <p>A proposed use case for collecting cache miss stats in the llite layer is:</p> <h3><a name="Characterizingworkloadonlowmemoryclients."></a>Characterizing work-load on low memory clients.</h3> <p>Our filesystem has many thousand OSTs. Memory is allocated on the clients for stats collection for each OSC. We would like to disable OSC stats collection entirely on our clients but still record the number of bytes that travel across the wire, and the number that are read from caches on the client.</p> <p>patch available here:</p> <p><a href="http://review.whamcloud.com/#change,1341" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,1341</a></p> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=ofa/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,ofa #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/llite/lproc_llite.c</li> <li>lustre/lclient/lcommon_cl.c</li> <li>lustre/llite/llite_internal.h</li> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/osc/osc_request.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el6,inkernel #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/llite/lproc_llite.c</li> <li>lustre/llite/llite_internal.h</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/osc/osc_request.c</li> <li>lustre/lclient/lcommon_cl.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el6,ib_stack=inkernel/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el6,inkernel #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/llite/lproc_llite.c</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/llite/llite_internal.h</li> <li>lustre/lclient/lcommon_cl.c</li> <li>lustre/osc/osc_request.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=sles11,ib_stack=inkernel/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,sles11,inkernel #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/llite/llite_internal.h</li> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/lclient/lcommon_cl.c</li> <li>lustre/llite/lproc_llite.c</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/osc/osc_request.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=inkernel/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,inkernel #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/llite/llite_internal.h</li> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/lclient/lcommon_cl.c</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/osc/osc_request.c</li> <li>lustre/llite/lproc_llite.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=inkernel/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,inkernel #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/lclient/lcommon_cl.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/llite/llite_internal.h</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/llite/lproc_llite.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el6,inkernel #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/lclient/lcommon_cl.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/llite/llite_internal.h</li> <li>lustre/llite/lproc_llite.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=ubuntu1004,ib_stack=inkernel/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,ubuntu1004,inkernel #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/osc/osc_request.c</li> <li>lustre/llite/lproc_llite.c</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/llite/llite_internal.h</li> <li>lustre/lclient/lcommon_cl.c</li> <li>lustre/include/linux/lustre_lite.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/red.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=ofa/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,ofa #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = FAILURE<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/llite/lproc_llite.c</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/llite/llite_internal.h</li> <li>lustre/osc/osc_request.c</li> <li>lustre/lclient/lcommon_cl.c</li> <li>lustre/include/linux/lustre_lite.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el6,ib_stack=inkernel/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el6,inkernel #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/llite/llite_internal.h</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/osc/osc_request.c</li> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/llite/lproc_llite.c</li> <li>lustre/lclient/lcommon_cl.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=inkernel/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,inkernel #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/osc/osc_request.c</li> <li>lustre/llite/llite_internal.h</li> <li>lustre/llite/lproc_llite.c</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/lclient/lcommon_cl.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=ofa/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,ofa #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/llite/lproc_llite.c</li> <li>lustre/llite/llite_internal.h</li> <li>lustre/liblustre/llite_lib.h</li> <li>lustre/lclient/lcommon_cl.c</li> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/osc/osc_request.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=ofa/317/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,ofa #317</a><br/> <a href="https://jira.whamcloud.com/browse/LU-334" title="Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses." class="issue-link" data-issue-key="LU-334"><del>LU-334</del></a> llite: Add LPROC_LL_OSC_</p> {READ,WRITE} <p>. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=07c6f609d37878ce0d308a129a0f3ae967d6197b" class="external-link" target="_blank" rel="nofollow noopener">07c6f609d37878ce0d308a129a0f3ae967d6197b</a><br/> Files : </p> <ul> <li>lustre/osc/osc_request.c</li> <li>lustre/include/linux/lustre_lite.h</li> <li>lustre/llite/llite_internal.h</li> <li>lustre/llite/lproc_llite.c</li> <li>lustre/lclient/lcommon_cl.c</li> <li>lustre/liblustre/llite_lib.h</li> </ul> Development Rank 1|hzv88v: Rank (Obsolete) 4870