[LU-334] Lustre client procfs stats: it is valuable to distinguish between client fs cache hits and misses.

• Status: Resolved
• Project: Lustre
• Type: Improvement
• Priority: Minor
• Reporter: Richard Henwood (Inactive)
• Assignee: Robert Read (Inactive)
• Resolution: Fixed

Description

The Lustre client has a cache. File reads may be serviced by this
cache, or the may need to be completed by the backend filesystem (a
cache miss). It is possible to discover if a cache miss has taken
place on the client, but it is time consuming and subject to race
conditions.

Comments

[Richard Henwood (Inactive)]

A proposed use case for collecting cache miss stats in the llite layer is:

Characterizing work-load on low memory clients.

Our filesystem has many thousand OSTs. Memory is allocated on the clients for stats collection for each OSC. We would like to disable OSC stats collection entirely on our clients but still record the number of bytes that travel across the wire, and the number that are read from caches on the client.

[Richard Henwood (Inactive)]

patch available here:

http://review.whamcloud.com/#change,1341

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,ofa #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/liblustre/llite_lib.h
• lustre/llite/lproc_llite.c
• lustre/lclient/lcommon_cl.c
• lustre/llite/llite_internal.h
• lustre/include/linux/lustre_lite.h
• lustre/osc/osc_request.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el6,inkernel #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/include/linux/lustre_lite.h
• lustre/llite/lproc_llite.c
• lustre/llite/llite_internal.h
• lustre/liblustre/llite_lib.h
• lustre/osc/osc_request.c
• lustre/lclient/lcommon_cl.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el6,inkernel #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/llite/lproc_llite.c
• lustre/liblustre/llite_lib.h
• lustre/include/linux/lustre_lite.h
• lustre/llite/llite_internal.h
• lustre/lclient/lcommon_cl.c
• lustre/osc/osc_request.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,sles11,inkernel #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/llite/llite_internal.h
• lustre/include/linux/lustre_lite.h
• lustre/lclient/lcommon_cl.c
• lustre/llite/lproc_llite.c
• lustre/liblustre/llite_lib.h
• lustre/osc/osc_request.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,inkernel #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/llite/llite_internal.h
• lustre/include/linux/lustre_lite.h
• lustre/lclient/lcommon_cl.c
• lustre/liblustre/llite_lib.h
• lustre/osc/osc_request.c
• lustre/llite/lproc_llite.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,inkernel #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/include/linux/lustre_lite.h
• lustre/lclient/lcommon_cl.c
• lustre/osc/osc_request.c
• lustre/llite/llite_internal.h
• lustre/liblustre/llite_lib.h
• lustre/llite/lproc_llite.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el6,inkernel #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/include/linux/lustre_lite.h
• lustre/liblustre/llite_lib.h
• lustre/lclient/lcommon_cl.c
• lustre/osc/osc_request.c
• lustre/llite/llite_internal.h
• lustre/llite/lproc_llite.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/osc/osc_request.c
• lustre/llite/lproc_llite.c
• lustre/liblustre/llite_lib.h
• lustre/llite/llite_internal.h
• lustre/lclient/lcommon_cl.c
• lustre/include/linux/lustre_lite.h

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,ofa #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = FAILURE
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/llite/lproc_llite.c
• lustre/liblustre/llite_lib.h
• lustre/llite/llite_internal.h
• lustre/osc/osc_request.c
• lustre/lclient/lcommon_cl.c
• lustre/include/linux/lustre_lite.h

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,inkernel #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/llite/llite_internal.h
• lustre/liblustre/llite_lib.h
• lustre/osc/osc_request.c
• lustre/include/linux/lustre_lite.h
• lustre/llite/lproc_llite.c
• lustre/lclient/lcommon_cl.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,inkernel #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/osc/osc_request.c
• lustre/llite/llite_internal.h
• lustre/llite/lproc_llite.c
• lustre/liblustre/llite_lib.h
• lustre/include/linux/lustre_lite.h
• lustre/lclient/lcommon_cl.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,ofa #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/llite/lproc_llite.c
• lustre/llite/llite_internal.h
• lustre/liblustre/llite_lib.h
• lustre/lclient/lcommon_cl.c
• lustre/include/linux/lustre_lite.h
• lustre/osc/osc_request.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,ofa #317
LU-334 llite: Add LPROC_LL_OSC_

{READ,WRITE}

. (Revision 07c6f609d37878ce0d308a129a0f3ae967d6197b)

Result = SUCCESS
Oleg Drokin : 07c6f609d37878ce0d308a129a0f3ae967d6197b
Files :

• lustre/osc/osc_request.c
• lustre/include/linux/lustre_lite.h
• lustre/llite/llite_internal.h
• lustre/llite/lproc_llite.c
• lustre/lclient/lcommon_cl.c
• lustre/liblustre/llite_lib.h