[LU-333] Lustre client procfs stats: read_bytes does not record the number of bytes transfered from the fs.

• Status: Resolved
• Project: Lustre
• Fix Version/s: Lustre 2.1.0
• Type: Bug
• Priority: Minor
• Reporter: Richard Henwood (Inactive)
• Assignee: Richard Henwood (Inactive)
• Resolution: Fixed
• Severity: 3

Description

Read bytes
----------

A client of a Lustre filesystem will be interested in the total bytes
transfered over the fabric. The stats file appears to provide a
valuable snapshot of high-level data transfer metrics. However, after
investigation the values recorded are of limited value. read_bytes
returns the number of bytes that have been requested. This is not the
same as the number of bytes that have been read. The example below
illustrates this confusion:

[root@rhel6_21 ~]# echo "hello lustre" > /mnt/lustre/test.txt
[root@rhel6_21 ~]# cat /mnt/lustre/test.txt > /dev/null
[root@rhel6_21 ~]# cat /proc/fs/lustre/llite/lustre-ffff88001aa95c00/stats
...
read_bytes                1 samples [bytes] 2097152 2097152 2097152
write_bytes               1 samples [bytes] 13 13 13
...

In this example, the read on the file was performed by cat. This
requests the number of bytes it needs to fill it's internal buffer. It
continues to do this until the read returns zero. So, in our example,
the internal buffer size of cat is 1KB and it performs two reads. As
it stands, this metric may be misleading to the uninformed.

Comments

[Andreas Dilger]

Patch is in http://review.whamcloud.com/#change,1094.

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,ofa #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/tests/sanity.sh
• lustre/llite/vvp_io.c
• lustre/llite/file.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el6,inkernel #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/tests/sanity.sh
• lustre/llite/file.c
• lustre/llite/vvp_io.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,inkernel #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/llite/file.c
• lustre/tests/sanity.sh
• lustre/llite/vvp_io.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,inkernel #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/llite/vvp_io.c
• lustre/tests/sanity.sh
• lustre/llite/file.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el6,inkernel #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/tests/sanity.sh
• lustre/llite/vvp_io.c
• lustre/llite/file.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,sles11,inkernel #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/llite/file.c
• lustre/tests/sanity.sh
• lustre/llite/vvp_io.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,inkernel #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/tests/sanity.sh
• lustre/llite/file.c
• lustre/llite/vvp_io.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,ofa #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/llite/file.c
• lustre/tests/sanity.sh
• lustre/llite/vvp_io.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el6,inkernel #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/tests/sanity.sh
• lustre/llite/vvp_io.c
• lustre/llite/file.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/tests/sanity.sh
• lustre/llite/vvp_io.c
• lustre/llite/file.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,ofa #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/llite/file.c
• lustre/llite/vvp_io.c
• lustre/tests/sanity.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,inkernel #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/llite/file.c
• lustre/tests/sanity.sh
• lustre/llite/vvp_io.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,ofa #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/llite/file.c
• lustre/llite/vvp_io.c
• lustre/tests/sanity.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,inkernel #245
LU-333: Make read_bytes in llite/*/stats report bytes read.

Oleg Drokin : 37eeb0ffd0325c5a3c426d6ab0e72ef6da84db99
Files :

• lustre/tests/sanity.sh
• lustre/llite/file.c
• lustre/llite/vvp_io.c

[Richard Henwood (Inactive)]

merged into Master.