[LU-1147] Reduce CPU overhead and performance degradation with larger striped files while reading uncached data in 1.8

Wed, 5 Mar 2014 22:40:57 +0000

Wile looking at functions with high CPU utilization for ~~LU-1056~~ we came across lov_stripe_size as one of the top functions for files with larger striping. After looking into this it appears the reason can be summarized as:

With the current read implementation in Lustre 1.8 ll_readpage->ll_readahead->odd_merge_lvb is called for every page of a file at least once. Even if the read ahead pre-fetched the data into cache it still requires a subsequent call to ll_readpage to set the page flags to uptodate. obd_merge_lvb is used to calculate the kms for an inode and calls lov_stripe_size for every stripe in a file. So the larger the striping of a file the larger the overhead in this calculation. To reduce the overhead on calculating the kms i_size_read() could be used for the inode instead of locking the stripe and calling obd_merge_lvb. The inode size should be updated by ll_extent_lock which is called by ll_file_aio_read.

Whamcloud Community JIRA

[LU-1147] Reduce CPU overhead and performance degradation with larger striped files while reading uncached data in 1.8