[LU-12071] bypass pagecache for large files Created: 14/Mar/19  Updated: 25/Nov/22  Resolved: 06/Dec/19

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.14.0

Type: Improvement Priority: Minor
Reporter: Alex Zhuravlev Assignee: Alex Zhuravlev
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Duplicate
is duplicated by LU-11341 Do not use pagecache for I/O Resolved
is duplicated by LU-12346 ladvise willread should work even if ... Resolved
Related
is related to LU-410 Performance concern with Shrink file_... Resolved
is related to LU-11347 Do not use pagecache for SSD I/O when... Resolved
is related to LU-12016 sanity: test_156 Error: ''IN CACHE: b... Resolved
is related to LU-13680 large allocations in osd_bufs_get() f... Resolved
is related to LU-12179 allocate continuous pages when disabl... Open
Rank (Obsolete): 9223372036854775807

 Description   

pagecache invalidation is quite expensive:

pagecache enabled:

ost  1 sz 268435456K rsz 16384K obj   16 thr   64 write 5094.16 [2287.82, 6383.46] read 5295.85 [5039.42, 5567.47] 

pagecache disabled:

ost  1 sz 268435456K rsz 16384K obj   16 thr   64 write 4460.22 [3615.59, 5151.63] read 5218.00 [4847.41, 5551.34] 

we do already have a mechanism to bypass pagecache in place, just need to use that properly.



 Comments   
Comment by Gerrit Updater [ 14/Mar/19 ]

Alex Zhuravlev (bzzz@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34422
Subject: LU-12071 osd-ldiskfs: bypass pagecache if requested
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 4652ad0b0d65b616b11c27829c221521003c623b

Comment by Gerrit Updater [ 06/Dec/19 ]

Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/34422/
Subject: LU-12071 osd-ldiskfs: bypass pagecache if requested
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 3043c6f18964b0cc843b2e7866756a1d1ddd61e3

Comment by Peter Jones [ 06/Dec/19 ]

Landed for 2.14

Generated at Sat Feb 10 02:49:25 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.