Metadata writeback cache support (LU-10938)

[LU-14820] WBC: trigger flush on background when exceed the dirty inode threshold Created: 06/Jul/21  Updated: 13/Feb/23

Status: Open
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Technical task Priority: Minor
Reporter: Qian Yingjin Assignee: Qian Yingjin
Resolution: Unresolved Votes: 0
Labels: None

Issue Links:
Related
Rank (Obsolete): 9223372036854775807

 Description   

Linux kernel only provides the periodic flush algorithm where the dirty inodes will stay in cache until dirty period is expired. This may result in many accumulated dirty inodes caching in memory before flushing. During this period, it does not make full use of the network and server capacity and resource.

 

Thus, it would better to design an aggressive dirty inodes flush algorithm on background when accumulated dirty inodes exceeds a threshold.

Moreover, the current writeback mechanism in kernel is single-threaded for each filesystem backend. It would better to parallelize the flushing of the dirty inodes on background.



 Comments   
Comment by Gerrit Updater [ 06/Jul/21 ]

Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/44147
Subject: LU-14820 wbc: parallel flush on background
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 9cafa692cffc0ac770885721d132fa1567b5b839

Comment by Gerrit Updater [ 23/Nov/21 ]

"Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/45644
Subject: LU-14820 wbc: Fix for some misc bugs
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 8e55b33d1a256637f5c05d5f955f5aea9261572e

Comment by Gerrit Updater [ 23/Nov/21 ]

"Yingjin Qian <qian@ddn.com>" uploaded a new patch: https://review.whamcloud.com/45645
Subject: LU-14820 wbc: fix some misc bugs V2
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 38508ed606d2976dd49bff94b138c785dfc3871a

Generated at Sat Feb 10 03:13:04 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.