PCC Phase 2 (LU-12714)

[LU-10918] Configurable rule based auto PCC caching for newly created files Created: 17/Apr/18  Updated: 25/Mar/21

Status: Open
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Technical task Priority: Minor
Reporter: Qian Yingjin (Inactive) Assignee: Qian Yingjin
Resolution: Unresolved Votes: 0
Labels: None

Issue Links:
Blocker
Related
is related to LU-10092 PCC: Lustre Persistent Client Cache Resolved
is related to LU-13792 enable project quota by default Open
Rank (Obsolete): 9223372036854775807

 Description   

To meet different caching management requirements, a rule based configurable caching infrastructure is proposed for PCC to achieve various objectives, such as customizing I/O caching, providing performance isolation and QoS guarantees.

The feature of configurable rule based auto PCC caching for newly create files can significantly benefit users for readwrite PCC. It can determine which file can use a cache on PCC directly without any admission control for high priority user/group/project or filename with wildcard support. Meanwhile, we can enforce a quota limitation of capacity usage for each user/group/project to providing caching isolation. 

It is similar to NRS TBF command line that supports logical conditional conjunction and disjunction operations among different user/group/project or filename with the wildcard support.

The command line to add this kind of rule is as follows:

lctl set_param llite.*.pcc="add /mnt/pcc projid={500 1000}&fname={*.doc},uid={1001} rwid=1 roid=1"

It means that Project ID of 500, 1000 AND file suffix name is "doc" OR User ID is 1001 can be auto cached on PCC for newly create file on the client. 



 Comments   
Comment by Gerrit Updater [ 17/Apr/18 ]

Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/32022
Subject: LU-10918 llite: Rule based auto PCC caching when create files
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 6787a6961ed4d9e32fad40774fd2ac43ce7c876c

Comment by Gerrit Updater [ 22/Aug/18 ]

Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/33050
Subject: LU-10918 pcc: auto RO-PCC caching when open files
Project: fs/lustre-release
Branch: pcc
Current Patch Set: 1
Commit: 9b3f64da2dbdb55a15018c739561cfbcaf85305e

Comment by Gerrit Updater [ 24/Apr/19 ]

Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/34751
Subject: LU-10918 llite: Rule based auto PCC caching when create files
Project: fs/lustre-release
Branch: pcc
Current Patch Set: 1
Commit: ab97f98aaacd2cad09cb0717f90d21dc56a4caf3

Comment by Gerrit Updater [ 13/Jun/19 ]

Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/34751/
Subject: LU-10918 llite: Rule based auto PCC caching when create files
Project: fs/lustre-release
Branch: pcc
Current Patch Set:
Commit: 4fbae13529471ea466ad0879f04e42e12aa02786

Comment by Gerrit Updater [ 24/Apr/20 ]

Yingjin Qian (qian@ddn.com) uploaded a new patch: https://review.whamcloud.com/38346
Subject: LU-10918 pcc: auto RO-PCC caching when O_RDONLY open files
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 8c3132f022a4f052a3f056b0971116e10fddb2aa

Generated at Sat Feb 10 02:39:20 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.