[LU-10092] PCC: Lustre Persistent Client Cache

• Type: New Feature
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.13.0
• Labels: patch
• Assignee: Li Xi
• Reporter: Li Xi (Inactive)

Description

PCC is a new framework which provides a group of local cache on Lustre client side. No global namespace will be provided by PCC. Each client uses its own SSD as a local cache for it self. Local file system is used on the SSD to manage the data on local caches. Cached I/O is directed to local file system while normal I/O is directed to OSTs.

PCC uses HSM for data synchronization. It uses HSM copytool to restore file from local caches to Lustre OSTs. Each PCC has a copytool instance running with unique archive number. Any remote access from another Lustre client would trigger the data synchronization. If a client with PCC goes offline, the cached data becomes inaccessible for other client temporally. And after the PCC client reboots and the copytool restarts, the data will be accessible again.

Following is what will happen in different conditions:

►When file is being created on PCC

• A normal file is created on MDT;
• An empty mirror file is created on local cache;
• The HSM status of the Lustre file will be set to archived and released;
• The archive number will be set to the proper value.

►When file is being **prefetched* to PCC*

• An mirror file is copied to local cache;
• The HSM status of the Lustre file will be set to archived and released;
• The archive number will be set to the proper value.

►When file is being accessed from PCC

• Data will be read directly from local cache;
• Metadata will be read from MDT, except file size;
• File size will be got from local cache.

PCC should be able to accelerate some applications with certain I/O patterns.

For more information, please check the presentation during LUG'18 (http://wiki.lustre.org/images/0/04/LUG2018-Lustre_Persistent_Client_Cache-Xi.pdf).

Issue Links

• has to be finished together with: LUDOC-432 Create documentation for PCC Feature
• is blocked by: LU-10499 Readonly Persistent Client Cache support
• is related to: LU-7207 HSM: Add Archive UUID to delete changelog records
• is related to: LU-13137 User process segfaults since 2.13 client upgrade
• is related to: LU-10602 Add file heat support for Persistent Client Cache
• is related to: LU-10606 HSM info as part of LOV layout xattr
• is related to: LU-11333 Using PCC to cache whole "virtual" directories
• is related to: LU-10918 Configurable rule based auto PCC caching for newly created files
• is related to: LU-13924 Document PCC "lfs pcc add" options
• is related to: LU-10114 Feasibility of increasing upper limit of maximum HSM backends registered with MDT

Comments

[Joseph Gmitter (Inactive)]

All patches targeted for V1 have been landed. Patches being worked on for V2 are moved to LU-12714

[James A Simmons]

Is it ready for testing yet?

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/35214/
Subject: LU-10092 First phase of persistent client cache project merging
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 478f97b212714bc3af9a9a104efab314ca942758

[Gerrit Updater]

Oleg Drokin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/35214
Subject: LU-10092 First phase of persistent client cache project merging
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 478f97b212714bc3af9a9a104efab314ca942758

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/33844/
Subject: LU-10092 pcc: change detach behavior and add keep option
Project: fs/lustre-release
Branch: pcc
Current Patch Set:
Commit: 2dadefb4148f753dd93ee1dbebb3aac49bda2f8d

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/33787/
Subject: LU-10092 pcc: auto attach during open for valid cache
Project: fs/lustre-release
Branch: pcc
Current Patch Set:
Commit: e29ecb659e51dd67758c5b0adb542210e7aeddb1

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/34637/
Subject: LU-10092 pcc: security and permission for non-root user access
Project: fs/lustre-release
Branch: pcc
Current Patch Set:
Commit: 2102c86e0d0ae735aed9ee8c1c6a77b63eda6037

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/32966/
Subject: LU-10092 pcc: Non-blocking PCC caching
Project: fs/lustre-release
Branch: pcc
Current Patch Set:
Commit: 58d744e3eaab358ef346e51ff4aa17e9f08efbb3

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/32963/
Subject: LU-10092 llite: Add persistent cache on client
Project: fs/lustre-release
Branch: pcc
Current Patch Set:
Commit: f172b116885753d0f316549a2fb9d451e9b4bd2e

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/34356/
Subject: LU-10092 pcc: Reserve a new connection flag for PCC
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 93aa684046699a1d8802524003115ebaf07758ca