[LU-12682] foreign LOV/LMV format usage implementation for DAOS specific use case

• Type: New Feature
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.15.0
• Assignee: Bruno Faccini (Inactive)
• Reporter: Bruno Faccini (Inactive)

Description

As a follow on to LU-11376, which has defined a new "foreign" format of LOV/LMV for file/dir to allow external storage reference from Lustre namespace (with the benefit of existing LOV/LMV pre-fetch mechanism, DLM protection and client/server multi-stages caching), this ticket documents a specific usage and implementation for DAOS purpose.

To be able to reference and access DAOS data, we first need to register both a pool and container uuids inside the foreign LOV/LMV, respectively for file/dir.

Then to permit transparent and quick access to DAOS containers from Lustre namespace, an extension to the Lustre Client needs to be implemented. A first try is to allow this as a symlink-like behaviour to DAOS fuse mounts.

Issue Links

• is related to: LU-14841 make foreign symlink upcall mechanism available to all foreign types and undeletable property to any Lustre file/dir
• is related to: LU-11376 Special file/dir to represent DAOS Containers

Comments

[Bruno Faccini (Inactive)]

Oops, I have abandoned #52556 as the sample of the foreign symlink upcall behaviour was already provided, as part of lustre/utils/l_foreign_symlink.c, in #35856 !!... Sorry for the noise.

[Bruno Faccini (Inactive)]

Gerrit #52556, is an addon to #35856, and is only provided as a sample of the foreign symlink upcall behaviour.

[Gerrit Updater]

"Faccini Bruno <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/52556
Subject: LU-12682 utils: foreign symlink format userhelper sample
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 40cfff2756f19b895951342b44f21d354c5a909b

[Bruno Faccini (Inactive)]

Closing now that main patch (https://review.whamcloud.com/35856/) has landed.
Further improvements that has been requested in its review comments, ie to make foreign symlink upcall mechanism available to all foreign types and undeletable property behaviour to any Lustre file/dir, will be addressed as part of LU-14841.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/35856/
Subject: LU-12682 llite: fake symlink type of foreign file/dir
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 15d44e787e17ff57fc1fb5a6c9ae568cdaab6e34

[Gerrit Updater]

Faccini Bruno ([e-mail]) uploaded a new patch: https://review.whamcloud.com/40125
Subject: LU-12682 llite: make undeletable property generic
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 573dc0ab55105b4c3f0adb7069d6b1a7b77b05a1

[Gerrit Updater]

Faccini Bruno ([e-mail]) uploaded a new patch: https://review.whamcloud.com/35856
Subject: LU-12682 llite: fake symlink for DAOS foreign file/dir
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 3035f37084f57e7641e2f92af9840faadd2b06b2