[LU-12682] foreign LOV/LMV format usage implementation for DAOS specific use case Created: 22/Aug/19  Updated: 30/Sep/23  Resolved: 12/Jul/21

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.15.0

Type: New Feature Priority: Major
Reporter: Bruno Faccini (Inactive) Assignee: Bruno Faccini (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Related
is related to LU-11376 Special file/dir to represent DAOS Co... Resolved
is related to LU-14841 make foreign symlink upcall mechanism... Open
Rank (Obsolete): 9223372036854775807

 Description   

As a follow on to LU-11376, which has defined a new "foreign" format of LOV/LMV for file/dir to allow external storage reference from Lustre namespace (with the benefit of existing LOV/LMV pre-fetch mechanism, DLM protection and client/server multi-stages caching), this ticket documents a specific usage and implementation for DAOS purpose.

To be able to reference and access DAOS data, we first need to register both a pool and container uuids inside the foreign LOV/LMV, respectively for file/dir.

Then to permit transparent and quick access to DAOS containers from Lustre namespace, an extension to the Lustre Client needs to be implemented. A first try is to allow this as a symlink-like behaviour to DAOS fuse mounts.



 Comments   
Comment by Gerrit Updater [ 22/Aug/19 ]

Faccini Bruno (bruno.faccini@intel.com) uploaded a new patch: https://review.whamcloud.com/35856
Subject: LU-12682 llite: fake symlink for DAOS foreign file/dir
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 3035f37084f57e7641e2f92af9840faadd2b06b2

Comment by Gerrit Updater [ 02/Oct/20 ]

Faccini Bruno (bruno.faccini@intel.com) uploaded a new patch: https://review.whamcloud.com/40125
Subject: LU-12682 llite: make undeletable property generic
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 573dc0ab55105b4c3f0adb7069d6b1a7b77b05a1

Comment by Gerrit Updater [ 26/Feb/21 ]

Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/35856/
Subject: LU-12682 llite: fake symlink type of foreign file/dir
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 15d44e787e17ff57fc1fb5a6c9ae568cdaab6e34

Comment by Bruno Faccini (Inactive) [ 12/Jul/21 ]

Closing now that main patch (https://review.whamcloud.com/35856/) has landed.
Further improvements that has been requested in its review comments, ie to make foreign symlink upcall mechanism available to all foreign types and undeletable property behaviour to any Lustre file/dir, will be addressed as part of LU-14841.

Comment by Gerrit Updater [ 29/Sep/23 ]

"Faccini Bruno <bruno.faccini@intel.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/52556
Subject: LU-12682 utils: foreign symlink format userhelper sample
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 40cfff2756f19b895951342b44f21d354c5a909b

Comment by Bruno Faccini (Inactive) [ 29/Sep/23 ]

Gerrit #52556, is an addon to #35856, and is only provided as a sample of the foreign symlink upcall behaviour.

Comment by Bruno Faccini (Inactive) [ 30/Sep/23 ]

Oops, I have abandoned #52556 as the sample of the foreign symlink upcall behaviour was already provided, as part of lustre/utils/l_foreign_symlink.c, in #35856 !!... Sorry for the noise.

Generated at Sat Feb 10 02:54:44 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.