[LU-28] Ability for client to mount subdirectories of a Lustre filesystem

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.0.0
• Fix Version/s: Lustre 2.9.0
• Type: Bug
• Priority: Minor
• Reporter: Lai Siyao
• Assignee: Wang Shilong (Inactive)
• Resolution: Fixed
• Labels: patch
• Severity: 3
• Bugzilla ID: 15,267
• Epic: metadata, mount

Description

In kicking around some ideas for the use of Lustre as a replacement for NFS user directories (home and application areas), the thought of being able to export/mount a subdirectory of a Lustre LOV came up.

Issue Links

• has to be finished together with: LUDOC-319 Add subdirectory mount feature to manual
• is related to: LU-5989 add subdirectory mounting support for...

Comments

[Lai Siyao]

Basically there are two ways to implement this:
1. client lookup the filesystem root, and then walk the filesystem (based on the
subdirectory path) and instantiate the subdirectory as the mountpoint root.
This can be implemented entirely on the client and does not require any protocol
changes.
2. change the MDS_GETSTATUS RPC to pass the subdirectory pathname from the client
to the MDS, and have it do the pathname traversal locally and return the "root"
FID for the subdirectory. This needs protocol changes, though simple ones that
can be implemented in a backward-complatible manner.

The advantage of the first way is:

• no protocol changes.
• client changes only, no compatibility issue.
• pathname transversal is more convenient and natural in client, especially for CMD
  which may involve several MDS.

Due to the above advantages this feature will be implemented in the first way.

However there are some limitations:

• <mountpoint>/.lustre doesn't exist for subdirectory mount. This '.lustre' directory
  is maintained under root directory on MDS for whole filesystem. Though we may create
  a link under subdirectory pointing to it, it may leak fids outside of its namespace.
  Currently the only affected utility is lustre_rsync, but user can do a normal mount
  and apply there (actually lustre_rsync should work on a normal mount, otherwise it
  may not be able to access files out of its namespace).
• symlink in the subdirectory will not be supported due to the extra complexity.

The following part of code will be changed:

• llite mount transverse subdirectory path.
• `lfs fid2path` support subdirectory mount.

[Lai Siyao]

code ready and is being reviewed by Niu and Bobi.

[Kit Westneat (Inactive)]

Has there been any progress on this issue? I haven't seen anything, but I thought I'd check as people have been asking about it.

[Lai Siyao]

The original patch is at http://review.whamcloud.com/#change,165, but it's not up to date. Since it's not urgent, I don't have plan to commit it soon. If someone would like to take over this work, that would be great.

[Kit Westneat (Inactive)]

I rebased it on master, it's here: http://review.whamcloud.com/#change,5007

[Kit Westneat (Inactive)]

Thanks for the review. I'm still new to Gerrit, is there someone I should add for +2?

[Peter Jones]

Kit

No further action is needed - the patch is already in the queue for landing consideration

Peter

[Kit Westneat (Inactive)]

Great, thanks

[Andreas Dilger]

What would also be very useful here for future expansion is to enhance the MDS_GETSTATUS RPC to accept a fileset name, currently always "ROOT", so that this handling can be done by the MDS in the future and the "traverse directory on client" hack can be avoided. That would allow completely independent filesets to be handled by different subtrees on the same MDT. For the initial implementation, the MDT would just check for "ROOT" (if it is sent), and return -ENODEV if it is something else, but it would at least get clients ready for the next step.

[Scott Nolin]

Has this patch been held up just due to the tab/space formatting issues since last January?

We are looking at working around this with bind mounts, and I ran across this patch.

Scott

[Peter Jones]

Scott

Thanks for drawing attention to this.

Lai

Kit has moved on to a new job. Could you please refresh the patch on his behalf?

Thanks

Peter

[Lai Siyao]

As Andreas suggested above, this feature should support mount with fileset name instead of "traverse directory on client" hack. This is not a minor change, I'll update it later.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/5007/
Subject: LU-28 fileset: add fileset mount support
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 9bd3e64b817ccbbf9760864b84908b87e13ebfe8

[Joseph Gmitter (Inactive)]

The patch has landed to master for 2.9.0