[LU-14975] DNE3: directory migration in non-recursive mode Created: 31/Aug/21  Updated: 04/Oct/23  Resolved: 13/Dec/21

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.15.0

Type: New Feature Priority: Minor
Reporter: Lai Siyao Assignee: Lai Siyao
Resolution: Fixed Votes: 0
Labels: migration_improvements

Issue Links:
Duplicate
is duplicated by LU-14210 DNE3: "lfs migrate -m" should allow-n... Resolved
Related
is related to LU-14366 "lfs mkdir" on existing directory ret... Resolved
is related to LU-15001 improve recovery of interrupted direc... Open
is related to LU-13076 DNE3: lfs migrate -m should allow -1 ... Resolved
is related to LU-16717 Directory restripe breaking lmv strip... Resolved
is related to LU-7607 Preserve inode number after MDT migra... Open
is related to LU-14211 DNE3: mechanism to interrupt and resu... Open
is related to LU-15001 improve recovery of interrupted direc... Open
is related to LU-15211 lfs migrate metadata performance test... Open
Rank (Obsolete): 9223372036854775807
Epic Link: MDT rebalance v3

 Description   

Directory migration will migrate target directory and all of its subdirectories to target MDTs recursively, this will cause huge inodes migration if the target directory is deep and contains lots of sub files. To make this more flexible, a "--non-recursive" option can be added to "lfs migrate -m" to only migrate target directory and the first level of sub files under it.

 Comments   
Comment by Andreas Dilger [ 31/Aug/21 ]

This should use the option name "-d|--directory" to limit the migrate to the specified directory, to match "lfs getstripe" and "ls -ld".

Comment by Lai Siyao [ 31/Aug/21 ]

The input is deformed, do you mean "--recursive"? Should it default to recursive mode?

Comment by Gerrit Updater [ 01/Sep/21 ]

"Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/44802
Subject: LU-14975 dne: dir migration in non-recursive mode
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: ae4985753b3b50b8aad19116e9d5d634a7bb171f

Comment by Gerrit Updater [ 13/Dec/21 ]

"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/44802/
Subject: LU-14975 dne: dir migration in non-recursive mode
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 5604a6d270b8be13a8aacd72a105fc72b5e16976

Comment by Peter Jones [ 13/Dec/21 ]

Landed for 2.15

Comment by Gerrit Updater [ 07/Apr/22 ]

"Lai Siyao <lai.siyao@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/47012
Subject: LU-14975 utils: non-recursive dir migration fix
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 571dafde377fc076acfda153bfb52112dc3675e1

Comment by Gerrit Updater [ 08/Aug/22 ]

"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/47012/
Subject: LU-14975 utils: non-recursive dir migration fix
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: df3e6b4404496530a2ee65722b4b739cc0278227

Comment by Gerrit Updater [ 03/Jul/23 ]

"Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51534
Subject: LU-14975 utils: non-recursive dir migration fix
Project: fs/lustre-release
Branch: b2_15
Current Patch Set: 1
Commit: 104f71d2f1707b49868408b896f0231e7407412c

Generated at Sat Feb 10 03:14:22 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.