[LU-18461] Lustre join file re-implementation

• Type: Improvement
• Resolution: Unresolved
• Priority: Minor
• Severity: 3
• Assignee: Alexey Lyashkov
• Reporter: Alexey Lyashkov

Description

So much workloads want to merge a several files in the one. Long time ago - lustre had a 'JOIN file' feature addressed it but it removed.

Once PFL exist it might be used to implement file join by adding components to a file with non-zero offset, but original PFL implementation has a bug/feature - which required start object from zero offset.

This prevents file join to use existing objects, and also caused troubles with large files on the ldiskfs backend.

Let's implement both features.

Issue Links

• is related to: LU-17326 Implement FALLOC_FL_COLLAPSE_RANGE and FALLOC_FL_INSERT_RANGE

Comments

[Gerrit Updater]

"Alexey Lyashkov <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57455
Subject: LU-18461 layout: join file implementation.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 1f13731f73923d40efebdcf6e59d7f3c7c8aeebe

[Gerrit Updater]

"Alexey Lyashkov <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57454
Subject: LU-18461 layout: allow to be started from zero offset.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 9fde53c70089f221faaa6a675e92db8a3a1b80ef

[Gerrit Updater]

"Alexey Lyashkov <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57190
Subject: LU-18461 lov: don't calculate if don't needs
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 494086ea418f149b911dbfce6c58932ed6c0a7ba

[Gerrit Updater]

"Alexey Lyashkov <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57189
Subject: LU-18461 lod: use an attributes in the declare xattr.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 9c687d2c698c7b63e91fd8bec71f6c9d38bcc48e

[Gerrit Updater]

"Alexey Lyashkov <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57188
Subject: LU-18461 lod: let's remove home coded lu_buf code.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 6ba665b1a443d6e0819490669fe9757df2d32a6f

[Gerrit Updater]

"Alexey Lyashkov <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57187
Subject: LU-18461 lod: convert a lti_ea_store to the lu_buf
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 7804634f368a98812215392796d150472c0783ef

[Gerrit Updater]

"Alexey Lyashkov <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57186
Subject: LU-18461 lod: fix layout conversion.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 3db122b6e7ecffb01aca7e4c5e28d6c10a4c2636