Details
-
Improvement
-
Resolution: Unresolved
-
Minor
-
None
-
None
-
None
-
3
-
9223372036854775807
Description
So much workloads want to merge a several files in the one. Long time ago - lustre had a 'JOIN file' feature addressed it but it removed.
Once PFL exist it might be used to implement file join by adding components to a file with non-zero offset, but original PFL implementation has a bug/feature - which required start object from zero offset.
This prevents file join to use existing objects, and also caused troubles with large files on the ldiskfs backend.
Let's implement both features.
Attachments
Issue Links
- is related to
-
-
- Open
-
Activity
| Description |
Original:
So much workloads want to merge a several files in the one.
Long time ago - lustre had a 'JOIN file' feature addressed it but it removed. Once PFL exist it might be implemented as components merge, but original PFL implementation had a bug/feature - which caused a start object from non zero offset. It prevent it and caused a troubles with large files on the ldiskfs backend. Let's implement both features. |
New:
So much workloads want to merge a several files in the one. Long time ago - lustre had a 'JOIN file' feature addressed it but it removed.
Once PFL exist it might be used to implement file join by adding components to a file with non-zero offset, but original PFL implementation has a bug/feature - which required start object from zero offset. This prevents file join to use existing objects, and also caused troubles with large files on the ldiskfs backend. Let's implement both features. |
"Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57454
Subject: LU-18461 layout: allow to be started from zero offset.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 9fde53c70089f221faaa6a675e92db8a3a1b80ef
"Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57190
Subject: LU-18461 lov: don't calculate if don't needs
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 494086ea418f149b911dbfce6c58932ed6c0a7ba
"Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57189
Subject: LU-18461 lod: use an attributes in the declare xattr.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 9c687d2c698c7b63e91fd8bec71f6c9d38bcc48e
"Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57188
Subject: LU-18461 lod: let's remove home coded lu_buf code.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 6ba665b1a443d6e0819490669fe9757df2d32a6f
"Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57187
Subject: LU-18461 lod: convert a lti_ea_store to the lu_buf
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 7804634f368a98812215392796d150472c0783ef
"Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57186
Subject: LU-18461 lod: fix layout conversion.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 3db122b6e7ecffb01aca7e4c5e28d6c10a4c2636
"Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/57455
Subject: LU-18461 layout: join file implementation.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 1f13731f73923d40efebdcf6e59d7f3c7c8aeebe