Details
-
New Feature
-
Resolution: Fixed
-
Critical
-
Lustre 2.10.0
-
None
-
9223372036854775807
Description
The work tracked under this ticket will implement Progressive File Layouts (PFL).
This feature simplifies Lustre usage of large files, avoiding the need for users to predetermine the required layout for each file. The goal is that a single file layout specified at file creation time can balance the following conflicting needs:
- minimize the number of stripes for small files to avoid the overhead of creating and accessing multiple OST objects
- maximize the number of stripes for large files to utilize the available bandwidth as well as distribute space usage to avoid consuming all of the space on a single OST
- flexibility to specify a layout that is suitable for a majority of uses, while allowing for variability and flexibility between users, applications, and sites
The administrator will be able to set a specific progressive layout for new files created in the filesystem, and users will be able to specify progressive layouts on their own files for their specific needs. It should be possible to specify a default progressive layout template for a directory that is inherited by new files and directories created in that directory, as well as a filesystem-wide global default layout that is used in the absence of more specific layouts.
Attachments
Issue Links
- is related to
-
LU-9479 sanity test 184d 244: don't instantiate PFL component when taking group lock
- Open
-
LU-9300 sanity-hsm test_1b: request on 0x200000401:0x8:0x0 is not SUCCEED on mds1
- Open
-
LU-9334 LBUG lu_device_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 1
- Resolved
-
LU-9340 PFL fails performance testsSpirit
- Resolved
-
LU-9342 It is possible that user defined LOVEA contains uninstantiated flag
- Resolved
-
LU-9351 'lfs setstripe' failed to set composite layout to an existing file
- Resolved
-
LU-9522 sanity test 27z is failing with 'test_27z failed with 6'
- Resolved
-
LU-9341 PFL: append should not instantiate full layout
- Resolved
-
LU-9357 PFL llapi_layout_comp_add() should inherit pool from previous component layout
- Resolved
-
LU-9268 Add PFL test to check striping distribution
- Resolved
-
LU-9315 New static analysis issues in v2_9_55_0-35-gaa32cc5
- Resolved
-
LU-9366 Interop 2.9.0<->master sanity test_27z: FF stripe 0 stripe_size=0 stripe_count=0 != 0
- Resolved
-
LU-9393 Enhance setstripe options for components
- Resolved
-
LU-9513 New static analysis issues in v2_9_57_0-66-gb6d5b5b
- Resolved
-
LU-10070 PFL self-extending file layout
- Resolved
-
LU-3480 Layout Enhancement
- Closed
-
LU-9344 sanity test_244: sendfile_grouplock test12() test hung
- Resolved
-
LU-9359 sanity test_27p: /mnt/lustre/d27p.sanity/f27p.sanity has size 4, not 80000004
- Resolved
-
LU-9362 PFL: Files with multiple components should not return multiple values for ‘lfs getstripe’
- Resolved
-
LU-9380 sanity test_27y: lod_comp_ost_in_use() ASSERTION(inuse->op_count < inuse->op_size) failed
- Resolved
-
LU-9324 sanity-pfl test 10 needs to reset the file system default layout
- Resolved
-
LU-9007 Improved object allocator for FLR composite files
- Resolved
-
LU-9378 extract lfs-getstripe.1 from lfs.1
- Resolved
- is related to
-
LU-9349 PFL known issues tracking ticket
- Resolved
-
LUDOC-361 Documentation for Progressive File Layouts (PFL) feature
- Resolved