[LU-80] Wide striping support

• Type: New Feature
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.2.0
• Affects Version/s: Lustre 2.0.0, Lustre 2.1.0, Lustre 1.8.6
• Bugzilla ID: 4,424
• Assignee: Patrick Farrell (Inactive)
• Reporter: Oleg Drokin

Description

ORNL wants to have ability to stripe file across more than 160 OSTs.

There is a number of patches in the bugzilla bug, but they are not totally complete for 2.x and there are some known issues.
Interop is also still a concern.

Issue Links

• is related to: LU-2348 e2image produce invalid image for a large xattr patch.
• is related to: LU-908 multi-block xattr support
• Trackbacks: Changelog 2.2 version 2.2.0 Support for networks: o2iblnd OFED 1.5.4 Server support for kernels: 2.6.32220.4.2.el6 (RHEL6) Client support for unpatched kernels: 2.6.18274.18.1.el5 (RHEL5) 2.6.32220.4.2.el6 (RHEL6) 2.6.32.360....
• Trackbacks: Lustre 2.2 Lustre 2.2 is scheduled for release at the end of Q1 2012. This is its anticipated support matrix. Server Support \ Client Support \ RHEL 6, \ CentOS 6 \ RHEL 6, \ CentOS 6, \ RHEL 5, \ CentOS 5, \ SLES 11 ,...

Comments

[Alexey Lyashkov]

e2image tool from a e2fsprogs broked after that change, so -r / -Q options don't copy a inode contents to the image.
I will send a fix son.

[Build Master (Inactive)]

Integrated in lustre-dev » x86_64,client,el6,inkernel #340
LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

• lustre/llite/llite_lib.c
• lustre/liblustre/llite_lib.h
• lustre/obdclass/obd_mount.c
• lustre/liblustre/super.c
• lustre/include/lustre_lite.h

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

• lustre/tests/test-framework.sh
• lustre/tests/sanity.sh
• lustre/doc/lfs_migrate.1
• lustre/scripts/lfs_migrate

[Build Master (Inactive)]

Integrated in lustre-dev » x86_64,server,el5,inkernel #340
LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

• lustre/include/lustre_lite.h
• lustre/obdclass/obd_mount.c
• lustre/liblustre/llite_lib.h
• lustre/llite/llite_lib.c
• lustre/liblustre/super.c

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

• lustre/tests/sanity.sh
• lustre/tests/test-framework.sh
• lustre/scripts/lfs_migrate
• lustre/doc/lfs_migrate.1

[Build Master (Inactive)]

Integrated in lustre-dev » i686,client,el5,inkernel #340
LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

• lustre/include/lustre_lite.h
• lustre/liblustre/llite_lib.h
• lustre/llite/llite_lib.c
• lustre/obdclass/obd_mount.c
• lustre/liblustre/super.c

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

• lustre/doc/lfs_migrate.1
• lustre/tests/sanity.sh
• lustre/tests/test-framework.sh
• lustre/scripts/lfs_migrate

[Build Master (Inactive)]

Integrated in lustre-dev » x86_64,server,el6,inkernel #340
LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

• lustre/liblustre/super.c
• lustre/include/lustre_lite.h
• lustre/llite/llite_lib.c
• lustre/liblustre/llite_lib.h
• lustre/obdclass/obd_mount.c

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

• lustre/doc/lfs_migrate.1
• lustre/tests/test-framework.sh
• lustre/tests/sanity.sh
• lustre/scripts/lfs_migrate

[Build Master (Inactive)]

Integrated in lustre-dev » i686,server,el5,inkernel #340
LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

• lustre/liblustre/super.c
• lustre/obdclass/obd_mount.c
• lustre/llite/llite_lib.c
• lustre/include/lustre_lite.h
• lustre/liblustre/llite_lib.h

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

• lustre/tests/sanity.sh
• lustre/tests/test-framework.sh
• lustre/scripts/lfs_migrate
• lustre/doc/lfs_migrate.1

[Build Master (Inactive)]

Integrated in lustre-dev » i686,client,el6,inkernel #340
LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

• lustre/liblustre/llite_lib.h
• lustre/liblustre/super.c
• lustre/include/lustre_lite.h
• lustre/obdclass/obd_mount.c
• lustre/llite/llite_lib.c

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

• lustre/tests/sanity.sh
• lustre/doc/lfs_migrate.1
• lustre/tests/test-framework.sh
• lustre/scripts/lfs_migrate

[Build Master (Inactive)]

Integrated in lustre-dev » x86_64,client,el5,inkernel #340
LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

• lustre/include/lustre_lite.h
• lustre/llite/llite_lib.c
• lustre/liblustre/llite_lib.h
• lustre/obdclass/obd_mount.c
• lustre/liblustre/super.c

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

• lustre/tests/sanity.sh
• lustre/scripts/lfs_migrate
• lustre/tests/test-framework.sh
• lustre/doc/lfs_migrate.1

[Jian Yu]

component	gerrit link	status
ldiskfs	http://review.whamcloud.com/1708	merged
lov	http://review.whamcloud.com/1111	merged
tests	http://review.whamcloud.com/1880	merged
utils	http://review.whamcloud.com/1194	merged
e2fsprogs	http://review.whamcloud.com/1886	merged
mdt	http://review.whamcloud.com/1930	merged
mds	http://review.whamcloud.com/1808	merged
manual	http://review.whamcloud.com/1929	merged

All of the patches have been merged. Let's close this ticket.

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,ofa #496
LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

Result = SUCCESS
Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
Files :

• lustre/mdt/mdt_internal.h
• lustre/mdd/mdd_dir.c
• lustre/mdd/mdd_object.c
• lustre/mdt/mdt_reint.c
• lustre/mdt/mdt_handler.c
• lustre/mdd/mdd_internal.h
• lustre/mdd/mdd_lov.c
• lustre/include/lustre_req_layout.h
• lustre/mdt/mdt_xattr.c
• lustre/mdt/mdt_lib.c
• lustre/mdc/mdc_lib.c
• lustre/ptlrpc/layout.c
• lustre/include/md_object.h
• lustre/mdt/mdt_open.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el6,inkernel #496
LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

Result = SUCCESS
Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
Files :

• lustre/mdt/mdt_reint.c
• lustre/mdd/mdd_dir.c
• lustre/mdt/mdt_handler.c
• lustre/include/md_object.h
• lustre/ptlrpc/layout.c
• lustre/mdd/mdd_lov.c
• lustre/mdt/mdt_internal.h
• lustre/mdc/mdc_lib.c
• lustre/mdd/mdd_object.c
• lustre/mdt/mdt_lib.c
• lustre/mdd/mdd_internal.h
• lustre/include/lustre_req_layout.h
• lustre/mdt/mdt_xattr.c
• lustre/mdt/mdt_open.c