[LU-80] Wide striping support - Whamcloud Community JIRA

Details

Type: New Feature
Resolution: Fixed
Priority: Minor
Fix Version/s: Lustre 2.2.0
Affects Version/s: Lustre 2.0.0, Lustre 2.1.0, Lustre 1.8.6
Labels:
None

Bugzilla ID:
4,424
Rank (Obsolete):
4227

Description

ORNL wants to have ability to stripe file across more than 160 OSTs.

There is a number of patches in the bugzilla bug, but they are not totally complete for 2.x and there are some known issues.
Interop is also still a concern.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

kern.log
16 kB
20/Dec/11 11:57 AM
LUG-2011-Widestriping.pdf
130 kB
31/Jan/12 9:24 PM
mds1.tar.gz
6.07 MB
25/Nov/11 4:01 AM
mdtest_xattr.patch
2 kB
09/Dec/11 11:59 AM
Wide Striping Test Plan.pdf
117 kB
08/Feb/12 4:07 AM

Issue Links

is related to

LU-2348 e2image produce invalid image for a large xattr patch.

Resolved

LU-908 multi-block xattr support

Resolved

Trackbacks

Changelog 2.2 version 2.2.0 Support for networks: o2iblnd OFED 1.5.4 Server support for kernels: 2.6.32220.4.2.el6 (RHEL6) Client support for unpatched kernels: 2.6.18274.18.1.el5 (RHEL5) 2.6.32220.4.2.el6 (RHEL6) 2.6.32.360....

Lustre 2.2 Lustre 2.2 is scheduled for release at the end of Q1 2012. This is its anticipated support matrix. Server Support \ Client Support \ RHEL 6, \ CentOS 6 \ RHEL 6, \ CentOS 6, \ RHEL 5, \ CentOS 5, \ SLES 11 ,...

Activity

[LU-80] Wide striping support

Andreas Dilger added a comment - 12/Aug/16 5:09 AM

http://review.whamcloud.com/2331

LU-80 tests: support regression testing on wide striping

This patch enables large_xattr feature at mkfs.lustre time to
support regression testing on wide striping. It is intended to
be built by Jenkins and performed by autotest system.

Signed-off-by: Yu Jian <yujian@whamcloud.com>
Change-Id: Iea7042891bab6fdcb19fb9dae7e6d54c02a99267

Andreas Dilger added a comment - 12/Aug/16 5:09 AM http://review.whamcloud.com/2331 LU-80 tests: support regression testing on wide striping This patch enables large_xattr feature at mkfs.lustre time to support regression testing on wide striping. It is intended to be built by Jenkins and performed by autotest system. Signed-off-by: Yu Jian <yujian@whamcloud.com> Change-Id: Iea7042891bab6fdcb19fb9dae7e6d54c02a99267

Peter Jones added a comment - 19/Nov/12 1:07 PM

Ah yes - ~~LU-2348~~ - thanks!

Peter Jones added a comment - 19/Nov/12 1:07 PM Ah yes - LU-2348 - thanks!

Alexey Lyashkov added a comment - 19/Nov/12 12:47 PM

Peter,

I already create one and submit a patch, but jenkins looks broken to test e2fsprogs patch.

Alexey Lyashkov added a comment - 19/Nov/12 12:47 PM Peter, I already create one and submit a patch, but jenkins looks broken to test e2fsprogs patch.

Peter Jones added a comment - 19/Nov/12 11:38 AM

Shadow could you please open a new ticket for any issues relating to this work? We can create links back to the original ticket but it makes it easier to track - thanks!

Peter Jones added a comment - 19/Nov/12 11:38 AM Shadow could you please open a new ticket for any issues relating to this work? We can create links back to the original ticket but it makes it easier to track - thanks!

Alexey Lyashkov added a comment - 15/Nov/12 3:12 AM

e2image tool from a e2fsprogs broked after that change, so -r / -Q options don't copy a inode contents to the image.
I will send a fix son.

Alexey Lyashkov added a comment - 15/Nov/12 3:12 AM e2image tool from a e2fsprogs broked after that change, so -r / -Q options don't copy a inode contents to the image. I will send a fix son.

Build Master (Inactive) added a comment - 02/May/12 3:37 PM

Integrated in lustre-dev » x86_64,client,el6,inkernel #340
~~LU-808~~ llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
~~LU-80~~ utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

lustre/llite/llite_lib.c
lustre/liblustre/llite_lib.h
lustre/obdclass/obd_mount.c
lustre/liblustre/super.c
lustre/include/lustre_lite.h

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

lustre/tests/test-framework.sh
lustre/tests/sanity.sh
lustre/doc/lfs_migrate.1
lustre/scripts/lfs_migrate

Build Master (Inactive) added a comment - 02/May/12 3:37 PM Integrated in lustre-dev » x86_64,client,el6,inkernel #340 LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163) LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c) Result = SUCCESS Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163 Files : lustre/llite/llite_lib.c lustre/liblustre/llite_lib.h lustre/obdclass/obd_mount.c lustre/liblustre/super.c lustre/include/lustre_lite.h Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c Files : lustre/tests/test-framework.sh lustre/tests/sanity.sh lustre/doc/lfs_migrate.1 lustre/scripts/lfs_migrate

Build Master (Inactive) added a comment - 02/May/12 3:19 PM

Integrated in lustre-dev » x86_64,server,el5,inkernel #340
~~LU-808~~ llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
~~LU-80~~ utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

lustre/include/lustre_lite.h
lustre/obdclass/obd_mount.c
lustre/liblustre/llite_lib.h
lustre/llite/llite_lib.c
lustre/liblustre/super.c

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

lustre/tests/sanity.sh
lustre/tests/test-framework.sh
lustre/scripts/lfs_migrate
lustre/doc/lfs_migrate.1

Build Master (Inactive) added a comment - 02/May/12 3:19 PM Integrated in lustre-dev » x86_64,server,el5,inkernel #340 LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163) LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c) Result = SUCCESS Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163 Files : lustre/include/lustre_lite.h lustre/obdclass/obd_mount.c lustre/liblustre/llite_lib.h lustre/llite/llite_lib.c lustre/liblustre/super.c Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c Files : lustre/tests/sanity.sh lustre/tests/test-framework.sh lustre/scripts/lfs_migrate lustre/doc/lfs_migrate.1

Build Master (Inactive) added a comment - 02/May/12 3:14 PM

Integrated in lustre-dev » i686,client,el5,inkernel #340
~~LU-808~~ llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
~~LU-80~~ utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

lustre/include/lustre_lite.h
lustre/liblustre/llite_lib.h
lustre/llite/llite_lib.c
lustre/obdclass/obd_mount.c
lustre/liblustre/super.c

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

lustre/doc/lfs_migrate.1
lustre/tests/sanity.sh
lustre/tests/test-framework.sh
lustre/scripts/lfs_migrate

Build Master (Inactive) added a comment - 02/May/12 3:14 PM Integrated in lustre-dev » i686,client,el5,inkernel #340 LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163) LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c) Result = SUCCESS Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163 Files : lustre/include/lustre_lite.h lustre/liblustre/llite_lib.h lustre/llite/llite_lib.c lustre/obdclass/obd_mount.c lustre/liblustre/super.c Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c Files : lustre/doc/lfs_migrate.1 lustre/tests/sanity.sh lustre/tests/test-framework.sh lustre/scripts/lfs_migrate

Build Master (Inactive) added a comment - 02/May/12 3:13 PM

Integrated in lustre-dev » x86_64,server,el6,inkernel #340
~~LU-808~~ llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
~~LU-80~~ utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

lustre/liblustre/super.c
lustre/include/lustre_lite.h
lustre/llite/llite_lib.c
lustre/liblustre/llite_lib.h
lustre/obdclass/obd_mount.c

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

lustre/doc/lfs_migrate.1
lustre/tests/test-framework.sh
lustre/tests/sanity.sh
lustre/scripts/lfs_migrate

Build Master (Inactive) added a comment - 02/May/12 3:13 PM Integrated in lustre-dev » x86_64,server,el6,inkernel #340 LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163) LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c) Result = SUCCESS Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163 Files : lustre/liblustre/super.c lustre/include/lustre_lite.h lustre/llite/llite_lib.c lustre/liblustre/llite_lib.h lustre/obdclass/obd_mount.c Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c Files : lustre/doc/lfs_migrate.1 lustre/tests/test-framework.sh lustre/tests/sanity.sh lustre/scripts/lfs_migrate

Build Master (Inactive) added a comment - 02/May/12 2:58 PM

Integrated in lustre-dev » i686,server,el5,inkernel #340
~~LU-808~~ llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163)
~~LU-80~~ utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c)

Result = SUCCESS
Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163
Files :

lustre/liblustre/super.c
lustre/obdclass/obd_mount.c
lustre/llite/llite_lib.c
lustre/include/lustre_lite.h
lustre/liblustre/llite_lib.h

Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c
Files :

lustre/tests/sanity.sh
lustre/tests/test-framework.sh
lustre/scripts/lfs_migrate
lustre/doc/lfs_migrate.1

Build Master (Inactive) added a comment - 02/May/12 2:58 PM Integrated in lustre-dev » i686,server,el5,inkernel #340 LU-808 llite: deny truncate beyond user rlimit (Revision a44174684d800d74d35d9eb0b1b65bcfd0dd8163) LU-80 utils: add "-c <stripe_count>" option to lfs_migrate (Revision d40ad918bd688d9b5b3307ded042dd6d03cc414c) Result = SUCCESS Oleg Drokin : a44174684d800d74d35d9eb0b1b65bcfd0dd8163 Files : lustre/liblustre/super.c lustre/obdclass/obd_mount.c lustre/llite/llite_lib.c lustre/include/lustre_lite.h lustre/liblustre/llite_lib.h Oleg Drokin : d40ad918bd688d9b5b3307ded042dd6d03cc414c Files : lustre/tests/sanity.sh lustre/tests/test-framework.sh lustre/scripts/lfs_migrate lustre/doc/lfs_migrate.1

People

Assignee:: Patrick Farrell (Inactive)

Reporter:: Oleg Drokin

Votes:: 0 Vote for this issue

Watchers:: 13 Start watching this issue

Dates

Created:: 09/Feb/11 1:06 PM

Updated:: 11/Jan/19 4:24 AM

Resolved:: 02/May/12 5:05 AM