Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-80

Wide striping support

Details

    • New Feature
    • Resolution: Fixed
    • Minor
    • Lustre 2.2.0
    • Lustre 2.0.0, Lustre 2.1.0, Lustre 1.8.6
    • None
    • 4,424
    • 4227

    Description

      ORNL wants to have ability to stripe file across more than 160 OSTs.

      There is a number of patches in the bugzilla bug, but they are not totally complete for 2.x and there are some known issues.
      Interop is also still a concern.

      Attachments

        1. kern.log
          16 kB
        2. LUG-2011-Widestriping.pdf
          130 kB
        3. mds1.tar.gz
          6.07 MB
        4. mdtest_xattr.patch
          2 kB
        5. Wide Striping Test Plan.pdf
          117 kB

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-2348 e2image produce invalid image for a large xattr patch.

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-908 multi-block xattr support

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          Trackbacks

          [Confluence: Whamcloud Community Space] Changelog 2.2 version 2.2.0 Support for networks: o2iblnd OFED 1.5.4 Server support for kernels: 2.6.32220.4.2.el6 (RHEL6) Client support for unpatched kernels: 2.6.18274.18.1.el5 (RHEL5) 2.6.32220.4.2.el6 (RHEL6) 2.6.32.360....

          [Confluence: Whamcloud Community Space] Lustre 2.2 Lustre 2.2 is scheduled for release at the end of Q1 2012. This is its anticipated support matrix. Server Support \ Client Support \ RHEL 6, \ CentOS 6 \ RHEL 6, \ CentOS 6, \ RHEL 5, \ CentOS 5, \ SLES 11 ,...

          Activity

            [LU-80] Wide striping support
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » x86_64,client,el6,ofa #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/mdt/mdt_handler.c
            • lustre/ptlrpc/layout.c
            • lustre/mdt/mdt_reint.c
            • lustre/mdt/mdt_xattr.c
            • lustre/include/md_object.h
            • lustre/mdd/mdd_internal.h
            • lustre/mdd/mdd_object.c
            • lustre/mdc/mdc_lib.c
            • lustre/mdt/mdt_open.c
            • lustre/mdt/mdt_internal.h
            • lustre/mdd/mdd_lov.c
            • lustre/include/lustre_req_layout.h
            • lustre/mdd/mdd_dir.c
            • lustre/mdt/mdt_lib.c
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » x86_64,client,el6,ofa #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/mdt/mdt_handler.c lustre/ptlrpc/layout.c lustre/mdt/mdt_reint.c lustre/mdt/mdt_xattr.c lustre/include/md_object.h lustre/mdd/mdd_internal.h lustre/mdd/mdd_object.c lustre/mdc/mdc_lib.c lustre/mdt/mdt_open.c lustre/mdt/mdt_internal.h lustre/mdd/mdd_lov.c lustre/include/lustre_req_layout.h lustre/mdd/mdd_dir.c lustre/mdt/mdt_lib.c
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » i686,server,el6,inkernel #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/mdc/mdc_lib.c
            • lustre/mdd/mdd_dir.c
            • lustre/mdt/mdt_handler.c
            • lustre/mdt/mdt_internal.h
            • lustre/include/md_object.h
            • lustre/mdd/mdd_lov.c
            • lustre/mdt/mdt_lib.c
            • lustre/mdd/mdd_object.c
            • lustre/mdt/mdt_reint.c
            • lustre/mdt/mdt_xattr.c
            • lustre/include/lustre_req_layout.h
            • lustre/mdd/mdd_internal.h
            • lustre/ptlrpc/layout.c
            • lustre/mdt/mdt_open.c
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » i686,server,el6,inkernel #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/mdc/mdc_lib.c lustre/mdd/mdd_dir.c lustre/mdt/mdt_handler.c lustre/mdt/mdt_internal.h lustre/include/md_object.h lustre/mdd/mdd_lov.c lustre/mdt/mdt_lib.c lustre/mdd/mdd_object.c lustre/mdt/mdt_reint.c lustre/mdt/mdt_xattr.c lustre/include/lustre_req_layout.h lustre/mdd/mdd_internal.h lustre/ptlrpc/layout.c lustre/mdt/mdt_open.c
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » x86_64,server,el6,inkernel #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/include/lustre_req_layout.h
            • lustre/mdt/mdt_lib.c
            • lustre/mdt/mdt_open.c
            • lustre/include/md_object.h
            • lustre/mdt/mdt_reint.c
            • lustre/mdd/mdd_lov.c
            • lustre/mdd/mdd_dir.c
            • lustre/mdt/mdt_internal.h
            • lustre/mdd/mdd_internal.h
            • lustre/ptlrpc/layout.c
            • lustre/mdc/mdc_lib.c
            • lustre/mdt/mdt_xattr.c
            • lustre/mdt/mdt_handler.c
            • lustre/mdd/mdd_object.c
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » x86_64,server,el6,inkernel #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/include/lustre_req_layout.h lustre/mdt/mdt_lib.c lustre/mdt/mdt_open.c lustre/include/md_object.h lustre/mdt/mdt_reint.c lustre/mdd/mdd_lov.c lustre/mdd/mdd_dir.c lustre/mdt/mdt_internal.h lustre/mdd/mdd_internal.h lustre/ptlrpc/layout.c lustre/mdc/mdc_lib.c lustre/mdt/mdt_xattr.c lustre/mdt/mdt_handler.c lustre/mdd/mdd_object.c
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » i686,client,el5,ofa #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/mdt/mdt_lib.c
            • lustre/include/lustre_req_layout.h
            • lustre/mdt/mdt_internal.h
            • lustre/ptlrpc/layout.c
            • lustre/mdt/mdt_handler.c
            • lustre/mdd/mdd_object.c
            • lustre/mdd/mdd_lov.c
            • lustre/mdc/mdc_lib.c
            • lustre/mdt/mdt_open.c
            • lustre/mdt/mdt_xattr.c
            • lustre/mdd/mdd_dir.c
            • lustre/mdd/mdd_internal.h
            • lustre/mdt/mdt_reint.c
            • lustre/include/md_object.h
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » i686,client,el5,ofa #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/mdt/mdt_lib.c lustre/include/lustre_req_layout.h lustre/mdt/mdt_internal.h lustre/ptlrpc/layout.c lustre/mdt/mdt_handler.c lustre/mdd/mdd_object.c lustre/mdd/mdd_lov.c lustre/mdc/mdc_lib.c lustre/mdt/mdt_open.c lustre/mdt/mdt_xattr.c lustre/mdd/mdd_dir.c lustre/mdd/mdd_internal.h lustre/mdt/mdt_reint.c lustre/include/md_object.h
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » x86_64,client,el5,ofa #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/mdt/mdt_handler.c
            • lustre/mdt/mdt_internal.h
            • lustre/mdc/mdc_lib.c
            • lustre/mdd/mdd_internal.h
            • lustre/mdt/mdt_lib.c
            • lustre/mdd/mdd_dir.c
            • lustre/mdt/mdt_xattr.c
            • lustre/ptlrpc/layout.c
            • lustre/include/lustre_req_layout.h
            • lustre/mdd/mdd_lov.c
            • lustre/mdt/mdt_open.c
            • lustre/mdd/mdd_object.c
            • lustre/mdt/mdt_reint.c
            • lustre/include/md_object.h
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » x86_64,client,el5,ofa #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/mdt/mdt_handler.c lustre/mdt/mdt_internal.h lustre/mdc/mdc_lib.c lustre/mdd/mdd_internal.h lustre/mdt/mdt_lib.c lustre/mdd/mdd_dir.c lustre/mdt/mdt_xattr.c lustre/ptlrpc/layout.c lustre/include/lustre_req_layout.h lustre/mdd/mdd_lov.c lustre/mdt/mdt_open.c lustre/mdd/mdd_object.c lustre/mdt/mdt_reint.c lustre/include/md_object.h
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » i686,client,el6,inkernel #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/include/lustre_req_layout.h
            • lustre/mdt/mdt_reint.c
            • lustre/mdc/mdc_lib.c
            • lustre/include/md_object.h
            • lustre/mdd/mdd_internal.h
            • lustre/mdt/mdt_handler.c
            • lustre/ptlrpc/layout.c
            • lustre/mdt/mdt_internal.h
            • lustre/mdd/mdd_dir.c
            • lustre/mdd/mdd_lov.c
            • lustre/mdt/mdt_lib.c
            • lustre/mdd/mdd_object.c
            • lustre/mdt/mdt_open.c
            • lustre/mdt/mdt_xattr.c
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » i686,client,el6,inkernel #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/include/lustre_req_layout.h lustre/mdt/mdt_reint.c lustre/mdc/mdc_lib.c lustre/include/md_object.h lustre/mdd/mdd_internal.h lustre/mdt/mdt_handler.c lustre/ptlrpc/layout.c lustre/mdt/mdt_internal.h lustre/mdd/mdd_dir.c lustre/mdd/mdd_lov.c lustre/mdt/mdt_lib.c lustre/mdd/mdd_object.c lustre/mdt/mdt_open.c lustre/mdt/mdt_xattr.c
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » i686,server,el5,inkernel #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/mdd/mdd_internal.h
            • lustre/mdd/mdd_object.c
            • lustre/mdt/mdt_internal.h
            • lustre/ptlrpc/layout.c
            • lustre/mdd/mdd_lov.c
            • lustre/mdt/mdt_lib.c
            • lustre/mdt/mdt_reint.c
            • lustre/include/lustre_req_layout.h
            • lustre/mdt/mdt_xattr.c
            • lustre/mdc/mdc_lib.c
            • lustre/mdt/mdt_open.c
            • lustre/mdt/mdt_handler.c
            • lustre/mdd/mdd_dir.c
            • lustre/include/md_object.h
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » i686,server,el5,inkernel #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/mdd/mdd_internal.h lustre/mdd/mdd_object.c lustre/mdt/mdt_internal.h lustre/ptlrpc/layout.c lustre/mdd/mdd_lov.c lustre/mdt/mdt_lib.c lustre/mdt/mdt_reint.c lustre/include/lustre_req_layout.h lustre/mdt/mdt_xattr.c lustre/mdc/mdc_lib.c lustre/mdt/mdt_open.c lustre/mdt/mdt_handler.c lustre/mdd/mdd_dir.c lustre/include/md_object.h
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » x86_64,client,el5,inkernel #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/ptlrpc/layout.c
            • lustre/mdt/mdt_open.c
            • lustre/mdt/mdt_reint.c
            • lustre/mdt/mdt_xattr.c
            • lustre/include/md_object.h
            • lustre/mdt/mdt_lib.c
            • lustre/mdd/mdd_lov.c
            • lustre/include/lustre_req_layout.h
            • lustre/mdd/mdd_internal.h
            • lustre/mdt/mdt_internal.h
            • lustre/mdt/mdt_handler.c
            • lustre/mdc/mdc_lib.c
            • lustre/mdd/mdd_object.c
            • lustre/mdd/mdd_dir.c
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » x86_64,client,el5,inkernel #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/ptlrpc/layout.c lustre/mdt/mdt_open.c lustre/mdt/mdt_reint.c lustre/mdt/mdt_xattr.c lustre/include/md_object.h lustre/mdt/mdt_lib.c lustre/mdd/mdd_lov.c lustre/include/lustre_req_layout.h lustre/mdd/mdd_internal.h lustre/mdt/mdt_internal.h lustre/mdt/mdt_handler.c lustre/mdc/mdc_lib.c lustre/mdd/mdd_object.c lustre/mdd/mdd_dir.c
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » x86_64,server,el6,ofa #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/mdd/mdd_object.c
            • lustre/mdc/mdc_lib.c
            • lustre/ptlrpc/layout.c
            • lustre/mdt/mdt_reint.c
            • lustre/mdt/mdt_internal.h
            • lustre/mdt/mdt_open.c
            • lustre/include/lustre_req_layout.h
            • lustre/mdd/mdd_dir.c
            • lustre/mdd/mdd_internal.h
            • lustre/mdt/mdt_lib.c
            • lustre/include/md_object.h
            • lustre/mdt/mdt_xattr.c
            • lustre/mdd/mdd_lov.c
            • lustre/mdt/mdt_handler.c
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » x86_64,server,el6,ofa #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/mdd/mdd_object.c lustre/mdc/mdc_lib.c lustre/ptlrpc/layout.c lustre/mdt/mdt_reint.c lustre/mdt/mdt_internal.h lustre/mdt/mdt_open.c lustre/include/lustre_req_layout.h lustre/mdd/mdd_dir.c lustre/mdd/mdd_internal.h lustre/mdt/mdt_lib.c lustre/include/md_object.h lustre/mdt/mdt_xattr.c lustre/mdd/mdd_lov.c lustre/mdt/mdt_handler.c
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » x86_64,server,el5,ofa #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/mdt/mdt_xattr.c
            • lustre/include/md_object.h
            • lustre/mdc/mdc_lib.c
            • lustre/mdd/mdd_lov.c
            • lustre/mdd/mdd_internal.h
            • lustre/include/lustre_req_layout.h
            • lustre/mdd/mdd_object.c
            • lustre/mdt/mdt_reint.c
            • lustre/mdt/mdt_handler.c
            • lustre/mdt/mdt_internal.h
            • lustre/mdt/mdt_open.c
            • lustre/mdd/mdd_dir.c
            • lustre/ptlrpc/layout.c
            • lustre/mdt/mdt_lib.c
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » x86_64,server,el5,ofa #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/mdt/mdt_xattr.c lustre/include/md_object.h lustre/mdc/mdc_lib.c lustre/mdd/mdd_lov.c lustre/mdd/mdd_internal.h lustre/include/lustre_req_layout.h lustre/mdd/mdd_object.c lustre/mdt/mdt_reint.c lustre/mdt/mdt_handler.c lustre/mdt/mdt_internal.h lustre/mdt/mdt_open.c lustre/mdd/mdd_dir.c lustre/ptlrpc/layout.c lustre/mdt/mdt_lib.c
            hudson Build Master (Inactive) added a comment -

            Integrated in lustre-master » i686,server,el5,ofa #496
            LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec)

            Result = SUCCESS
            Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec
            Files :

            • lustre/mdd/mdd_object.c
            • lustre/mdt/mdt_lib.c
            • lustre/include/lustre_req_layout.h
            • lustre/mdt/mdt_handler.c
            • lustre/mdd/mdd_internal.h
            • lustre/include/md_object.h
            • lustre/mdd/mdd_lov.c
            • lustre/mdt/mdt_open.c
            • lustre/mdc/mdc_lib.c
            • lustre/mdt/mdt_xattr.c
            • lustre/ptlrpc/layout.c
            • lustre/mdt/mdt_internal.h
            • lustre/mdt/mdt_reint.c
            • lustre/mdd/mdd_dir.c
            hudson Build Master (Inactive) added a comment - Integrated in lustre-master » i686,server,el5,ofa #496 LU-80 mds: use md_size supplied by client, repack reply (Revision 4fd92d576124fd7772c9f718b83eb67f500e5cec) Result = SUCCESS Oleg Drokin : 4fd92d576124fd7772c9f718b83eb67f500e5cec Files : lustre/mdd/mdd_object.c lustre/mdt/mdt_lib.c lustre/include/lustre_req_layout.h lustre/mdt/mdt_handler.c lustre/mdd/mdd_internal.h lustre/include/md_object.h lustre/mdd/mdd_lov.c lustre/mdt/mdt_open.c lustre/mdc/mdc_lib.c lustre/mdt/mdt_xattr.c lustre/ptlrpc/layout.c lustre/mdt/mdt_internal.h lustre/mdt/mdt_reint.c lustre/mdd/mdd_dir.c

            People

              pfarrell Patrick Farrell (Inactive)
              green Oleg Drokin
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: