Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-4665

utils: lfs setstripe to specify OSTs

Details

    • New Feature
    • Resolution: Fixed
    • Critical
    • Lustre 2.7.0
    • None
    • 3
    • 12785

    Description

      #5: Sparse OST indicies
      #6: Setstripe for specified OSTs.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-5170 lfs usability

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-5878 lfs migrate sends file to stdout

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. LU-9392 lfs migrate -o and lfs setstripe -o should pick OST from ost_list

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-8417 setstripe -o does not work on directories

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-3840 llapi_layout API design discussion

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. LU-6135 improved support for selecting specific OSTs for files

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-4665] utils: lfs setstripe to specify OSTs
            green Oleg Drokin added a comment -

            This feature totally needs a way to specify ost_count in addition to OST list that way we do not force user to do their own load balancing.
            Say I have a set of 100 OSTs that are local enough for my set of nodes, but I only need a striping of 4...
            We seriously should consider adding this as a follow on patch.

            green Oleg Drokin added a comment - This feature totally needs a way to specify ost_count in addition to OST list that way we do not force user to do their own load balancing. Say I have a set of 100 OSTs that are local enough for my set of nodes, but I only need a striping of 4... We seriously should consider adding this as a follow on patch.
            pjones Peter Jones added a comment -

            Emoly

            Could you please assist with reviewing these patches?

            Thanks

            Peter

            pjones Peter Jones added a comment - Emoly Could you please assist with reviewing these patches? Thanks Peter
            simmonsja James A Simmons added a comment -

            Not with the patch directly. I did see failures due to the new layout api using fsetxattr instead of the ioctl for setting stripes. There was code in ll_setxattr that if sent in stripe_offset was set to zero it was set to -1 which meant a random OST was picked instead of OST 0. The base LU-2182 patch which this work depends on should now behave properly. We will see once Maloo is done.

            simmonsja James A Simmons added a comment - Not with the patch directly. I did see failures due to the new layout api using fsetxattr instead of the ioctl for setting stripes. There was code in ll_setxattr that if sent in stripe_offset was set to zero it was set to -1 which meant a random OST was picked instead of OST 0. The base LU-2182 patch which this work depends on should now behave properly. We will see once Maloo is done.
            jay Jinshan Xiong (Inactive) added a comment -

            Is there any problems with the patch?

            jay Jinshan Xiong (Inactive) added a comment - Is there any problems with the patch?
            simmonsja James A Simmons added a comment -

            Yes. In fact I'm debugging it right now.

            simmonsja James A Simmons added a comment - Yes. In fact I'm debugging it right now.
            jay Jinshan Xiong (Inactive) added a comment -

            Hi James,

            Are you still working on this? We're going to land this patch in 2.7.

            jay Jinshan Xiong (Inactive) added a comment - Hi James, Are you still working on this? We're going to land this patch in 2.7.
            simmonsja James A Simmons added a comment - - edited

            Started integrating this work with LU-2182.

            simmonsja James A Simmons added a comment - - edited Started integrating this work with LU-2182 .
            ihara Shuichi Ihara (Inactive) added a comment -

            Is this still for regular file only? What's other porject or dependency to support specific OST selection for directory?

            ihara Shuichi Ihara (Inactive) added a comment - Is this still for regular file only? What's other porject or dependency to support specific OST selection for directory?
            jay Jinshan Xiong (Inactive) added a comment -

            Hi James,

            Please feel free to pick it up and move it forward. Thanks

            Jinshan

            jay Jinshan Xiong (Inactive) added a comment - Hi James, Please feel free to pick it up and move it forward. Thanks Jinshan
            simmonsja James A Simmons added a comment -

            If you don't have the time Jinshan I will gladly do the work.

            simmonsja James A Simmons added a comment - If you don't have the time Jinshan I will gladly do the work.
            morrone Christopher Morrone (Inactive) added a comment -

            I agree with James.

            morrone Christopher Morrone (Inactive) added a comment - I agree with James.

            People

              emoly.liu Emoly Liu
              jay Jinshan Xiong (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: