Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-4665

utils: lfs setstripe to specify OSTs

Details

    • New Feature
    • Resolution: Fixed
    • Critical
    • Lustre 2.7.0
    • None
    • 3
    • 12785

    Description

      #5: Sparse OST indicies
      #6: Setstripe for specified OSTs.

      Attachments

        Issue Links

          Activity

            [LU-4665] utils: lfs setstripe to specify OSTs
            green Oleg Drokin added a comment -

            Ah, I also noticed that the current patch returns error if ldo_def_stripe_offset is not in the list of OSTs, but failed to consider that -1 should mean "use something that makes sense". This too needs to be addressed. Esp. in light of the previous comment

            green Oleg Drokin added a comment - Ah, I also noticed that the current patch returns error if ldo_def_stripe_offset is not in the list of OSTs, but failed to consider that -1 should mean "use something that makes sense". This too needs to be addressed. Esp. in light of the previous comment
            green Oleg Drokin added a comment -

            This feature totally needs a way to specify ost_count in addition to OST list that way we do not force user to do their own load balancing.
            Say I have a set of 100 OSTs that are local enough for my set of nodes, but I only need a striping of 4...
            We seriously should consider adding this as a follow on patch.

            green Oleg Drokin added a comment - This feature totally needs a way to specify ost_count in addition to OST list that way we do not force user to do their own load balancing. Say I have a set of 100 OSTs that are local enough for my set of nodes, but I only need a striping of 4... We seriously should consider adding this as a follow on patch.
            pjones Peter Jones added a comment -

            Emoly

            Could you please assist with reviewing these patches?

            Thanks

            Peter

            pjones Peter Jones added a comment - Emoly Could you please assist with reviewing these patches? Thanks Peter

            Not with the patch directly. I did see failures due to the new layout api using fsetxattr instead of the ioctl for setting stripes. There was code in ll_setxattr that if sent in stripe_offset was set to zero it was set to -1 which meant a random OST was picked instead of OST 0. The base LU-2182 patch which this work depends on should now behave properly. We will see once Maloo is done.

            simmonsja James A Simmons added a comment - Not with the patch directly. I did see failures due to the new layout api using fsetxattr instead of the ioctl for setting stripes. There was code in ll_setxattr that if sent in stripe_offset was set to zero it was set to -1 which meant a random OST was picked instead of OST 0. The base LU-2182 patch which this work depends on should now behave properly. We will see once Maloo is done.

            Is there any problems with the patch?

            jay Jinshan Xiong (Inactive) added a comment - Is there any problems with the patch?

            Yes. In fact I'm debugging it right now.

            simmonsja James A Simmons added a comment - Yes. In fact I'm debugging it right now.

            Hi James,

            Are you still working on this? We're going to land this patch in 2.7.

            jay Jinshan Xiong (Inactive) added a comment - Hi James, Are you still working on this? We're going to land this patch in 2.7.
            simmonsja James A Simmons added a comment - - edited

            Started integrating this work with LU-2182.

            simmonsja James A Simmons added a comment - - edited Started integrating this work with LU-2182 .

            Is this still for regular file only? What's other porject or dependency to support specific OST selection for directory?

            ihara Shuichi Ihara (Inactive) added a comment - Is this still for regular file only? What's other porject or dependency to support specific OST selection for directory?

            Hi James,

            Please feel free to pick it up and move it forward. Thanks

            Jinshan

            jay Jinshan Xiong (Inactive) added a comment - Hi James, Please feel free to pick it up and move it forward. Thanks Jinshan

            If you don't have the time Jinshan I will gladly do the work.

            simmonsja James A Simmons added a comment - If you don't have the time Jinshan I will gladly do the work.

            People

              emoly.liu Emoly Liu
              jay Jinshan Xiong (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: