https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-4665 Lustre <p>#5: Sparse OST indicies<br/> #6: Setstripe for specified OSTs.</p> LU-4665

utils: lfs setstripe to specify OSTs

New Feature Critical Resolved Fixed Emoly Liu Jinshan Xiong llnl Tue, 25 Feb 2014 03:13:02 +0000 Tue, 6 Nov 2018 08:03:06 +0000 Tue, 20 Jan 2015 00:52:47 +0000 Lustre 2.7.0 Thu, 31 Mar 2016 00:00:00 +0000 1 21 <p>patch is at: <a href="http://review.whamcloud.com/#/c/9383" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/9383</a> </p> <p>People have at ORNL have been asking for #6 for a very long time. You made many people happy.</p> <p>Ditto. LLNL folks have been asking for that a long time as well.</p> <p>Patch to improve Lustre test framework to support specifying arbitrary OST indices: <a href="http://review.whamcloud.com/9722" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/9722</a><br/> Patch to add regression test cases into conf-sanity.sh: <a href="http://review.whamcloud.com/9775" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/9775</a></p> <p>I like to suggest that we rebase this work on top of <a href="https://jira.whamcloud.com/browse/LU-2182" title="Add llapi_file_get_layout() function in liblustreapi" class="issue-link" data-issue-key="LU-2182"><del>LU-2182</del></a>. The <a href="https://jira.whamcloud.com/browse/LU-2182" title="Add llapi_file_get_layout() function in liblustreapi" class="issue-link" data-issue-key="LU-2182"><del>LU-2182</del></a> work is in pretty good shape. </p> <p>I agree with James.</p> <p>If you don't have the time Jinshan I will gladly do the work.</p> <p>Hi James,</p> <p>Please feel free to pick it up and move it forward. Thanks</p> <p>Jinshan</p> <p>Is this still for regular file only? What's other porject or dependency to support specific OST selection for directory?</p> <p>Started integrating this work with <a href="https://jira.whamcloud.com/browse/LU-2182" title="Add llapi_file_get_layout() function in liblustreapi" class="issue-link" data-issue-key="LU-2182"><del>LU-2182</del></a>.</p> <p>Hi James,</p> <p>Are you still working on this? We're going to land this patch in 2.7.</p> <p>Yes. In fact I'm debugging it right now.</p> <p>Is there any problems with the patch?</p> <p>Not with the patch directly. I did see failures due to the new layout api using fsetxattr instead of the ioctl for setting stripes. There was code in ll_setxattr that if sent in stripe_offset was set to zero it was set to -1 which meant a random OST was picked instead of OST 0. The base <a href="https://jira.whamcloud.com/browse/LU-2182" title="Add llapi_file_get_layout() function in liblustreapi" class="issue-link" data-issue-key="LU-2182"><del>LU-2182</del></a> patch which this work depends on should now behave properly. We will see once Maloo is done.</p> <p>Emoly</p> <p>Could you please assist with reviewing these patches?</p> <p>Thanks</p> <p>Peter</p> <p>This feature totally needs a way to specify ost_count in addition to OST list that way we do not force user to do their own load balancing.<br/> Say I have a set of 100 OSTs that are local enough for my set of nodes, but I only need a striping of 4...<br/> We seriously should consider adding this as a follow on patch.</p> <p>Ah, I also noticed that the current patch returns error if ldo_def_stripe_offset is not in the list of OSTs, but failed to consider that -1 should mean "use something that makes sense". This too needs to be addressed. Esp. in light of the previous comment</p> <p>Is it possible to access this functionality via the new <tt>llapi_layout_&#42;</tt> API added in <a href="https://jira.whamcloud.com/browse/LU-3840" title="llapi_layout API design discussion" class="issue-link" data-issue-key="LU-3840"><del>LU-3840</del></a>? It doesn't seem like it looking at the code. I've got a partially completed patch to add this, will link it here when I push the patch.</p> <p>No. The llapi_layout api is not mature enough to be used. I tried using it as a back end but it just broke lots of test.</p> <p>I've pushed <a href="http://review.whamcloud.com/12663" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/12663</a> but it is a best-effort patch for now. It doesn't have a test case yet, and has had no testing at all.</p> <p>Emoly, could you please refresh the 12663 patch according to the review comments, and add a test case for this to the llapi_layout_ test program.</p> <p>Andreas, sure.</p> <p>Do we need a new ticket # for <a href="http://review.whamcloud.com/#/c/12275?" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/12275?</a></p> <p>I opened <a href="https://jira.whamcloud.com/browse/LU-6135" title="improved support for selecting specific OSTs for files" class="issue-link" data-issue-key="LU-6135"><del>LU-6135</del></a> for the follow-on patches.</p> <p>Have moved the other patches over to <a href="https://jira.whamcloud.com/browse/LU-6135" title="improved support for selecting specific OSTs for files" class="issue-link" data-issue-key="LU-6135"><del>LU-6135</del></a>.</p> Related LU-3840 LU-6135 LU-5170 LU-5878 LU-8417 LU-9392 Development Rank 1|hzwfrj: Rank (Obsolete) 12785 Severity