https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-1658 Lustre <p>When running reviews with 300 osts several test reliably fail.</p> <p>Sanity: test_27n (Out of disk space so probably a test issue rather than lustre issue)<br/> Sanityn: test_34<br/> Conf-sanity: test_46a<br/> Sanity-quota: test_1<br/> replay-single: Timesout</p> <p>Results here:<br/> <a href="https://maloo.whamcloud.com/test_sessions/21b8e000-d3bb-11e1-90f0-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/21b8e000-d3bb-11e1-90f0-52540035b04c</a><br/> <a href="https://maloo.whamcloud.com/test_sessions/360f11e4-d3ea-11e1-a98e-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/360f11e4-d3ea-11e1-a98e-52540035b04c</a><br/> <a href="https://maloo.whamcloud.com/test_sessions/e03561de-d3cf-11e1-90f0-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/e03561de-d3cf-11e1-90f0-52540035b04c</a><br/> <a href="https://maloo.whamcloud.com/test_sessions/f94947d8-d449-11e1-a98e-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/f94947d8-d449-11e1-a98e-52540035b04c</a></p> <p>Note these results where found during my development testing of autotest but are so repeatable I'm convinced they are real. If wide-stripe testing is not part of production autotest when this is debug please ask for my help (chris)</p> LU-1658

Review consistantly fails when running with 300 osts - wide stripe testing.

Bug Minor Resolved Duplicate WC Triage Chris Gearing Mon, 23 Jul 2012 06:08:36 +0000 Sat, 9 Oct 2021 06:30:32 +0000 Sat, 9 Oct 2021 06:30:32 +0000 Lustre 2.3.0 0 3 <p>Yujian</p> <p>could you please look into this one?</p> <p>Thanks</p> <p>Peter</p> <p>Hi Chris,</p> <p>From the test outputs and MDT debug logs, I found the "large_xattr" option was not specified while formatting the MDT. After <a href="http://review.whamcloud.com/#change,2907" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,2907</a> was landed on master branch, the cfg/local.sh was changed a lot, and the variable used to specify arguments for "--mkfsoptions" on MDT is MDS_FS_MKFS_OPTS. So, in autotest_config.sh, the following variable should be specified instead of MDSOPT: </p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>MDS_FS_MKFS_OPTS="-O large_xattr" </pre> </div></div> <p>The test session you sent to me by email had the "large_xattr" option specified but the journal size was too big:<br/> <a href="https://maloo.whamcloud.com/test_sessions/13920dfa-d0f8-11e1-8d8f-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/13920dfa-d0f8-11e1-8d8f-52540035b04c</a></p> <p>I've fixed up the code so that it makes use of local.sh and ncli.sh from the lustre sources itself, much less is now defined by autotest.</p> <p>I fear this may throw up new issues but it is certainly a move forwards</p> <p>So these results use the local.sh and ncli.sh from the lustre source itself. I've attached the config file used, I believe this means that if a mount option is incorrect it needs to be changed in the source - i.e. autotest no longer produces mount the options.</p> <p>The errors seem to be the same;</p> <p><a href="https://maloo.whamcloud.com/test_sessions/6aeba286-d73e-11e1-ab1c-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/6aeba286-d73e-11e1-ab1c-52540035b04c</a></p> <p>To be clear autotest is not specifying any mount options, all mount options are within Lustre and perhaps a change is required there, perhaps mkfs_opts() needs to be updated.</p> <blockquote> <p>The errors seem to be the same;</p> <p><a href="https://maloo.whamcloud.com/test_sessions/6aeba286-d73e-11e1-ab1c-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/6aeba286-d73e-11e1-ab1c-52540035b04c</a></p> <p>To be clear autotest is not specifying any mount options, all mount options are within Lustre and perhaps a change is required there, perhaps mkfs_opts() needs to be updated.</p></blockquote> <p>Hi Chris,</p> <p>In the above test session, the "large_xattr" option was still not specified while <em>formatting</em> the MDT. Could you please specify the following variable in autotest_config.sh?</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>MDS_FS_MKFS_OPTS="-O large_xattr" </pre> </div></div> <p>Thanks.</p> <p>This is a lustre issue surely. If this flag is required then should mkfs_opts not add the flag. That is the point of mkfs_opts in the test framework.</p> <p>local.cfg does not contain any MKFS_OPTS.</p> <blockquote><p>This is a lustre issue surely. If this flag is required then should mkfs_opts not add the flag. That is the point of mkfs_opts in the test framework.</p></blockquote> <p>Currently the large xattr feature (wide striping) is disabled by default in Lustre. To test this feature, the "-O large_xattr" option needs to be set on MDT either with --mkfsoptions at format time or via tune2fs.</p> <blockquote><p>local.cfg does not contain any MKFS_OPTS.</p></blockquote> <p>In cfg/local.sh:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre># Arguments for "--mkfsoptions" shall be specified with these # variables: # # - &lt;fstype&gt;_MKFS_OPTS # - &lt;facet_type&gt;_FS_MKFS_OPTS # &lt;~snip~&gt; MDS_FS_MKFS_OPTS=${MDS_FS_MKFS_OPTS:-} </pre> </div></div> <p>Before we decide to enable the feature by default in Lustre, we have to explicitly specify MDS_FS_MKFS_OPTS="-O large_xattr" to test the feature.</p> <p>Lowering priority because the testing that triggered these failures is not rolled into production yet and so the issue will not affect release testing.</p> <p>The next step for this ticket is to make autotest perform the wide stripe testing with MDS_FS_MKFS_OPTS="-O large_xattr" on a specific test cluster (not to disturb the normal review/full testings). So, we need the help from Chris to do this. And after new results are reported, I'll vet them.</p> <p>Fixed as part of patch <a href="https://review.whamcloud.com/28425" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/28425</a> "<tt><a href="https://jira.whamcloud.com/browse/LU-9846" title="Overstriping - more than stripe per OST per component" class="issue-link" data-issue-key="LU-9846"><del>LU-9846</del></a> lod: Add overstriping support</tt>"</p> Related LU-9846 Development Rank 1|hzw2b3: Rank (Obsolete) 10456 Severity