https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-4039 Lustre <p>This issue was created by maloo for sarah &lt;sarah@whamcloud.com&gt;</p> <p>This issue relates to the following test suite run: <a href="http://maloo.whamcloud.com/test_sets/f9c487da-26c9-11e3-83d1-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">http://maloo.whamcloud.com/test_sets/f9c487da-26c9-11e3-83d1-52540035b04c</a>.</p> <p>The sub-test test_90 failed with the following error:</p> <blockquote> <p>Create the files<br/> /mnt/lustre/d0.replay-single/d90/f0<br/> lmm_stripe_count: 1<br/> lmm_stripe_size: 1048576<br/> lmm_pattern: 1<br/> lmm_layout_gen: 0<br/> lmm_stripe_offset: 1<br/> obdidx objid objid group<br/> 1 30476 0x770c 0</p> <p> replay-single test_90: @@@@@@ FAIL: wrong stripe: f0, uuid: lustre-OST0000_UUID </p></blockquote> <p>Info required for matching: replay-single 90</p> server and client: lustre-master build # 1687 LU-4039

Failure on test suite replay-single test_90: wrong stripe: f0, uuid: lustre-OST0000_UUID

Bug Critical Resolved Fixed Yang Sheng Maloo zfs Tue, 1 Oct 2013 19:59:06 +0000 Fri, 20 Jan 2017 21:28:46 +0000 Thu, 11 Aug 2016 11:58:11 +0000 Lustre 2.5.0 Lustre 2.9.0 Lustre 2.9.0 0 9 <p>This issue was caused by test_89 failed OST0000 and then import still is not in FULL state while test_90 start. So stripe alloced wrong. I'll push a patch to fix it.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>/proc/fs/lustre/osp/lustre-MDT0000-osp-MDT0001/state:current_state: FULL /proc/fs/lustre/osp/lustre-MDT0001-osp-MDT0000/state:current_state: FULL /proc/fs/lustre/osp/lustre-OST0000-osc-MDT0000/state:current_state: REPLAY_WAIT /proc/fs/lustre/osp/lustre-OST0000-osc-MDT0001/state:current_state: REPLAY_WAIT /proc/fs/lustre/osp/lustre-OST0001-osc-MDT0000/state:current_state: FULL /proc/fs/lustre/osp/lustre-OST0001-osc-MDT0001/state:current_state: FULL </pre> </div></div> <p>Yang Sheng (yang.sheng@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/20931" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20931</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-4039" title="Failure on test suite replay-single test_90: wrong stripe: f0, uuid: lustre-OST0000_UUID" class="issue-link" data-issue-key="LU-4039"><del>LU-4039</del></a> tests: ensure osc import in FULL state<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: d03dbc49b9ee5da93341a5d4ddc42a8915293612</p> <p>Several recent hits on master, like:<br/> <a href="https://testing.hpdd.intel.com/test_sets/ae363b24-4205-11e6-a0ce-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/ae363b24-4205-11e6-a0ce-5254006e85c2</a></p> <p>It appears that this test only started failing again on 2016-06-28, so it is very likely a regression caused by some patch that recently landed. It seems that the MDS is not enforcing setstripe requests that specify a starting OST index, possibly if that OST does not have any precreated objects. One candidate is patch <a href="http://review.whamcloud.com/19195" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/19195</a> "<a href="https://jira.whamcloud.com/browse/LU-7759" title="umount hanging in modern distros when OST is unavailable" class="issue-link" data-issue-key="LU-7759"><del>LU-7759</del></a> llite: handle inactive OSTs better in statfs" though I can't see why it would be a problem...</p> <p>Looking at the patch testing history for <a href="http://review.whamcloud.com/19195" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/19195</a> it appears that it was failing replay-single test_90 on a regular basis, except for the very last version of the patch, which was landed.</p> <p>Andreas Dilger (andreas.dilger@intel.com) merged in patch <a href="http://review.whamcloud.com/20931/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20931/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-4039" title="Failure on test suite replay-single test_90: wrong stripe: f0, uuid: lustre-OST0000_UUID" class="issue-link" data-issue-key="LU-4039"><del>LU-4039</del></a> tests: ensure osc import in FULL state<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: eb2657a654a449f2c5504fa4c5ba4b7e1413ddea</p> <p>Patch landed. Close ticket.</p> <p>It looks like this patch did not fix the problem. There were two recent patch tests that failed replay-single.sh even though they included the latest patch:</p> <p><a href="http://review.whamcloud.com/18758" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/18758</a></p> <ul class="alternate" type="square"> <li><a href="https://testing.hpdd.intel.com/test_sets/30c3291a-4320-11e6-bbf5-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/30c3291a-4320-11e6-bbf5-5254006e85c2</a></li> </ul> <p><a href="http://review.whamcloud.com/16105" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/16105</a></p> <ul class="alternate" type="square"> <li><a href="https://testing.hpdd.intel.com/test_sets/2cde8cee-4353-11e6-acf3-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/2cde8cee-4353-11e6-acf3-5254006e85c2</a></li> </ul> <p>Looks like almost tests failed on:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>replay-single test_90: @@@@@@ FAIL: wrong stripe: all, uuid: lustre-OST0000_UUID </pre> </div></div> <p>and test_89 is skipped. I'll push a debug patch for it.</p> <p>Yang Sheng (yang.sheng@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/21175" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21175</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-4039" title="Failure on test suite replay-single test_90: wrong stripe: f0, uuid: lustre-OST0000_UUID" class="issue-link" data-issue-key="LU-4039"><del>LU-4039</del></a> tests: debug patch<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 927531c4e0981990861cb2a82319816e2f913fab</p> <p>Increased priority of ticket because replay-single test 90 is failing on master multiple times a day.</p> <p>This is blocking patch review testing on master branch:<br/> <a href="https://testing.hpdd.intel.com/test_sets/becbbe9c-3fed-11e6-80b9-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/becbbe9c-3fed-11e6-80b9-5254006e85c2</a><br/> <a href="https://testing.hpdd.intel.com/test_sets/828464ba-40e8-11e6-acf3-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/828464ba-40e8-11e6-acf3-5254006e85c2</a><br/> <a href="https://testing.hpdd.intel.com/test_sets/e00ada42-4020-11e6-acf3-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/e00ada42-4020-11e6-acf3-5254006e85c2</a></p> <p>James Nunez (james.a.nunez@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/21224" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21224</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-4039" title="Failure on test suite replay-single test_90: wrong stripe: f0, uuid: lustre-OST0000_UUID" class="issue-link" data-issue-key="LU-4039"><del>LU-4039</del></a> tests: EXCEPT replay-single test 90<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 27688be30c7c58343ec4eec88798b0588771f196</p> <p>Andreas Dilger (andreas.dilger@intel.com) merged in patch <a href="http://review.whamcloud.com/21224/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21224/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-4039" title="Failure on test suite replay-single test_90: wrong stripe: f0, uuid: lustre-OST0000_UUID" class="issue-link" data-issue-key="LU-4039"><del>LU-4039</del></a> tests: EXCEPT replay-single test 90<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 95dbe2cbd2e8829356fc8287366b04fed7131ada</p> <p>Yang Sheng (yang.sheng@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/21736" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21736</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-4039" title="Failure on test suite replay-single test_90: wrong stripe: f0, uuid: lustre-OST0000_UUID" class="issue-link" data-issue-key="LU-4039"><del>LU-4039</del></a> tests: enable test_90 for replay-single<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 5762823612887e81bc9d60874028f97cc441419b</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/21736/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21736/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-4039" title="Failure on test suite replay-single test_90: wrong stripe: f0, uuid: lustre-OST0000_UUID" class="issue-link" data-issue-key="LU-4039"><del>LU-4039</del></a> tests: enable test_90 for replay-single<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: f49e518491e8cc96ca720e22e3f62443148cb102</p> <p>Test is active again so reclosing. Let's open a new ticket if any furhter failures are found for this test</p> <p>Hit it again on master:<br/> <a href="https://testing.hpdd.intel.com/test_sets/a102421e-5ff5-11e6-b2e2-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/a102421e-5ff5-11e6-b2e2-5254006e85c2</a></p> <p>Open new ticket <a href="https://jira.whamcloud.com/browse/LU-8526" title="replay-single test_90: @@@@@@ FAIL: wrong stripe: all, uuid: lustre-OST0000_UUID" class="issue-link" data-issue-key="LU-8526"><del>LU-8526</del></a> for new failures on master recently.</p> Related LU-8544 LU-7759 LU-8526 Development Rank 1|hzw4kf: Rank (Obsolete) 10848 Severity