https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-13321 Lustre <p>This issue was created by maloo for Lai Siyao &lt;lai.siyao@whamcloud.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://testing.whamcloud.com/test_sets/ddd8bcd4-cb29-447c-8d67-c749d3fc38f1" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/ddd8bcd4-cb29-447c-8d67-c749d3fc38f1</a></p> LU-13321

sanity: 160f failed "mds3: user cl6 index expected 0 + 2, but is 0"

Bug Major Resolved Fixed Andreas Dilger Maloo Wed, 4 Mar 2020 01:58:27 +0000 Fri, 12 Mar 2021 03:31:24 +0000 Fri, 3 Apr 2020 17:17:07 +0000 Lustre 2.14.0 0 5 <p>Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/38129" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/38129</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13321" title="sanity: 160f failed &quot;mds3: user cl6 index expected 0 + 2, but is 0&quot;" class="issue-link" data-issue-key="LU-13321"><del>LU-13321</del></a> tests: force even DNE file distribution<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 9b8d21cde5f674588eb9f92e14f980064a63841e</p> <p>It looks like this was introduced by patch <a href="https://review.whamcloud.com/36775" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36775</a> "<tt><a href="https://jira.whamcloud.com/browse/LU-11025" title="DNE3: directory restripe" class="issue-link" data-issue-key="LU-11025"><del>LU-11025</del></a> dne: introduce new directory hash type: 'crush'</tt>" causing the directory distribution to be uneven and causing intermittent failures for sanity <tt>test_160f</tt>, about 15% (1/8) of the tests are failing.</p> <p>This was hit repeatedly during the development of that patch, but with enough retesting it was made to pass. It is still a cause of test failures for the other patches for the <a href="https://jira.whamcloud.com/browse/LU-11025" title="DNE3: directory restripe" class="issue-link" data-issue-key="LU-11025"><del>LU-11025</del></a> ticket, but should be fixed by the patch here.</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/38129/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/38129/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13321" title="sanity: 160f failed &quot;mds3: user cl6 index expected 0 + 2, but is 0&quot;" class="issue-link" data-issue-key="LU-13321"><del>LU-13321</del></a> tests: force even DNE file distribution<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 489afbe69d5b7a867e44f6c2364513e660cf862b</p> <p>This may need to be replaced again with the "<tt>all_char</tt>" hash instead of "<tt>fnv_1a_64</tt>" since there are still errors when running on a large number of MDTs (e.g. 20+). The hash function is not <em>perfectly</em> uniform, only statistically so, which results in MDT imbalances when the stripe count is higher (e.g. from my 12-MDT test run for v6 of patch <a href="https://review.whamcloud.com/38058" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/38058</a> "<tt><a href="https://jira.whamcloud.com/browse/LU-12506" title="Client unable to mount filesystem with very large number of MDTs" class="issue-link" data-issue-key="LU-12506"><del>LU-12506</del></a> tests: clean up MDT name generation</tt>":<br/> <a href="https://testing.whamcloud.com/test_sets/1e911540-e60d-4086-bba6-fa975354cb9d" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/1e911540-e60d-4086-bba6-fa975354cb9d</a></p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>mds4: user cl6 index expected 0 + 2, but is 0 mds6: user cl8 index expected 6 + 2, but is 6 mds2: user cl10 index expected 6 + 2, but is 6 </pre> </div></div> <p>The "<tt>all_chars</tt>" hash is perfectly uniform (essentially round-robin) as long as the filenames are generated in a uniform pattern (e.g. counter).</p> Related LU-12506 Development Rank 1|i00urj: Rank (Obsolete) 9223372036854775807 Severity