https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-11729 Lustre <p>This issue was created by maloo for Andreas Dilger &lt;adilger@whamcloud.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://testing.whamcloud.com/test_sets/a298010c-f721-11e8-86c0-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/a298010c-f721-11e8-86c0-52540065bddc</a></p> <p>The test_810 added for <a href="https://jira.whamcloud.com/browse/LU-11663" title="corrupt data after page-unaligned write with zfs backend lustre 2.10" class="issue-link" data-issue-key="LU-11663"><del>LU-11663</del></a> fails on ARM on ldiskfs with the following test error:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>osc.lustre-OST0006-osc-ffff800039d7f800.checksum_type=adler fail_loc=0x411 dd: error writing '/mnt/lustre/f810.sanity': Input/output error 6bf5f3489c417a2e6f9e223278d93278 /mnt/lustre/f810.sanity != d375c4c8a12ae6de34e09e696c3725b1 /mnt/lustre/f810.sanity </pre> </div></div> <p>The client console logs show the checksums do not match between the client and server so there is still some kind of alignment problem:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>LustreError: 132-0: lustre-OST0000-osc-ffff800039d7f800: BAD WRITE CHECKSUM: changed in transit before arrival at OST: from 10.9.3.137@tcp inode [0x200006991:0xc:0x0] object 0x0:27458 extent [10240-20479], original client csum 6a00237 (type 20), server csum ab0036d (type 20), client csum now 6a00237 LustreError: 22024:0:(osc_request.c:1923:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffff80003069f300 x1618848577499536/t42949672971(42949672971) o4-&gt;lustre-OST0000-osc-ffff800039d7f800@10.9.3.137@tcp:6/4 lens 488/416 e 0 to 0 dl 1543857802 ref 2 fl Interpret:RM/0/0 rc 0/0 LustreError: 22024:0:(osc_request.c:2048:brw_interpret()) lustre-OST0000-osc-ffff800039d7f800: too many resent retries for object: 0:27458, rc = -11. </pre> </div></div> <p>VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV<br/> sanity test_810 - 6bf5f3489c417a2e6f9e223278d93278 /mnt/lustre/f810.sanity != d375c4c8a12ae6de34e09e696c3725b1 /mnt/lustre/f810.sanity</p> LU-11729

ARM: sanity test_810: BAD WRITE CHECKSUM with adler

Bug Critical Resolved Fixed Dongyang Li Maloo arm Tue, 4 Dec 2018 01:36:34 +0000 Mon, 23 Sep 2019 09:02:27 +0000 Tue, 17 Sep 2019 00:05:33 +0000 Lustre 2.12.0 Lustre 2.13.0 Lustre 2.12.3 0 8 <p>I thought this would be a 100% failure on ARM, but it seems like there are a few test failing and the majority of test_810 tests pass.</p> <p>It is possible that the speed of T10PI4K (type=20) is not 100% the fastest checksum type? In that case, only a few test select T10PI4K as the checksum type. And in these tests, the test will 100% fail.</p> <p>I think this failure might be caused by the bug fixed by patch: <br/> <a href="https://review.whamcloud.com/#/c/33727/4" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/33727/4</a></p> <p>The client is ARM with 64K page size right? I feel more tests with 64KB client + 4KB server will help us to find more problems like this...</p> <p>ok - assuming to be a duplicate of <a href="https://jira.whamcloud.com/browse/LU-11697" title="BAD WRITE CHECKSUM with t10ip4K and t10ip512 checksums" class="issue-link" data-issue-key="LU-11697"><del>LU-11697</del></a> unless proven otherwise</p> <p>This is definitely not a duplicate of the T10 checksum bug. The sanity test_810 explicitly uses <tt>adler</tt> as the checksum type. </p> <p>&gt; This is definitely not a duplicate of the T10 checksum bug. The sanity test_810 explicitly uses adler as the checksum type.</p> <p>Oh, It is strange then, because according the following log, the checksum type used is T10PI4K (type 0x20), not adler (type 0x2).</p> <p>I guess the problem might be caused by the delay/failure of setting checksum type?</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>LustreError: 132-0: lustre-OST0000-osc-ffff800039d7f800: BAD WRITE CHECKSUM: changed in transit before arrival at OST: from 10.9.3.137@tcp inode [0x200006991:0xc:0x0] object 0x0:27458 extent [10240-20479], original client csum 6a00237 (type 20), server csum ab0036d (type 20), client csum now 6a00237 </pre> </div></div> <p>You are right, it may be a duplicate of the T10-PI ticket then. It may be that "<tt>lfs set_param</tt>" is trying to set the checksum type to <tt>adler</tt>, but this type is not available? It <em>should</em> always be one of the supported checksum types, but possibly this has been lost from the code.</p> <p>Before this bug is closed again it would make sense to improve <tt>test_810</tt> to test all of the available checksum types listed from "<tt>lctl get_param osc.&#42;OST0000&#42;.checksum_type</tt>" to ensure they are all working for this test case.</p> <p>Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/33864" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33864</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11729" title="ARM: sanity test_810: BAD WRITE CHECKSUM with adler" class="issue-link" data-issue-key="LU-11729"><del>LU-11729</del></a> tests: skip sanity test 810 for ARM<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: e5498fc90e2b7809a00220b0cf18c1ac9a730a86</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/33864/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33864/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11729" title="ARM: sanity test_810: BAD WRITE CHECKSUM with adler" class="issue-link" data-issue-key="LU-11729"><del>LU-11729</del></a> tests: skip sanity test 810 for ARM<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: a6239c48da38ff0da4564da496766deebc88923f</p> <p>Dongyang</p> <p>Could you please investigate?</p> <p>Thanks</p> <p>Peter</p> <p>Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/34043" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/34043</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11729" title="ARM: sanity test_810: BAD WRITE CHECKSUM with adler" class="issue-link" data-issue-key="LU-11729"><del>LU-11729</del></a> tests: verify checksum types in sanity test_810<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 6cbddb97cf05cdd2c9d229cf218912e6881cc64a</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/34043/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/34043/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11729" title="ARM: sanity test_810: BAD WRITE CHECKSUM with adler" class="issue-link" data-issue-key="LU-11729"><del>LU-11729</del></a> obdclass: align to T10 sector size when generating guard<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 98ceaf854bb4738305769c5cd1df556ee99aa859</p> <p>Landed for 2.13</p> <p>Minh Diep (mdiep@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/36205" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36205</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11729" title="ARM: sanity test_810: BAD WRITE CHECKSUM with adler" class="issue-link" data-issue-key="LU-11729"><del>LU-11729</del></a> obdclass: align to T10 sector size when generating guard<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: 1<br/> Commit: c78fa4e0f024d4823c6d867d04c108293f6d0859</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/36205/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/36205/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11729" title="ARM: sanity test_810: BAD WRITE CHECKSUM with adler" class="issue-link" data-issue-key="LU-11729"><del>LU-11729</del></a> obdclass: align to T10 sector size when generating guard<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: <br/> Commit: 38e83f124a41b633da02073b76cf20495bef3919</p> Related LU-11663 LU-11697 LU-10300 Development Rank 1|i007dj: Rank (Obsolete) 9223372036854775807 Severity