https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-14201 Lustre <p>replay-single test_89 fails with '3072 blocks leaked'. We’ve seen this test fail with this error message, <a href="https://jira.whamcloud.com/browse/LU-1867" title="replay-single test_89: @@@@@@ FAIL: 4 blocks leaked" class="issue-link" data-issue-key="LU-1867"><del>LU-1867</del></a> and <a href="https://jira.whamcloud.com/browse/LU-5761" title="replay-single test_89: @@@@@@ FAIL: 2560 blocks leaked" class="issue-link" data-issue-key="LU-5761"><del>LU-5761</del></a>, but all these tickets are closed. Since late September 2020, we’ve seen this test fail with this error for branch testing and for patches, but there are several other replay-single tests that fail prior to test 89; for example <a href="https://testing.whamcloud.com/test_sets/b83cb774-5cb2-473e-a641-90e5875fe6a6" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/b83cb774-5cb2-473e-a641-90e5875fe6a6</a>. </p> <p>For the test failure at <a href="https://testing.whamcloud.com/test_sets/a6260ca9-b7a0-4818-9d48-ab79249ba526" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/a6260ca9-b7a0-4818-9d48-ab79249ba526</a>, the last lines in the suite_log are</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Waiting for orphan cleanup... CMD: trevis-20vm4 /usr/sbin/lctl list_param osp.*osc*.old_sync_processed 2&gt; /dev/null osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed osp.lustre-OST0002-osc-MDT0000.old_sync_processed osp.lustre-OST0003-osc-MDT0000.old_sync_processed osp.lustre-OST0004-osc-MDT0000.old_sync_processed osp.lustre-OST0005-osc-MDT0000.old_sync_processed osp.lustre-OST0006-osc-MDT0000.old_sync_processed wait 40 secs maximumly for trevis-20vm4 mds-ost sync done. CMD: trevis-20vm4 /usr/sbin/lctl get_param -n osp.*osc*.old_sync_processed sleep 5 for ZFS zfs Waiting for local destroys to complete replay-single test_89: @@@@@@ FAIL: 3072 blocks leaked Trace dump: = /usr/lib64/lustre/tests/test-framework.sh:5907:error() = /usr/lib64/lustre/tests/replay-single.sh:3329:test_89() </pre> </div></div> <p>There is nothing obviously wrong in the console logs. </p> ZFS LU-14201

replay-single test 89 fails with '3072 blocks leaked'

Bug Minor Open Unresolved WC Triage James Nunez Tue, 8 Dec 2020 20:09:08 +0000 Tue, 22 Nov 2022 01:00:33 +0000 Lustre 2.12.6 0 3 <p>I had a quick look at this, and so far it is a one-off test failure. There was one other test_89 failure in the past month, but it looked quite different.</p> <p>This test is verifying that if a file is deleted across both an OSS and MDS restart that the space on the OSTs is released. In terms of severity, this is fairly low, in the sense that concurrent MDS and OSS failure is fairly rare, while also deleting files. At worst, some space on the OST would be leaked. It may also be that this is a test script issue (e.g. the delete didn't happen yet because "<tt>wait_delete_completed_mds()</tt>" didn't wait long enough).</p> <p>So I don't think it is a blocker for the 2.12.6 release, but we can keep an eye on whether it is being hit regularly.</p> <p>Duplicate with <a href="https://jira.whamcloud.com/browse/LU-16271" title="replay-single test_89 FAIL: 20480 blocks leaked " class="issue-link" data-issue-key="LU-16271"><del>LU-16271</del></a>, but seems to be hitting more regularly. Only 5 failures in 2022-07 and 2022-08, but 16 in the past 4 weeks.</p> Related LU-16271 Development Rank 1|i01gnz: Rank (Obsolete) 9223372036854775807 Severity