https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12340 Lustre <p>It seems replay-dual test0b started to timeout a lot for me (not sure if 100%).</p> <p>Server side logs indicate this which certainly does not look normal:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[ 243.748011] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 0 evicted) to recover in 0:19 [ 243.749658] Lustre: Skipped 1 previous similar message [ 263.267987] Lustre: lustre-MDT0000: recovery is timed out, evict stale exports [ 263.269233] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 263.780003] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 1 evicted) to recover in 0:34 [ 263.782005] Lustre: Skipped 3 previous similar messages [ 298.835999] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 1 evicted) already passed deadline 0:00 [ 298.838164] Lustre: Skipped 6 previous similar messages [ 363.940436] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 1 evicted) already passed deadline 1:05 [ 363.941848] Lustre: Skipped 12 previous similar messages [ 494.164193] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 1 evicted) already passed deadline 3:15 [ 494.166791] Lustre: Skipped 25 previous similar messages [ 754.579831] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 1 evicted) already passed deadline 7:36 [ 754.581284] Lustre: Skipped 51 previous similar messages [ 1270.403818] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 1 evicted) already passed deadline 16:11 [ 1270.405106] Lustre: Skipped 102 previous similar messages [ 1871.363761] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 1 evicted) already passed deadline 26:12 [ 1871.364853] Lustre: Skipped 119 previous similar messages [ 2472.323982] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 1 evicted) already passed deadline 36:13 [ 2472.325633] Lustre: Skipped 119 previous similar messages [ 3073.284066] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 1 evicted) already passed deadline 46:14 [ 3073.285972] Lustre: Skipped 119 previous similar messages [ 3674.244100] Lustre: lustre-MDT0000: Denying connection for new client d11934b8-d154-4 (at 192.168.10.167@tcp), waiting for 2 known clients (0 recovered, 1 in progress, and 1 evicted) already passed deadline 56:15 [ 3674.246309] Lustre: Skipped 119 previous similar messages </pre> </div></div> <p>sample reports:<br/> <a href="http://testing.linuxhacker.ru:3333/lustre-reports/279/testresults/replay-dual-zfs-centos7_x86_64-centos7_x86_64/" class="external-link" target="_blank" rel="nofollow noopener">http://testing.linuxhacker.ru:3333/lustre-reports/279/testresults/replay-dual-zfs-centos7_x86_64-centos7_x86_64/</a><br/> <a href="http://testing.linuxhacker.ru:3333/lustre-reports/278/testresults/replay-dual-ldiskfs-DNE-centos7_x86_64-centos7_x86_64/" class="external-link" target="_blank" rel="nofollow noopener">http://testing.linuxhacker.ru:3333/lustre-reports/278/testresults/replay-dual-ldiskfs-DNE-centos7_x86_64-centos7_x86_64/</a></p> LU-12340

replay-dual test 0b timeouts

Bug Major Resolved Fixed WC Triage Oleg Drokin Sat, 25 May 2019 22:29:13 +0000 Thu, 10 Oct 2019 12:25:49 +0000 Thu, 10 Oct 2019 12:25:49 +0000 Lustre 2.13.0 0 4 <p>+1 on master branch: <a href="https://testing.whamcloud.com/test_sets/a0bb8926-bf1c-11e9-98c8-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/a0bb8926-bf1c-11e9-98c8-52540065bddc</a></p> <p>This is a duplicate of <a href="https://jira.whamcloud.com/browse/LU-11762" title="replay-single test 0d fails with &#39;post-failover df failed&#39;" class="issue-link" data-issue-key="LU-11762"><del>LU-11762</del></a>. This is really hard to reproduce expect for Oleg.</p> <p>Potential fix from <a href="https://jira.whamcloud.com/browse/LU-12769" title="replay-dual test 0b hangs in client mount" class="issue-link" data-issue-key="LU-12769"><del>LU-12769</del></a></p> <p>This should be resolved by <a href="https://review.whamcloud.com/#/c/36274/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/36274/ </a>If not we can reopen.</p> Related LU-12769 LU-11762 Development Rank 1|i00gzj: Rank (Obsolete) 9223372036854775807 Severity