https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12028 Lustre <p>We get operation 'mds_connect to node failed' every 10 minutes or so on our OSSs. Example:</p> <p>/var/log/messages-20190224:Feb 24 02:07:10 foss4 kernel: LustreError: 11-0: foxtrot-MDT0000-lwp-OST003e: operation mds_connect to node 10.21.22.10@tcp failed: rc = -52<br/> /var/log/messages-20190224:Feb 24 02:17:35 foss4 kernel: LustreError: 11-0: foxtrot-MDT0000-lwp-OST0036: operation mds_connect to node 10.21.22.10@tcp failed: rc = -52<br/> /var/log/messages-20190224:Feb 24 02:28:00 foss4 kernel: LustreError: 11-0: foxtrot-MDT0000-lwp-OST0037: operation mds_connect to node 10.21.22.10@tcp failed: rc = -52<br/> /var/log/messages-20190224:Feb 24 02:38:00 foss4 kernel: LustreError: 11-0: foxtrot-MDT0000-lwp-OST0038: operation mds_connect to node 10.21.22.10@tcp failed: rc = -52<br/> /var/log/messages-20190224:Feb 24 02:48:25 foss4 kernel: LustreError: 11-0: foxtrot-MDT0000-lwp-OST0037: operation mds_connect to node 10.21.22.10@tcp failed: rc = -52<br/> /var/log/messages-20190224:Feb 24 02:58:50 foss4 kernel: LustreError: 11-0: foxtrot-MDT0000-lwp-OST0042: operation mds_connect to node 10.21.22.10@tcp failed: rc = -52<br/> /var/log/messages-20190224:Feb 24 03:08:50 foss4 kernel: LustreError: 11-0: foxtrot-MDT0000-lwp-OST0035: operation mds_connect to node 10.21.22.10@tcp failed: rc = -52</p> <p> </p> <p>What could be causing this?</p> <p>Kind regards,</p> <p>Campbell</p> <p> </p> LU-12028

operation mds_connect to node failed

Bug Minor Open Unresolved Peter Jones Campbell Mcleay Wed, 27 Feb 2019 13:13:16 +0000 Wed, 27 Feb 2019 18:08:23 +0000 Lustre 2.10.6 0 2 <p>Sorry, forgot versions:</p> <p>2.10.6.2</p> <p>This has patches as per <a href="https://jira.whamcloud.com/browse/LU-11826" title="Cannot send after transport endpoint shutdown" class="issue-link" data-issue-key="LU-11826"><del>LU-11826</del></a> and <a href="https://jira.whamcloud.com/browse/LU-11693" title="Soft lockups on Lustre clients" class="issue-link" data-issue-key="LU-11693">LU-11693</a></p> <p>Kernel is kernel-3.10.0-514.el7_lustre.x86_64</p> <p> </p> <p>Corresponding messages on the MDS:</p> <p> </p> <p>Feb 24 13:20:05 fmds1 kernel: Lustre: 10400:0:(mdt_handler.c:5340:mdt_connect_internal()) foxtrot-MDT0000: client foxtrot-MDT0000-lwp-OST0007_UUID does not support ibits lock, either very old or an invalid client: flags 0x2041401043000020</p> <p>Campbell</p> <p>I think that the issue is that you are carrying the patch for <a href="https://jira.whamcloud.com/browse/LU-11647" title="niobuf.c:330:ptlrpc_register_bulk()) ASSERTION( desc-&gt;bd_md_count == 0 ) failed:" class="issue-link" data-issue-key="LU-11647"><del>LU-11647</del></a> which also needs this patch - <a href="https://review.whamcloud.com/#/c/34027/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/34027/</a> . We are putting the finishing touches to 2.10.7 which should have everything that you need. Even if you decide to patch immediately I would definitely recommend upgrading to the official release once it becomes available.</p> <p>Peter</p> <p>Thanks Peter. I am not sure whether it is actually causing an issue for our workloads. I'm hoping we can go for the official release - any idea roughly on  when it will hit the street?</p> <p>Cheers,</p> <p>Campbell</p> <p>The exact timing depends on testing results but I would hope that the release is out within a couple of weeks.</p> Development Rank 1|i00cfb: Rank (Obsolete) 9223372036854775807 Severity