https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-12161 Lustre <p>Hi,</p> <p>We're getting these messages every 10 minutes or so on all of our clients:</p> <p>Apr 4 13:49:06 bravo3 kernel: Lustre: 2835:0:(client.c:2116:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: <span class="error">&#91;sent 1554382146/real 1554382146&#93;</span> req@ffff909af965f800 x1629627154208576/t0(0) o8-&gt;bravo-OST0000-osc-ffff909676561800@10.21.22.51@tcp:28/4 lens 520/544 e 0 to 1 dl 1554382201 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1<br/> Apr 4 13:49:06 bravo3 kernel: Lustre: 2835:0:(client.c:2116:ptlrpc_expire_one_request()) Skipped 849 previous similar messages</p> <p>What do these messages mean? Is this something to be concerned about?</p> <p>Thanks for any help.</p> <p>Kind regards,</p> <p>Campbell</p> <p> </p> LU-12161

Request sent has failed due to network error: [sent 1554382146/real 1554382146]

Bug Minor Resolved Not a Bug Peter Jones Campbell Mcleay Thu, 4 Apr 2019 13:12:01 +0000 Tue, 9 Apr 2019 14:08:56 +0000 Tue, 9 Apr 2019 14:08:56 +0000 Lustre 2.10.7 0 4 <p>I should mention that there is currently, there is no writes/reads on this cluster from the clients.</p> <p>This may be indicative of a network issue with 10.21.22.51.  Do you have logs from OST0000 that you could attach for more information?</p> <p>Hi Joseph,</p> <p>Would the message log from the server suffice, or do you need something else?</p> <p>Kind regards,</p> <p>Campbell</p> <p>Most of the failures (1750 out of 1958) are to that one OSS</p> <p>Campbell,</p> <p>If the cluster is idle, those are Lustre ping failures.  That's a pretty trivial activity for Lustre, so if it's failing (which is what that message means), it's likely some sort of network issue, rather than a Lustre problem.  'dmesg' from the node is probably most helpful for this, but it may not contain the right info.</p> <p>I'd encourage you to look through the logs and possibly do some other network testing.</p> <p>Thanks Patrick, I checked the interface errors and there were none, nor any log entries in /var/log/messages that could explain it. I will do some ping/iperf tests and see what the results are.</p> <p>Hi Patrick,</p> <p>I did a bit of reading and found the lctl ping command, which alerted me to the fact that the OSTs were not mounted on two of the nodes. This is now fixed so you can close this ticket. Apologies for the bother.</p> <p>Regards,</p> <p>Campbell</p> <p>No problem - thanks for letting us know!</p> Development Rank 1|i00eiv: Rank (Obsolete) 9223372036854775807 Severity