https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-875 Lustre <p>we are seeing the following error messages very offen at the customer site.</p> <p>Nov 17 23:36:29 ALPL506 kernel: LustreError: 1810:0:(mds_open.c:1645:mds_close()) @@@ no handle for file close ino 20549237: cookie 0xffea02d92441093b req@ffff810604316800 x1385446631059308/t0 o35-&gt;3f691b52-07fd-72a2-4901-6a11eb41c9af@NET_0x500000a03061c_UUID:0/0 lens 408/4896 e 0 to 0 dl 1321544195 ref 1 fl Interpret:/0/0 rc 0/0<br/> Nov 17 23:36:29 ALPL506 kernel: LustreError: 1810:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (<del>116) req@ffff810604316800 x1385446631059308/t0 o35</del>&gt;3f691b52-07fd-72a2-4901-6a11eb41c9af@NET_0x500000a03061c_UUID:0/0 lens 408/2928 e 0 to 0 dl 1321544195 ref 1 fl Interpret:/0/0 rc -116/0<br/> Nov 17 23:36:29 ALPL506 kernel: LustreError: 1873:0:(mds_open.c:1645:mds_close()) @@@ no handle for file close ino 20549177: cookie 0xffea02d9245b5b8d req@ffff810450e77800 x1385446631059335/t0 o35-&gt;3f691b52-07fd-72a2-4901-6a11eb41c9af@NET_0x500000a03061c_UUID:0/0 lens 408/4896 e 0 to 0 dl 1321544195 ref 1 fl Interpret:/0/0 rc 0/0<br/> Nov 17 23:36:29 ALPL506 kernel: LustreError: 1873:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (<del>116) req@ffff810450e77800 x1385446631059335/t0 o35</del>&gt;3f691b52-07fd-72a2-4901-6a11eb41c9af@NET_0x500000a03061c_UUID:0/0 lens 408/2928 e 0 to 0 dl 1321544195 ref 1 fl Interpret:/0/0 rc -116/0<br/> Nov 17 23:36:36 ALPL506 kernel: LustreError: 2012:0:(mds_open.c:1645:mds_close()) @@@ no handle for file close ino 20549276: cookie 0xffea02d9244de445 req@ffff8102c148c450 x1385446631059475/t0 o35-&gt;3f691b52-07fd-72a2-4901-6a11eb41c9af@NET_0x500000a03061c_UUID:0/0 lens 408/4896 e 0 to 0 dl 1321544202 ref 1 fl Interpret:/0/0 rc 0/0<br/> Nov 17 23:36:36 ALPL506 kernel: LustreError: 2012:0:(ldlm_lib.c:1919:target_send_reply_msg()) @@@ processing error (<del>116) req@ffff8102c148c450 x1385446631059475/t0 o35</del>&gt;3f691b52-07fd-72a2-4901-6a11eb41c9af@NET_0x500000a03061c_UUID:0/0 lens 408/2928 e 0 to 0 dl 1321544202 ref 1 fl Interpret:/0/0 rc -116/0</p> <p>please advise whether this is something problem ot not.</p> LU-875

(mds_open.c:1645:mds_close()) @@@ no handle for file close

Bug Minor Resolved Fixed Niu Yawei Shuichi Ihara Wed, 23 Nov 2011 02:39:53 +0000 Fri, 6 Jan 2012 08:58:12 +0000 Fri, 6 Jan 2012 08:58:12 +0000 Lustre 1.8.6 0 2 <p>This message is itself not a serious problem. It means that the clients were previously evicted from the MDS, and when they try to close the files, there is no record of the open on the MDS.</p> <p>If the clients are being evicted on a regular basis, then this is the real problem to be investigating.</p> <p>I had a look at log files. Some of clients were eveicted from MDS, but it happened one or more hours before these messages showed up. do these eveistions still affect to this error messages?</p> <p>Nov 17 18:05:10 ALPL506 kernel: Lustre: LFS05-MDT0000: haven't heard from client b5553d1d-d2d7-10eb-8dd2-47d28010c55a (at 10.3.9.23@o2ib) in 227 seconds. I think it's dead, and I am evicting it.<br/> Nov 17 18:05:10 ALPL506 kernel: Lustre: Skipped 7 previous similar messages<br/> Nov 17 22:43:54 ALPL506 kernel: Lustre: LFS05-MDT0000: haven't heard from client 3f691b52-07fd-72a2-4901-6a11eb41c9af (at 10.3.6.28@o2ib) in 227 seconds. I think it's dead, and I am evicting it.<br/> Nov 17 22:43:54 ALPL506 kernel: Lustre: Skipped 1 previous similar message<br/> Nov 17 22:43:54 ALPL506 kernel: Lustre: MGS: haven't heard from client 5b087fc9-5c1b-1600-b1aa-170c245d32f5 (at 10.3.6.28@o2ib) in 227 seconds. I think it's dead, and I am evicting it.<br/> Nov 17 23:36:29 ALPL506 kernel: LustreError: 1810:0:(mds_open.c:1645:mds_close()) @@@ no handle for file close ino 20549237: cookie 0xffea02d92441093b req@ffff810604316800 x1385446631059308/t0 o35-&gt;3f691b52-07fd-72a2-4901-6a11eb41c9af@NET_0x500000a03061c_UUID:0/0 lens 408/4896 e 0 to 0 dl 1321544195 ref 1 fl Interpret:/0/0 rc 0/0</p> <p>Niu</p> <p>Can you please look into this one?</p> <p>Thanks</p> <p>Peter</p> <p>Ihara, yes these messages will only happen when the client tries to close the file, regardless of how long ago it was evicted.</p> <p>Did the client(s) have a large number of files open? If there are more such messages from the same client UUID after it is clear that the application running there at the time of eviction is stopped, then it may be some new problem.</p> <p>It seems that Infinbiand issues happened occasionally at that time. So, we saw many evicted clients due to these IB issues.<br/> we haven't much seen same messages so far. Please close this ticket, and I will open new ticket if we see same messages as real problem. </p> <p>ok - thanks Ihara!</p> Development Rank 1|hzvhp3: Rank (Obsolete) 6516 Severity