https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-14603 Lustre <p>After upgrading a few clients on our Sherlock cluster from Lustre 2.13 to 2.14, we are seeing more and more "no handlers for opcode 0x16" errors on the servers (running 2.12.6).</p> <p>From <tt>lustre_idl.h</tt>, I can see that ost opcode 0x16 is:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> OST_FALLOCATE = 22, </pre> </div></div> <p>So it's probably related to new fallocate support for Lustre/ldiskfs (<a href="https://jira.whamcloud.com/browse/LU-3606" title="Implement fallocate() support for ldiskfs Lustre" class="issue-link" data-issue-key="LU-3606"><del>LU-3606</del></a>). I guess that's a good sign that codes are using fallocate! <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/> </p> <p>However, we only have a few clients running 2.14 in production, and I'm now worried that after we upgrade the whole cluster (1,800+ nodes), this will lead to an extremely high rate of these messages on the servers. Would it be possible to update Lustre 2.12 LTS to print those when debugging only? for better compatibility between 2.12 servers and 2.14 clients.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Apr 09 09:26:39 oak-io6-s2 kernel: LustreError: 91410:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST012d: no handlers for opcode 0x16 Apr 09 09:26:39 oak-io6-s2 kernel: LustreError: 91410:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 6 previous similar messages Apr 09 09:26:39 oak-io5-s1 kernel: LustreError: 187145:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00f2: no handlers for opcode 0x16 Apr 09 09:26:39 oak-io5-s1 kernel: LustreError: 187145:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 15 previous similar messages Apr 09 09:26:39 oak-io6-s1 kernel: LustreError: 46667:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST0124: no handlers for opcode 0x16 Apr 09 09:26:39 oak-io6-s1 kernel: LustreError: 46667:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 14 previous similar messages Apr 09 09:26:40 oak-io5-s2 kernel: LustreError: 272212:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00ed: no handlers for opcode 0x16 Apr 09 09:26:40 oak-io5-s2 kernel: LustreError: 272212:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 6 previous similar messages Apr 09 09:26:40 oak-io6-s2 kernel: LustreError: 14583:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST012b: no handlers for opcode 0x16 Apr 09 09:26:40 oak-io6-s2 kernel: LustreError: 14583:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 2 previous similar messages Apr 09 09:26:40 oak-io5-s1 kernel: LustreError: 186541:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00fc: no handlers for opcode 0x16 Apr 09 09:26:40 oak-io5-s1 kernel: LustreError: 186541:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 1 previous similar message Apr 09 09:26:41 oak-io5-s2 kernel: LustreError: 272212:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00fb: no handlers for opcode 0x16 Apr 09 09:26:42 oak-io4-s1 kernel: LustreError: 259539:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST0096: no handlers for opcode 0x16 Apr 09 09:26:42 oak-io2-s1 kernel: LustreError: 55897:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST0048: no handlers for opcode 0x16 Apr 09 09:26:42 oak-io2-s1 kernel: LustreError: 55897:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 1 previous similar message Apr 09 09:26:43 oak-io3-s2 kernel: LustreError: 229599:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST0071: no handlers for opcode 0x16 Apr 09 09:26:43 oak-io6-s1 kernel: LustreError: 210680:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST0128: no handlers for opcode 0x16 Apr 09 09:26:43 oak-io4-s1 kernel: LustreError: 62400:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00ac: no handlers for opcode 0x16 Apr 09 09:26:43 oak-io5-s1 kernel: LustreError: 55531:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00d0: no handlers for opcode 0x16 Apr 09 09:26:43 oak-io5-s1 kernel: LustreError: 55531:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 3 previous similar messages Apr 09 09:26:44 oak-io5-s2 kernel: LustreError: 272148:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00f1: no handlers for opcode 0x16 Apr 09 09:26:44 oak-io5-s2 kernel: LustreError: 272148:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 1 previous similar message Apr 09 09:26:44 oak-io3-s1 kernel: LustreError: 1095:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST0076: no handlers for opcode 0x16 Apr 09 09:26:45 oak-io6-s2 kernel: LustreError: 150751:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST012f: no handlers for opcode 0x16 Apr 09 09:26:45 oak-io6-s2 kernel: LustreError: 150751:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 1 previous similar message Apr 09 09:26:45 oak-io3-s2 kernel: LustreError: 233125:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST008f: no handlers for opcode 0x16 Apr 09 09:26:45 oak-io6-s1 kernel: LustreError: 149884:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST0132: no handlers for opcode 0x16 Apr 09 09:26:45 oak-io6-s1 kernel: LustreError: 149884:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 4 previous similar messages Apr 09 09:26:46 oak-io4-s2 kernel: LustreError: 51373:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00ad: no handlers for opcode 0x16 Apr 09 09:26:47 oak-io4-s1 kernel: LustreError: 259545:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00b0: no handlers for opcode 0x16 Apr 09 09:26:48 oak-io2-s1 kernel: LustreError: 65922:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST004c: no handlers for opcode 0x16 Apr 09 09:26:49 oak-io5-s2 kernel: LustreError: 272129:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00e5: no handlers for opcode 0x16 Apr 09 09:26:49 oak-io5-s2 kernel: LustreError: 272129:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 4 previous similar messages Apr 09 09:26:49 oak-io5-s1 kernel: LustreError: 53823:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST00fe: no handlers for opcode 0x16 Apr 09 09:26:49 oak-io5-s1 kernel: LustreError: 53823:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 2 previous similar messages Apr 09 09:26:51 oak-io6-s2 kernel: LustreError: 183056:0:(tgt_handler.c:617:tgt_handler_find_check()) oak-OST012b: no handlers for opcode 0x16 Apr 09 09:26:51 oak-io6-s2 kernel: LustreError: 183056:0:(tgt_handler.c:617:tgt_handler_find_check()) Skipped 3 previous similar messages </pre> </div></div> CentOS 7; ldiskfs/mdraid backend, clients are running Lustre 2.12, 2.13 and 2.14 LU-14603

OST: no handlers for opcode 0x16

Bug Minor Resolved Fixed Peter Jones Stephane Thiell Fri, 9 Apr 2021 16:49:02 +0000 Thu, 15 Jul 2021 20:43:08 +0000 Wed, 19 May 2021 18:01:56 +0000 Lustre 2.12.6 Lustre 2.12.7 Lustre 2.15.0 0 4 <p>I don't think there is any problem to quiet this error message, preferably to only quiet this opcode. Are you planning to submit a patch?</p> <p>It looks like there may be a similar issue with <tt>OST_SEEK=23</tt>, but that has an <tt>OBD_CONNECT2_SEEK</tt> flag that may prevent its use on older servers. It wouldn't hurt to exclude that opcode anyway. </p> <p>I am not planning to submit a patch at this time. It's just for reporting at this point.</p> <p>Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/43257" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/43257</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-14603" title="OST: no handlers for opcode 0x16" class="issue-link" data-issue-key="LU-14603"><del>LU-14603</del></a> ptlrpc: quiet messages for unsupported opcodes<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: ed519374deddeacbeef9ae2e680bd9928ebe4d51</p> <p>Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/43260" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/43260</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-14603" title="OST: no handlers for opcode 0x16" class="issue-link" data-issue-key="LU-14603"><del>LU-14603</del></a> ptlrpc: quiet messages for unsupported opcodes<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: 1<br/> Commit: 6aba58dca74f14cf982b1c94cc05e6793eb37806</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/43257/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/43257/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-14603" title="OST: no handlers for opcode 0x16" class="issue-link" data-issue-key="LU-14603"><del>LU-14603</del></a> ptlrpc: quiet messages for unsupported opcodes<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: a23767580aebfab7f093df562ac7598e85b71b3e</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/43260/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/43260/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-14603" title="OST: no handlers for opcode 0x16" class="issue-link" data-issue-key="LU-14603"><del>LU-14603</del></a> ptlrpc: quiet messages for unsupported opcodes<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: <br/> Commit: 2cbdbb65a6a40434191ef6c8a26acc2595cffb53</p> <p>Seems to have landed to both master and b2_12</p> Development Rank 1|i01rtb: Rank (Obsolete) 9223372036854775807 Severity