https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-11822 Lustre <p>Getting the Error during monting</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> [ 535.815603] LustreError: 32661:0:(osd_handler.c:2345:osd_conf_get()) nbp16-OST0004: unsupported T10PI type '' [ 535.844913] LustreError: 32661:0:(osd_handler.c:2345:osd_conf_get()) Skipped 5 previous similar messages </pre> </div></div> lustre2.12RC1 LU-11822

what does this mean nbp16-OST0004: unsupported T10PI type ''

Question/Request Major Resolved Fixed Dongyang Li Mahmoud Hanafi Fri, 21 Dec 2018 19:48:04 +0000 Wed, 24 Jul 2019 17:12:54 +0000 Wed, 24 Jul 2019 17:12:54 +0000 Lustre 2.12.0 0 5 <p>Mahmoud</p> <p>Before diving into this in any depth can you first see whether this issue still affects RC4? There have been quite a few changes since RC1</p> <p>Peter</p> <p>will do.</p> <p> </p> <p>2.12rc4 has the same error and some additional</p> <p>Here is the integrity format for our devices:</p> <p>/sys/class/block/sdz/integrity/format: T10-DIF-TYPE1-IP</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> [ 159.018504] LustreError: 32487:0:(osd_handler.c:2345:osd_conf_get()) MGS: unsupported T10PI type '' [ 160.003320] LustreError: 32604:0:(osd_handler.c:2345:osd_conf_get()) nbp16-MDT0000: unsupported T10PI type '' [ 160.182395] format at osd_handler.c:2345:osd_conf_get doesn't end in newline [ 160.202887] format at osd_handler.c:2345:osd_conf_get doesn't end in newline [ 160.233917] format at osd_handler.c:2345:osd_conf_get doesn't end in newline </pre> </div></div> <p> </p> <p>Dongyang</p> <p>Can you please advise?</p> <p>Thanks</p> <p>Peter</p> <p>patch tracking at <a href="https://review.whamcloud.com/#/c/33923/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/33923/</a></p> <p>There is additional issue with the 'unsupported T10PI type' IO will return "Unknown error 524" </p> <p>Will the above patch fix this issue? </p> <p>Here is the debug info from the server</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> 00000001:00001000:4.0:1547783119.952280:0:48199:0:(osd_io.c:1233:osd_ldiskfs_map_inode_pages()) inode 35860: map 536 pages from 0 00000001:00000001:4.0:1547783119.952324:0:48199:0:(osd_io.c:503:osd_do_bio()) <span class="code-object">Process</span> entered 00000001:00000001:4.0:1547783119.952326:0:48199:0:(osd_io.c:451:osd_bio_init()) <span class="code-object">Process</span> entered 00000001:00000010:4.0:1547783119.952327:0:48199:0:(osd_io.c:455:osd_bio_init()) kmalloced <span class="code-quote">'(bio_private)'</span>: 16 at ffff882dc598b560. 00000001:00000001:4.0:1547783119.952327:0:48199:0:(osd_io.c:467:osd_bio_init()) <span class="code-object">Process</span> leaving (rc=0 : 0 : 0) 00000001:00000002:4.0:1547783119.952335:0:48199:0:(osd_io.c:563:osd_do_bio()) bio++ sz 1048576 vcnt 256(256) sectors 2048(4096) psg 148(512) hsg 0(512) 00000001:00000001:4.0:1547783119.952336:0:48199:0:(osd_io.c:390:osd_bio_integrity_handle()) <span class="code-object">Process</span> entered 00000001:00000001:4.0:1547783119.952337:0:48199:0:(osd_io.c:398:osd_bio_integrity_handle()) <span class="code-object">Process</span> leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4) 00000001:00000010:4.0:1547783119.952338:0:48199:0:(osd_io.c:641:osd_do_bio()) kfreed <span class="code-quote">'bio_private'</span>: 16 at ffff882dc598b560. 00000001:00000001:4.0:1547783119.952339:0:48199:0:(osd_io.c:644:osd_do_bio()) <span class="code-object">Process</span> leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4) 00000001:00000001:4.0:1547783119.952426:0:48199:0:(osd_io.c:1664:osd_write_commit()) <span class="code-object">Process</span> leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4) 00002000:00000001:4.0:1547783119.952426:0:48199:0:(ofd_io.c:1188:ofd_commitrw_write()) <span class="code-object">Process</span> leaving via out_stop (rc=18446744073709551092 : -524 : 0xfffffffffffffdf4) 00080000:00000001:4.0:1547783119.952428:0:48199:0:(osd_handler.c:1976:osd_trans_stop()) <span class="code-object">Process</span> entered 00000001:00000001:4.0:1547783119.952428:0:48199:0:(tgt_lastrcvd.c:1211:tgt_last_rcvd_update()) <span class="code-object">Process</span> entered 00000001:00000002:4.0:1547783119.952428:0:48199:0:(tgt_lastrcvd.c:1252:tgt_last_rcvd_update()) transno = 0, last_committed = 47244640266 00000001:00000010:4.0:1547783119.952429:0:48199:0:(tgt_lastrcvd.c:916:tgt_last_commit_cb_add()) kmalloced <span class="code-quote">'(ccb)'</span>: 96 at ffff882f19362f60. 00000001:00000040:4.0:1547783119.952430:0:48199:0:(tgt_lastrcvd.c:921:tgt_last_commit_cb_add()) callback GETting export ffff882c31c1f800 : <span class="code-keyword">new</span> cb_count 2 00000020:00000040:4.0:1547783119.952431:0:48199:0:(genops.c:1008:class_export_get()) GETting export ffff882c31c1f800 : <span class="code-keyword">new</span> refcount 10 00000001:00000001:4.0:1547783119.952432:0:48199:0:(tgt_lastrcvd.c:1394:tgt_last_rcvd_update()) <span class="code-object">Process</span> leaving (rc=0 : 0 : 0) 00000001:00000040:19.0:1547783119.952780:0:27975:0:(tgt_lastrcvd.c:901:tgt_cb_last_committed()) callback PUTting export ffff882c31c1f800 : <span class="code-keyword">new</span> cb_count 1 00000020:00000040:19.0:1547783119.952781:0:27975:0:(genops.c:1018:class_export_put()) PUTting export ffff882c31c1f800 : <span class="code-keyword">new</span> refcount 9 00000001:00000010:19.0:1547783119.952781:0:27975:0:(tgt_lastrcvd.c:902:tgt_cb_last_committed()) kfreed <span class="code-quote">'ccb'</span>: 96 at ffff882f19362f60. 00080000:00000010:19.0:1547783119.952782:0:27975:0:(osd_handler.c:1725:osd_trans_commit_cb()) kfreed <span class="code-quote">'oh'</span>: 216 at ffff882df4840c00. 00000100:00000001:19.0:1547783119.952785:0:27975:0:(service.c:408:ptlrpc_commit_replies()) <span class="code-object">Process</span> entered 00000100:00000001:19.0:1547783119.952786:0:27975:0:(service.c:428:ptlrpc_commit_replies()) <span class="code-object">Process</span> leaving 00000001:00080000:19.0:1547783119.952786:0:27975:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) nbp16-OST0000: transno 47244640267 is committed 00000001:00000040:19.0:1547783119.952787:0:27975:0:(tgt_lastrcvd.c:901:tgt_cb_last_committed()) callback PUTting export ffff882c31c1f800 : <span class="code-keyword">new</span> cb_count 0 00000020:00000040:19.0:1547783119.952787:0:27975:0:(genops.c:1018:class_export_put()) PUTting export ffff882c31c1f800 : <span class="code-keyword">new</span> refcount 8 00000001:00000010:19.0:1547783119.952788:0:27975:0:(tgt_lastrcvd.c:902:tgt_cb_last_committed()) kfreed <span class="code-quote">'ccb'</span>: 96 at ffff882f19362ae0. 00080000:00000010:19.0:1547783119.952788:0:27975:0:(osd_handler.c:1725:osd_trans_commit_cb()) kfreed <span class="code-quote">'oh'</span>: 216 at ffff882df4841600. 00000001:00000010:4.0:1547783119.952792:0:48199:0:(osd_io.c:2414:osd_trunc_unlock_all()) kfreed <span class="code-quote">'al'</span>: 32 at ffff882c7e686420. 00000001:00000010:4.0:1547783119.952792:0:48199:0:(osd_io.c:2414:osd_trunc_unlock_all()) kfreed <span class="code-quote">'al'</span>: 32 at ffff882c7e686460. 00040000:00000001:4.0:1547783119.952793:0:48199:0:(qsd_handler.c:1088:qsd_op_end()) <span class="code-object">Process</span> entered 00040000:00000001:4.0:1547783119.952793:0:48199:0:(qsd_handler.c:1119:qsd_op_end()) <span class="code-object">Process</span> leaving 00080000:00000001:4.0:1547783119.952794:0:48199:0:(osd_handler.c:2058:osd_trans_stop()) <span class="code-object">Process</span> leaving (rc=0 : 0 : 0) 00000001:00000001:4.0:1547783119.952907:0:48199:0:(osd_io.c:800:osd_bufs_put()) <span class="code-object">Process</span> leaving (rc=0 : 0 : 0) 00000020:00000002:4.0:1547783119.952908:0:48199:0:(lu_object.c:189:lu_object_put()) Add ffff882c3220a820/ffff882c3220a7d0 to site lru. hash: ffff882d64990a80, bkt: ffffc90180e45018 00002000:00000001:4.0:1547783119.952909:0:48199:0:(tgt_grant.c:1398:tgt_grant_commit()) <span class="code-object">Process</span> entered 00002000:00000001:4.0:1547783119.952909:0:48199:0:(tgt_grant.c:1452:tgt_grant_commit()) <span class="code-object">Process</span> leaving 00002000:00000001:4.0:1547783119.952910:0:48199:0:(ofd_io.c:1241:ofd_commitrw_write()) <span class="code-object">Process</span> leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4) 00000001:00000001:4.0:1547783119.952911:0:48199:0:(nodemap_handler.c:610:nodemap_get_from_exp()) <span class="code-object">Process</span> entered 00000001:00000001:4.0:1547783119.952911:0:48199:0:(nodemap_handler.c:613:nodemap_get_from_exp()) <span class="code-object">Process</span> leaving (rc=0 : 0 : 0) 00002000:00000001:4.0:1547783119.952912:0:48199:0:(ofd_io.c:1376:ofd_commitrw()) <span class="code-object">Process</span> leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4) 00000020:00000001:4.0:1547783119.952912:0:48199:0:(obd_class.h:1143:obd_commitrw()) <span class="code-object">Process</span> leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4) 00000020:00000001:4.0:1547783119.952913:0:48199:0:(tgt_handler.c:1707:tgt_brw_unlock()) <span class="code-object">Process</span> entered 00000020:00000001:4.0:1547783119.952913:0:48199:0:(tgt_handler.c:1716:tgt_brw_unlock()) <span class="code-object">Process</span> leaving 00000100:00000001:4.0:1547783119.952914:0:48199:0:(client.c:258:ptlrpc_free_bulk()) <span class="code-object">Process</span> entered 00000020:00000040:4.0:1547783119.952914:0:48199:0:(genops.c:1018:class_export_put()) PUTting export ffff882c31c1f800 : <span class="code-keyword">new</span> refcount 7 00000100:00000010:4.0:1547783119.952915:0:48199:0:(client.c:279:ptlrpc_free_bulk()) kfreed <span class="code-quote">'((desc)-&gt;bd_u.bd_kiov.bd_vec)'</span>: 8576 at ffff882c28694000. 00000100:00000010:4.0:1547783119.952916:0:48199:0:(client.c:283:ptlrpc_free_bulk()) kfreed <span class="code-quote">'desc'</span>: 280 at ffff882f30965800. 00000100:00000001:4.0:1547783119.952917:0:48199:0:(client.c:284:ptlrpc_free_bulk()) <span class="code-object">Process</span> leaving 00000020:00000001:4.0:1547783119.952917:0:48199:0:(tgt_handler.c:2708:tgt_brw_write()) <span class="code-object">Process</span> leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4) 00010000:00000040:4.0:1547783119.952918:0:48199:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 47244640267, transno 0, xid 1616080612036320 00010000:00000001:4.0:1547783119.952919:0:48199:0:(ldlm_lib.c:2958:target_send_reply()) <span class="code-object">Process</span> entered 00010000:00000200:4.0:1547783119.952920:0:48199:0:(ldlm_lib.c:2946:target_send_reply_msg()) @@@ sending reply req@ffff882c79daf450 x1616080612036320/t0(0) o4-&gt;e546db30-4f4a-e59f-299b-f3a7d766ca4e@10.151.5.47@o2ib:91/0 lens 608/448 e 0 to 0 dl 1547783311 ref 1 fl Interpret:/0/0 rc -524/0  </pre> </div></div> <p> </p> <p> </p> <p>524 is ENOTSUPP returned by osd_get_integrity_profile, the reason is the integrity profile was not setup properly in osd_conf_get.</p> <p>and yes the patch should fix this, given the profile will be set.</p> <p>Patch set #4 failed to compile with 2.12. Can we get a back port for 2.12. </p> <p>Patch set #6 failed to merge to b2_12:<br/> &lt;&lt;&lt;&lt;&lt;&lt;&lt; HEAD<br/> static inline unsigned int bip_size(struct bio_integrity_payload *bip)</p> { #ifdef HAVE_BIP_ITER_BIO_INTEGRITY_PAYLOAD return bip-&gt;bip_iter.bi_size; #else return bip-&gt;bip_size; #endif } <p>=======<br/> &gt;&gt;&gt;&gt;&gt;&gt;&gt; 52ad5efa9e... <a href="https://jira.whamcloud.com/browse/LU-11770" title="preserve kernel API when T10-PI patches are applied" class="issue-link" data-issue-key="LU-11770"><del>LU-11770</del></a> osc: allow build without blk_integrity or crc-t10</p> <p>Could you please provide a back port to b2_12? Thanks!</p> <p>Here is <a href="https://jira.whamcloud.com/browse/LU-11770" title="preserve kernel API when T10-PI patches are applied" class="issue-link" data-issue-key="LU-11770"><del>LU-11770</del></a> port for b2_12:</p> <p><a href="https://review.whamcloud.com/#/c/34156/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/#/c/34156/</a></p> <p>please close</p> Related LU-11770 Development Rank 1|i008m7: Rank (Obsolete) 9223372036854775807