[LU-11822] what does this mean nbp16-OST0004: unsupported T10PI type ''

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.12.0
• Type: Question/Request
• Priority: Major
• Reporter: Mahmoud Hanafi
• Assignee: Dongyang Li
• Resolution: Fixed

Environment

lustre2.12RC1

Description

Getting the Error during monting

[  535.815603] LustreError: 32661:0:(osd_handler.c:2345:osd_conf_get()) nbp16-OST0004: unsupported T10PI type ''
[  535.844913] LustreError: 32661:0:(osd_handler.c:2345:osd_conf_get()) Skipped 5 previous similar messages

Issue Links

• is related to: LU-11770 preserve kernel API when T10-PI patch...

Comments

[Peter Jones]

Mahmoud

Before diving into this in any depth can you first see whether this issue still affects RC4? There have been quite a few changes since RC1

Peter

[Mahmoud Hanafi]

will do.

 

[Mahmoud Hanafi]

2.12rc4 has the same error and some additional

Here is the integrity format for our devices:

/sys/class/block/sdz/integrity/format: T10-DIF-TYPE1-IP

 [  159.018504] LustreError: 32487:0:(osd_handler.c:2345:osd_conf_get()) MGS: unsupported T10PI type ''
[  160.003320] LustreError: 32604:0:(osd_handler.c:2345:osd_conf_get()) nbp16-MDT0000: unsupported T10PI type ''
[  160.182395] format at osd_handler.c:2345:osd_conf_get doesn't end in newline
[  160.202887] format at osd_handler.c:2345:osd_conf_get doesn't end in newline
[  160.233917] format at osd_handler.c:2345:osd_conf_get doesn't end in newline

 

[Peter Jones]

Dongyang

Can you please advise?

Thanks

Peter

[Dongyang Li]

patch tracking at https://review.whamcloud.com/#/c/33923/

[Mahmoud Hanafi]

There is additional issue with the 'unsupported T10PI type' IO will return "Unknown error 524"

Will the above patch fix this issue?

Here is the debug info from the server

00000001:00001000:4.0:1547783119.952280:0:48199:0:(osd_io.c:1233:osd_ldiskfs_map_inode_pages()) inode 35860: map 536 pages from 0
00000001:00000001:4.0:1547783119.952324:0:48199:0:(osd_io.c:503:osd_do_bio()) Process entered
00000001:00000001:4.0:1547783119.952326:0:48199:0:(osd_io.c:451:osd_bio_init()) Process entered
00000001:00000010:4.0:1547783119.952327:0:48199:0:(osd_io.c:455:osd_bio_init()) kmalloced '(bio_private)': 16 at ffff882dc598b560.
00000001:00000001:4.0:1547783119.952327:0:48199:0:(osd_io.c:467:osd_bio_init()) Process leaving (rc=0 : 0 : 0)
00000001:00000002:4.0:1547783119.952335:0:48199:0:(osd_io.c:563:osd_do_bio()) bio++ sz 1048576 vcnt 256(256) sectors 2048(4096) psg 148(512) hsg 0(512)
00000001:00000001:4.0:1547783119.952336:0:48199:0:(osd_io.c:390:osd_bio_integrity_handle()) Process entered
00000001:00000001:4.0:1547783119.952337:0:48199:0:(osd_io.c:398:osd_bio_integrity_handle()) Process leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4)
00000001:00000010:4.0:1547783119.952338:0:48199:0:(osd_io.c:641:osd_do_bio()) kfreed 'bio_private': 16 at ffff882dc598b560.
00000001:00000001:4.0:1547783119.952339:0:48199:0:(osd_io.c:644:osd_do_bio()) Process leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4)
00000001:00000001:4.0:1547783119.952426:0:48199:0:(osd_io.c:1664:osd_write_commit()) Process leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4)
00002000:00000001:4.0:1547783119.952426:0:48199:0:(ofd_io.c:1188:ofd_commitrw_write()) Process leaving via out_stop (rc=18446744073709551092 : -524 : 0xfffffffffffffdf4)
00080000:00000001:4.0:1547783119.952428:0:48199:0:(osd_handler.c:1976:osd_trans_stop()) Process entered
00000001:00000001:4.0:1547783119.952428:0:48199:0:(tgt_lastrcvd.c:1211:tgt_last_rcvd_update()) Process entered
00000001:00000002:4.0:1547783119.952428:0:48199:0:(tgt_lastrcvd.c:1252:tgt_last_rcvd_update()) transno = 0, last_committed = 47244640266
00000001:00000010:4.0:1547783119.952429:0:48199:0:(tgt_lastrcvd.c:916:tgt_last_commit_cb_add()) kmalloced '(ccb)': 96 at ffff882f19362f60.
00000001:00000040:4.0:1547783119.952430:0:48199:0:(tgt_lastrcvd.c:921:tgt_last_commit_cb_add()) callback GETting export ffff882c31c1f800 : new cb_count 2
00000020:00000040:4.0:1547783119.952431:0:48199:0:(genops.c:1008:class_export_get()) GETting export ffff882c31c1f800 : new refcount 10
00000001:00000001:4.0:1547783119.952432:0:48199:0:(tgt_lastrcvd.c:1394:tgt_last_rcvd_update()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:19.0:1547783119.952780:0:27975:0:(tgt_lastrcvd.c:901:tgt_cb_last_committed()) callback PUTting export ffff882c31c1f800 : new cb_count 1
00000020:00000040:19.0:1547783119.952781:0:27975:0:(genops.c:1018:class_export_put()) PUTting export ffff882c31c1f800 : new refcount 9
00000001:00000010:19.0:1547783119.952781:0:27975:0:(tgt_lastrcvd.c:902:tgt_cb_last_committed()) kfreed 'ccb': 96 at ffff882f19362f60.
00080000:00000010:19.0:1547783119.952782:0:27975:0:(osd_handler.c:1725:osd_trans_commit_cb()) kfreed 'oh': 216 at ffff882df4840c00.
00000100:00000001:19.0:1547783119.952785:0:27975:0:(service.c:408:ptlrpc_commit_replies()) Process entered
00000100:00000001:19.0:1547783119.952786:0:27975:0:(service.c:428:ptlrpc_commit_replies()) Process leaving
00000001:00080000:19.0:1547783119.952786:0:27975:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) nbp16-OST0000: transno 47244640267 is committed
00000001:00000040:19.0:1547783119.952787:0:27975:0:(tgt_lastrcvd.c:901:tgt_cb_last_committed()) callback PUTting export ffff882c31c1f800 : new cb_count 0
00000020:00000040:19.0:1547783119.952787:0:27975:0:(genops.c:1018:class_export_put()) PUTting export ffff882c31c1f800 : new refcount 8
00000001:00000010:19.0:1547783119.952788:0:27975:0:(tgt_lastrcvd.c:902:tgt_cb_last_committed()) kfreed 'ccb': 96 at ffff882f19362ae0.
00080000:00000010:19.0:1547783119.952788:0:27975:0:(osd_handler.c:1725:osd_trans_commit_cb()) kfreed 'oh': 216 at ffff882df4841600.
00000001:00000010:4.0:1547783119.952792:0:48199:0:(osd_io.c:2414:osd_trunc_unlock_all()) kfreed 'al': 32 at ffff882c7e686420.
00000001:00000010:4.0:1547783119.952792:0:48199:0:(osd_io.c:2414:osd_trunc_unlock_all()) kfreed 'al': 32 at ffff882c7e686460.
00040000:00000001:4.0:1547783119.952793:0:48199:0:(qsd_handler.c:1088:qsd_op_end()) Process entered
00040000:00000001:4.0:1547783119.952793:0:48199:0:(qsd_handler.c:1119:qsd_op_end()) Process leaving
00080000:00000001:4.0:1547783119.952794:0:48199:0:(osd_handler.c:2058:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:4.0:1547783119.952907:0:48199:0:(osd_io.c:800:osd_bufs_put()) Process leaving (rc=0 : 0 : 0)
00000020:00000002:4.0:1547783119.952908:0:48199:0:(lu_object.c:189:lu_object_put()) Add ffff882c3220a820/ffff882c3220a7d0 to site lru. hash: ffff882d64990a80, bkt: ffffc90180e45018
00002000:00000001:4.0:1547783119.952909:0:48199:0:(tgt_grant.c:1398:tgt_grant_commit()) Process entered
00002000:00000001:4.0:1547783119.952909:0:48199:0:(tgt_grant.c:1452:tgt_grant_commit()) Process leaving
00002000:00000001:4.0:1547783119.952910:0:48199:0:(ofd_io.c:1241:ofd_commitrw_write()) Process leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4)
00000001:00000001:4.0:1547783119.952911:0:48199:0:(nodemap_handler.c:610:nodemap_get_from_exp()) Process entered
00000001:00000001:4.0:1547783119.952911:0:48199:0:(nodemap_handler.c:613:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:4.0:1547783119.952912:0:48199:0:(ofd_io.c:1376:ofd_commitrw()) Process leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4)
00000020:00000001:4.0:1547783119.952912:0:48199:0:(obd_class.h:1143:obd_commitrw()) Process leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4)
00000020:00000001:4.0:1547783119.952913:0:48199:0:(tgt_handler.c:1707:tgt_brw_unlock()) Process entered
00000020:00000001:4.0:1547783119.952913:0:48199:0:(tgt_handler.c:1716:tgt_brw_unlock()) Process leaving
00000100:00000001:4.0:1547783119.952914:0:48199:0:(client.c:258:ptlrpc_free_bulk()) Process entered
00000020:00000040:4.0:1547783119.952914:0:48199:0:(genops.c:1018:class_export_put()) PUTting export ffff882c31c1f800 : new refcount 7
00000100:00000010:4.0:1547783119.952915:0:48199:0:(client.c:279:ptlrpc_free_bulk()) kfreed '((desc)->bd_u.bd_kiov.bd_vec)': 8576 at ffff882c28694000.
00000100:00000010:4.0:1547783119.952916:0:48199:0:(client.c:283:ptlrpc_free_bulk()) kfreed 'desc': 280 at ffff882f30965800.
00000100:00000001:4.0:1547783119.952917:0:48199:0:(client.c:284:ptlrpc_free_bulk()) Process leaving
00000020:00000001:4.0:1547783119.952917:0:48199:0:(tgt_handler.c:2708:tgt_brw_write()) Process leaving (rc=18446744073709551092 : -524 : fffffffffffffdf4)
00010000:00000040:4.0:1547783119.952918:0:48199:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 47244640267, transno 0, xid 1616080612036320
00010000:00000001:4.0:1547783119.952919:0:48199:0:(ldlm_lib.c:2958:target_send_reply()) Process entered
00010000:00000200:4.0:1547783119.952920:0:48199:0:(ldlm_lib.c:2946:target_send_reply_msg()) @@@ sending reply  req@ffff882c79daf450 x1616080612036320/t0(0) o4->e546db30-4f4a-e59f-299b-f3a7d766ca4e@10.151.5.47@o2ib:91/0 lens 608/448 e 0 to 0 dl 1547783311 ref 1 fl Interpret:/0/0 rc -524/0

 

 

 

[Dongyang Li]

524 is ENOTSUPP returned by osd_get_integrity_profile, the reason is the integrity profile was not setup properly in osd_conf_get.

and yes the patch should fix this, given the profile will be set.

[Mahmoud Hanafi]

Patch set #4 failed to compile with 2.12. Can we get a back port for 2.12.

[Jay Lan (Inactive)]

Patch set #6 failed to merge to b2_12:
<<<<<<< HEAD
static inline unsigned int bip_size(struct bio_integrity_payload *bip)

{ #ifdef HAVE_BIP_ITER_BIO_INTEGRITY_PAYLOAD return bip->bip_iter.bi_size; #else return bip->bip_size; #endif }

=======
>>>>>>> 52ad5efa9e... LU-11770 osc: allow build without blk_integrity or crc-t10

Could you please provide a back port to b2_12? Thanks!

[Dongyang Li]

Here is LU-11770 port for b2_12:

https://review.whamcloud.com/#/c/34156/

[Mahmoud Hanafi]

please close