[LU-16532] Kerberos LBUG (gss_keyring.c:724:request_key_unlink()) ASSERTION( ring ) failed Created: 06/Feb/23  Updated: 18/Feb/23  Resolved: 14/Feb/23

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.16.0
Fix Version/s: Lustre 2.16.0

Type: Bug Priority: Minor
Reporter: Sebastien Buisson Assignee: Sebastien Buisson
Resolution: Fixed Votes: 0
Labels: patch, sec

Issue Links:
Related
Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

Attempting to mount a client with Kerberos for MGS connection failed like this:

2023-01-10T16:47:46.792399-08:00 lnode kernel: [ 9908.694003] Call Trace:
2023-01-10T16:47:46.792402-08:00 lnode kernel: [ 9908.694006]  <TASK>
2023-01-10T16:47:46.792402-08:00 lnode kernel: [ 9908.694010]  lookup_user_key+0xf4/0x700
2023-01-10T16:47:46.792402-08:00 lnode kernel: [ 9908.694013]  ? key_validate+0x50/0x50
2023-01-10T16:47:46.792403-08:00 lnode kernel: [ 9908.694016]  request_key_unlink+0x196/0x270 [ptlrpc_gss]
2023-01-10T16:47:46.792403-08:00 lnode kernel: [ 9908.694028]  gss_sec_lookup_ctx_kr+0xa15/0xca5 [ptlrpc_gss]
2023-01-10T16:47:46.792403-08:00 lnode kernel: [ 9908.694036]  get_my_ctx+0x5f/0x140 [ptlrpc]
2023-01-10T16:47:46.792405-08:00 lnode kernel: [ 9908.694074]  sptlrpc_req_get_ctx+0x15a/0x280 [ptlrpc]
2023-01-10T16:47:46.792405-08:00 lnode kernel: [ 9908.694108]  ptlrpc_request_bufs_pack+0x283/0x6a0 [ptlrpc]
2023-01-10T16:47:46.792405-08:00 lnode kernel: [ 9908.694138]  ptlrpc_connect_import_locked+0xfd9/0x14a0 [ptlrpc]
2023-01-10T16:47:46.792406-08:00 lnode kernel: [ 9908.694171]  ? strlcpy+0x32/0x50
2023-01-10T16:47:46.792406-08:00 lnode kernel: [ 9908.694176]  ptlrpc_connect_import+0x22/0x30 [ptlrpc]
2023-01-10T16:47:46.792406-08:00 lnode kernel: [ 9908.694209]  ptlrpc_initiate_recovery+0x2d/0x170 [ptlrpc]
2023-01-10T16:47:46.792415-08:00 lnode kernel: [ 9908.694267]  ptlrpc_pinger_main+0x4da/0xab0 [ptlrpc]
2023-01-10T16:47:46.792417-08:00 lnode kernel: [ 9908.694303]  process_one_work+0x228/0x3d0
2023-01-10T16:47:46.792417-08:00 lnode kernel: [ 9908.694309]  worker_thread+0x53/0x420
2023-01-10T16:47:46.792417-08:00 lnode kernel: [ 9908.694310]  ? process_one_work+0x3d0/0x3d0
2023-01-10T16:47:46.792417-08:00 lnode kernel: [ 9908.694312]  kthread+0x127/0x150
2023-01-10T16:47:46.792418-08:00 lnode kernel: [ 9908.694315]  ? set_kthread_struct+0x50/0x50
2023-01-10T16:47:46.792418-08:00 lnode kernel: [ 9908.694317]  ret_from_fork+0x1f/0x30
2023-01-10T16:47:46.792421-08:00 lnode kernel: [ 9908.694324]  </TASK>
2023-01-10T16:47:46.792440-08:00 lnode kernel: [ 9908.694326] ---[ end trace 980abd6d4fa4f0b3 ]---
2023-01-10T16:47:46.792441-08:00 lnode kernel: [ 9908.694334] LustreError: 43783:0:(gss_keyring.c:724:request_key_unlink()) ASSERTION( ring ) failed:
2023-01-10T16:47:46.792843-08:00 lnode lgss_keyring: [135939]:TRACE:lgssc_negotiation(): start gss negotiation
2023-01-10T16:47:46.795065-08:00 lnode lgss_keyring: [135939]:TRACE:do_nego_rpc(): start negotiation rpc
2023-01-10T16:47:46.795112-08:00 lnode lgss_keyring: [135939]:TRACE:gss_do_ioctl(): to open /sys/kernel/debug/lustre/sptlrpc/gss/init_channel
2023-01-10T16:47:46.795131-08:00 lnode lgss_keyring: [135939]:TRACE:gss_do_ioctl(): to down-write
2023-01-10T16:47:46.803857-08:00 lnode kernel: [ 9908.705667] LustreError: 43783:0:(gss_keyring.c:724:request_key_unlink()) LBUG
2023-01-10T16:47:46.812705-08:00 lnode kernel: [ 9908.714612] Pid: 43783, comm: kworker/u448:15 5.15.0-57-generic #63-Ubuntu SMP Thu Nov 24 13:43:17 UTC 2022
2023-01-10T16:47:46.812710-08:00 lnode kernel: [ 9908.714614] Call Trace TBD:
2023-01-10T16:47:46.812711-08:00 lnode kernel: [ 9908.714615] Kernel panic - not syncing: LBUG


 Comments   
Comment by Gerrit Updater [ 06/Feb/23 ]

"Sebastien Buisson <sbuisson@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49909
Subject: LU-16532 sec: session key bad keyring
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: ea294dfe28f0b32ab909d496092c7feeb26eb025

Comment by Gerrit Updater [ 14/Feb/23 ]

"Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49909/
Subject: LU-16532 sec: session key bad keyring
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 1f034cf610deeb6b070338a9d005b75ce964f945

Comment by Peter Jones [ 14/Feb/23 ]

Landed for 2.16

Generated at Sat Feb 10 03:27:49 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.