[LU-10581] osd_handler.c:1978:osd_object_release()) LBUG Created: 30/Jan/18  Updated: 24/Sep/20

Status: Open
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.10.3
Fix Version/s: None

Type: Bug Priority: Minor
Reporter: Andriy Skulysh Assignee: Andriy Skulysh
Resolution: Unresolved Votes: 0
Labels: patch

Issue Links:
Duplicate
is duplicated by LU-8992 osd_object_release() LBUG Resolved
Related
is related to LU-11578 ldiskfs_map_blocks: comm mdt00_100: l... Resolved
is related to LU-13980 Kernel panic on OST after removing fi... Open
Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

[ 394.702625] LustreError: 13061:0:(osd_handler.c:1978:osd_object_release()) LBUG
[ 394.705323] Pid: 13061, comm: mdt00_012
[ 394.707464]
Call Trace:
[ 394.710658] [<ffffffffa02ee7ee>] libcfs_call_trace+0x4e/0x60 [libcfs]
[ 394.714030] [<ffffffffa02ee87c>] lbug_with_loc+0x4c/0xb0 [libcfs]
[ 394.717662] [<ffffffffa0bc3220>] osd_statfs+0x0/0x310 [osd_ldiskfs]
[ 394.720645] [<ffffffffa044f5ad>] lu_object_put+0x17d/0x3d0 [obdclass]
[ 394.720678] [<ffffffffa0da40a3>] mdt_reint_migrate_internal.isra.38+0x793/0x16e0 [mdt]
[ 394.720734] [<ffffffffa06427e1>] ? ldlm_cli_enqueue_local+0x271/0x860 [ptlrpc]
[ 394.720743] [<ffffffffa0da5255>] mdt_reint_rename_or_migrate.isra.39+0x265/0x860 [mdt]
[ 394.720768] [<ffffffffa0647300>] ? ldlm_blocking_ast+0x0/0x170 [ptlrpc]
[ 394.720791] [<ffffffffa06417d0>] ? ldlm_completion_ast+0x0/0x920 [ptlrpc]
[ 394.720800] [<ffffffffa0da5860>] mdt_reint_migrate+0x10/0x20 [mdt]
[ 394.720809] [<ffffffffa0da98b0>] mdt_reint_rec+0x80/0x210 [mdt]
[ 394.720816] [<ffffffffa0d8b2fb>] mdt_reint_internal+0x5fb/0x9c0 [mdt]
[ 394.720824] [<ffffffffa0d96e47>] mdt_reint+0x67/0x140 [mdt]
[ 394.720865] [<ffffffffa06db1e5>] tgt_request_handle+0x925/0x1370 [ptlrpc]
[ 394.720893] [<ffffffffa0683aa6>] ptlrpc_server_handle_request+0x236/0xa90 [ptlrpc]
[ 394.720899] [<ffffffff8163c15b>] ? _raw_spin_unlock_irqrestore+0x1b/0x40
[ 394.720926] [<ffffffffa0687a80>] ptlrpc_main+0xaa0/0x1de0 [ptlrpc]
[ 394.720929] [<ffffffff81013588>] ? __switch_to+0xf8/0x4b0
[ 394.720955] [<ffffffffa0686fe0>] ? ptlrpc_main+0x0/0x1de0 [ptlrpc]
[ 394.720958] [<ffffffff810a5b8f>] kthread+0xcf/0xe0
[ 394.720959] [<ffffffff810a5ac0>] ? kthread+0x0/0xe0
[ 394.720961] [<ffffffff81644f58>] ret_from_fork+0x58/0x90
[ 394.720963] [<ffffffff810a5ac0>] ? kthread+0x0/0xe0
[ 394.720964]
[ 394.720965] Kernel panic - not syncing: LBUG



 Comments   
Comment by Gerrit Updater [ 30/Jan/18 ]

Andriy Skulysh (c17819@cray.com) uploaded a new patch: https://review.whamcloud.com/31087
Subject: LU-10581 mdd: osd_object_release()) LBUG
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: bd6b01117f3bf79d5a589d1f177f746720caf51f

Comment by Saurabh Tandan (Inactive) [ 11/Apr/18 ]

Hit it on 2.10.3 build 96 forĀ 

SLES12 SP3 Server/Client ldiskfs DNE

MDS console:

[37344.279212] Lustre: DEBUG MARKER: == racer test 1: racer on clients: onyx-48vm5,onyx-48vm6 DURATION=900 ================================ 03:22:37 (1523355757)
[37399.395093] Lustre: lustre-MDT0002: Client 7252301d-8a7e-b311-b5c7-46a2468e261a (at 10.2.8.228@tcp) reconnecting
[37432.000323] Lustre: lustre-MDT0000: Client 7252301d-8a7e-b311-b5c7-46a2468e261a (at 10.2.8.228@tcp) reconnecting
[37446.987681] Lustre: lustre-MDT0000: Client 832ac1ec-3789-962c-9e5e-858870d7dbad (at 10.2.8.228@tcp) reconnecting
[37476.111103] Lustre: lustre-MDT0000: Client 7252301d-8a7e-b311-b5c7-46a2468e261a (at 10.2.8.228@tcp) reconnecting
[37481.835630] Lustre: lustre-MDT0002: Client 832ac1ec-3789-962c-9e5e-858870d7dbad (at 10.2.8.228@tcp) reconnecting
[37494.359226] Lustre: lustre-MDT0000: Client 832ac1ec-3789-962c-9e5e-858870d7dbad (at 10.2.8.228@tcp) reconnecting
[37516.513289] LustreError: 17814:0:(mdt_open.c:1167:mdt_cross_open()) lustre-MDT0000: [0x200000404:0x92c:0x0] doesn't exist!: rc = -14
[37526.390139] Lustre: lustre-MDT0002: Client 832ac1ec-3789-962c-9e5e-858870d7dbad (at 10.2.8.228@tcp) reconnecting
[37573.063885] LustreError: 17808:0:(osd_handler.c:1987:osd_object_release()) LBUG
[37573.065168] Pid: 17808, comm: mdt00_034
[37573.065955] 
[37573.065955] Call Trace:
[37573.066850] [<ffffffff81019b59>] dump_trace+0x59/0x340
[37573.067895] [<ffffffffa077c6ca>] libcfs_call_trace+0x4a/0x60 [libcfs]
[37573.069080] [<ffffffffa077c741>] lbug_with_loc+0x41/0xa0 [libcfs]
[37573.070405] [<ffffffffa0eaa1b4>] osd_object_release+0x54/0x60 [osd_ldiskfs]
[37573.071629] [<ffffffffa0a857c2>] lu_object_put+0x102/0x390 [obdclass]
[37573.072315] [<ffffffffa101729a>] mdt_reint_migrate_internal.isra.38+0x72a/0x1680 [mdt]
[37573.073392] [<ffffffffa10183f5>] mdt_reint_rename_or_migrate.isra.39+0x205/0x7d0 [mdt]
[37573.074230] [<ffffffffa101c791>] mdt_reint_rec+0x71/0x1e0 [mdt]
[37573.074865] [<ffffffffa0fff68b>] mdt_reint_internal+0x59b/0x960 [mdt]
[37573.075552] [<ffffffffa100aa41>] mdt_reint+0x61/0x120 [mdt]
[37573.076197] [<ffffffffa08a62da>] tgt_request_handle+0x8ca/0x12e0 [ptlrpc]
[37573.076937] [<ffffffffa0852da1>] ptlrpc_server_handle_request+0x241/0xa50 [ptlrpc]
[37573.077900] [<ffffffffa0856bb0>] ptlrpc_main+0xa40/0x1da0 [ptlrpc]
[37573.078555] [<ffffffff8109e879>] kthread+0xc9/0xe0
[37573.079061] [<ffffffff81618345>] ret_from_fork+0x55/0x80
[37573.082159] (null)DWARF2 unwinder stuck at ret_from_fork+0x55/0x80
[37573.082855] 
[37573.083024] (null)Leftover inexact backtrace:
[37573.083024] 
[37573.083628] [<ffffffff8109e7b0>] ? kthread+0x0/0xe0
[37573.084128] 
[37573.084306] Kernel panic - not syncing: LBUG
[37573.084754] CPU: 1 PID: 17808 Comm: mdt00_034 Tainted: G W OE N 4.4.120-94.17_lustre-default #1
[37573.085860] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
[37573.086443] 0000000000000000 ffffffff81329890 ffffffffa0798e91 ffff880059d27b18
[37573.087281] ffffffff811909a1 ffff880000000008 ffff880059d27b28 ffff880059d27ac8
[37573.088110] ffffffff811911c6 0000000000000246 0000000000000001 0000000000000006
[37573.089189] Call Trace:
[37573.089477] [<ffffffff81019b59>] dump_trace+0x59/0x340
[37573.090022] [<ffffffff81019f2a>] show_stack_log_lvl+0xea/0x170
[37573.090636] [<ffffffff8101acd1>] show_stack+0x21/0x40
[37573.091159] [<ffffffff81329890>] dump_stack+0x5c/0x7c
[37573.091695] [<ffffffff811909a1>] panic+0xd2/0x232
[37573.092189] [<ffffffffa077c759>] lbug_with_loc+0x59/0xa0 [libcfs]
[37573.092834] [<ffffffffa0eaa1b4>] osd_object_release+0x54/0x60 [osd_ldiskfs]
[37573.093721] [<ffffffffa0a857c2>] lu_object_put+0x102/0x390 [obdclass]
[37573.094407] [<ffffffffa101729a>] mdt_reint_migrate_internal.isra.38+0x72a/0x1680 [mdt]
[37573.095309] [<ffffffffa10183f5>] mdt_reint_rename_or_migrate.isra.39+0x205/0x7d0 [mdt]
[37573.096277] [<ffffffffa101c791>] mdt_reint_rec+0x71/0x1e0 [mdt]
[37573.096910] [<ffffffffa0fff68b>] mdt_reint_internal+0x59b/0x960 [mdt]
[37573.097721] [<ffffffffa100aa41>] mdt_reint+0x61/0x120 [mdt]
[37573.098391] [<ffffffffa08a62da>] tgt_request_handle+0x8ca/0x12e0 [ptlrpc]
[37573.099154] [<ffffffffa0852da1>] ptlrpc_server_handle_request+0x241/0xa50 [ptlrpc]
[37573.099975] [<ffffffffa0856bb0>] ptlrpc_main+0xa40/0x1da0 [ptlrpc]
[37573.100651] [<ffffffff8109e879>] kthread+0xc9/0xe0
[37573.101264] [<ffffffff81618345>] ret_from_fork+0x55/0x80
[37573.104156] DWARF2 unwinder stuck at ret_from_fork+0x55/0x80
[37573.104762] 
[37573.104937] Leftover inexact backtrace:
[37573.104937] 
[37573.105632] [<ffffffff8109e7b0>] ? kthread_park+0x50/0x50
[ 3.317569] RPC: Registered named UNIX socket transport module.

Comment by Oleg Drokin [ 03/Aug/18 ]

any plans to update this patch?

Generated at Sat Feb 10 02:36:22 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.