[LU-10936] racer test_1: osd_index.c:898:osd_declare_dir_insert()) ASSERTION( rec1->rec_type != 0 )

• Status: Open
• Project: Lustre
• Affects Version/s: Lustre 2.12.0
• Type: Bug
• Priority: Minor
• Reporter: Maloo
• Assignee: WC Triage
• Resolution: Unresolved
• Severity: 3

Description

This issue was created by maloo for Oleg Drokin <[e-mail]>

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/cc4ad8d6-4438-11e8-b45c-52540065bddc

MDT panicked with assertion failure:

[57671.903153] LustreError: 11116:0:(osd_index.c:898:osd_declare_dir_insert()) ASSERTION( rec1->rec_type != 0 ) failed: 
[57671.906577] LustreError: 11116:0:(osd_index.c:898:osd_declare_dir_insert()) LBUG
[57671.909496] Pid: 11116, comm: mdt_out00_002
[57671.912077] 
Call Trace:
[57671.916798]  [<ffffffffc0af07ae>] libcfs_call_trace+0x4e/0x60 [libcfs]
[57671.919518]  [<ffffffffc0af083c>] lbug_with_loc+0x4c/0xb0 [libcfs]
[57671.922162]  [<ffffffffc10d3fd7>] osd_declare_dir_insert+0x317/0x350 [osd_zfs]
[57671.924984]  [<ffffffff81063f5e>] ? kvm_clock_get_cycles+0x1e/0x20
[57671.927741]  [<ffffffffc0f010e7>] out_index_insert_add_exec+0xc7/0x200 [ptlrpc]
[57671.930508]  [<ffffffffc0ef965f>] out_index_insert+0x53f/0x5e0 [ptlrpc]
[57671.933195]  [<ffffffffc0efb376>] out_handle+0x1566/0x1bb0 [ptlrpc]
[57671.935799]  [<ffffffffc0e88ac2>] ? lustre_msg_get_opc+0x22/0xf0 [ptlrpc]
[57671.938351]  [<ffffffffc0eefae9>] ? tgt_request_preprocess.isra.29+0x299/0x7a0 [ptlrpc]
[57671.940996]  [<ffffffffc0ef294a>] tgt_request_handle+0x92a/0x13b0 [ptlrpc]
[57671.943542]  [<ffffffffc0e96a53>] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc]
[57671.946030]  [<ffffffff810bdc4b>] ? __wake_up_common+0x5b/0x90
[57671.948371]  [<ffffffffc0e9a202>] ptlrpc_main+0xa92/0x1f40 [ptlrpc]
[57671.950665]  [<ffffffffc0e99770>] ? ptlrpc_main+0x0/0x1f40 [ptlrpc]
[57671.952945]  [<ffffffff810b4031>] kthread+0xd1/0xe0
[57671.955061]  [<ffffffff810b3f60>] ? kthread+0x0/0xe0
[57671.957150]  [<ffffffff816c0577>] ret_from_fork+0x77/0xb0
[57671.959194]  [<ffffffff810b3f60>] ? kthread+0x0/0xe0

VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV
racer test_1 - Test crashed during racer test_1

Comments

[Oleg Drokin]

I am seeing this in my testing too now:

[ 3592.306353] LustreError: 14626:0:(mdd_object.c:405:mdd_xattr_get()) lustre-MDD0001: object [0x240000403:0x382:0x0] not found: rc = -2
[ 3617.289412] LustreError: 32542:0:(osd_index.c:898:osd_declare_dir_insert()) ASSERTION( rec1->rec_type != 0 ) failed: 
[ 3617.305582] LustreError: 32542:0:(osd_index.c:898:osd_declare_dir_insert()) LBUG
[ 3617.307110] Pid: 32542, comm: mdt_out04_000 3.10.0-7.5-debug #1 SMP Sun Jun 3 13:35:38 EDT 2018
[ 3617.308715] Call Trace:
[ 3617.309446]  [<ffffffffa07967dc>] libcfs_call_trace+0x8c/0xc0 [libcfs]
[ 3617.310368]  [<ffffffffa079688c>] lbug_with_loc+0x4c/0xa0 [libcfs]
[ 3617.311245]  [<ffffffffa0fcba67>] osd_declare_dir_insert+0x317/0x350 [osd_zfs]
[ 3617.313710]  [<ffffffffa0ba1594>] out_index_insert_add_exec+0xc4/0x1f0 [ptlrpc]
[ 3617.317191]  [<ffffffffa0b9be7f>] out_index_insert+0x53f/0x5e0 [ptlrpc]
[ 3617.318607]  [<ffffffffa0b9b302>] out_handle+0x1512/0x1b50 [ptlrpc]
[ 3617.319988]  [<ffffffffa0b94a25>] tgt_request_handle+0xaf5/0x1590 [ptlrpc]
[ 3617.321428]  [<ffffffffa0b38eb6>] ptlrpc_server_handle_request+0x256/0xad0 [ptlrpc]
[ 3617.323800]  [<ffffffffa0b3ccae>] ptlrpc_main+0xabe/0x1f80 [ptlrpc]
[ 3617.325307]  [<ffffffff810ae864>] kthread+0xe4/0xf0
[ 3617.326646]  [<ffffffff81783777>] ret_from_fork_nospec_end+0x0/0x39
[ 3617.327925]  [<ffffffffffffffff>] 0xffffffffffffffff

[Oleg Drokin]

Also seems to be happening in maloo: https://testing.whamcloud.com/test_sessions/6575a25b-3835-4eed-8b14-d520fb9809ab