[LU-13195] replay-single test_118: dt_declare_record_write() ASSERTION( dt->do_body_ops ) failed

• Type: Bug
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.15.0, Lustre 2.12.10
• Affects Version/s: Lustre 2.14.0
• Severity: 3
• Assignee: Alex Zhuravlev
• Reporter: Maloo

Description

This issue was created by maloo for liuying <[e-mail]>

This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/ca28353a-46ca-11ea-91a9-52540065bddc

test_118 failed with the following error:

== replay-single test 118: invalidate osp update will not cause update log corruption ================ 17:21:23 (1580750483)
CMD: trevis-19vm4 lctl set_param fail_loc=0x1705

and the following stack trace on the console:

[10146.524712] LustreError: 19994:0:(dt_object.h:2191:dt_declare_record_write()) ASSERTION( dt->do_body_ops ) failed: 
[10146.525745] LustreError: 19994:0:(dt_object.h:2191:dt_declare_record_write()) LBUG
[10146.526542] Pid: 19994, comm: mdt_out00_000 3.10.0-957.27.2.el7_lustre.x86_64 #1 SMP Sat Jan 18 23:01:59 UTC 2020
[10146.527632] Call Trace:
[10146.527905]  [<ffffffffc0c348ac>] libcfs_call_trace+0x8c/0xc0 [libcfs]
[10146.528605]  [<ffffffffc0c3495c>] lbug_with_loc+0x4c/0xa0 [libcfs]
[10146.529291]  [<ffffffffc10f65eb>] out_write_add_exec+0x13b/0x1b0 [ptlrpc]
[10146.530275]  [<ffffffffc10eed43>] out_write+0x333/0x370 [ptlrpc]
[10146.530971]  [<ffffffffc10f1086>] out_handle+0x1566/0x1bb0 [ptlrpc]
[10146.531652]  [<ffffffffc10e7eca>] tgt_request_handle+0x95a/0x1610 [ptlrpc]
[10146.532417]  [<ffffffffc108b816>] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc]
[10146.533234]  [<ffffffffc108f8a4>] ptlrpc_main+0xbb4/0x1550 [ptlrpc]

This issue happened several times in Maloo testing but no more logs were collected.
https://testing.whamcloud.com/sub_tests/121c5288-447b-11ea-bffa-52540065bddc
https://testing.whamcloud.com/sub_tests/7cefb86c-4362-11ea-86b2-52540065bddc

VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV
replay-single test_118 - trevis-19vm4 crashed during replay-single test_118

Issue Links

• duplicates: LU-10143 LBUG dt_object.h:2166:dt_declare_record_write
• is duplicated by: LU-13295 replay-single test_118: ASSERTION( dt->do_body_ops ) failed
• is related to: LU-13469 MDS hung during mount
• is related to: LU-15139 sanity test_160h: dt_record_write() ASSERTION( dt->do_body_ops->dbo_write ) failed
• is related to: LU-13411 processing of update logs couldn't delete empty plain llogs
• is related to: LU-15849 replay-dual: test_26 hit dt_declare_record_write()) ASSERTION( dt->do_body_ops )