[LU-7298] replay-single test_70b: ASSERTION( dt->do_body_ops->dbo_write ) failed

• Type: Bug
• Resolution: Duplicate
• Priority: Major
• Affects Version/s: Lustre 2.8.0
• Severity: 3
• Assignee: WC Triage
• Reporter: Maloo

Description

This issue was created by maloo for John Hammond <[e-mail]>

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/1e89fd4a-6f78-11e5-a88f-5254006e85c2.

The sub-test test_70b failed with the following error:

test failed to respond and timed out

In this 70b failure MDT0 panicked:

09:32:39:Lustre: DEBUG MARKER: test_70b fail mds4 4 times
09:32:39:LustreError: 11-0: lustre-MDT0003-osp-MDT0000: operation obd_ping to node 10.1.4.179@tcp failed: rc = -107
09:32:39:Lustre: DEBUG MARKER: /usr/sbin/lctl mark mdc.lustre-MDT0003-mdc-*.mds_server_uuid in FULL state after 4 sec
09:32:39:Lustre: DEBUG MARKER: /usr/sbin/lctl mark mdc.lustre-MDT0003-mdc-*.mds_server_uuid in FULL state after 4 sec
09:32:39:Lustre: DEBUG MARKER: mdc.lustre-MDT0003-mdc-*.mds_server_uuid in FULL state after 4 sec
09:32:39:LustreError: 27041:0:(dt_object.c:512:dt_record_write()) ASSERTION( dt->do_body_ops->dbo_write ) failed: 
09:32:39:LustreError: 27041:0:(dt_object.c:512:dt_record_write()) LBUG
09:32:39:Pid: 27041, comm: mdt_out00_002
09:32:39:
09:32:39:Call Trace:
09:32:39: [<ffffffffa049b875>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
09:32:39: [<ffffffffa049be77>] lbug_with_loc+0x47/0xb0 [libcfs]
09:32:39: [<ffffffffa05f579f>] dt_record_write+0xbf/0x130 [obdclass]
09:32:39: [<ffffffffa08902ae>] out_tx_write_exec+0x7e/0x300 [ptlrpc]
09:32:39: [<ffffffffa0887dca>] out_tx_end+0xda/0x5d0 [ptlrpc]
09:32:39: [<ffffffffa088d896>] out_handle+0xbd6/0x1890 [ptlrpc]
09:32:39: [<ffffffffa07d44e0>] ? target_bulk_timeout+0x0/0xc0 [ptlrpc]
09:32:39: [<ffffffffa0884aac>] tgt_request_handle+0x8bc/0x12e0 [ptlrpc]
09:32:39: [<ffffffffa082c531>] ptlrpc_main+0xe41/0x1910 [ptlrpc]
09:32:39: [<ffffffffa082b6f0>] ? ptlrpc_main+0x0/0x1910 [ptlrpc]
09:32:39: [<ffffffff810a0fce>] kthread+0x9e/0xc0
09:32:39: [<ffffffff8100c28a>] child_rip+0xa/0x20
09:32:39: [<ffffffff810a0f30>] ? kthread+0x0/0xc0
09:32:39: [<ffffffff8100c280>] ? child_rip+0x0/0x20
09:32:39:

Info required for matching: replay-single 70b

Issue Links

• is related to: LU-6844 replay-single test 70b failure: 'rundbench load on * failed!'
• is related to: LU-7739 replay-single test 70b hangs with LBUG '(mgc_request.c:995:mgc_blocking_ast()) ASSERTION( atomic_read(&cld->cld_refcount) > 0 )'
• is related to: LU-10143 LBUG dt_object.h:2166:dt_declare_record_write