https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-6969 Lustre <p>Met this during local racer test on master.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>5[77465]: segfault at 8 ip 00000031f720b3f3 sp 00007fff8f7c3e50 error 4 in ld-2.12.so[31f7200000+20000] LustreError: 20700:0:(mdd_object.c:70:mdd_la_get()) lustre-MDD0000: object [0x200000404:0x4774:0x0] not found: rc = -2 LustreError: 20700:0:(mdd_object.c:70:mdd_la_get()) Skipped 1 previous similar message Lustre: 42406:0:(osd_internal.h:1087:osd_trans_exec_check()) op 9: used 10, used now 10, reserved 5 Lustre: 42406:0:(osd_handler.c:902:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 Lustre: 42406:0:(osd_handler.c:909:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 1/64/0 Lustre: 42406:0:(osd_handler.c:919:osd_trans_dump_creds()) write: 6/14/0, punch: 0/0/0, quota 4/4/0 Lustre: 42406:0:(osd_handler.c:926:osd_trans_dump_creds()) insert: 0/0/0, delete: 1/5/10 Lustre: 42406:0:(osd_handler.c:933:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 1/1/0 LustreError: 42406:0:(osd_internal.h:1090:osd_trans_exec_check()) LBUG Pid: 42406, comm: mdt_out00_004 Call Trace: [&lt;ffffffffa05b4875&gt;] libcfs_debug_dumpstack+0x55/0x80 [libcfs] [&lt;ffffffffa05b4e77&gt;] lbug_with_loc+0x47/0xb0 [libcfs] [&lt;ffffffffa0f30631&gt;] osd_index_ea_delete+0x7b1/0xe10 [osd_ldiskfs] [&lt;ffffffffa0999f90&gt;] out_obj_index_delete+0x150/0x370 [ptlrpc] [&lt;ffffffffa099a1d8&gt;] out_tx_index_delete_exec+0x28/0x190 [ptlrpc] [&lt;ffffffffa098e0ca&gt;] out_tx_end+0xda/0x5d0 [ptlrpc] [&lt;ffffffffa09931df&gt;] out_handle+0x7af/0x1950 [ptlrpc] [&lt;ffffffffa05c0c01&gt;] ? libcfs_debug_msg+0x41/0x50 [libcfs] [&lt;ffffffffa098afc2&gt;] tgt_request_handle+0xa42/0x1230 [ptlrpc] [&lt;ffffffffa09331a1&gt;] ptlrpc_main+0xe41/0x1920 [ptlrpc] [&lt;ffffffffa0932360&gt;] ? ptlrpc_main+0x0/0x1920 [ptlrpc] [&lt;ffffffff8109e66e&gt;] kthread+0x9e/0xc0 [&lt;ffffffff8100c20a&gt;] child_rip+0xa/0x20 [&lt;ffffffff8109e5d0&gt;] ? kthread+0x0/0xc0 [&lt;ffffffff8100c200&gt;] ? child_rip+0x0/0x20 LustreError: dumping log to /tmp/lustre-log.1438790617.42406 Message from syslogd@testnode at Aug 5 09:48:22 ... kernel:LustreError: 8393:0:(osd_internal.h:1090:osd_trans_exec_check()) LBUG </pre> </div></div> LU-6969

osd_internal.h:1090:osd_trans_exec_check()) LBUG for osd_index_ea_delete()

Bug Blocker Resolved Fixed Alex Zhuravlev Di Wang Fri, 7 Aug 2015 07:13:28 +0000 Fri, 13 May 2016 05:29:02 +0000 Thu, 1 Oct 2015 14:35:34 +0000 Lustre 2.8.0 Lustre 2.8.0 0 12 <p>Alex Zhuravlev (alexey.zhuravlev@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/15924" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/15924</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6969" title="osd_internal.h:1090:osd_trans_exec_check()) LBUG for osd_index_ea_delete()" class="issue-link" data-issue-key="LU-6969"><del>LU-6969</del></a> osd: remove agent inodes in a separate transaction<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 16e897bb4dce91ffac63ce9e0b7fbbdf53796fa4</p> <p>Looking at the call trace seems we also hit this issue while running test: sanity test 51e in osd_xattr_set() path. </p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>LustreError: 122338:0:(osd_internal.h:1090:osd_trans_exec_check()) LBUG Lustre: 122338:0:(osd_handler.c:933:osd_trans_dump_creds()) ref_add: 1/1/1, ref_del: 0/0/0 Pid: 122338, comm: mdt01_006" Call Trace: [&lt;ffffffffa0521875&gt;] libcfs_debug_dumpstack+0x55/0x80 [libcfs] [&lt;ffffffffa0521e77&gt;] lbug_with_loc+0x47/0xb0 [libcfs] [&lt;ffffffffa10628c8&gt;] osd_xattr_set+0x5d8/0x6c0 [osd_ldiskfs] [&lt;ffffffffa111c683&gt;] lod_sub_object_xattr_set+0x223/0x460 [lod] [&lt;ffffffffa101268b&gt;] ? ldiskfs_xattr_inode_get+0xdb/0xf0 [ldiskfs] [&lt;ffffffffa11088b6&gt;] lod_xattr_set_internal+0x126/0x2b0 [lod] [&lt;ffffffffa11143b6&gt;] lod_xattr_set+0x156/0x3e0 [lod] [&lt;ffffffffa101531b&gt;] ? ldiskfs_xattr_trusted_get+0x2b/0x30 [ldiskfs] [&lt;ffffffffa0e9bd8b&gt;] dt_xattr_set.clone.2+0x9b/0x1b0 [mdd] [&lt;ffffffffa0e9c78d&gt;] mdd_links_write+0x12d/0x1f0 [mdd] [&lt;ffffffffa0ea2d72&gt;] mdd_links_rename+0x302/0x540 [mdd] [&lt;ffffffffa0eaa736&gt;] mdd_link+0xff6/0x1170 [mdd] [&lt;ffffffffa0f23c61&gt;] mdt_reint_link+0x9b1/0xb40 [mdt] [&lt;ffffffffa0f1b6ac&gt;] ? mdt_root_squash+0x2c/0x3f0 [mdt] [&lt;ffffffffa0904882&gt;] ? __req_capsule_get+0x162/0x6e0 [ptlrpc] [&lt;ffffffffa0f1f86d&gt;] mdt_reint_rec+0x5d/0x200 [mdt] [&lt;ffffffffa0f0b78b&gt;] mdt_reint_internal+0x62b/0xb80 [mdt] [&lt;ffffffffa0946792&gt;] tgt_request_handle+0xa42/0x1230 [ptlrpc] [&lt;ffffffffa08ee3a1&gt;] ptlrpc_main+0xe41/0x1920 [ptlrpc] [&lt;ffffffffa08ed560&gt;] ? ptlrpc_main+0x0/0x1920 [ptlrpc] [&lt;ffffffff8109ac66&gt;] kthread+0x96/0xa0 [&lt;ffffffff8100c20a&gt;] child_rip+0xa/0x20 [&lt;ffffffff8109abd0&gt;] ? kthread+0x0/0xa0 [&lt;ffffffff8100c200&gt;] ? child_rip+0x0/0x20 </pre> </div></div> <p>hit this issue on master branch sanity test_17n</p> <p><a href="https://testing.hpdd.intel.com/test_sets/d44ca36c-54ed-11e5-9cd2-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/d44ca36c-54ed-11e5-9cd2-5254006e85c2</a></p> <p>client and server: lustre-master build# 3175 RHEL7 DNE</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>15:47:04:[ 1734.620293] Lustre: lustre-MDT0001: Recovery over after 0:04, of 5 clients 5 recovered and 0 were evicted. 15:47:04:[ 1734.797772] Lustre: 5127:0:(osd_internal.h:1087:osd_trans_exec_check()) op 9: used 8, used now 8, reserved 5 15:47:04:[ 1734.798682] Lustre: 5127:0:(osd_handler.c:902:osd_trans_dump_creds()) create: 1/8/0, destroy: 0/0/0 15:47:04:[ 1734.799491] Lustre: 5127:0:(osd_handler.c:909:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 0/0/0 15:47:04:[ 1734.800321] Lustre: 5127:0:(osd_handler.c:919:osd_trans_dump_creds()) write: 8/36/0, punch: 0/0/0, quota 2/2/0 15:47:04:[ 1734.801212] Lustre: 5127:0:(osd_handler.c:926:osd_trans_dump_creds()) insert: 2/53/0, delete: 1/5/8 15:47:04:[ 1734.802011] Lustre: 5127:0:(osd_handler.c:933:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 1/1/0 15:47:04:[ 1734.802807] LustreError: 5127:0:(osd_internal.h:1090:osd_trans_exec_check()) LBUG 15:47:04:[ 1734.803540] Pid: 5127, comm: mdt_out00_003 15:47:04:[ 1734.803938] 15:47:04:[ 1734.803938] Call Trace: 15:47:04:[ 1734.804394] [&lt;ffffffffa06197d3&gt;] libcfs_debug_dumpstack+0x53/0x80 [libcfs] 15:47:04:[ 1734.805110] [&lt;ffffffffa0619d75&gt;] lbug_with_loc+0x45/0xc0 [libcfs] 15:47:06:[ 1734.805766] [&lt;ffffffffa0c0088e&gt;] osd_it_ea_rec.part.94+0x0/0x36 [osd_ldiskfs] 15:47:06:[ 1734.806516] [&lt;ffffffffa0bd47d7&gt;] osd_index_ea_delete+0x6d7/0xad0 [osd_ldiskfs] 15:47:06:[ 1734.807250] [&lt;ffffffff811abe7e&gt;] ? kmem_cache_alloc_trace+0x1ce/0x1f0 15:47:06:[ 1734.808058] [&lt;ffffffffa0a25d71&gt;] out_obj_index_delete+0x111/0x2f0 [ptlrpc] 15:47:06:[ 1734.808864] [&lt;ffffffffa0759d73&gt;] ? lu_context_init+0xd3/0x1f0 [obdclass] 15:47:06:[ 1734.809583] [&lt;ffffffffa0a25f95&gt;] out_tx_index_delete_exec+0x25/0x180 [ptlrpc] 15:47:06:[ 1734.810395] [&lt;ffffffffa0a2074e&gt;] out_tx_end+0xde/0x5e0 [ptlrpc] 15:47:06:[ 1734.811057] [&lt;ffffffffa0a243c7&gt;] out_handle+0xe77/0x18d0 [ptlrpc] 15:47:06:[ 1734.811691] [&lt;ffffffffa096f8f0&gt;] ? target_bulk_timeout+0x0/0xb0 [ptlrpc] 15:47:06:[ 1734.812429] [&lt;ffffffffa0a1a479&gt;] tgt_request_handle+0x719/0x1170 [ptlrpc] 15:47:06:[ 1734.813182] [&lt;ffffffffa09c2d5b&gt;] ptlrpc_server_handle_request+0x21b/0xa90 [ptlrpc] 15:47:06:[ 1734.813883] [&lt;ffffffffa09c0b68&gt;] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] 15:47:06:[ 1734.814498] [&lt;ffffffff810a9662&gt;] ? default_wake_function+0x12/0x20 15:47:06:[ 1734.815046] [&lt;ffffffff810a0898&gt;] ? __wake_up_common+0x58/0x90 15:47:06:[ 1734.815596] [&lt;ffffffffa09c6500&gt;] ptlrpc_main+0xb70/0x1e90 [ptlrpc] 15:47:07:[ 1734.816154] [&lt;ffffffff810ad8b6&gt;] ? __dequeue_entity+0x26/0x40 15:47:07:[ 1734.816687] [&lt;ffffffffa09c5990&gt;] ? ptlrpc_main+0x0/0x1e90 [ptlrpc] 15:47:07:[ 1734.817244] [&lt;ffffffff8109739f&gt;] kthread+0xcf/0xe0 15:47:07:[ 1734.817661] [&lt;ffffffff810972d0&gt;] ? kthread+0x0/0xe0 15:47:07:[ 1734.818124] [&lt;ffffffff81615018&gt;] ret_from_fork+0x58/0x90 15:47:07:[ 1734.818586] [&lt;ffffffff810972d0&gt;] ? kthread+0x0/0xe0 15:47:07:[ 1734.819039] 15:47:07:[ 1734.822140] Kernel panic - not syncing: LBUG 15:47:07:[ 1734.822532] CPU: 0 PID: 5127 Comm: mdt_out00_003 Tainted: GF O-------------- 3.10.0-229.7.2.el7_lustre.gea2bb60.x86_64 #1 15:47:07:[ 1734.823024] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007 15:47:07:[ 1734.823024] ffffffffa0636ecf 00000000fbb88fcf ffff8800643c79c0 ffffffff816051aa 15:47:07:[ 1734.823024] ffff8800643c7a40 ffffffff815fea1e ffffffff00000008 ffff8800643c7a50 15:47:07:[ 1734.823024] ffff8800643c79f0 00000000fbb88fcf ffffffffa0c027d0 0000000000000246 15:47:07:[ 1734.823024] Call Trace: 15:47:07:[ 1734.823024] [&lt;ffffffff816051aa&gt;] dump_stack+0x19/0x1b 15:47:07:[ 1734.823024] [&lt;ffffffff815fea1e&gt;] panic+0xd8/0x1e7 15:47:07:[ 1734.823024] [&lt;ffffffffa0619ddb&gt;] lbug_with_loc+0xab/0xc0 [libcfs] 15:47:07:[ 1734.823024] [&lt;ffffffffa0c0088e&gt;] osd_trans_exec_check.part.91+0x1a/0x1a [osd_ldiskfs] 15:47:07:[ 1734.823024] [&lt;ffffffffa0bd47d7&gt;] osd_index_ea_delete+0x6d7/0xad0 [osd_ldiskfs] 15:47:07:[ 1734.823024] [&lt;ffffffff811abe7e&gt;] ? kmem_cache_alloc_trace+0x1ce/0x1f0 15:47:07:[ 1734.823024] [&lt;ffffffffa0a25d71&gt;] out_obj_index_delete+0x111/0x2f0 [ptlrpc] 15:47:07:[ 1734.823024] [&lt;ffffffffa0759d73&gt;] ? lu_context_init+0xd3/0x1f0 [obdclass] 15:47:07:[ 1734.823024] [&lt;ffffffffa0a25f95&gt;] out_tx_index_delete_exec+0x25/0x180 [ptlrpc] 15:47:07:[ 1734.823024] [&lt;ffffffffa0a2074e&gt;] out_tx_end+0xde/0x5e0 [ptlrpc] 15:47:07:[ 1734.823024] [&lt;ffffffffa0a243c7&gt;] out_handle+0xe77/0x18d0 [ptlrpc] 15:47:07:[ 1734.823024] [&lt;ffffffffa096f8f0&gt;] ? target_send_reply_msg+0x170/0x170 [ptlrpc] 15:47:07:[ 1734.823024] [&lt;ffffffffa0a1a479&gt;] tgt_request_handle+0x719/0x1170 [ptlrpc] 15:47:07:[ 1734.823024] [&lt;ffffffffa09c2d5b&gt;] ptlrpc_server_handle_request+0x21b/0xa90 [ptlrpc] 15:47:07:[ 1734.823024] [&lt;ffffffffa09c0b68&gt;] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] 15:47:07:[ 1734.823024] [&lt;ffffffff810a9662&gt;] ? default_wake_function+0x12/0x20 15:47:07:[ 1734.823024] [&lt;ffffffff810a0898&gt;] ? __wake_up_common+0x58/0x90 15:47:07:[ 1734.823024] [&lt;ffffffffa09c6500&gt;] ptlrpc_main+0xb70/0x1e90 [ptlrpc] 15:47:07:[ 1734.823024] [&lt;ffffffff810ad8b6&gt;] ? __dequeue_entity+0x26/0x40 15:47:07:[ 1734.823024] [&lt;ffffffffa09c5990&gt;] ? ptlrpc_register_service+0xfc0/0xfc0 [ptlrpc] 15:47:07:[ 1734.823024] [&lt;ffffffff8109739f&gt;] kthread+0xcf/0xe0 15:47:07:[ 1734.823024] [&lt;ffffffff810972d0&gt;] ? kthread_create_on_node+0x140/0x140 15:47:07:[ 1734.823024] [&lt;ffffffff81615018&gt;] ret_from_fork+0x58/0x90 15:47:07:[ 1734.823024] [&lt;ffffffff810972d0&gt;] ? kthread_create_on_node+0x140/0x140 15:47:07:[ 1734.823024] drm_kms_helper: panic occurred, switching back to text console 15:47:07:[ 1734.823024] ------------[ cut here ]------------ 15:47:07:[ 1734.823024] kernel BUG at arch/x86/mm/pageattr.c:216! 15:47:07:[ 1734.823024] invalid opcode: 0000 [#1] SMP 15:47:07:[ 1734.823024] Modules linked in: osp(OF) mdd(OF) lod(OF) mdt(OF) lfsck(OF) mgc(OF) osd_ldiskfs(OF) lquota(OF) fid(OF) fld(OF) ksocklnd(OF) ptlrpc(OF) obdclass(OF) lnet(OF) sha512_generic libcfs(OF) ldiskfs(OF) dm_mod nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd fscache xprtrdma sunrpc ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr ppdev pcspkr virtio_balloon serio_raw i2c_piix4 parport_pc parport ext4 mbcache jbd2 ata_generic pata_acpi 8139too virtio_blk cirrus syscopyarea sysfillrect sysimgblt drm_kms_helper 8139cp ttm ata_piix mii virtio_pci drm virtio_ring virtio i2c_core libata floppy 15:47:07:[ 1734.823024] CPU: 0 PID: 5127 Comm: mdt_out00_003 Tainted: GF O-------------- 3.10.0-229.7.2.el7_lustre.gea2bb60.x86_64 #1 15:47:07:[ 1734.823024] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007 15:47:07:[ 1734.823024] task: ffff8800642fc440 ti: ffff8800643c4000 task.ti: ffff8800643c4000 15:47:07:[ 1734.823024] RIP: 0010:[&lt;ffffffff8105c2ef&gt;] [&lt;ffffffff8105c2ef&gt;] change_page_attr_set_clr+0x4ef/0x500 15:47:08:[ 1734.823024] RSP: 0018:ffff8800643c71c0 EFLAGS: 00010046 15:47:08:[ 1734.823024] RAX: 0000000000000046 RBX: 0000000000000000 RCX: 0000000000000010 15:47:08:[ 1734.823024] RDX: 0000000000002000 RSI: 0000000000000000 RDI: 0000000080000000 15:47:08:[ 1734.823024] RBP: ffff8800643c7258 R08: 0000000000000004 R09: 000000000006adf7 15:47:08:[ 1734.823024] R10: 0000000000003689 R11: 0000000000000002 R12: 0000000000000010 15:47:08:[ 1734.823024] R13: 0000000000000000 R14: 0000000000000200 R15: 0000000000000005 15:47:08:[ 1734.823024] FS: 0000000000000000(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000 15:47:08:[ 1734.823024] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 15:47:08:[ 1734.823024] CR2: 00007f8a24fe8220 CR3: 000000000190e000 CR4: 00000000000006f0 15:47:08:[ 1734.823024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 15:47:08:[ 1734.823024] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 15:47:08:[ 1734.823024] Stack: 15:47:08:[ 1734.823024] 00000004a0a8a89c ffff880000000000 0000000000000000 ffff88006b751000 15:47:08:[ 1734.823024] ffff8800642fc440 0000000000000000 0000000000000000 0000000000000010 15:47:08:[ 1734.823024] 0000000000000000 0000000500000001 000000000006adf7 0000020000000000 15:47:08:[ 1734.823024] Call Trace: 15:47:08:[ 1734.823024] [&lt;ffffffff8105c646&gt;] _set_pages_array+0xe6/0x130 15:47:08:[ 1734.823024] [&lt;ffffffff8105c6c3&gt;] set_pages_array_wc+0x13/0x20 15:47:08:[ 1734.823024] [&lt;ffffffffa00dd3af&gt;] ttm_set_pages_caching+0x2f/0x70 [ttm] 15:47:08:[ 1734.823024] [&lt;ffffffffa00dd4f4&gt;] ttm_alloc_new_pages.isra.7+0xb4/0x180 [ttm] 15:47:08:[ 1734.823024] [&lt;ffffffffa00dde50&gt;] ttm_pool_populate+0x3e0/0x500 [ttm] 15:47:08:[ 1734.823024] [&lt;ffffffffa012332e&gt;] cirrus_ttm_tt_populate+0xe/0x10 [cirrus] 15:47:08:[ 1734.823024] [&lt;ffffffffa00da6dd&gt;] ttm_bo_move_memcpy+0x65d/0x6e0 [ttm] 15:47:08:[ 1734.823024] [&lt;ffffffff8118f73e&gt;] ? map_vm_area+0x2e/0x40 15:47:08:[ 1734.823024] [&lt;ffffffffa00d62c9&gt;] ? ttm_tt_init+0x69/0xb0 [ttm] 15:47:08:[ 1734.823024] [&lt;ffffffffa01232d8&gt;] cirrus_bo_move+0x18/0x20 [cirrus] 15:47:08:[ 1734.823024] [&lt;ffffffffa00d7de5&gt;] ttm_bo_handle_move_mem+0x265/0x5b0 [ttm] 15:47:08:[ 1734.823024] [&lt;ffffffff81601a64&gt;] ? __slab_free+0x10e/0x277 15:47:08:[ 1734.823024] [&lt;ffffffff8118ef33&gt;] ? __free_vmap_area+0xb3/0xf0 15:47:08:[ 1734.823024] [&lt;ffffffffa00d874a&gt;] ? ttm_bo_mem_space+0x10a/0x310 [ttm] 15:47:08:[ 1734.823024] [&lt;ffffffffa00d8e17&gt;] ttm_bo_validate+0x247/0x260 [ttm] 15:47:08:[ 1734.823024] [&lt;ffffffff81059e69&gt;] ? iounmap+0x79/0xa0 15:47:08:[ 1734.823024] [&lt;ffffffff81050000&gt;] ? kgdb_arch_late+0x80/0x180 15:47:08:[ 1734.823024] [&lt;ffffffffa0123ac2&gt;] cirrus_bo_push_sysram+0x82/0xe0 [cirrus] 15:47:08:[ 1734.823024] [&lt;ffffffffa0121c84&gt;] cirrus_crtc_do_set_base.isra.8.constprop.10+0x84/0x430 [cirrus] 15:47:08:[ 1734.823024] [&lt;ffffffffa0122479&gt;] cirrus_crtc_mode_set+0x449/0x4d0 [cirrus] 15:47:08:[ 1734.823024] [&lt;ffffffffa0103939&gt;] drm_crtc_helper_set_mode+0x2e9/0x520 [drm_kms_helper] 15:47:08:[ 1734.823024] [&lt;ffffffffa01046bf&gt;] drm_crtc_helper_set_config+0x87f/0xaa0 [drm_kms_helper] 15:47:08:[ 1734.823024] [&lt;ffffffffa0096711&gt;] drm_mode_set_config_internal+0x61/0xe0 [drm] 15:47:08:[ 1734.823024] [&lt;ffffffffa010be83&gt;] restore_fbdev_mode+0xb3/0xe0 [drm_kms_helper] 15:47:08:[ 1734.823024] [&lt;ffffffffa010c045&gt;] drm_fb_helper_force_kernel_mode+0x75/0xb0 [drm_kms_helper] 15:47:08:[ 1734.823024] [&lt;ffffffffa010cd59&gt;] drm_fb_helper_panic+0x29/0x30 [drm_kms_helper] 15:47:08:[ 1734.823024] [&lt;ffffffff81610a6c&gt;] notifier_call_chain+0x4c/0x70 15:47:08:[ 1734.823024] [&lt;ffffffff81610aca&gt;] atomic_notifier_call_chain+0x1a/0x20 15:47:08:[ 1734.823024] [&lt;ffffffff815fea4c&gt;] panic+0x106/0x1e7 15:47:08:[ 1734.823024] [&lt;ffffffffa0619ddb&gt;] lbug_with_loc+0xab/0xc0 [libcfs] 15:47:08:[ 1734.823024] [&lt;ffffffffa0c0088e&gt;] osd_trans_exec_check.part.91+0x1a/0x1a [osd_ldiskfs] 15:47:08:[ 1734.823024] [&lt;ffffffffa0bd47d7&gt;] osd_index_ea_delete+0x6d7/0xad0 [osd_ldiskfs] 15:47:08:[ 1734.823024] [&lt;ffffffff811abe7e&gt;] ? kmem_cache_alloc_trace+0x1ce/0x1f0 15:47:08:[ 1734.823024] [&lt;ffffffffa0a25d71&gt;] out_obj_index_delete+0x111/0x2f0 [ptlrpc] 16:46:00:********** Timeout by autotest system ********** </pre> </div></div> <p>another instance on master:</p> <p>replay-dual: <a href="https://testing.hpdd.intel.com/test_sets/ce9cc5be-54ed-11e5-9cd2-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/ce9cc5be-54ed-11e5-9cd2-5254006e85c2</a><br/> sanity-quota: <a href="https://testing.hpdd.intel.com/test_sets/cfae1cb4-54ed-11e5-9cd2-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/cfae1cb4-54ed-11e5-9cd2-5254006e85c2</a><br/> racer: <a href="https://testing.hpdd.intel.com/test_sets/ccb8516e-54ed-11e5-9cd2-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/ccb8516e-54ed-11e5-9cd2-5254006e85c2</a></p> <p>I think several recent failures of el7 client/server on master that had been classified as <a href="https://jira.whamcloud.com/browse/LU-5500" title="sanity test_17n: test failed to respond and timed out" class="issue-link" data-issue-key="LU-5500"><del>LU-5500</del></a> are in fact more instances of this bug. one example is <a href="https://testing.hpdd.intel.com/test_sets/2da949ac-5213-11e5-aed3-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/2da949ac-5213-11e5-aed3-5254006e85c2</a></p> <p>another seen in el7 client/server on master:<br/> <a href="https://testing.hpdd.intel.com/test_sets/4f0cbd82-5d6b-11e5-80c4-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/4f0cbd82-5d6b-11e5-80c4-5254006e85c2</a></p> <p>from console log of mds:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>14:33:34:[ 7016.394189] LustreError: 4685:0:(osd_internal.h:1090:osd_trans_exec_check()) LBUG 14:33:34:[ 7016.394773] Pid: 4685, comm: mdt_out00_001 14:33:34:[ 7016.395093] 14:33:34:[ 7016.395093] Call Trace: 14:33:34:[ 7016.395500] [&lt;ffffffffa062a7d3&gt;] libcfs_debug_dumpstack+0x53/0x80 [libcfs] 14:33:34:[ 7016.396023] [&lt;ffffffffa062ad75&gt;] lbug_with_loc+0x45/0xc0 [libcfs] 14:33:34:[ 7016.396542] [&lt;ffffffffa0c08a5e&gt;] osd_it_ea_rec.part.94+0x0/0x36 [osd_ldiskfs] 14:33:34:[ 7016.397083] [&lt;ffffffffa0bdc857&gt;] osd_index_ea_delete+0x6d7/0xad0 [osd_ldiskfs] 14:33:34:[ 7016.397664] [&lt;ffffffff811ac1be&gt;] ? kmem_cache_alloc_trace+0x1ce/0x1f0 14:33:34:[ 7016.398235] [&lt;ffffffffa0a30fb1&gt;] out_obj_index_delete+0x111/0x2f0 [ptlrpc] 14:33:34:[ 7016.398805] [&lt;ffffffffa076ae83&gt;] ? lu_context_init+0xd3/0x1f0 [obdclass] 14:33:34:[ 7016.399351] [&lt;ffffffffa0a311d5&gt;] out_tx_index_delete_exec+0x25/0x180 [ptlrpc] 14:33:34:[ 7016.399985] [&lt;ffffffffa0a2b98e&gt;] out_tx_end+0xde/0x5e0 [ptlrpc] 14:33:34:[ 7016.400493] [&lt;ffffffffa0a2f607&gt;] out_handle+0xe77/0x18d0 [ptlrpc] 14:33:34:[ 7016.401083] [&lt;ffffffffa097aaa0&gt;] ? target_bulk_timeout+0x0/0xb0 [ptlrpc] 14:33:34:[ 7016.401606] [&lt;ffffffffa0a25723&gt;] tgt_request_handle+0x7f3/0x1190 [ptlrpc] 14:33:34:[ 7016.402134] [&lt;ffffffffa09cdf5b&gt;] ptlrpc_server_handle_request+0x21b/0xa90 [ptlrpc] 14:33:34:[ 7016.402763] [&lt;ffffffffa09cbd68&gt;] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] 14:33:34:[ 7016.403269] [&lt;ffffffff810a9672&gt;] ? default_wake_function+0x12/0x20 14:33:34:[ 7016.403758] [&lt;ffffffff810a08a8&gt;] ? __wake_up_common+0x58/0x90 14:33:34:[ 7016.404214] [&lt;ffffffffa09d1700&gt;] ptlrpc_main+0xb70/0x1e90 [ptlrpc] 14:33:34:[ 7016.404700] [&lt;ffffffff810ad906&gt;] ? __dequeue_entity+0x26/0x40 14:33:34:[ 7016.405131] [&lt;ffffffff810125f6&gt;] ? __switch_to+0x136/0x4a0 14:33:34:[ 7016.405583] [&lt;ffffffffa09d0b90&gt;] ? ptlrpc_main+0x0/0x1e90 [ptlrpc] 14:33:34:[ 7016.406057] [&lt;ffffffff810973af&gt;] kthread+0xcf/0xe0 14:33:34:[ 7016.406460] [&lt;ffffffff810972e0&gt;] ? kthread+0x0/0xe0 14:33:34:[ 7016.406813] [&lt;ffffffff81615198&gt;] ret_from_fork+0x58/0x90 14:33:34:[ 7016.407216] [&lt;ffffffff810972e0&gt;] ? kthread+0x0/0xe0 14:33:34:[ 7016.407627] 14:33:34:[ 7016.407840] Kernel panic - not syncing: LBUG 14:33:34:[ 7016.408176] CPU: 1 PID: 4685 Comm: mdt_out00_001 Tainted: GF O-------------- 3.10.0-229.14.1.el7_lustre.g630ab85.x86_64 #1 14:33:34:[ 7016.408827] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007 14:33:34:[ 7016.408827] ffffffffa0647ecf 0000000001e4f211 ffff88007b4039c0 ffffffff8160533a 14:33:34:[ 7016.408827] ffff88007b403a40 ffffffff815febae ffffffff00000008 ffff88007b403a50 14:33:34:[ 7016.408827] ffff88007b4039f0 0000000001e4f211 ffffffffa0c0a7d0 0000000000000246 14:33:34:[ 7016.408827] Call Trace: 14:33:34:[ 7016.408827] [&lt;ffffffff8160533a&gt;] dump_stack+0x19/0x1b 14:33:34:[ 7016.408827] [&lt;ffffffff815febae&gt;] panic+0xd8/0x1e7 14:33:34:[ 7016.408827] [&lt;ffffffffa062addb&gt;] lbug_with_loc+0xab/0xc0 [libcfs] 14:33:34:[ 7016.408827] [&lt;ffffffffa0c08a5e&gt;] osd_trans_exec_check.part.91+0x1a/0x1a [osd_ldiskfs] 14:33:34:[ 7016.408827] [&lt;ffffffffa0bdc857&gt;] osd_index_ea_delete+0x6d7/0xad0 [osd_ldiskfs] 14:33:34:[ 7016.408827] [&lt;ffffffff811ac1be&gt;] ? kmem_cache_alloc_trace+0x1ce/0x1f0 14:33:34:[ 7016.408827] [&lt;ffffffffa0a30fb1&gt;] out_obj_index_delete+0x111/0x2f0 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffffa076ae83&gt;] ? lu_context_init+0xd3/0x1f0 [obdclass] 14:33:34:[ 7016.408827] [&lt;ffffffffa0a311d5&gt;] out_tx_index_delete_exec+0x25/0x180 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffffa0a2b98e&gt;] out_tx_end+0xde/0x5e0 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffffa0a2f607&gt;] out_handle+0xe77/0x18d0 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffffa097aaa0&gt;] ? target_send_reply_msg+0x170/0x170 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffffa0a25723&gt;] tgt_request_handle+0x7f3/0x1190 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffffa09cdf5b&gt;] ptlrpc_server_handle_request+0x21b/0xa90 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffffa09cbd68&gt;] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffff810a9672&gt;] ? default_wake_function+0x12/0x20 14:33:34:[ 7016.408827] [&lt;ffffffff810a08a8&gt;] ? __wake_up_common+0x58/0x90 14:33:34:[ 7016.408827] [&lt;ffffffffa09d1700&gt;] ptlrpc_main+0xb70/0x1e90 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffff810ad906&gt;] ? __dequeue_entity+0x26/0x40 14:33:34:[ 7016.408827] [&lt;ffffffff810125f6&gt;] ? __switch_to+0x136/0x4a0 14:33:34:[ 7016.408827] [&lt;ffffffffa09d0b90&gt;] ? ptlrpc_register_service+0xfc0/0xfc0 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffff810973af&gt;] kthread+0xcf/0xe0 14:33:34:[ 7016.408827] [&lt;ffffffff810972e0&gt;] ? kthread_create_on_node+0x140/0x140 14:33:34:[ 7016.408827] [&lt;ffffffff81615198&gt;] ret_from_fork+0x58/0x90 14:33:34:[ 7016.408827] [&lt;ffffffff810972e0&gt;] ? kthread_create_on_node+0x140/0x140 14:33:34:[ 7016.408827] drm_kms_helper: panic occurred, switching back to text console 14:33:34:[ 7016.408827] ------------[ cut here ]------------ 14:33:34:[ 7016.408827] kernel BUG at arch/x86/mm/pageattr.c:216! 14:33:34:[ 7016.408827] invalid opcode: 0000 [#1] SMP 14:33:34:[ 7016.408827] Modules linked in: osp(OF) mdd(OF) lod(OF) mdt(OF) lfsck(OF) mgs(OF) mgc(OF) osd_ldiskfs(OF) lquota(OF) fid(OF) fld(OF) ksocklnd(OF) ptlrpc(OF) obdclass(OF) lnet(OF) sha512_generic libcfs(OF) ldiskfs(OF) dm_mod nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd fscache xprtrdma sunrpc ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ppdev ib_sa serio_raw pcspkr virtio_balloon i2c_piix4 ib_mad parport_pc parport ib_core ib_addr ext4 mbcache jbd2 ata_generic pata_acpi 8139too virtio_blk cirrus syscopyarea sysfillrect sysimgblt virtio_pci virtio_ring virtio drm_kms_helper 8139cp mii ata_piix ttm drm i2c_core libata floppy 14:33:34:[ 7016.408827] CPU: 1 PID: 4685 Comm: mdt_out00_001 Tainted: GF O-------------- 3.10.0-229.14.1.el7_lustre.g630ab85.x86_64 #1 14:33:34:[ 7016.408827] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007 14:33:34:[ 7016.408827] task: ffff8800697e71c0 ti: ffff88007b400000 task.ti: ffff88007b400000 14:33:34:[ 7016.408827] RIP: 0010:[&lt;ffffffff8105c2ef&gt;] [&lt;ffffffff8105c2ef&gt;] change_page_attr_set_clr+0x4ef/0x500 14:33:34:[ 7016.408827] RSP: 0018:ffff88007b4031c0 EFLAGS: 00010046 14:33:34:[ 7016.408827] RAX: 0000000000000046 RBX: 0000000000000000 RCX: 0000000000000010 14:33:34:[ 7016.408827] RDX: 0000000000002000 RSI: 0000000000000000 RDI: 0000000080000000 14:33:34:[ 7016.408827] RBP: ffff88007b403258 R08: 0000000000000004 R09: 000000000006d4cb 14:33:34:[ 7016.408827] R10: 0000000000003689 R11: ffffffff811902af R12: 0000000000000010 14:33:34:[ 7016.408827] R13: 0000000000000000 R14: 0000000000000200 R15: 0000000000000005 14:33:34:[ 7016.408827] FS: 0000000000000000(0000) GS:ffff88007fd00000(0000) knlGS:0000000000000000 14:33:34:[ 7016.408827] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 14:33:34:[ 7016.408827] CR2: 00007f79ce24d018 CR3: 000000000190e000 CR4: 00000000000006e0 14:33:34:[ 7016.408827] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 14:33:34:[ 7016.408827] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 14:33:34:[ 7016.408827] Stack: 14:33:34:[ 7016.408827] 000000045a5a5a5a 0000000000000000 0000000000000000 ffff88006df2b000 14:33:34:[ 7016.408827] ffff8800697e71c0 0000000000000000 0000000000000000 0000000000000010 14:33:34:[ 7016.408827] 0000000000000000 0000000500000001 000000000006d4cb 0000020000000000 14:33:34:[ 7016.408827] Call Trace: 14:33:34:[ 7016.408827] [&lt;ffffffff8105c646&gt;] _set_pages_array+0xe6/0x130 14:33:34:[ 7016.408827] [&lt;ffffffff8105c6c3&gt;] set_pages_array_wc+0x13/0x20 14:33:34:[ 7016.408827] [&lt;ffffffffa00cf3af&gt;] ttm_set_pages_caching+0x2f/0x70 [ttm] 14:33:34:[ 7016.408827] [&lt;ffffffffa00cf4f4&gt;] ttm_alloc_new_pages.isra.7+0xb4/0x180 [ttm] 14:33:34:[ 7016.408827] [&lt;ffffffffa00cfe50&gt;] ttm_pool_populate+0x3e0/0x500 [ttm] 14:33:34:[ 7016.408827] [&lt;ffffffffa013332e&gt;] cirrus_ttm_tt_populate+0xe/0x10 [cirrus] 14:33:34:[ 7016.408827] [&lt;ffffffffa00cc6dd&gt;] ttm_bo_move_memcpy+0x65d/0x6e0 [ttm] 14:33:34:[ 7016.408827] [&lt;ffffffff8118fa7e&gt;] ? map_vm_area+0x2e/0x40 14:33:34:[ 7016.408827] [&lt;ffffffffa00c82c9&gt;] ? ttm_tt_init+0x69/0xb0 [ttm] 14:33:34:[ 7016.408827] [&lt;ffffffffa01332d8&gt;] cirrus_bo_move+0x18/0x20 [cirrus] 14:33:34:[ 7016.408827] [&lt;ffffffffa00c9de5&gt;] ttm_bo_handle_move_mem+0x265/0x5b0 [ttm] 14:33:34:[ 7016.408827] [&lt;ffffffff81601bf4&gt;] ? __slab_free+0x10e/0x277 14:33:34:[ 7016.408827] [&lt;ffffffff8118f273&gt;] ? __free_vmap_area+0xb3/0xf0 14:33:34:[ 7016.408827] [&lt;ffffffffa00ca74a&gt;] ? ttm_bo_mem_space+0x10a/0x310 [ttm] 14:33:34:[ 7016.408827] [&lt;ffffffffa00cae17&gt;] ttm_bo_validate+0x247/0x260 [ttm] 14:33:34:[ 7016.408827] [&lt;ffffffff81059e69&gt;] ? iounmap+0x79/0xa0 14:33:34:[ 7016.408827] [&lt;ffffffff81050000&gt;] ? kgdb_arch_late+0x80/0x180 14:33:34:[ 7016.408827] [&lt;ffffffffa0133ac2&gt;] cirrus_bo_push_sysram+0x82/0xe0 [cirrus] 14:33:34:[ 7016.408827] [&lt;ffffffffa0131c84&gt;] cirrus_crtc_do_set_base.isra.8.constprop.10+0x84/0x430 [cirrus] 14:33:34:[ 7016.408827] [&lt;ffffffffa0132479&gt;] cirrus_crtc_mode_set+0x449/0x4d0 [cirrus] 14:33:34:[ 7016.408827] [&lt;ffffffffa00e8939&gt;] drm_crtc_helper_set_mode+0x2e9/0x520 [drm_kms_helper] 14:33:34:[ 7016.408827] [&lt;ffffffffa00e96bf&gt;] drm_crtc_helper_set_config+0x87f/0xaa0 [drm_kms_helper] 14:33:34:[ 7016.408827] [&lt;ffffffffa0088711&gt;] drm_mode_set_config_internal+0x61/0xe0 [drm] 14:33:34:[ 7016.408827] [&lt;ffffffffa00f0e83&gt;] restore_fbdev_mode+0xb3/0xe0 [drm_kms_helper] 14:33:34:[ 7016.408827] [&lt;ffffffffa00f1045&gt;] drm_fb_helper_force_kernel_mode+0x75/0xb0 [drm_kms_helper] 14:33:34:[ 7016.408827] [&lt;ffffffffa00f1d59&gt;] drm_fb_helper_panic+0x29/0x30 [drm_kms_helper] 14:33:34:[ 7016.408827] [&lt;ffffffff81610bec&gt;] notifier_call_chain+0x4c/0x70 14:33:34:[ 7016.408827] [&lt;ffffffff81610c4a&gt;] atomic_notifier_call_chain+0x1a/0x20 14:33:34:[ 7016.408827] [&lt;ffffffff815febdc&gt;] panic+0x106/0x1e7 14:33:34:[ 7016.408827] [&lt;ffffffffa062addb&gt;] lbug_with_loc+0xab/0xc0 [libcfs] 14:33:34:[ 7016.408827] [&lt;ffffffffa0c08a5e&gt;] osd_trans_exec_check.part.91+0x1a/0x1a [osd_ldiskfs] 14:33:34:[ 7016.408827] [&lt;ffffffffa0bdc857&gt;] osd_index_ea_delete+0x6d7/0xad0 [osd_ldiskfs] 14:33:34:[ 7016.408827] [&lt;ffffffff811ac1be&gt;] ? kmem_cache_alloc_trace+0x1ce/0x1f0 14:33:34:[ 7016.408827] [&lt;ffffffffa0a30fb1&gt;] out_obj_index_delete+0x111/0x2f0 [ptlrpc] 14:33:34:[ 7016.408827] [&lt;ffffffffa076ae83&gt;] ? lu_context_init+0xd3/0x1f0 [obdclass] 14:33:34:[ 7016.408827] [&lt;ffffffffa0a311d5&gt;] out_tx_index_delete_exec+0x25/0x180 [ptlrpc] 15:34:29:********** Timeout by autotest system ********** </pre> </div></div> <p>We have also hit this issue during master testing. This seems to be reproduced multiple times in last few days. </p> <p>I think it would be good to mark this issue as a blocker for 2.8.0. </p> <p>2 more instances seen in el7 test on master:<br/> <a href="https://testing.hpdd.intel.com/test_sets/1960c0a2-60ef-11e5-b495-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/1960c0a2-60ef-11e5-b495-5254006e85c2</a><br/> <a href="https://testing.hpdd.intel.com/test_sets/1a18a8ca-60ef-11e5-b495-5254006e85c2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/1a18a8ca-60ef-11e5-b495-5254006e85c2</a></p> <p>Reproduces a lot on tests of el7 server</p> <p>Kalpak, did you test <a href="http://review.whamcloud.com/15924" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/15924</a> to see if it fixes this issue?</p> <p>We faced this issue in sanity, test_51e and with the patch indicated in this ticket <a href="http://review.whamcloud.com/#/c/15924" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/15924</a>, did not face the issue even after running the test for 50 times.</p> <p>We have asked test team to verify the same if they have any scenario/cases in which this re-produces and also started multi runs for Intel specific failures like racer, test_1 etc. </p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/15924/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/15924/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6969" title="osd_internal.h:1090:osd_trans_exec_check()) LBUG for osd_index_ea_delete()" class="issue-link" data-issue-key="LU-6969"><del>LU-6969</del></a> osd: remove agent inodes in a separate transaction<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 0887b89c0c4e2b7c5a7ba3365e758a7d94c667fa</p> <p>Landed for 2.8.0</p> <p>The issue looks to be not resolved completely. Hit this while running racer, test_1 for multiple times. Attaching the log file.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Lustre: DEBUG MARKER: == racer test 1: racer on clients: fre0311,fre0312 DURATION=900 == 22:55:04 (1443740104) Lustre: 7246:0:(osd_handler.c:912:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0 Lustre: 7246:0:(osd_handler.c:919:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 1/1/0 Lustre: 7246:0:(osd_handler.c:929:osd_trans_dump_creds()) write: 2/12/0, punch: 1/4/0, quota 2/2/0 Lustre: 7246:0:(osd_handler.c:936:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0 Lustre: 7246:0:(osd_handler.c:943:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 LustreError: 7246:0:(osd_internal.h:1040:osd_trans_exec_op()) lustre-OST0001-osd: op = 7, rb = 7 LustreError: 7246:0:(osd_internal.h:1048:osd_trans_exec_op()) LBUG Pid: 7246, comm: ll_ost_io00_009 Call Trace: [&lt;ffffffffa032a875&gt;] libcfs_debug_dumpstack+0x55/0x80 [libcfs] [&lt;ffffffffa032ae77&gt;] lbug_with_loc+0x47/0xb0 [libcfs] [&lt;ffffffffa0b7e0be&gt;] osd_write+0x41e/0x5b0 [osd_ldiskfs] [&lt;ffffffffa0477c4d&gt;] dt_record_write+0x3d/0x130 [obdclass] [&lt;ffffffffa06f8545&gt;] tgt_client_data_write+0x165/0x1b0 [ptlrpc] [&lt;ffffffffa06f9517&gt;] tgt_txn_stop_cb+0x477/0x1110 [ptlrpc] [&lt;ffffffffa0477b1e&gt;] dt_txn_hook_stop+0x5e/0x90 [obdclass] [&lt;ffffffffa0b5b0ce&gt;] osd_trans_stop+0x1ae/0x990 [osd_ldiskfs] [&lt;ffffffffa0b6bd58&gt;] ? osd_attr_set+0x148/0x620 [osd_ldiskfs] [&lt;ffffffffa0ce7a7f&gt;] ofd_trans_stop+0x1f/0x60 [ofd] [&lt;ffffffffa0ce94aa&gt;] ofd_object_punch+0x35a/0xa30 [ofd] [&lt;ffffffffa0cd573e&gt;] ofd_punch_hdl+0x36e/0xb20 [ofd] [&lt;ffffffffa07084bc&gt;] tgt_request_handle+0x8bc/0x12e0 [ptlrpc] [&lt;ffffffffa06afb41&gt;] ptlrpc_main+0xe41/0x1910 [ptlrpc] [&lt;ffffffffa06aed00&gt;] ? ptlrpc_main+0x0/0x1910 [ptlrpc] [&lt;ffffffff8109abf6&gt;] kthread+0x96/0xa0 [&lt;ffffffff8100c20a&gt;] child_rip+0xa/0x20 [&lt;ffffffff8109ab60&gt;] ? kthread+0x0/0xa0 [&lt;ffffffff8100c200&gt;] ? child_rip+0x0/0x20 </pre> </div></div> <p>Correct me If I am wrong.</p> <p>sorry, this is a different issue happened to OST.</p> <p>Sorry, my bad. </p> Related LU-7021 LU-6918 Development Rank 1|hzxjzz: Rank (Obsolete) 9223372036854775807 Severity