[LU-16525] Oops in osd_object_delete

Related — Fri, 3 Feb 2023 07:08:45 +0000

[ 1000.389772] LustreError: 29691:0:(fld_handler.c:264:fld_server_lookup()) Skipped 757 previous similar messages
[ 1451.003561] BUG: unable to handle kernel NULL pointer dereference at 0000000000000b48
[ 1451.005902] IP: [<ffffffffc10bbd3b>] osd_object_delete+0x27b/0x370 [osd_ldiskfs]
[ 1451.008102] PGD 332f956067 PUD 332aaf1067 PMD 0
[ 1451.009947] Oops: 0002 1 SMP
[ 1451.011584] Modules linked in: ip_vs_rr xt_ipvs ip_vs xt_REDIRECT nf_nat_redirect osp(OE) mdd(OE) lod(OE) xt_nat veth vxlan ip6_udp_tunnel udp_tunnel iptable_mangle xt_mark xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c br_netfilter bridge stp llc ofd(OE) ost(OE) mdt(OE) lfsck(OE) overlay(T) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) mgc(OE) lustre(OE) lmv(OE) mdc(OE) osc(OE) lov(OE) fid(OE) fld(OE) ko2iblnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) mlx5_ib(OE) ib_uverbs(OE) mlx4_en(OE) mlx4_ib(OE) ib_core(OE) mlx4_core(OE) sunrpc ppdev iTCO_wdt nfit iTCO_vendor_support libnvdimm iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev parport_pc i2c_i801 lpc_ich pcspkr sg parport i6300esb ip_tables ext4 mbcache jbd2 sd_mod sr_mod cdrom crc_t10dif crct10dif_generic bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm virtio_net net_failover ahci virtio_blk failover virtio_scsi(OE) drm libahci mlx5_core(OE) bnxt_en libata crct10dif_pclmul mlxfw(OE) crct10dif_common ptp crc32c_intel pps_core virtio_pci mlx_compat(OE) serio_raw devlink virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
[ 1451.042772] CPU: 6 PID: 7226 Comm: ldlm_bl_01 Kdump: loaded Tainted: G OE ------------ T 3.10.0-1160.80.1.el7_lustre.x86_64 #1
[ 1451.045738] Hardware name: DDN SFA200NVX2E, BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
[ 1451.048281] task: ffff8fdcec7fd280 ti: ffff8fdc47984000 task.ti: ffff8fdc47984000
[ 1451.050568] RIP: 0010:[<ffffffffc10bbd3b>] [<ffffffffc10bbd3b>] osd_object_delete+0x27b/0x370 [osd_ldiskfs]
[ 1451.053186] RSP: 0018:ffff8fdc47987a50 EFLAGS: 00010246
[ 1451.055189] RAX: 0000000000000000 RBX: ffff8fdc282a5a00 RCX: 0000000000000000
[ 1451.057434] RDX: ffff8fdc47cce000 RSI: ffffffffc11183a0 RDI: ffff8fdceb0b2d80
[ 1451.059658] RBP: ffff8fdc47987a80 R08: 0000000000000000 R09: d7d17faf400c0000
[ 1451.061873] R10: ffffc91a3f980e70 R11: ffffdcd6ccb36fc0 R12: ffff8fdceb0b2d80
[ 1451.064084] R13: 0000000000000000 R14: ffff8fd7d17faea0 R15: 0000000000000b48
[ 1451.066294] FS: 0000000000000000(0000) GS:ffff8fdcf1180000(0000) knlGS:0000000000000000
[ 1451.068599] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1451.070596] CR2: 0000000000000b48 CR3: 000000332e502000 CR4: 0000000000760fe0
[ 1451.072756] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1451.074883] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1451.076983] PKRU: 00000000
[ 1451.078508] Call Trace:
[ 1451.080016] [<ffffffffc0d5ab88>] lu_object_free.isra.30+0x68/0x170 [obdclass]
[ 1451.082094] [<ffffffffc0b179c8>] ? cfs_hash_bd_from_key+0x38/0xb0 [libcfs]
[ 1451.084159] [<ffffffffc0d5d995>] lu_object_put+0xc5/0x3c0 [obdclass]
[ 1451.086130] [<ffffffffc1667200>] ? mdt_punch_hpreq_lock_match+0x260/0x260 [mdt]
[ 1451.088199] [<ffffffffc16672b1>] ldlm_dom_discard_cp_ast+0xb1/0x2b0 [mdt]
[ 1451.090215] [<ffffffffc127e988>] ldlm_work_cp_ast_lock+0xa8/0x1e0 [ptlrpc]
[ 1451.092229] [<ffffffffc12c9542>] ptlrpc_set_wait+0x72/0x790 [ptlrpc]
[ 1451.094132] [<ffffffffb8235195>] ? kmem_cache_alloc_node_trace+0x125/0x220
[ 1451.096106] [<ffffffffc0d3b679>] ? lprocfs_counter_add+0xf9/0x160 [obdclass]
[ 1451.098087] [<ffffffffc127e8e0>] ? __ldlm_handle2lock+0x3f0/0x3f0 [ptlrpc]
[ 1451.100024] [<ffffffffc12bf992>] ? ptlrpc_prep_set+0xd2/0x280 [ptlrpc]
[ 1451.101896] [<ffffffffc1284445>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc]
[ 1451.103739] [<ffffffffc1284c1f>] __ldlm_reprocess_all+0x11f/0x360 [ptlrpc]
[ 1451.105625] [<ffffffffc1284e73>] ldlm_reprocess_all+0x13/0x20 [ptlrpc]
[ 1451.107445] [<ffffffffc129e83e>] ldlm_cli_cancel_local+0x2ce/0x420 [ptlrpc]
[ 1451.109295] [<ffffffffc12a465a>] ldlm_cli_cancel+0x10a/0x530 [ptlrpc]
[ 1451.111038] [<ffffffffb80e41f5>] ? sched_clock_cpu+0x85/0xc0
[ 1451.112674] [<ffffffffb802c5ee>] ? __switch_to+0xce/0x590
[ 1451.114292] [<ffffffffc12a4b24>] ldlm_blocking_ast_nocheck+0xa4/0x310 [ptlrpc]
[ 1451.116133] [<ffffffffc12a4eca>] ldlm_blocking_ast+0x13a/0x170 [ptlrpc]
[ 1451.117891] [<ffffffffc12b0ecd>] ldlm_handle_bl_callback+0xdd/0x430 [ptlrpc]
[ 1451.119693] [<ffffffffc12b17d9>] ldlm_bl_thread_main+0x5b9/0xac0 [ptlrpc]
[ 1451.121445] [<ffffffffb80e1020>] ? wake_up_state+0x20/0x20
[ 1451.123031] [<ffffffffc12b1220>] ? ldlm_handle_bl_callback+0x430/0x430 [ptlrpc]
[ 1451.124806] [<ffffffffb80cb4d1>] kthread+0xd1/0xe0
[ 1451.126239] [<ffffffffb80cb400>] ? insert_kthread_work+0x40/0x40
[ 1451.127803] [<ffffffffb87c51dd>] ret_from_fork_nospec_begin+0x7/0x21
[ 1451.129395] [<ffffffffb80cb400>] ? insert_kthread_work+0x40/0x40
[ 1451.130912] Code: 42 59 04 00 0f 1f 40 00 48 85 db 74 b7 4c 89 e7 48 c7 c6 a0 83 11 c1 e8 c4 ed c9 ff 49 89 c5 44 89 f8 31 c9 4d 8d bd 48 0b 00 00 <49> 89 85 48 0b 00 00 48 89 de 4c 89 e7 4c 89 fa e8 d0 76 fb ff
[ 1451.136495] RIP [<ffffffffc10bbd3b>] osd_object_delete+0x27b/0x370 [osd_ldiskfs]
[ 1451.138195] RSP <ffff8fdc47987a50>
[ 1451.139342] CR2: 0000000000000b48
[ 2.743494] dracut-initqueue[248]: RTNETLINK answers: Network is unreachable
[ 4.837413] systemd-fsck[518]: /dev/mapper/VolGroup01-LogVol03: recovering journal
[ 4.843614] systemd-fsck[518]: /dev/mapper/VolGroup01-LogVol03: clean, 120/1941504 files, 3163795/7766016 blocks

Whamcloud Community JIRA

[LU-16525] Oops in osd_object_delete