[LU-9864] sanity: test_103b failed at ldlm_resource_getref+0x29/0x110

• Type: Bug
• Resolution: Unresolved
• Priority: Minor
• Affects Version/s: Lustre 2.10.6
• Severity: 3
• Assignee: WC Triage
• Reporter: Maloo

Description

This issue was created by maloo for Jinshan Xiong <[e-mail]>

Please provide additional information about the failure here.

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/42786a68-7e10-11e7-b158-5254006e85c2.

The client side stack showed the following stack trace:

19:48:23:[ 2993.073314] general protection fault: 0000 [#1] SMP 
19:48:23:[ 2993.074007] Modules linked in: loop lustre(OE) obdecho(OE) mgc(OE) lov(OE) osc(OE) mdc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod crc_t10dif crct10dif_generic ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr virtio_balloon i2c_piix4 parport_pc parport nfsd nfs_acl auth_rpcgss lockd grace sunrpc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi virtio_blk cirrus ata_piix crct10dif_pclmul crct10dif_common drm_kms_helper syscopyarea sysfillrect sysimgblt crc32c_intel fb_sys_fops ttm serio_raw drm virtio_pci 8139too virtio_ring virtio libata i2c_core 8139cp mii floppy
19:48:23:[ 2993.074007] CPU: 0 PID: 2595 Comm: ptlrpcd_rcv Tainted: G           OE  ------------   3.10.0-514.26.2.el7.x86_64 #1
19:48:23:[ 2993.074007] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007
19:48:23:[ 2993.074007] task: ffff88007b8ece70 ti: ffff88007aa40000 task.ti: ffff88007aa40000
19:48:23:[ 2993.074007] RIP: 0010:[<ffffffffa097c849>]  [<ffffffffa097c849>] ldlm_resource_getref+0x29/0x110 [ptlrpc]
19:48:23:[ 2993.074007] RSP: 0018:ffff88007aa43a58  EFLAGS: 00010292
19:48:23:[ 2993.074007] RAX: 5a5a5a5a5a5a5a5a RBX: fffefffffffffff8 RCX: 000000000000000b
19:48:23:[ 2993.074007] RDX: ffffc900038f4000 RSI: ffff000000000000 RDI: fffefffffffffff8
19:48:23:[ 2993.074007] RBP: ffff88007aa43a60 R08: 00000000ba2e8ba3 R09: 0000000000000008
19:48:23:[ 2993.074007] R10: 0000000000000008 R11: 0000000200000007 R12: 0000000000000002
19:48:23:[ 2993.074007] R13: 0000000000000000 R14: 0000000000000000 R15: ffff880079c200c0
19:48:23:[ 2993.074007] FS:  0000000000000000(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000
19:48:23:[ 2993.074007] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
19:48:23:[ 2993.074007] CR2: 00007fcdf3cbf1ee CR3: 000000007c163000 CR4: 00000000000406f0
19:48:23:[ 2993.074007] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
19:48:23:[ 2993.074007] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
19:48:23:[ 2993.074007] Stack:
19:48:23:[ 2993.074007]  ffff000000000000 ffff88007aa43a70 ffffffffa097c942 ffff88007aa43af0
19:48:23:[ 2993.074007]  ffffffffa0655a97 00000000ffffffff 000000000000000b 000000c100000000
19:48:23:[ 2993.074007]  ffff88007aa43b58 ffffffffa0989140 0000000101017c00  ffffc900038f4000
19:48:23:[ 2993.074007] Call Trace:
19:48:23:[ 2993.074007]  [<ffffffffa097c942>] ldlm_res_hop_get_locked+0x12/0x20 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa0655a97>] cfs_hash_for_each_relax+0x187/0x400 [libcfs]
19:48:23:[ 2993.074007]  [<ffffffffa0989140>] ? ldlm_resource_foreach+0x2d0/0x2d0 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa0989140>] ? ldlm_resource_foreach+0x2d0/0x2d0 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa0658cd5>] cfs_hash_for_each_nolock+0x75/0x1c0 [libcfs]
19:48:23:[ 2993.074007]  [<ffffffffa0989438>] ldlm_replay_locks+0xd8/0x8a0 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa064fb77>] ? libcfs_debug_msg+0x57/0x80 [libcfs]
19:48:23:[ 2993.074007]  [<ffffffffa0981c80>] ? ldlm_cancel_aged_policy+0x30/0x30 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa09c85cd>] ptlrpc_import_recovery_state_machine+0x74d/0xbc0 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa09cb3f2>] ptlrpc_connect_interpret+0xda2/0x2680 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa09a79e4>] ? ptlrpc_unregister_bulk+0xc4/0x7c0 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa099f048>] ? ptlrpc_free_committed+0x148/0x740 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa09a0e1c>] ptlrpc_check_set.part.23+0x44c/0x1d90 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa09a27bb>] ptlrpc_check_set+0x5b/0xe0 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa09ce52b>] ptlrpcd_check+0x4db/0x5d0 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffffa09ce8db>] ptlrpcd+0x2bb/0x560 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffff810c54e0>] ? wake_up_state+0x20/0x20
19:48:23:[ 2993.074007]  [<ffffffffa09ce620>] ? ptlrpcd_check+0x5d0/0x5d0 [ptlrpc]
19:48:23:[ 2993.074007]  [<ffffffff810b0a4f>] kthread+0xcf/0xe0
19:48:23:[ 2993.074007]  [<ffffffff810b0980>] ? kthread_create_on_node+0x140/0x140
19:48:23:[ 2993.074007]  [<ffffffff81697758>] ret_from_fork+0x58/0x90
19:48:23:[ 2993.074007]  [<ffffffff810b0980>] ? kthread_create_on_node+0x140/0x140

Issue Links

• is related to: LU-10401 sanity test_133g: timeout during MDT mount
• is related to: LU-11878 sanity test 103b: OOM because of too many bash processes: page allocation stalls for 18420ms