[LU-6293] runtests test_1: panic on dbuf_dirty (async update for zfs DNE)

• Type: Bug
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.8.0
• Affects Version/s: Lustre 2.8.0
• Severity: 3
• Assignee: Di Wang
• Reporter: Maloo

Description

This issue was created by maloo for wangdi <[e-mail]>

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/c80680c0-bd29-11e4-a946-5254006e85c2.

The sub-test test_1 failed with the following error:

test failed to respond and timed out
10:03:43:Lustre: DEBUG MARKER: == runtests test 1: All Runtests == 10:03:26 (1424858606)
10:03:43:Lustre: DEBUG MARKER: /usr/sbin/lctl mark touching \/mnt\/lustre at Wed Feb 25 10:03:27 UTC 2015 \(@1424858607\)
10:03:43:Lustre: DEBUG MARKER: touching /mnt/lustre at Wed Feb 25 10:03:27 UTC 2015 (@1424858607)
10:03:43:Lustre: DEBUG MARKER: /usr/sbin/lctl mark create an empty file \/mnt\/lustre\/hosts.6923
10:03:43:Lustre: DEBUG MARKER: create an empty file /mnt/lustre/hosts.6923
10:03:43:general protection fault: 0000 [#1] SMP 
10:03:43:last sysfs file: /sys/devices/system/cpu/online
10:03:43:CPU 1 
10:03:43:Modules linked in: osp(U) mdd(U) lod(U) mdt(U) lfsck(U) mgs(U) mgc(U) osd_zfs(U) lquota(U) lustre(U) lov(U) mdc(U) fid(U) lmv(U) fld(U) ksocklnd(U) ptlrpc(U) obdclass(U) lnet(U) sha512_generic libcfs(U) nfsd exportfs nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr ipv6 zfs(P)(U) zcommon(P)(U) znvpair(P)(U) zavl(P)(U) zunicode(P)(U) spl(U) zlib_deflate microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: speedstep_lib]
10:03:43:
10:03:43:Pid: 3430, comm: mdt00_001 Tainted: P           ---------------    2.6.32-504.8.1.el6_lustre.g0ef66b1.x86_64 #1 Red Hat KVM
10:03:43:RIP: 0010:[<ffffffffa01fa5b6>]  [<ffffffffa01fa5b6>] dbuf_dirty+0x16/0x910 [zfs]
10:03:43:RSP: 0018:ffff880072461580  EFLAGS: 00010282
10:03:43:RAX: 0000000000000000 RBX: ffff88006be24768 RCX: 0000000000000000
10:03:43:RDX: 0000000000000001 RSI: 5a5a5a5a5a5a5a5a RDI: ffff88006be24768
10:03:43:RBP: ffff880072461600 R08: 5a5a5a5a5a5a5a5a R09: 0000000100000002
10:03:43:R10: ffffc900047ec34b R11: 0000000000000001 R12: 5a5a5a5a5a5a5a5a
10:03:43:R13: 0000000000000009 R14: ffff88007cb390c0 R15: 0000000000000246
10:03:43:FS:  0000000000000000(0000) GS:ffff880002300000(0000) knlGS:0000000000000000
10:03:43:CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
10:03:43:CR2: 00000000004482f0 CR3: 0000000037cee000 CR4: 00000000000006e0
10:03:43:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
10:03:43:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
10:03:43:Process mdt00_001 (pid: 3430, threadinfo ffff880072460000, task ffff880073096080)
10:03:43:Stack:
10:03:43: ffff8800724616d0 ffff8800724615d0 ffff88006e6b2410 0000000000000000
10:03:43:<d> ffff880072461610 ffffffffa01badd3 ffff880072461610 ffffffffa01ba8d9
10:03:43:<d> 0000000172461620 6e6b24380000000a ffff88006e6b2430 ffff88006be24768
10:03:43:Call Trace:
10:03:43: [<ffffffffa01badd3>] ? nvs_xdr_nvp_op+0x363/0x3b0 [znvpair]
10:03:43: [<ffffffffa01ba8d9>] ? nvs_xdr_nvp_size+0x39/0x1d0 [znvpair]
10:03:43: [<ffffffffa01fb742>] dmu_buf_will_dirty+0xb2/0x100 [zfs]
10:03:43: [<ffffffffa0232e4d>] sa_attr_op+0x25d/0x3e0 [zfs]
10:03:43: [<ffffffffa01b9ca0>] ? nvs_operation+0xc0/0x2e0 [znvpair]
10:03:43: [<ffffffffa023303d>] sa_bulk_update_impl+0x6d/0x110 [zfs]
10:03:43: [<ffffffffa0233230>] sa_update+0x50/0x80 [zfs]
10:03:43: [<ffffffffa0e8a77c>] osd_object_sa_update+0x3c/0xd0 [osd_zfs]
10:03:43: [<ffffffffa0e986fb>] __osd_sa_xattr_update+0x24b/0x2f0 [osd_zfs]
10:03:43: [<ffffffffa0e9951a>] __osd_sa_xattr_set+0x17a/0x300 [osd_zfs]
10:03:44: [<ffffffffa0e9997f>] osd_xattr_set+0x2df/0x4e0 [osd_zfs]
10:03:44: [<ffffffffa0e8a5b1>] ? osd_object_sa_dirty_add+0x81/0x90 [osd_zfs]
10:03:44: [<ffffffffa077202a>] dt_version_set+0x7a/0x240 [obdclass]
10:03:44: [<ffffffffa09df7d4>] tgt_txn_stop_cb+0x7e4/0xd50 [ptlrpc]
10:03:44: [<ffffffffa0770cae>] dt_txn_hook_stop+0x5e/0x90 [obdclass]
10:03:44: [<ffffffffa0e84d73>] osd_trans_stop+0x253/0x420 [osd_zfs]
10:03:44: [<ffffffffa09fe444>] top_trans_stop+0x74/0xb80 [ptlrpc]
10:03:44: [<ffffffffa118ae8d>] ? mdd_attr_set_internal+0xfd/0x330 [mdd]
10:03:44: [<ffffffffa10f0381>] lod_trans_stop+0x61/0x70 [lod]
10:03:44: [<ffffffffa11964aa>] mdd_trans_stop+0x1a/0xac [mdd]
10:03:44: [<ffffffffa1184e3f>] mdd_create+0x137f/0x1720 [mdd]
10:03:44: [<ffffffffa103109c>] ? mdt_version_save+0x8c/0x1a0 [mdt]
10:03:44: [<ffffffffa1035491>] mdt_reint_create+0xbf1/0xd40 [mdt]
10:03:44: [<ffffffffa078cc40>] ? lu_ucred+0x20/0x30 [obdclass]
10:03:44: [<ffffffffa100fed5>] ? mdt_ucred+0x15/0x20 [mdt]
10:03:44: [<ffffffffa102be6c>] ? mdt_root_squash+0x2c/0x3f0 [mdt]
10:03:44: [<ffffffffa09b0c82>] ? __req_capsule_get+0x162/0x6d0 [ptlrpc]
10:03:44: [<ffffffffa103011d>] mdt_reint_rec+0x5d/0x200 [mdt]
10:03:44: [<ffffffffa101424b>] mdt_reint_internal+0x4cb/0x7a0 [mdt]
10:03:44: [<ffffffffa10149bb>] mdt_reint+0x6b/0x120 [mdt]
10:03:44: [<ffffffffa09ebe3e>] tgt_request_handle+0x8be/0x1000 [ptlrpc]
10:03:44: [<ffffffffa099bba1>] ptlrpc_main+0xe41/0x1960 [ptlrpc]
10:03:44: [<ffffffffa099ad60>] ? ptlrpc_main+0x0/0x1960 [ptlrpc]
10:03:44: [<ffffffff8109e66e>] kthread+0x9e/0xc0
10:03:44: [<ffffffff8100c20a>] child_rip+0xa/0x20
10:03:44: [<ffffffff8109e5d0>] ? kthread+0x0/0xc0
10:03:44: [<ffffffff8100c200>] ? child_rip+0x0/0x20
10:03:44:Code: d1 f9 ff ff 89 c2 31 c0 85 d2 48 0f 44 45 f8 c9 c3 0f 1f 40 00 55 48 89 e5 41 57 41 56 41 55 41 54 53 48 83 ec 58 0f 1f 44 00 00 <48> 8b 46 38 49 89 fc 49 89 f7 48 89 45 b8 48 8b 7f 28 e8 63 02 
10:03:44:RIP  [<ffffffffa01fa5b6>] dbuf_dirty+0x16/0x910 [zfs]
10:03:44: RSP <ffff880072461580>
10:03:44:Initializing cgroup subsys cpuset

Please provide additional information about the failure here.

Info required for matching: runtests 1

Issue Links

• is related to: LU-3534 async update cross-MDTs