18:42:11:Lustre: DEBUG MARKER: == conf-sanity test 43: check root_squash and nosquash_nids == 18:41:55 (1374198115) 18:42:11:Lustre: DEBUG MARKER: mkdir -p /mnt/lustre 18:42:11:Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,acl,flock wtm-14vm7@tcp:/lustre /mnt/lustre 18:42:11:LustreError: 152-6: Ignoring deprecated mount option 'acl'. 18:43:54:LustreError: 13347:0:(obd_config.c:1303:class_process_proc_param()) lustre-client-ffff88007d16ec00: unknown param some_wrong_param=10 18:43:54:LustreError: 11-0: lustre-MDT0000-mdc-ffff88007d16ec00: Communicating with 10.10.16.156@tcp, operation mds_connect failed with -11. 18:43:54:Lustre: Layout lock feature supported. 18:43:54:Lustre: Mounted lustre-client 18:43:54:LNet: 13360:0:(debug.c:326:libcfs_debug_str2mask()) You are trying to use a numerical value for the mask - this will be deprecated in a future release. 18:43:54:Lustre: DEBUG MARKER: lctl get_param -n llite.lustre*.root_squash 18:43:54:Lustre: DEBUG MARKER: lctl get_param -n llite.lustre*.nosquash_nids 18:43:54:Lustre: lustre: nosquash_nids is cleared 18:43:54:Lustre: lustre: root_squash is set to 500:500 18:43:54:Lustre: DEBUG MARKER: lctl get_param -n llite.lustre*.root_squash 18:43:54:Lustre: DEBUG MARKER: lctl get_param -n llite.lustre*.nosquash_nids 18:43:54:Lustre: lustre: nosquash_nids is set to 2@elan 0@lo 10.10.16.151@tcp 192.168.0.[2,10]@tcp 18:43:54:Lustre: DEBUG MARKER: lctl get_param -n llite.lustre*.nosquash_nids 18:43:55:Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true 18:43:55:Lustre: DEBUG MARKER: grep -c /mnt/lustre' ' /proc/mounts 18:43:55:Lustre: DEBUG MARKER: lsof -t /mnt/lustre 18:43:55:Lustre: DEBUG MARKER: umount /mnt/lustre 2>&1 18:43:55:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:43:55:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:43:55:CPU 0 18:43:55:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:43:55: 18:43:55:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:43:55:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:43:55:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:43:55:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:43:55:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:43:55:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:43:55:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:43:55:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:43:55:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:43:55:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:43:55:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:43:55:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:43:55:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:43:55:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:43:55:Stack: 18:43:55: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:43:55: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:43:55: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:43:55:Call Trace: 18:43:55: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:43:55: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:43:55: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:43:55: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:43:55: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:43:55: [] ? ll_put_super+0xd9/0x370 [lustre] 18:43:55: [] ? dispose_list+0xfc/0x120 18:43:55: [] ? invalidate_inodes+0xf6/0x190 18:45:17: [] ? generic_shutdown_super+0x5b/0xe0 18:45:17: [] ? kill_anon_super+0x16/0x60 18:45:17: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:45:17: [] ? deactivate_super+0x57/0x80 18:45:17: [] ? mntput_no_expire+0xbf/0x110 18:45:17: [] ? sys_umount+0x7b/0x3a0 18:45:17: [] ? system_call_fastpath+0x16/0x1b 18:45:17:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 18:45:17:Call Trace: 18:45:17: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:45:17: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:45:17: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:45:17: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:45:17: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:45:17: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:45:17: [] ? ll_put_super+0xd9/0x370 [lustre] 18:45:17: [] ? dispose_list+0xfc/0x120 18:45:17: [] ? invalidate_inodes+0xf6/0x190 18:45:17: [] ? generic_shutdown_super+0x5b/0xe0 18:45:17: [] ? kill_anon_super+0x16/0x60 18:45:17: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:45:18: [] ? deactivate_super+0x57/0x80 18:45:18: [] ? mntput_no_expire+0xbf/0x110 18:45:18: [] ? sys_umount+0x7b/0x3a0 18:45:18: [] ? system_call_fastpath+0x16/0x1b 18:45:18:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:45:18:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:45:18:CPU 0 18:45:18:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:45:18: 18:45:18:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:45:18:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:45:18:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:45:18:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:45:18:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:45:18:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:45:18:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:45:18:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:45:18:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:45:18:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:45:18:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:45:18:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:45:18:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:45:18:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:45:18:Stack: 18:45:18: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:45:18: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:45:18: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:45:18:Call Trace: 18:45:18: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:45:18: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:45:18: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:46:40: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:46:40: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:46:41: [] ? ll_put_super+0xd9/0x370 [lustre] 18:46:41: [] ? dispose_list+0xfc/0x120 18:46:41: [] ? invalidate_inodes+0xf6/0x190 18:46:41: [] ? generic_shutdown_super+0x5b/0xe0 18:46:41: [] ? kill_anon_super+0x16/0x60 18:46:41: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:46:41: [] ? deactivate_super+0x57/0x80 18:46:41: [] ? mntput_no_expire+0xbf/0x110 18:46:41: [] ? sys_umount+0x7b/0x3a0 18:46:41: [] ? system_call_fastpath+0x16/0x1b 18:46:41:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 18:46:41:Call Trace: 18:46:42: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:46:42: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:46:42: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:46:42: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:46:42: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:46:42: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:46:42: [] ? ll_put_super+0xd9/0x370 [lustre] 18:46:42: [] ? dispose_list+0xfc/0x120 18:46:42: [] ? invalidate_inodes+0xf6/0x190 18:46:42: [] ? generic_shutdown_super+0x5b/0xe0 18:46:42: [] ? kill_anon_super+0x16/0x60 18:46:42: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:46:42: [] ? deactivate_super+0x57/0x80 18:46:42: [] ? mntput_no_expire+0xbf/0x110 18:46:42: [] ? sys_umount+0x7b/0x3a0 18:46:42: [] ? system_call_fastpath+0x16/0x1b 18:46:42:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:46:42:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:46:42:CPU 0 18:46:42:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:46:42: 18:46:42:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:46:42:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:46:42:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:46:42:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:46:42:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:46:42:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:46:42:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:46:42:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:46:42:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:46:42:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:46:42:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:46:42:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:46:42:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:46:42:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:46:42:Stack: 18:46:42: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:46:42: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:48:05: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:48:05:Call Trace: 18:48:05: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:48:05: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:48:05: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:48:05: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:48:05: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:48:05: [] ? ll_put_super+0xd9/0x370 [lustre] 18:48:05: [] ? dispose_list+0xfc/0x120 18:48:05: [] ? invalidate_inodes+0xf6/0x190 18:48:05: [] ? generic_shutdown_super+0x5b/0xe0 18:48:05: [] ? kill_anon_super+0x16/0x60 18:48:05: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:48:05: [] ? deactivate_super+0x57/0x80 18:48:05: [] ? mntput_no_expire+0xbf/0x110 18:48:05: [] ? sys_umount+0x7b/0x3a0 18:48:05: [] ? system_call_fastpath+0x16/0x1b 18:48:05:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 18:48:05:Call Trace: 18:48:06: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:48:06: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:48:06: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:48:06: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:48:06: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:48:06: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:48:06: [] ? ll_put_super+0xd9/0x370 [lustre] 18:48:06: [] ? dispose_list+0xfc/0x120 18:48:06: [] ? invalidate_inodes+0xf6/0x190 18:48:06: [] ? generic_shutdown_super+0x5b/0xe0 18:48:06: [] ? kill_anon_super+0x16/0x60 18:48:06: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:48:06: [] ? deactivate_super+0x57/0x80 18:48:06: [] ? mntput_no_expire+0xbf/0x110 18:48:06: [] ? sys_umount+0x7b/0x3a0 18:48:06: [] ? system_call_fastpath+0x16/0x1b 18:48:06:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:48:06:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:48:06:CPU 0 18:48:06:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:48:06: 18:48:06:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:48:06:RIP: 0010:[] [] __do_softirq+0x73/0x1e0 18:48:06:RSP: 0018:ffff880002203ed0 EFLAGS: 00000206 18:48:07:RAX: 0000000000011400 RBX: ffff880002203f30 RCX: 000000000000001b 18:48:07:RDX: ffff88003c8affd8 RSI: 0000000000000000 RDI: 00000000000000b0 18:48:07:RBP: ffffffff8100bb93 R08: ffff880002213e88 R09: ffff88003c8afc08 18:48:07:R10: 000000000000000f R11: 0000000000000000 R12: ffff880002203e50 18:48:07:R13: ffff88003c8affd8 R14: 0000000000000008 R15: ffffffff815172ab 18:48:07:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:48:07:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:48:07:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:48:07:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:48:07:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:49:30:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:49:31:Stack: 18:49:31: ffff88007c3c8f00 ffff880002203f28 000000000000000a ffff88003c8affd8 18:49:31: ffff88003c8affd8 0000000000011400 ffffffff81a83a80 0000000000000046 18:49:31: ffff88003c8affd8 000000000000000b ffff88003c8afb58 ffff88007c3c8f00 18:49:31:Call Trace: 18:49:31: 18:49:31: [] ? call_softirq+0x1c/0x30 18:49:33: [] ? do_softirq+0x65/0xa0 18:49:33: [] ? irq_exit+0x85/0x90 18:49:33: [] ? do_IRQ+0x75/0xf0 18:49:33: [] ? ret_from_intr+0x0/0x11 18:49:33: 18:49:33: [] ? lu_site_purge+0x120/0x4a0 [obdclass] 18:49:33: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:49:35: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:49:35: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:49:35: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:49:35: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:49:35: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:49:35: [] ? ll_put_super+0xd9/0x370 [lustre] 18:49:35: [] ? dispose_list+0xfc/0x120 18:49:35: [] ? invalidate_inodes+0xf6/0x190 18:49:35: [] ? generic_shutdown_super+0x5b/0xe0 18:49:35: [] ? kill_anon_super+0x16/0x60 18:49:36: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:49:36: [] ? deactivate_super+0x57/0x80 18:49:37: [] ? mntput_no_expire+0xbf/0x110 18:49:37: [] ? sys_umount+0x7b/0x3a0 18:49:37: [] ? system_call_fastpath+0x16/0x1b 18:49:37:Code: 8b 55 c0 c7 45 b0 0a 00 00 00 48 89 45 c8 48 89 55 b8 66 0f 1f 44 00 00 65 c7 04 25 40 65 01 00 00 00 00 00 fb 66 0f 1f 44 00 00 <45> 31 ed 49 c7 c4 80 30 a8 81 eb 05 90 49 83 c4 08 f6 c3 01 74 18:49:38:Call Trace: 18:49:38: [] ? call_softirq+0x1c/0x30 18:49:38: [] ? do_softirq+0x65/0xa0 18:49:38: [] ? irq_exit+0x85/0x90 18:49:39: [] ? do_IRQ+0x75/0xf0 18:49:39: [] ? ret_from_intr+0x0/0x11 18:49:39: [] ? lu_site_purge+0x120/0x4a0 [obdclass] 18:49:39: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:49:39: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:49:39: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:49:40: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:49:40: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:49:40: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:49:40: [] ? ll_put_super+0xd9/0x370 [lustre] 18:49:40: [] ? dispose_list+0xfc/0x120 18:49:40: [] ? invalidate_inodes+0xf6/0x190 18:49:40: [] ? generic_shutdown_super+0x5b/0xe0 18:49:40: [] ? kill_anon_super+0x16/0x60 18:49:40: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:49:40: [] ? deactivate_super+0x57/0x80 18:49:40: [] ? mntput_no_expire+0xbf/0x110 18:49:40: [] ? sys_umount+0x7b/0x3a0 18:49:40: [] ? system_call_fastpath+0x16/0x1b 18:49:40:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:49:40:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:49:40:CPU 0 18:50:53:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:50:53: 18:50:53:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:50:53:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:50:53:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:50:53:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:50:53:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:50:53:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:50:53:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:50:53:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:50:53:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:50:53:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:50:53:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:50:53:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:50:53:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:50:53:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:50:53:Stack: 18:50:53: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:50:53: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:50:53: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:50:53:Call Trace: 18:50:53: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:50:53: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:50:53: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:50:53: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:50:53: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:50:53: [] ? ll_put_super+0xd9/0x370 [lustre] 18:50:53: [] ? dispose_list+0xfc/0x120 18:50:53: [] ? invalidate_inodes+0xf6/0x190 18:50:53: [] ? generic_shutdown_super+0x5b/0xe0 18:50:53: [] ? kill_anon_super+0x16/0x60 18:50:53: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:50:53: [] ? deactivate_super+0x57/0x80 18:50:53: [] ? mntput_no_expire+0xbf/0x110 18:50:53: [] ? sys_umount+0x7b/0x3a0 18:50:53: [] ? system_call_fastpath+0x16/0x1b 18:50:53:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 18:50:53:Call Trace: 18:50:53: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:50:53: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:50:53: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:50:53: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:50:53: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:50:53: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:50:53: [] ? ll_put_super+0xd9/0x370 [lustre] 18:50:53: [] ? dispose_list+0xfc/0x120 18:50:53: [] ? invalidate_inodes+0xf6/0x190 18:50:53: [] ? generic_shutdown_super+0x5b/0xe0 18:50:53: [] ? kill_anon_super+0x16/0x60 18:50:53: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:50:53: [] ? deactivate_super+0x57/0x80 18:50:53: [] ? mntput_no_expire+0xbf/0x110 18:50:53: [] ? sys_umount+0x7b/0x3a0 18:50:53: [] ? system_call_fastpath+0x16/0x1b 18:50:53:BUG: soft lockup - CPU#0 stuck for 68s! [umount:14036] 18:50:53:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:50:53:CPU 0 18:52:17:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:52:17: 18:52:17:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:52:17:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:52:17:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:52:17:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:52:17:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:52:17:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:52:17:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:52:17:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:52:17:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:52:17:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:52:17:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:52:17:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:52:17:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:52:17:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:52:17:Stack: 18:52:17: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:52:17: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:52:17: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:52:17:Call Trace: 18:52:17: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:52:17: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:52:17: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:52:17: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:52:17: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:52:17: [] ? ll_put_super+0xd9/0x370 [lustre] 18:52:17: [] ? dispose_list+0xfc/0x120 18:52:17: [] ? invalidate_inodes+0xf6/0x190 18:52:17: [] ? generic_shutdown_super+0x5b/0xe0 18:52:17: [] ? kill_anon_super+0x16/0x60 18:52:17: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:52:17: [] ? deactivate_super+0x57/0x80 18:52:17: [] ? mntput_no_expire+0xbf/0x110 18:52:17: [] ? sys_umount+0x7b/0x3a0 18:52:17: [] ? system_call_fastpath+0x16/0x1b 18:52:17:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 18:52:17:Call Trace: 18:52:17: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:52:17: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:52:17: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:52:17: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:52:17: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:52:17: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:52:17: [] ? ll_put_super+0xd9/0x370 [lustre] 18:52:17: [] ? dispose_list+0xfc/0x120 18:52:17: [] ? invalidate_inodes+0xf6/0x190 18:52:17: [] ? generic_shutdown_super+0x5b/0xe0 18:52:17: [] ? kill_anon_super+0x16/0x60 18:52:17: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:52:17: [] ? deactivate_super+0x57/0x80 18:52:17: [] ? mntput_no_expire+0xbf/0x110 18:52:17: [] ? sys_umount+0x7b/0x3a0 18:52:17: [] ? system_call_fastpath+0x16/0x1b 18:52:17:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:53:39:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:53:39:CPU 0 18:53:39:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:53:39: 18:53:39:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:53:39:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:53:40:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:53:40:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:53:41:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:53:41:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:53:41:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:53:41:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:53:41:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:53:41:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:53:41:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:53:41:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:53:41:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:53:42:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:53:42:Stack: 18:53:42: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:53:42: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:53:43: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:53:43:Call Trace: 18:53:43: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:53:43: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:53:43: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:53:43: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:53:45: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:53:45: [] ? ll_put_super+0xd9/0x370 [lustre] 18:53:45: [] ? dispose_list+0xfc/0x120 18:53:45: [] ? invalidate_inodes+0xf6/0x190 18:53:45: [] ? generic_shutdown_super+0x5b/0xe0 18:53:46: [] ? kill_anon_super+0x16/0x60 18:53:46: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:53:46: [] ? deactivate_super+0x57/0x80 18:53:47: [] ? mntput_no_expire+0xbf/0x110 18:53:48: [] ? sys_umount+0x7b/0x3a0 18:53:48: [] ? system_call_fastpath+0x16/0x1b 18:53:48:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 18:53:48:Call Trace: 18:53:48: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:53:48: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:53:48: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:53:48: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:53:48: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:53:48: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:53:48: [] ? ll_put_super+0xd9/0x370 [lustre] 18:53:48: [] ? dispose_list+0xfc/0x120 18:53:48: [] ? invalidate_inodes+0xf6/0x190 18:53:48: [] ? generic_shutdown_super+0x5b/0xe0 18:53:48: [] ? kill_anon_super+0x16/0x60 18:53:48: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:53:49: [] ? deactivate_super+0x57/0x80 18:53:50: [] ? mntput_no_expire+0xbf/0x110 18:53:50: [] ? sys_umount+0x7b/0x3a0 18:53:50: [] ? system_call_fastpath+0x16/0x1b 18:53:50:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:55:04:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:55:04:CPU 0 18:55:04:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:55:04: 18:55:04:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:55:04:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:55:04:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:55:04:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:55:04:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:55:04:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:55:04:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:55:04:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:55:04:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:55:04:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:55:04:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:55:04:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:55:04:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:55:04:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:55:04:Stack: 18:55:04: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:55:04: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:55:04: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:55:04:Call Trace: 18:55:04: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:55:04: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:55:04: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:55:04: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:55:04: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:55:04: [] ? ll_put_super+0xd9/0x370 [lustre] 18:55:04: [] ? dispose_list+0xfc/0x120 18:55:04: [] ? invalidate_inodes+0xf6/0x190 18:55:04: [] ? generic_shutdown_super+0x5b/0xe0 18:55:04: [] ? kill_anon_super+0x16/0x60 18:55:04: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:55:04: [] ? deactivate_super+0x57/0x80 18:55:04: [] ? mntput_no_expire+0xbf/0x110 18:55:04: [] ? sys_umount+0x7b/0x3a0 18:55:04: [] ? system_call_fastpath+0x16/0x1b 18:55:04:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 18:55:04:Call Trace: 18:55:04: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:55:04: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:55:04: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:55:04: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:55:04: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:55:04: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:55:04: [] ? ll_put_super+0xd9/0x370 [lustre] 18:55:04: [] ? dispose_list+0xfc/0x120 18:55:04: [] ? invalidate_inodes+0xf6/0x190 18:55:04: [] ? generic_shutdown_super+0x5b/0xe0 18:55:04: [] ? kill_anon_super+0x16/0x60 18:55:04: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:55:04: [] ? deactivate_super+0x57/0x80 18:55:04: [] ? mntput_no_expire+0xbf/0x110 18:55:04: [] ? sys_umount+0x7b/0x3a0 18:55:04: [] ? system_call_fastpath+0x16/0x1b 18:55:04:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:55:04:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:55:04:CPU 0 18:55:04:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:55:04: 18:55:04:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:55:04:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:55:04:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:55:04:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:55:04:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:55:04:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:55:04:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:55:04:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:55:04:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:55:04:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:55:04:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:55:04:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:55:04:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:55:04:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:55:04:Stack: 18:55:04: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:55:04: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:55:04: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:55:04:Call Trace: 18:55:04: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:55:04: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:55:04: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:55:04: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:55:04: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:55:04: [] ? ll_put_super+0xd9/0x370 [lustre] 18:55:04: [] ? dispose_list+0xfc/0x120 18:55:04: [] ? invalidate_inodes+0xf6/0x190 18:55:04: [] ? generic_shutdown_super+0x5b/0xe0 18:55:04: [] ? kill_anon_super+0x16/0x60 18:55:04: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:55:04: [] ? deactivate_super+0x57/0x80 18:55:04: [] ? mntput_no_expire+0xbf/0x110 18:55:04: [] ? sys_umount+0x7b/0x3a0 18:55:04: [] ? system_call_fastpath+0x16/0x1b 18:55:04:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 18:55:04:Call Trace: 18:55:04: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:55:04: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:55:04: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:55:04: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:55:04: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:55:04: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:55:04: [] ? ll_put_super+0xd9/0x370 [lustre] 18:55:04: [] ? dispose_list+0xfc/0x120 18:55:04: [] ? invalidate_inodes+0xf6/0x190 18:55:04: [] ? generic_shutdown_super+0x5b/0xe0 18:55:04: [] ? kill_anon_super+0x16/0x60 18:55:04: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:56:28: [] ? deactivate_super+0x57/0x80 18:56:28: [] ? mntput_no_expire+0xbf/0x110 18:56:28: [] ? sys_umount+0x7b/0x3a0 18:56:28: [] ? system_call_fastpath+0x16/0x1b 18:56:28:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:56:28:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:56:28:CPU 0 18:56:28:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:56:28: 18:56:28:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:56:28:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:56:28:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:56:28:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:56:28:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:56:29:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:56:29:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:56:29:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:56:29:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:56:29:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:56:29:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:56:29:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:56:29:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:56:29:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:56:29:Stack: 18:56:29: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:56:29: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:56:29: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:56:29:Call Trace: 18:56:29: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:56:29: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:56:29: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:56:29: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:56:29: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:56:29: [] ? ll_put_super+0xd9/0x370 [lustre] 18:56:29: [] ? dispose_list+0xfc/0x120 18:56:29: [] ? invalidate_inodes+0xf6/0x190 18:56:29: [] ? generic_shutdown_super+0x5b/0xe0 18:56:29: [] ? kill_anon_super+0x16/0x60 18:56:29: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:56:29: [] ? deactivate_super+0x57/0x80 18:56:29: [] ? mntput_no_expire+0xbf/0x110 18:56:29: [] ? sys_umount+0x7b/0x3a0 18:56:29: [] ? system_call_fastpath+0x16/0x1b 18:56:29:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 18:56:29:Call Trace: 18:56:29: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:56:29: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:56:29: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:56:29: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:56:29: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:56:29: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:56:29: [] ? ll_put_super+0xd9/0x370 [lustre] 18:57:51: [] ? dispose_list+0xfc/0x120 18:57:51: [] ? invalidate_inodes+0xf6/0x190 18:57:51: [] ? generic_shutdown_super+0x5b/0xe0 18:57:51: [] ? kill_anon_super+0x16/0x60 18:57:51: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:57:51: [] ? deactivate_super+0x57/0x80 18:57:52: [] ? mntput_no_expire+0xbf/0x110 18:57:52: [] ? sys_umount+0x7b/0x3a0 18:57:52: [] ? system_call_fastpath+0x16/0x1b 18:57:52:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:57:53:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:57:53:CPU 0 18:57:53:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:57:53: 18:57:53:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:57:53:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:57:53:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:57:53:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:57:53:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:57:53:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:57:53:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:57:53:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:57:53:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:57:53:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:57:53:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:57:53:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:57:53:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:57:53:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:57:53:Stack: 18:57:53: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:57:53: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:57:53: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:57:53:Call Trace: 18:57:53: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:57:53: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:57:53: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:57:53: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:57:53: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:57:53: [] ? ll_put_super+0xd9/0x370 [lustre] 18:57:53: [] ? dispose_list+0xfc/0x120 18:57:53: [] ? invalidate_inodes+0xf6/0x190 18:57:54: [] ? generic_shutdown_super+0x5b/0xe0 18:57:54: [] ? kill_anon_super+0x16/0x60 18:57:54: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:57:54: [] ? deactivate_super+0x57/0x80 18:57:54: [] ? mntput_no_expire+0xbf/0x110 18:57:54: [] ? sys_umount+0x7b/0x3a0 18:57:54: [] ? system_call_fastpath+0x16/0x1b 18:57:54:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 18:57:54:Call Trace: 18:57:54: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 18:57:54: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:59:18: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:59:18: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:59:18: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:59:18: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:59:18: [] ? ll_put_super+0xd9/0x370 [lustre] 18:59:18: [] ? dispose_list+0xfc/0x120 18:59:18: [] ? invalidate_inodes+0xf6/0x190 18:59:18: [] ? generic_shutdown_super+0x5b/0xe0 18:59:18: [] ? kill_anon_super+0x16/0x60 18:59:18: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:59:18: [] ? deactivate_super+0x57/0x80 18:59:18: [] ? mntput_no_expire+0xbf/0x110 18:59:18: [] ? sys_umount+0x7b/0x3a0 18:59:18: [] ? system_call_fastpath+0x16/0x1b 18:59:18:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 18:59:18:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:59:18:CPU 0 18:59:18:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 18:59:18: 18:59:18:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 18:59:18:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 18:59:19:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 18:59:19:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 18:59:19:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 18:59:19:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 18:59:19:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 18:59:19:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 18:59:19:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 18:59:19:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 18:59:19:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 18:59:19:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 18:59:19:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 18:59:19:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 18:59:19:Stack: 18:59:19: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 18:59:19: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 18:59:19: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 18:59:19:Call Trace: 18:59:19: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 18:59:19: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 18:59:19: [] ? cl_stack_fini+0xe/0x10 [obdclass] 18:59:19: [] ? cl_sb_fini+0x6d/0x190 [lustre] 18:59:19: [] ? client_common_put_super+0x54/0xaa0 [lustre] 18:59:19: [] ? ll_put_super+0xd9/0x370 [lustre] 18:59:19: [] ? dispose_list+0xfc/0x120 18:59:19: [] ? invalidate_inodes+0xf6/0x190 18:59:19: [] ? generic_shutdown_super+0x5b/0xe0 18:59:19: [] ? kill_anon_super+0x16/0x60 18:59:19: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 18:59:19: [] ? deactivate_super+0x57/0x80 18:59:19: [] ? mntput_no_expire+0xbf/0x110 18:59:19: [] ? sys_umount+0x7b/0x3a0 18:59:19: [] ? system_call_fastpath+0x16/0x1b 19:00:45:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:00:45:Call Trace: 19:00:45: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:00:45: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:00:45: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:00:45: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:00:45: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:00:45: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:00:45: [] ? ll_put_super+0xd9/0x370 [lustre] 19:00:45: [] ? dispose_list+0xfc/0x120 19:00:45: [] ? invalidate_inodes+0xf6/0x190 19:00:45: [] ? generic_shutdown_super+0x5b/0xe0 19:00:45: [] ? kill_anon_super+0x16/0x60 19:00:45: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:00:45: [] ? deactivate_super+0x57/0x80 19:00:45: [] ? mntput_no_expire+0xbf/0x110 19:00:45: [] ? sys_umount+0x7b/0x3a0 19:00:45: [] ? system_call_fastpath+0x16/0x1b 19:00:45:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:00:45:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:00:45:CPU 0 19:00:45:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:00:45: 19:00:45:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:00:45:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:00:45:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:00:45:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:00:45:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:00:45:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:00:45:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:00:45:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:00:45:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:00:45:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:00:45:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:00:45:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:00:45:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:00:45:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:00:45:Stack: 19:00:45: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:00:45: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:00:45: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:00:45:Call Trace: 19:00:45: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:00:45: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:00:45: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:00:45: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:00:45: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:00:45: [] ? ll_put_super+0xd9/0x370 [lustre] 19:00:45: [] ? dispose_list+0xfc/0x120 19:00:45: [] ? invalidate_inodes+0xf6/0x190 19:00:45: [] ? generic_shutdown_super+0x5b/0xe0 19:00:45: [] ? kill_anon_super+0x16/0x60 19:00:45: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:00:45: [] ? deactivate_super+0x57/0x80 19:02:10: [] ? mntput_no_expire+0xbf/0x110 19:02:10: [] ? sys_umount+0x7b/0x3a0 19:02:10: [] ? system_call_fastpath+0x16/0x1b 19:02:10:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:02:10:Call Trace: 19:02:10: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:02:10: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:02:10: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:02:10: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:02:10: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:02:10: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:02:10: [] ? ll_put_super+0xd9/0x370 [lustre] 19:02:10: [] ? dispose_list+0xfc/0x120 19:02:10: [] ? invalidate_inodes+0xf6/0x190 19:02:10: [] ? generic_shutdown_super+0x5b/0xe0 19:02:10: [] ? kill_anon_super+0x16/0x60 19:02:10: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:02:10: [] ? deactivate_super+0x57/0x80 19:02:10: [] ? mntput_no_expire+0xbf/0x110 19:02:10: [] ? sys_umount+0x7b/0x3a0 19:02:10: [] ? system_call_fastpath+0x16/0x1b 19:02:10:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:02:10:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:02:10:CPU 0 19:02:10:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:02:10: 19:02:10:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:02:10:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:02:10:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:02:10:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:02:10:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:02:10:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:02:10:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:02:10:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:02:10:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:02:10:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:02:10:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:02:10:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:02:10:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:02:10:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:02:10:Stack: 19:02:10: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:02:10: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:02:10: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:02:10:Call Trace: 19:02:10: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:02:10: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:02:10: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:02:10: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:02:10: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:02:10: [] ? ll_put_super+0xd9/0x370 [lustre] 19:02:10: [] ? dispose_list+0xfc/0x120 19:03:34: [] ? invalidate_inodes+0xf6/0x190 19:03:34: [] ? generic_shutdown_super+0x5b/0xe0 19:03:34: [] ? kill_anon_super+0x16/0x60 19:03:34: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:03:34: [] ? deactivate_super+0x57/0x80 19:03:34: [] ? mntput_no_expire+0xbf/0x110 19:03:34: [] ? sys_umount+0x7b/0x3a0 19:03:34: [] ? system_call_fastpath+0x16/0x1b 19:03:34:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:03:34:Call Trace: 19:03:34: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:03:34: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:03:34: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:03:34: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:03:34: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:03:35: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:03:35: [] ? ll_put_super+0xd9/0x370 [lustre] 19:03:35: [] ? dispose_list+0xfc/0x120 19:03:35: [] ? invalidate_inodes+0xf6/0x190 19:03:35: [] ? generic_shutdown_super+0x5b/0xe0 19:03:35: [] ? kill_anon_super+0x16/0x60 19:03:35: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:03:35: [] ? deactivate_super+0x57/0x80 19:03:35: [] ? mntput_no_expire+0xbf/0x110 19:03:35: [] ? sys_umount+0x7b/0x3a0 19:03:35: [] ? system_call_fastpath+0x16/0x1b 19:03:35:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:03:35:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:03:35:CPU 0 19:03:35:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:03:35: 19:03:35:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:03:35:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:03:35:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:03:35:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:03:35:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:03:35:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:03:35:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:03:35:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:03:35:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:03:35:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:03:35:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:03:35:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:03:35:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:03:35:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:03:35:Stack: 19:03:35: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:03:35: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:03:35: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:03:35:Call Trace: 19:03:35: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:03:35: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:04:59: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:04:59: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:04:59: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:04:59: [] ? ll_put_super+0xd9/0x370 [lustre] 19:04:59: [] ? dispose_list+0xfc/0x120 19:04:59: [] ? invalidate_inodes+0xf6/0x190 19:04:59: [] ? generic_shutdown_super+0x5b/0xe0 19:04:59: [] ? kill_anon_super+0x16/0x60 19:04:59: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:04:59: [] ? deactivate_super+0x57/0x80 19:04:59: [] ? mntput_no_expire+0xbf/0x110 19:04:59: [] ? sys_umount+0x7b/0x3a0 19:04:59: [] ? system_call_fastpath+0x16/0x1b 19:04:59:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:04:59:Call Trace: 19:04:59: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:04:59: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:04:59: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:04:59: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:04:59: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:04:59: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:04:59: [] ? ll_put_super+0xd9/0x370 [lustre] 19:04:59: [] ? dispose_list+0xfc/0x120 19:04:59: [] ? invalidate_inodes+0xf6/0x190 19:04:59: [] ? generic_shutdown_super+0x5b/0xe0 19:04:59: [] ? kill_anon_super+0x16/0x60 19:04:59: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:04:59: [] ? deactivate_super+0x57/0x80 19:04:59: [] ? mntput_no_expire+0xbf/0x110 19:04:59: [] ? sys_umount+0x7b/0x3a0 19:04:59: [] ? system_call_fastpath+0x16/0x1b 19:04:59:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:04:59:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:04:59:CPU 0 19:04:59:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:04:59: 19:04:59:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:04:59:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:04:59:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:04:59:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:04:59:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:04:59:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:04:59:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:04:59:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:04:59:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:04:59:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:04:59:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:05:00:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:05:00:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:05:00:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:05:00:Stack: 19:05:00: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:06:23: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:06:23: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:06:23:Call Trace: 19:06:23: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:06:23: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:06:23: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:06:23: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:06:23: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:06:23: [] ? ll_put_super+0xd9/0x370 [lustre] 19:06:23: [] ? dispose_list+0xfc/0x120 19:06:23: [] ? invalidate_inodes+0xf6/0x190 19:06:23: [] ? generic_shutdown_super+0x5b/0xe0 19:06:23: [] ? kill_anon_super+0x16/0x60 19:06:23: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:06:23: [] ? deactivate_super+0x57/0x80 19:06:23: [] ? mntput_no_expire+0xbf/0x110 19:06:23: [] ? sys_umount+0x7b/0x3a0 19:06:23: [] ? system_call_fastpath+0x16/0x1b 19:06:23:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:06:23:Call Trace: 19:06:23: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:06:23: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:06:23: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:06:23: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:06:23: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:06:23: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:06:23: [] ? ll_put_super+0xd9/0x370 [lustre] 19:06:23: [] ? dispose_list+0xfc/0x120 19:06:23: [] ? invalidate_inodes+0xf6/0x190 19:06:23: [] ? generic_shutdown_super+0x5b/0xe0 19:06:23: [] ? kill_anon_super+0x16/0x60 19:06:23: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:06:23: [] ? deactivate_super+0x57/0x80 19:06:23: [] ? mntput_no_expire+0xbf/0x110 19:06:23: [] ? sys_umount+0x7b/0x3a0 19:06:23: [] ? system_call_fastpath+0x16/0x1b 19:06:23:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:06:23:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:06:23:CPU 0 19:06:23:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:06:23: 19:06:23:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:06:23:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:06:23:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:06:23:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:06:23:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:06:23:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:06:23:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:06:23:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:06:23:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:06:23:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:06:23:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:06:23:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:07:47:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:07:47:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:07:47:Stack: 19:07:47: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:07:47: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:07:47: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:07:47:Call Trace: 19:07:47: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:07:47: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:07:47: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:07:47: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:07:47: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:07:47: [] ? ll_put_super+0xd9/0x370 [lustre] 19:07:47: [] ? dispose_list+0xfc/0x120 19:07:47: [] ? invalidate_inodes+0xf6/0x190 19:07:47: [] ? generic_shutdown_super+0x5b/0xe0 19:07:47: [] ? kill_anon_super+0x16/0x60 19:07:47: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:07:47: [] ? deactivate_super+0x57/0x80 19:07:47: [] ? mntput_no_expire+0xbf/0x110 19:07:47: [] ? sys_umount+0x7b/0x3a0 19:07:47: [] ? system_call_fastpath+0x16/0x1b 19:07:47:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:07:47:Call Trace: 19:07:47: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:07:47: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:07:47: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:07:47: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:07:47: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:07:47: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:07:47: [] ? ll_put_super+0xd9/0x370 [lustre] 19:07:47: [] ? dispose_list+0xfc/0x120 19:07:47: [] ? invalidate_inodes+0xf6/0x190 19:07:47: [] ? generic_shutdown_super+0x5b/0xe0 19:07:47: [] ? kill_anon_super+0x16/0x60 19:07:47: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:07:47: [] ? deactivate_super+0x57/0x80 19:07:47: [] ? mntput_no_expire+0xbf/0x110 19:07:47: [] ? sys_umount+0x7b/0x3a0 19:07:47: [] ? system_call_fastpath+0x16/0x1b 19:07:47:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:07:47:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:07:47:CPU 0 19:07:47:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:07:47: 19:07:47:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:07:47:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:07:47:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:07:47:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:07:47:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:07:47:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:07:47:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:09:10:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:09:10:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:09:10:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:09:10:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:09:10:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:09:10:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:09:10:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:09:10:Stack: 19:09:10: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:09:10: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:09:10: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:09:10:Call Trace: 19:09:10: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:09:10: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:09:10: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:09:10: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:09:10: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:09:10: [] ? ll_put_super+0xd9/0x370 [lustre] 19:09:10: [] ? dispose_list+0xfc/0x120 19:09:10: [] ? invalidate_inodes+0xf6/0x190 19:09:10: [] ? generic_shutdown_super+0x5b/0xe0 19:09:10: [] ? kill_anon_super+0x16/0x60 19:09:10: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:09:10: [] ? deactivate_super+0x57/0x80 19:09:10: [] ? mntput_no_expire+0xbf/0x110 19:09:10: [] ? sys_umount+0x7b/0x3a0 19:09:10: [] ? system_call_fastpath+0x16/0x1b 19:09:10:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:09:10:Call Trace: 19:09:10: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:09:10: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:09:10: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:09:11: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:09:11: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:09:11: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:09:11: [] ? ll_put_super+0xd9/0x370 [lustre] 19:09:11: [] ? dispose_list+0xfc/0x120 19:09:11: [] ? invalidate_inodes+0xf6/0x190 19:09:11: [] ? generic_shutdown_super+0x5b/0xe0 19:09:11: [] ? kill_anon_super+0x16/0x60 19:09:11: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:09:11: [] ? deactivate_super+0x57/0x80 19:09:11: [] ? mntput_no_expire+0xbf/0x110 19:09:11: [] ? sys_umount+0x7b/0x3a0 19:09:12: [] ? system_call_fastpath+0x16/0x1b 19:09:12:BUG: soft lockup - CPU#0 stuck for 68s! [umount:14036] 19:09:12:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:09:12:CPU 0 19:09:12:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:09:12: 19:09:12:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:09:12:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:09:12:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:10:35:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:10:35:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:10:35:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:10:35:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:10:35:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:10:35:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:10:35:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:10:35:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:10:35:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:10:35:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:10:35:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:10:35:Stack: 19:10:35: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:10:35: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:10:35: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:10:35:Call Trace: 19:10:35: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:10:35: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:10:35: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:10:35: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:10:35: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:10:35: [] ? ll_put_super+0xd9/0x370 [lustre] 19:10:35: [] ? dispose_list+0xfc/0x120 19:10:35: [] ? invalidate_inodes+0xf6/0x190 19:10:35: [] ? generic_shutdown_super+0x5b/0xe0 19:10:35: [] ? kill_anon_super+0x16/0x60 19:10:35: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:10:35: [] ? deactivate_super+0x57/0x80 19:10:35: [] ? mntput_no_expire+0xbf/0x110 19:10:35: [] ? sys_umount+0x7b/0x3a0 19:10:35: [] ? system_call_fastpath+0x16/0x1b 19:10:35:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:10:35:Call Trace: 19:10:35: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:10:35: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:10:35: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:10:35: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:10:35: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:10:35: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:10:35: [] ? ll_put_super+0xd9/0x370 [lustre] 19:10:35: [] ? dispose_list+0xfc/0x120 19:10:35: [] ? invalidate_inodes+0xf6/0x190 19:10:35: [] ? generic_shutdown_super+0x5b/0xe0 19:10:35: [] ? kill_anon_super+0x16/0x60 19:10:35: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:10:35: [] ? deactivate_super+0x57/0x80 19:10:35: [] ? mntput_no_expire+0xbf/0x110 19:10:35: [] ? sys_umount+0x7b/0x3a0 19:10:35: [] ? system_call_fastpath+0x16/0x1b 19:10:35:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:10:35:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:10:35:CPU 0 19:10:35:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:10:35: 19:11:58:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:11:58:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:11:58:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:11:58:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:11:58:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:11:58:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:11:58:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:11:58:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:11:58:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:11:58:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:11:58:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:11:58:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:11:58:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:11:58:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:11:58:Stack: 19:11:58: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:11:58: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:11:58: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:11:58:Call Trace: 19:11:58: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:11:58: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:11:58: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:11:58: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:11:58: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:11:58: [] ? ll_put_super+0xd9/0x370 [lustre] 19:11:59: [] ? dispose_list+0xfc/0x120 19:11:59: [] ? invalidate_inodes+0xf6/0x190 19:11:59: [] ? generic_shutdown_super+0x5b/0xe0 19:11:59: [] ? kill_anon_super+0x16/0x60 19:11:59: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:11:59: [] ? deactivate_super+0x57/0x80 19:11:59: [] ? mntput_no_expire+0xbf/0x110 19:11:59: [] ? sys_umount+0x7b/0x3a0 19:11:59: [] ? system_call_fastpath+0x16/0x1b 19:11:59:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:11:59:Call Trace: 19:11:59: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:11:59: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:11:59: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:11:59: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:11:59: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:11:59: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:11:59: [] ? ll_put_super+0xd9/0x370 [lustre] 19:11:59: [] ? dispose_list+0xfc/0x120 19:11:59: [] ? invalidate_inodes+0xf6/0x190 19:11:59: [] ? generic_shutdown_super+0x5b/0xe0 19:11:59: [] ? kill_anon_super+0x16/0x60 19:11:59: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:11:59: [] ? deactivate_super+0x57/0x80 19:11:59: [] ? mntput_no_expire+0xbf/0x110 19:11:59: [] ? sys_umount+0x7b/0x3a0 19:11:59: [] ? system_call_fastpath+0x16/0x1b 19:11:59:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:11:59:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:11:59:CPU 0 19:13:22:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:13:22: 19:13:22:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:13:22:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:13:22:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:13:22:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:13:22:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:13:22:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:13:22:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:13:22:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:13:22:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:13:22:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:13:22:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:13:22:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:13:22:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:13:22:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:13:22:Stack: 19:13:22: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:13:22: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:13:22: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:13:22:Call Trace: 19:13:23: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:13:23: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:13:23: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:13:23: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:13:23: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:13:23: [] ? ll_put_super+0xd9/0x370 [lustre] 19:13:23: [] ? dispose_list+0xfc/0x120 19:13:23: [] ? invalidate_inodes+0xf6/0x190 19:13:23: [] ? generic_shutdown_super+0x5b/0xe0 19:13:24: [] ? kill_anon_super+0x16/0x60 19:13:25: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:13:25: [] ? deactivate_super+0x57/0x80 19:13:25: [] ? mntput_no_expire+0xbf/0x110 19:13:25: [] ? sys_umount+0x7b/0x3a0 19:13:25: [] ? system_call_fastpath+0x16/0x1b 19:13:25:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:13:25:Call Trace: 19:13:25: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:13:25: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:13:25: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:13:25: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:13:25: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:13:25: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:13:25: [] ? ll_put_super+0xd9/0x370 [lustre] 19:13:25: [] ? dispose_list+0xfc/0x120 19:13:25: [] ? invalidate_inodes+0xf6/0x190 19:13:25: [] ? generic_shutdown_super+0x5b/0xe0 19:13:26: [] ? kill_anon_super+0x16/0x60 19:13:26: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:13:26: [] ? deactivate_super+0x57/0x80 19:13:26: [] ? mntput_no_expire+0xbf/0x110 19:13:26: [] ? sys_umount+0x7b/0x3a0 19:13:26: [] ? system_call_fastpath+0x16/0x1b 19:13:26:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:13:26:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:13:26:CPU 0 19:14:45:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:14:46: 19:14:46:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:14:46:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:14:46:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:14:46:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:14:46:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:14:46:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:14:46:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:14:46:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:14:46:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:14:46:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:14:46:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:14:46:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:14:46:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:14:46:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:14:46:Stack: 19:14:46: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:14:46: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:14:46: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:14:46:Call Trace: 19:14:46: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:14:46: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:14:46: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:14:46: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:14:46: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:14:46: [] ? ll_put_super+0xd9/0x370 [lustre] 19:14:46: [] ? dispose_list+0xfc/0x120 19:14:46: [] ? invalidate_inodes+0xf6/0x190 19:14:46: [] ? generic_shutdown_super+0x5b/0xe0 19:14:46: [] ? kill_anon_super+0x16/0x60 19:14:46: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:14:46: [] ? deactivate_super+0x57/0x80 19:14:46: [] ? mntput_no_expire+0xbf/0x110 19:14:46: [] ? sys_umount+0x7b/0x3a0 19:14:46: [] ? system_call_fastpath+0x16/0x1b 19:14:46:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:14:46:Call Trace: 19:14:46: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:14:46: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:14:46: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:14:46: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:14:46: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:14:46: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:14:46: [] ? ll_put_super+0xd9/0x370 [lustre] 19:14:46: [] ? dispose_list+0xfc/0x120 19:14:46: [] ? invalidate_inodes+0xf6/0x190 19:14:46: [] ? generic_shutdown_super+0x5b/0xe0 19:14:46: [] ? kill_anon_super+0x16/0x60 19:14:46: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:14:46: [] ? deactivate_super+0x57/0x80 19:14:46: [] ? mntput_no_expire+0xbf/0x110 19:14:46: [] ? sys_umount+0x7b/0x3a0 19:14:46: [] ? system_call_fastpath+0x16/0x1b 19:14:46:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:16:10:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:16:10:CPU 0 19:16:10:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:16:10: 19:16:10:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:16:11:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:16:11:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:16:11:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:16:11:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:16:11:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:16:11:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:16:11:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:16:11:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:16:11:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:16:11:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:16:11:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:16:11:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:16:11:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:16:11:Stack: 19:16:11: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:16:11: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:16:12: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:16:12:Call Trace: 19:16:12: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:16:12: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:16:12: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:16:12: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:16:12: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:16:12: [] ? ll_put_super+0xd9/0x370 [lustre] 19:16:12: [] ? dispose_list+0xfc/0x120 19:16:12: [] ? invalidate_inodes+0xf6/0x190 19:16:12: [] ? generic_shutdown_super+0x5b/0xe0 19:16:12: [] ? kill_anon_super+0x16/0x60 19:16:12: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:16:12: [] ? deactivate_super+0x57/0x80 19:16:12: [] ? mntput_no_expire+0xbf/0x110 19:16:12: [] ? sys_umount+0x7b/0x3a0 19:16:13: [] ? system_call_fastpath+0x16/0x1b 19:16:13:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:16:13:Call Trace: 19:16:13: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:16:13: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:16:13: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:16:14: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:16:14: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:16:14: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:16:14: [] ? ll_put_super+0xd9/0x370 [lustre] 19:16:14: [] ? dispose_list+0xfc/0x120 19:16:14: [] ? invalidate_inodes+0xf6/0x190 19:16:14: [] ? generic_shutdown_super+0x5b/0xe0 19:16:14: [] ? kill_anon_super+0x16/0x60 19:16:14: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:16:14: [] ? deactivate_super+0x57/0x80 19:16:14: [] ? mntput_no_expire+0xbf/0x110 19:16:14: [] ? sys_umount+0x7b/0x3a0 19:16:15: [] ? system_call_fastpath+0x16/0x1b 19:16:15:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:16:15:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:16:15:CPU 0 19:16:15:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:16:15: 19:16:15:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:16:15:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:16:15:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:16:15:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:16:15:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:16:15:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:16:15:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:16:15:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:16:15:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:16:15:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:16:15:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:16:15:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:16:15:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:16:15:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:16:15:Stack: 19:16:15: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:16:15: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:16:15: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:16:15:Call Trace: 19:16:15: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:16:15: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:16:15: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:16:16: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:16:16: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:16:16: [] ? ll_put_super+0xd9/0x370 [lustre] 19:16:16: [] ? dispose_list+0xfc/0x120 19:16:16: [] ? invalidate_inodes+0xf6/0x190 19:16:16: [] ? generic_shutdown_super+0x5b/0xe0 19:16:16: [] ? kill_anon_super+0x16/0x60 19:16:16: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:16:16: [] ? deactivate_super+0x57/0x80 19:16:16: [] ? mntput_no_expire+0xbf/0x110 19:16:16: [] ? sys_umount+0x7b/0x3a0 19:16:16: [] ? system_call_fastpath+0x16/0x1b 19:16:16:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:16:16:Call Trace: 19:16:16: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:16:16: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:16:16: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:16:16: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:16:16: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:16:16: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:16:16: [] ? ll_put_super+0xd9/0x370 [lustre] 19:16:16: [] ? dispose_list+0xfc/0x120 19:16:16: [] ? invalidate_inodes+0xf6/0x190 19:16:16: [] ? generic_shutdown_super+0x5b/0xe0 19:16:16: [] ? kill_anon_super+0x16/0x60 19:16:16: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:16:17: [] ? deactivate_super+0x57/0x80 19:17:31: [] ? mntput_no_expire+0xbf/0x110 19:17:31: [] ? sys_umount+0x7b/0x3a0 19:17:31: [] ? system_call_fastpath+0x16/0x1b 19:17:31:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:17:32:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:17:32:CPU 0 19:17:32:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:17:32: 19:17:32:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:17:32:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:17:32:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:17:32:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:17:32:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:17:32:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:17:32:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:17:32:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:17:32:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:17:32:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:17:32:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:17:32:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:17:32:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:17:32:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:17:32:Stack: 19:17:32: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:17:32: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:17:32: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:17:32:Call Trace: 19:17:32: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:17:32: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:17:32: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:17:32: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:17:32: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:17:32: [] ? ll_put_super+0xd9/0x370 [lustre] 19:17:32: [] ? dispose_list+0xfc/0x120 19:17:32: [] ? invalidate_inodes+0xf6/0x190 19:17:32: [] ? generic_shutdown_super+0x5b/0xe0 19:17:32: [] ? kill_anon_super+0x16/0x60 19:17:32: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:17:32: [] ? deactivate_super+0x57/0x80 19:17:32: [] ? mntput_no_expire+0xbf/0x110 19:17:32: [] ? sys_umount+0x7b/0x3a0 19:17:32: [] ? system_call_fastpath+0x16/0x1b 19:17:32:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:17:32:Call Trace: 19:17:32: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:17:32: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:17:32: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:17:32: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:17:32: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:17:32: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:17:32: [] ? ll_put_super+0xd9/0x370 [lustre] 19:17:32: [] ? dispose_list+0xfc/0x120 19:18:53: [] ? invalidate_inodes+0xf6/0x190 19:18:53: [] ? generic_shutdown_super+0x5b/0xe0 19:18:53: [] ? kill_anon_super+0x16/0x60 19:18:53: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:18:53: [] ? deactivate_super+0x57/0x80 19:18:53: [] ? mntput_no_expire+0xbf/0x110 19:18:53: [] ? sys_umount+0x7b/0x3a0 19:18:53: [] ? system_call_fastpath+0x16/0x1b 19:18:53:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:18:53:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:18:53:CPU 0 19:18:53:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:18:53: 19:18:53:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:18:53:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:18:53:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:18:53:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:18:53:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:18:53:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:18:53:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:18:53:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:18:53:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:18:53:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:18:53:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:18:54:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:18:54:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:18:54:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:18:54:Stack: 19:18:54: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:18:54: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:18:54: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:18:54:Call Trace: 19:18:54: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:18:54: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:18:54: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:18:54: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:18:54: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:18:54: [] ? ll_put_super+0xd9/0x370 [lustre] 19:18:54: [] ? dispose_list+0xfc/0x120 19:18:54: [] ? invalidate_inodes+0xf6/0x190 19:18:54: [] ? generic_shutdown_super+0x5b/0xe0 19:18:54: [] ? kill_anon_super+0x16/0x60 19:18:54: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:18:54: [] ? deactivate_super+0x57/0x80 19:18:54: [] ? mntput_no_expire+0xbf/0x110 19:18:54: [] ? sys_umount+0x7b/0x3a0 19:18:54: [] ? system_call_fastpath+0x16/0x1b 19:18:54:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:18:54:Call Trace: 19:18:54: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:18:54: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:18:54: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:20:17: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:20:17: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:20:17: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:20:17: [] ? ll_put_super+0xd9/0x370 [lustre] 19:20:17: [] ? dispose_list+0xfc/0x120 19:20:17: [] ? invalidate_inodes+0xf6/0x190 19:20:17: [] ? generic_shutdown_super+0x5b/0xe0 19:20:17: [] ? kill_anon_super+0x16/0x60 19:20:17: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:20:17: [] ? deactivate_super+0x57/0x80 19:20:17: [] ? mntput_no_expire+0xbf/0x110 19:20:17: [] ? sys_umount+0x7b/0x3a0 19:20:17: [] ? system_call_fastpath+0x16/0x1b 19:20:17:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:20:17:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:20:17:CPU 0 19:20:17:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:20:17: 19:20:17:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:20:17:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:20:17:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:20:17:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:20:17:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:20:17:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:20:17:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:20:17:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:20:17:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:20:17:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:20:17:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:20:17:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:20:17:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:20:17:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:20:17:Stack: 19:20:17: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:20:17: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:20:17: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:20:17:Call Trace: 19:20:17: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:20:17: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:20:17: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:20:17: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:20:17: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:20:17: [] ? ll_put_super+0xd9/0x370 [lustre] 19:20:17: [] ? dispose_list+0xfc/0x120 19:20:17: [] ? invalidate_inodes+0xf6/0x190 19:20:17: [] ? generic_shutdown_super+0x5b/0xe0 19:20:17: [] ? kill_anon_super+0x16/0x60 19:20:17: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:20:17: [] ? deactivate_super+0x57/0x80 19:20:17: [] ? mntput_no_expire+0xbf/0x110 19:20:17: [] ? sys_umount+0x7b/0x3a0 19:20:17: [] ? system_call_fastpath+0x16/0x1b 19:21:40:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:21:40:Call Trace: 19:21:40: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:21:40: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:21:40: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:21:40: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:21:40: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:21:40: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:21:40: [] ? ll_put_super+0xd9/0x370 [lustre] 19:21:40: [] ? dispose_list+0xfc/0x120 19:21:40: [] ? invalidate_inodes+0xf6/0x190 19:21:40: [] ? generic_shutdown_super+0x5b/0xe0 19:21:40: [] ? kill_anon_super+0x16/0x60 19:21:40: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:21:40: [] ? deactivate_super+0x57/0x80 19:21:40: [] ? mntput_no_expire+0xbf/0x110 19:21:40: [] ? sys_umount+0x7b/0x3a0 19:21:40: [] ? system_call_fastpath+0x16/0x1b 19:21:40:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:21:40:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:21:40:CPU 0 19:21:40:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:21:40: 19:21:40:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:21:40:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:21:40:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:21:40:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:21:40:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:21:40:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:21:40:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:21:40:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:21:40:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:21:40:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:21:40:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:21:40:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:21:40:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:21:40:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:21:40:Stack: 19:21:40: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:21:40: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:21:40: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:21:40:Call Trace: 19:21:40: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:21:40: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:21:40: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:21:40: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:21:40: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:21:40: [] ? ll_put_super+0xd9/0x370 [lustre] 19:21:40: [] ? dispose_list+0xfc/0x120 19:21:40: [] ? invalidate_inodes+0xf6/0x190 19:21:40: [] ? generic_shutdown_super+0x5b/0xe0 19:21:40: [] ? kill_anon_super+0x16/0x60 19:21:40: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:21:40: [] ? deactivate_super+0x57/0x80 19:21:40: [] ? mntput_no_expire+0xbf/0x110 19:23:12: [] ? sys_umount+0x7b/0x3a0 19:23:12: [] ? system_call_fastpath+0x16/0x1b 19:23:12:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:23:12:Call Trace: 19:23:12: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:23:12: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:23:12: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:23:12: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:23:12: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:23:12: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:23:12: [] ? ll_put_super+0xd9/0x370 [lustre] 19:23:12: [] ? dispose_list+0xfc/0x120 19:23:12: [] ? invalidate_inodes+0xf6/0x190 19:23:12: [] ? generic_shutdown_super+0x5b/0xe0 19:23:12: [] ? kill_anon_super+0x16/0x60 19:23:12: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:23:12: [] ? deactivate_super+0x57/0x80 19:23:12: [] ? mntput_no_expire+0xbf/0x110 19:23:12: [] ? sys_umount+0x7b/0x3a0 19:23:12: [] ? system_call_fastpath+0x16/0x1b 19:23:12:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:23:12:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:23:12:CPU 0 19:23:12:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:23:12: 19:23:12:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:23:12:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:23:12:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:23:12:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:23:12:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:23:12:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:23:13:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:23:13:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:23:13:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:23:13:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:23:13:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:23:13:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:23:13:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:23:13:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:23:13:Stack: 19:23:13: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:23:13: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:23:13: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:23:13:Call Trace: 19:23:13: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:23:13: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:23:13: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:23:13: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:23:13: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:23:13: [] ? ll_put_super+0xd9/0x370 [lustre] 19:23:13: [] ? dispose_list+0xfc/0x120 19:23:13: [] ? invalidate_inodes+0xf6/0x190 19:24:35: [] ? generic_shutdown_super+0x5b/0xe0 19:24:35: [] ? kill_anon_super+0x16/0x60 19:24:35: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:24:35: [] ? deactivate_super+0x57/0x80 19:24:35: [] ? mntput_no_expire+0xbf/0x110 19:24:35: [] ? sys_umount+0x7b/0x3a0 19:24:35: [] ? system_call_fastpath+0x16/0x1b 19:24:35:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:24:35:Call Trace: 19:24:35: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:24:35: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:24:35: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:24:35: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:24:35: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:24:35: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:24:35: [] ? ll_put_super+0xd9/0x370 [lustre] 19:24:35: [] ? dispose_list+0xfc/0x120 19:24:35: [] ? invalidate_inodes+0xf6/0x190 19:24:35: [] ? generic_shutdown_super+0x5b/0xe0 19:24:35: [] ? kill_anon_super+0x16/0x60 19:24:35: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:24:35: [] ? deactivate_super+0x57/0x80 19:24:35: [] ? mntput_no_expire+0xbf/0x110 19:24:35: [] ? sys_umount+0x7b/0x3a0 19:24:35: [] ? system_call_fastpath+0x16/0x1b 19:24:35:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:24:35:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:24:35:CPU 0 19:24:35:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:24:35: 19:24:35:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:24:35:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:24:35:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:24:35:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:24:35:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:24:35:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:24:35:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:24:35:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:24:35:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:24:35:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:24:35:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:24:35:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:24:35:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:24:35:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:24:35:Stack: 19:24:35: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:24:35: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:24:35: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:24:35:Call Trace: 19:24:35: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:24:35: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:24:35: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:26:00: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:26:00: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:26:00: [] ? ll_put_super+0xd9/0x370 [lustre] 19:26:00: [] ? dispose_list+0xfc/0x120 19:26:00: [] ? invalidate_inodes+0xf6/0x190 19:26:00: [] ? generic_shutdown_super+0x5b/0xe0 19:26:00: [] ? kill_anon_super+0x16/0x60 19:26:00: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:26:00: [] ? deactivate_super+0x57/0x80 19:26:00: [] ? mntput_no_expire+0xbf/0x110 19:26:00: [] ? sys_umount+0x7b/0x3a0 19:26:00: [] ? system_call_fastpath+0x16/0x1b 19:26:00:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:26:00:Call Trace: 19:26:00: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:26:00: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:26:00: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:26:00: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:26:00: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:26:00: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:26:00: [] ? ll_put_super+0xd9/0x370 [lustre] 19:26:00: [] ? dispose_list+0xfc/0x120 19:26:00: [] ? invalidate_inodes+0xf6/0x190 19:26:00: [] ? generic_shutdown_super+0x5b/0xe0 19:26:00: [] ? kill_anon_super+0x16/0x60 19:26:00: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:26:00: [] ? deactivate_super+0x57/0x80 19:26:00: [] ? mntput_no_expire+0xbf/0x110 19:26:00: [] ? sys_umount+0x7b/0x3a0 19:26:00: [] ? system_call_fastpath+0x16/0x1b 19:26:00:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:26:00:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:26:00:CPU 0 19:26:00:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:26:00: 19:26:00:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:26:00:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:26:00:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:26:00:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:26:00:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:26:00:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:26:00:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:26:01:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:26:01:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:26:01:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:26:02:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:26:02:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:26:02:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:26:02:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:26:02:Stack: 19:26:02: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:26:02: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:27:16: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:27:16:Call Trace: 19:27:16: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:27:16: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:27:16: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:27:16: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:27:16: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:27:16: [] ? ll_put_super+0xd9/0x370 [lustre] 19:27:16: [] ? dispose_list+0xfc/0x120 19:27:16: [] ? invalidate_inodes+0xf6/0x190 19:27:16: [] ? generic_shutdown_super+0x5b/0xe0 19:27:16: [] ? kill_anon_super+0x16/0x60 19:27:16: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:27:16: [] ? deactivate_super+0x57/0x80 19:27:17: [] ? mntput_no_expire+0xbf/0x110 19:27:17: [] ? sys_umount+0x7b/0x3a0 19:27:17: [] ? system_call_fastpath+0x16/0x1b 19:27:17:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:27:17:Call Trace: 19:27:17: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:27:17: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:27:17: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:27:17: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:27:17: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:27:17: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:27:17: [] ? ll_put_super+0xd9/0x370 [lustre] 19:27:17: [] ? dispose_list+0xfc/0x120 19:27:17: [] ? invalidate_inodes+0xf6/0x190 19:27:17: [] ? generic_shutdown_super+0x5b/0xe0 19:27:17: [] ? kill_anon_super+0x16/0x60 19:27:17: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:27:17: [] ? deactivate_super+0x57/0x80 19:27:17: [] ? mntput_no_expire+0xbf/0x110 19:27:17: [] ? sys_umount+0x7b/0x3a0 19:27:18: [] ? system_call_fastpath+0x16/0x1b 19:27:18:BUG: soft lockup - CPU#0 stuck for 68s! [umount:14036] 19:27:18:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:27:18:CPU 0 19:27:18:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:27:18: 19:27:18:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:27:18:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:27:18:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:27:19:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:27:19:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:27:19:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:27:19:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:27:19:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:27:19:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:27:19:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:27:19:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:27:19:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:28:41:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:28:41:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:28:41:Stack: 19:28:41: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:28:41: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:28:41: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:28:41:Call Trace: 19:28:41: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:28:41: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:28:41: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:28:41: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:28:41: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:28:41: [] ? ll_put_super+0xd9/0x370 [lustre] 19:28:41: [] ? dispose_list+0xfc/0x120 19:28:41: [] ? invalidate_inodes+0xf6/0x190 19:28:41: [] ? generic_shutdown_super+0x5b/0xe0 19:28:41: [] ? kill_anon_super+0x16/0x60 19:28:41: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:28:41: [] ? deactivate_super+0x57/0x80 19:28:41: [] ? mntput_no_expire+0xbf/0x110 19:28:41: [] ? sys_umount+0x7b/0x3a0 19:28:41: [] ? system_call_fastpath+0x16/0x1b 19:28:41:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:28:42:Call Trace: 19:28:42: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:28:42: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:28:42: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:28:42: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:28:42: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:28:42: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:28:42: [] ? ll_put_super+0xd9/0x370 [lustre] 19:28:42: [] ? dispose_list+0xfc/0x120 19:28:42: [] ? invalidate_inodes+0xf6/0x190 19:28:42: [] ? generic_shutdown_super+0x5b/0xe0 19:28:42: [] ? kill_anon_super+0x16/0x60 19:28:42: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:28:42: [] ? deactivate_super+0x57/0x80 19:28:42: [] ? mntput_no_expire+0xbf/0x110 19:28:42: [] ? sys_umount+0x7b/0x3a0 19:28:42: [] ? system_call_fastpath+0x16/0x1b 19:28:42:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:28:42:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:28:42:CPU 0 19:28:42:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:28:42: 19:28:42:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:28:42:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:28:42:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:28:42:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:28:42:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:28:42:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:28:42:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:28:42:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:30:05:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:30:05:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:30:05:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:30:05:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:30:05:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:30:05:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:30:05:Stack: 19:30:05: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:30:05: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:30:05: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:30:05:Call Trace: 19:30:05: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:30:05: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:30:05: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:30:05: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:30:05: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:30:05: [] ? ll_put_super+0xd9/0x370 [lustre] 19:30:05: [] ? dispose_list+0xfc/0x120 19:30:05: [] ? invalidate_inodes+0xf6/0x190 19:30:06: [] ? generic_shutdown_super+0x5b/0xe0 19:30:06: [] ? kill_anon_super+0x16/0x60 19:30:06: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:30:06: [] ? deactivate_super+0x57/0x80 19:30:06: [] ? mntput_no_expire+0xbf/0x110 19:30:06: [] ? sys_umount+0x7b/0x3a0 19:30:06: [] ? system_call_fastpath+0x16/0x1b 19:30:06:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:30:06:Call Trace: 19:30:06: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:30:06: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:30:06: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:30:06: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:30:06: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:30:06: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:30:06: [] ? ll_put_super+0xd9/0x370 [lustre] 19:30:06: [] ? dispose_list+0xfc/0x120 19:30:06: [] ? invalidate_inodes+0xf6/0x190 19:30:06: [] ? generic_shutdown_super+0x5b/0xe0 19:30:06: [] ? kill_anon_super+0x16/0x60 19:30:06: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:30:06: [] ? deactivate_super+0x57/0x80 19:30:06: [] ? mntput_no_expire+0xbf/0x110 19:30:06: [] ? sys_umount+0x7b/0x3a0 19:30:06: [] ? system_call_fastpath+0x16/0x1b 19:30:06:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:30:06:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:30:06:CPU 0 19:30:06:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:30:06: 19:30:06:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:30:06:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:30:06:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:30:06:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:31:30:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:31:30:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:31:30:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:31:30:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:31:30:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:31:30:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:31:30:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:31:30:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:31:30:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:31:30:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:31:30:Stack: 19:31:30: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:31:30: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:31:30: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:31:30:Call Trace: 19:31:30: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:31:30: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:31:30: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:31:30: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:31:30: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:31:30: [] ? ll_put_super+0xd9/0x370 [lustre] 19:31:30: [] ? dispose_list+0xfc/0x120 19:31:30: [] ? invalidate_inodes+0xf6/0x190 19:31:30: [] ? generic_shutdown_super+0x5b/0xe0 19:31:30: [] ? kill_anon_super+0x16/0x60 19:31:30: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:31:30: [] ? deactivate_super+0x57/0x80 19:31:30: [] ? mntput_no_expire+0xbf/0x110 19:31:30: [] ? sys_umount+0x7b/0x3a0 19:31:30: [] ? system_call_fastpath+0x16/0x1b 19:31:30:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:31:30:Call Trace: 19:31:30: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:31:30: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:31:30: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:31:30: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:31:30: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:31:30: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:31:30: [] ? ll_put_super+0xd9/0x370 [lustre] 19:31:30: [] ? dispose_list+0xfc/0x120 19:31:30: [] ? invalidate_inodes+0xf6/0x190 19:31:30: [] ? generic_shutdown_super+0x5b/0xe0 19:31:30: [] ? kill_anon_super+0x16/0x60 19:31:30: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:31:30: [] ? deactivate_super+0x57/0x80 19:31:30: [] ? mntput_no_expire+0xbf/0x110 19:31:30: [] ? sys_umount+0x7b/0x3a0 19:31:30: [] ? system_call_fastpath+0x16/0x1b 19:31:30:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:31:30:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:31:30:CPU 0 19:31:30:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:31:30: 19:32:52:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:32:52:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:32:52:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:32:52:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:32:52:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:32:52:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:32:52:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:32:52:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:32:52:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:32:52:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:32:52:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:32:52:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:32:52:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:32:52:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:32:52:Stack: 19:32:52: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:32:52: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:32:52: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:32:52:Call Trace: 19:32:52: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:32:52: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:32:52: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:32:52: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:32:52: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:32:52: [] ? ll_put_super+0xd9/0x370 [lustre] 19:32:52: [] ? dispose_list+0xfc/0x120 19:32:52: [] ? invalidate_inodes+0xf6/0x190 19:32:52: [] ? generic_shutdown_super+0x5b/0xe0 19:32:52: [] ? kill_anon_super+0x16/0x60 19:32:52: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:32:52: [] ? deactivate_super+0x57/0x80 19:32:52: [] ? mntput_no_expire+0xbf/0x110 19:32:52: [] ? sys_umount+0x7b/0x3a0 19:32:52: [] ? system_call_fastpath+0x16/0x1b 19:32:52:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:32:52:Call Trace: 19:32:52: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:32:52: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:32:52: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:32:52: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:32:52: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:32:52: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:32:52: [] ? ll_put_super+0xd9/0x370 [lustre] 19:32:52: [] ? dispose_list+0xfc/0x120 19:32:52: [] ? invalidate_inodes+0xf6/0x190 19:32:52: [] ? generic_shutdown_super+0x5b/0xe0 19:32:52: [] ? kill_anon_super+0x16/0x60 19:32:52: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:32:52: [] ? deactivate_super+0x57/0x80 19:32:52: [] ? mntput_no_expire+0xbf/0x110 19:32:52: [] ? sys_umount+0x7b/0x3a0 19:32:52: [] ? system_call_fastpath+0x16/0x1b 19:32:52:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:32:52:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:32:52:CPU 0 19:34:24:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:34:24: 19:34:24:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:34:24:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:34:24:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:34:24:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:34:24:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:34:24:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:34:24:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:34:24:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:34:24:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:34:24:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:34:24:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:34:24:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:34:24:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:34:24:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:34:24:Stack: 19:34:24: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:34:24: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:34:24: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:34:24:Call Trace: 19:34:24: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:34:24: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:34:24: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:34:24: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:34:24: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:34:24: [] ? ll_put_super+0xd9/0x370 [lustre] 19:34:24: [] ? dispose_list+0xfc/0x120 19:34:24: [] ? invalidate_inodes+0xf6/0x190 19:34:24: [] ? generic_shutdown_super+0x5b/0xe0 19:34:24: [] ? kill_anon_super+0x16/0x60 19:34:24: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:34:24: [] ? deactivate_super+0x57/0x80 19:34:24: [] ? mntput_no_expire+0xbf/0x110 19:34:24: [] ? sys_umount+0x7b/0x3a0 19:34:24: [] ? system_call_fastpath+0x16/0x1b 19:34:24:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:34:24:Call Trace: 19:34:24: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:34:24: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:34:24: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:34:24: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:34:24: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:34:24: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:34:24: [] ? ll_put_super+0xd9/0x370 [lustre] 19:34:24: [] ? dispose_list+0xfc/0x120 19:34:24: [] ? invalidate_inodes+0xf6/0x190 19:34:24: [] ? generic_shutdown_super+0x5b/0xe0 19:34:24: [] ? kill_anon_super+0x16/0x60 19:34:24: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:34:24: [] ? deactivate_super+0x57/0x80 19:34:24: [] ? mntput_no_expire+0xbf/0x110 19:34:24: [] ? sys_umount+0x7b/0x3a0 19:34:24: [] ? system_call_fastpath+0x16/0x1b 19:34:24:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:34:24:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:34:24:CPU 0 19:35:46:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:35:46: 19:35:46:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:35:46:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:35:46:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:35:46:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:35:46:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:35:46:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:35:46:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:35:46:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:35:46:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:35:46:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:35:46:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:35:46:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:35:46:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:35:46:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:35:46:Stack: 19:35:46: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:35:46: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:35:46: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:35:46:Call Trace: 19:35:46: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:35:46: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:35:46: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:35:46: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:35:46: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:35:46: [] ? ll_put_super+0xd9/0x370 [lustre] 19:35:46: [] ? dispose_list+0xfc/0x120 19:35:46: [] ? invalidate_inodes+0xf6/0x190 19:35:46: [] ? generic_shutdown_super+0x5b/0xe0 19:35:46: [] ? kill_anon_super+0x16/0x60 19:35:46: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:35:46: [] ? deactivate_super+0x57/0x80 19:35:46: [] ? mntput_no_expire+0xbf/0x110 19:35:46: [] ? sys_umount+0x7b/0x3a0 19:35:46: [] ? system_call_fastpath+0x16/0x1b 19:35:46:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:35:46:Call Trace: 19:35:46: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:35:46: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:35:46: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:35:46: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:35:46: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:35:46: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:35:46: [] ? ll_put_super+0xd9/0x370 [lustre] 19:35:46: [] ? dispose_list+0xfc/0x120 19:35:46: [] ? invalidate_inodes+0xf6/0x190 19:35:46: [] ? generic_shutdown_super+0x5b/0xe0 19:35:46: [] ? kill_anon_super+0x16/0x60 19:35:46: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:35:46: [] ? deactivate_super+0x57/0x80 19:35:46: [] ? mntput_no_expire+0xbf/0x110 19:35:46: [] ? sys_umount+0x7b/0x3a0 19:35:46: [] ? system_call_fastpath+0x16/0x1b 19:35:46:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:37:08:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:37:08:CPU 0 19:37:08:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:37:08: 19:37:08:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:37:08:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:37:08:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:37:11:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:37:11:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:37:11:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:37:11:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:37:11:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:37:11:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:37:11:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:37:11:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:37:11:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:37:11:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:37:11:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:37:11:Stack: 19:37:11: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:37:11: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:37:11: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:37:11:Call Trace: 19:37:11: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:37:11: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:37:11: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:37:11: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:37:11: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:37:11: [] ? ll_put_super+0xd9/0x370 [lustre] 19:37:11: [] ? dispose_list+0xfc/0x120 19:37:11: [] ? invalidate_inodes+0xf6/0x190 19:37:11: [] ? generic_shutdown_super+0x5b/0xe0 19:37:11: [] ? kill_anon_super+0x16/0x60 19:37:11: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:37:11: [] ? deactivate_super+0x57/0x80 19:37:11: [] ? mntput_no_expire+0xbf/0x110 19:37:11: [] ? sys_umount+0x7b/0x3a0 19:37:11: [] ? system_call_fastpath+0x16/0x1b 19:37:11:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:37:11:Call Trace: 19:37:11: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:37:11: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:37:12: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:37:12: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:37:12: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:37:12: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:37:12: [] ? ll_put_super+0xd9/0x370 [lustre] 19:37:12: [] ? dispose_list+0xfc/0x120 19:37:12: [] ? invalidate_inodes+0xf6/0x190 19:37:12: [] ? generic_shutdown_super+0x5b/0xe0 19:37:12: [] ? kill_anon_super+0x16/0x60 19:37:12: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:37:12: [] ? deactivate_super+0x57/0x80 19:37:12: [] ? mntput_no_expire+0xbf/0x110 19:37:12: [] ? sys_umount+0x7b/0x3a0 19:37:12: [] ? system_call_fastpath+0x16/0x1b 19:37:12:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:37:12:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:37:12:CPU 0 19:37:12:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:37:12: 19:37:12:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:37:12:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:37:12:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:37:12:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:37:12:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:37:12:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:37:12:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:37:12:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:37:12:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:37:12:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:37:12:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:37:12:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:37:12:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:37:12:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:37:12:Stack: 19:37:12: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:37:12: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:37:13: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:37:13:Call Trace: 19:37:13: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:37:13: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:37:13: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:37:13: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:37:13: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:37:13: [] ? ll_put_super+0xd9/0x370 [lustre] 19:37:13: [] ? dispose_list+0xfc/0x120 19:37:13: [] ? invalidate_inodes+0xf6/0x190 19:37:13: [] ? generic_shutdown_super+0x5b/0xe0 19:37:13: [] ? kill_anon_super+0x16/0x60 19:37:13: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:37:13: [] ? deactivate_super+0x57/0x80 19:37:13: [] ? mntput_no_expire+0xbf/0x110 19:37:13: [] ? sys_umount+0x7b/0x3a0 19:37:13: [] ? system_call_fastpath+0x16/0x1b 19:37:13:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:37:13:Call Trace: 19:37:13: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:37:13: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:37:13: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:37:13: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:37:15: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:37:15: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:37:15: [] ? ll_put_super+0xd9/0x370 [lustre] 19:37:15: [] ? dispose_list+0xfc/0x120 19:37:15: [] ? invalidate_inodes+0xf6/0x190 19:37:15: [] ? generic_shutdown_super+0x5b/0xe0 19:37:15: [] ? kill_anon_super+0x16/0x60 19:37:15: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:37:15: [] ? deactivate_super+0x57/0x80 19:37:15: [] ? mntput_no_expire+0xbf/0x110 19:38:27: [] ? sys_umount+0x7b/0x3a0 19:38:27: [] ? system_call_fastpath+0x16/0x1b 19:38:27:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:38:27:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:38:27:CPU 0 19:38:27:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:38:27: 19:38:27:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:38:27:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:38:27:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:38:27:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:38:27:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:38:27:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:38:27:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:38:27:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:38:28:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:38:28:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:38:28:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:38:28:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:38:28:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:38:28:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:38:28:Stack: 19:38:28: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:38:28: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:38:28: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:38:28:Call Trace: 19:38:28: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:38:28: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:38:28: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:38:28: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:38:28: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:38:28: [] ? ll_put_super+0xd9/0x370 [lustre] 19:38:28: [] ? dispose_list+0xfc/0x120 19:38:28: [] ? invalidate_inodes+0xf6/0x190 19:38:28: [] ? generic_shutdown_super+0x5b/0xe0 19:38:28: [] ? kill_anon_super+0x16/0x60 19:38:28: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:38:28: [] ? deactivate_super+0x57/0x80 19:38:28: [] ? mntput_no_expire+0xbf/0x110 19:38:28: [] ? sys_umount+0x7b/0x3a0 19:38:28: [] ? system_call_fastpath+0x16/0x1b 19:38:28:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:38:28:Call Trace: 19:38:28: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:38:28: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:38:28: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:38:28: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:38:28: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:38:28: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:38:28: [] ? ll_put_super+0xd9/0x370 [lustre] 19:38:28: [] ? dispose_list+0xfc/0x120 19:38:28: [] ? invalidate_inodes+0xf6/0x190 19:39:51: [] ? generic_shutdown_super+0x5b/0xe0 19:39:51: [] ? kill_anon_super+0x16/0x60 19:39:51: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:39:51: [] ? deactivate_super+0x57/0x80 19:39:52: [] ? mntput_no_expire+0xbf/0x110 19:39:52: [] ? sys_umount+0x7b/0x3a0 19:39:52: [] ? system_call_fastpath+0x16/0x1b 19:39:52:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:39:52:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:39:53:CPU 0 19:39:53:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:39:53: 19:39:53:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:39:53:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:39:53:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:39:53:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:39:53:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:39:53:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:39:53:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:39:53:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:39:53:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:39:53:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:39:55:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:39:55:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:39:55:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:39:55:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:39:55:Stack: 19:39:55: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:39:55: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:39:55: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:39:55:Call Trace: 19:39:55: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:39:55: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:39:55: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:39:55: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:39:55: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:39:55: [] ? ll_put_super+0xd9/0x370 [lustre] 19:39:55: [] ? dispose_list+0xfc/0x120 19:39:55: [] ? invalidate_inodes+0xf6/0x190 19:39:55: [] ? generic_shutdown_super+0x5b/0xe0 19:39:55: [] ? kill_anon_super+0x16/0x60 19:39:55: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:39:55: [] ? deactivate_super+0x57/0x80 19:39:55: [] ? mntput_no_expire+0xbf/0x110 19:39:55: [] ? sys_umount+0x7b/0x3a0 19:39:55: [] ? system_call_fastpath+0x16/0x1b 19:39:55:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:39:55:Call Trace: 19:39:55: [] ? lu_site_purge+0x103/0x4a0 [obdclass] 19:39:55: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:39:55: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:39:55: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:41:18: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:41:18: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:41:18: [] ? ll_put_super+0xd9/0x370 [lustre] 19:41:18: [] ? dispose_list+0xfc/0x120 19:41:19: [] ? invalidate_inodes+0xf6/0x190 19:41:19: [] ? generic_shutdown_super+0x5b/0xe0 19:41:19: [] ? kill_anon_super+0x16/0x60 19:41:19: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:41:19: [] ? deactivate_super+0x57/0x80 19:41:19: [] ? mntput_no_expire+0xbf/0x110 19:41:19: [] ? sys_umount+0x7b/0x3a0 19:41:19: [] ? system_call_fastpath+0x16/0x1b 19:41:19:BUG: soft lockup - CPU#0 stuck for 67s! [umount:14036] 19:41:19:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:41:19:CPU 0 19:41:19:Modules linked in: lustre(U) obdecho(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) ext2 sha512_generic sha256_generic nfsd exportfs autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ipv6 ib_sa ib_mad ib_core microcode virtio_balloon 8139too 8139cp mii i2c_piix4 i2c_core ext3 jbd mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: libcfs] 19:41:19: 19:41:19:Pid: 14036, comm: umount Not tainted 2.6.32-358.11.1.el6.x86_64 #1 Red Hat KVM 19:41:19:RIP: 0010:[] [] lu_site_purge+0x120/0x4a0 [obdclass] 19:41:19:RSP: 0018:ffff88003c8afc08 EFLAGS: 00010286 19:41:19:RAX: 0000000000008000 RBX: ffff88003c8afca8 RCX: ffffc9000181f018 19:41:19:RDX: 0000000000000030 RSI: 0000000000000030 RDI: ffff88007c3c8f00 19:41:19:RBP: ffffffff8100bb8e R08: 00000000ffffff0a R09: 0000000000000000 19:41:19:R10: 000000000000000f R11: 000000000000000f R12: 0000000000000000 19:41:19:R13: ffff880079c1b0c0 R14: ffff88003c8afc68 R15: ffff88007c3c8f00 19:41:19:FS: 00007f0107aa8740(0000) GS:ffff880002200000(0000) knlGS:0000000000000000 19:41:19:CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b 19:41:19:CR2: ffffc9000181f020 CR3: 0000000065b0f000 CR4: 00000000000006f0 19:41:19:DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 19:41:19:DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 19:41:19:Process umount (pid: 14036, threadinfo ffff88003c8ae000, task ffff880067d5eae0) 19:41:19:Stack: 19:41:19: 00000000000036d4 ffff88003c8afc58 ffff88006a17fc68 000000e0ffffffff 19:41:19: 000000e000000000 ffffc90001815020 ffffc90001817000 ffff88006a17fc68 19:41:19: ffffc90001815020 ffff88006a17fc60 ffff88003c8afc58 ffff88003c8afc58 19:41:19:Call Trace: 19:41:19: [] ? libcfs_debug_msg+0x41/0x50 [libcfs] 19:41:20: [] ? lu_stack_fini+0x2d/0xc0 [obdclass] 19:41:20: [] ? cl_stack_fini+0xe/0x10 [obdclass] 19:41:20: [] ? cl_sb_fini+0x6d/0x190 [lustre] 19:41:20: [] ? client_common_put_super+0x54/0xaa0 [lustre] 19:41:20: [] ? ll_put_super+0xd9/0x370 [lustre] 19:41:20: [] ? dispose_list+0xfc/0x120 19:41:20: [] ? invalidate_inodes+0xf6/0x190 19:41:20: [] ? generic_shutdown_super+0x5b/0xe0 19:41:20: [] ? kill_anon_super+0x16/0x60 19:41:20: [] ? lustre_kill_super+0x4a/0x60 [obdclass] 19:41:20: [] ? deactivate_super+0x57/0x80 19:41:20: [] ? mntput_no_expire+0xbf/0x110 19:41:20: [] ? sys_umount+0x7b/0x3a0 19:41:20: [] ? system_call_fastpath+0x16/0x1b 19:41:20:Code: 4d 8b 7d 00 49 8b 47 18 4c 89 ff ff 50 08 41 0f b7 57 2e 41 0f b6 4f 36 0f b7 f2 d3 e0 8d 4c 06 18 48 63 c9 48 29 d1 48 03 4d 90 <48> 8b 51 08 48 83 c1 08 4c 8d 7a c8 48 39 ca 49 8b 47 38 48 89 19:41:20:Call Trace: