[47400.288764] Lustre: DEBUG MARKER: /usr/sbin/lctl mark == ost-pools test 18: File create in a directory which references a deleted pool ===================== 01:16:28 \(1434356188\)
[47400.681119] Lustre: DEBUG MARKER: == ost-pools test 18: File create in a directory which references a deleted pool ===================== 01:16:28 (1434356188)
[47401.792963] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47402.021937] Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n osd*.*MD*.force_sync 1
[47402.355179] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47403.631867] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47404.910225] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47406.173498] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47407.433753] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47408.754109] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47409.944647] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47411.194761] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47412.424538] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47442.232084] Lustre: DEBUG MARKER: lctl pool_new lustre.testpool
[47452.524195] Lustre: DEBUG MARKER: lctl pool_add lustre.testpool lustre-OST[0000-0006/1]
[47461.462995] Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
[47481.660971] ------------[ cut here ]------------
[47481.662751] WARNING: at /var/lib/jenkins/workspace/lustre-master/arch/x86_64/build_type/server/distro/el7/ib_stack/inkernel/BUILD/BUILD/lustre-2.7.55/ldiskfs/ext4_jbd2.c:260 __ldiskfs_handle_dirty_metadata+0x1c2/0x220 [ldiskfs]()
[47481.665841] Modules linked in: loop osp(OF) mdd(OF) lod(OF) mdt(OF) lfsck(OF) mgs(OF) mgc(OF) osd_ldiskfs(OF) lquota(OF) fid(OF) fld(OF) ksocklnd(OF) ptlrpc(OF) obdclass(OF) lnet(OF) sha512_generic libcfs(OF) ldiskfs(OF) dm_mod rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd fscache xprtrdma sunrpc ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ppdev serio_raw pcspkr parport_pc parport virtio_balloon i2c_piix4 ib_addr ext4 mbcache jbd2 ata_generic pata_acpi 8139too virtio_blk cirrus syscopyarea sysfillrect sysimgblt drm_kms_helper ttm drm virtio_pci 8139cp virtio_ring mii virtio ata_piix libata i2c_core floppy
[47481.678942] CPU: 0 PID: 565 Comm: mdt00_002 Tainted: GF       W  O--------------   3.10.0-229.4.2.el7_lustre.x86_64 #1
[47481.680890] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007
[47481.682532]  0000000000000000 00000000b7c54144 ffff88006963b7f8 ffffffff816050da
[47481.684337]  ffff88006963b830 ffffffff8106e34b ffff880057224680 ffff88007b994ae0
[47481.686152]  0000000000000000 ffffffffa05b49c0 00000000000013f7 ffff88006963b840
[47481.687984] Call Trace:
[47481.689419]  [<ffffffff816050da>] dump_stack+0x19/0x1b
[47481.691178]  [<ffffffff8106e34b>] warn_slowpath_common+0x6b/0xb0
[47481.692969]  [<ffffffff8106e49a>] warn_slowpath_null+0x1a/0x20
[47481.694722]  [<ffffffffa055f6b2>] __ldiskfs_handle_dirty_metadata+0x1c2/0x220 [ldiskfs]
[47481.696632]  [<ffffffffa0575fa4>] ? ldiskfs_dirty_inode+0x54/0x60 [ldiskfs]
[47481.698767]  [<ffffffffa0582676>] ldiskfs_free_blocks+0x5e6/0xb90 [ldiskfs]
[47481.700655]  [<ffffffff812e0ca9>] ? pointer.isra.17+0x1b9/0x490
[47481.702479]  [<ffffffffa0576f75>] ldiskfs_xattr_release_block+0x275/0x330 [ldiskfs]
[47481.704345]  [<ffffffffa057a1ab>] ldiskfs_xattr_delete_inode+0x2bb/0x300 [ldiskfs]
[47481.706278]  [<ffffffffa0574ad5>] ldiskfs_evict_inode+0x1b5/0x610 [ldiskfs]
[47481.708108]  [<ffffffff811e23d7>] evict+0xa7/0x170
[47481.709854]  [<ffffffff811e2c15>] iput+0xf5/0x180
[47481.711543]  [<ffffffffa0ba1e73>] osd_object_delete+0x1d3/0x300 [osd_ldiskfs]
[47481.713520]  [<ffffffffa07566ad>] lu_object_free.isra.30+0x9d/0x1a0 [obdclass]
[47481.715393]  [<ffffffffa0756872>] lu_object_put+0xc2/0x320 [obdclass]
[47481.717283]  [<ffffffffa0d63b56>] mdt_reint_unlink+0x796/0x11b0 [mdt]
[47481.719287]  [<ffffffffa09ac070>] ? lustre_msg_buf_v2+0x1b0/0x1b0 [ptlrpc]
[47481.721162]  [<ffffffffa077880e>] ? lu_ucred+0x1e/0x30 [obdclass]
[47481.722845]  [<ffffffffa0d671d0>] mdt_reint_rec+0x80/0x210 [mdt]
[47481.724579]  [<ffffffffa0d4ae6c>] mdt_reint_internal+0x58c/0x780 [mdt]
[47481.726287]  [<ffffffffa0d54167>] mdt_reint+0x67/0x140 [mdt]
[47481.728052]  [<ffffffffa0a097e5>] tgt_request_handle+0x6d5/0x1060 [ptlrpc]
[47481.729866]  [<ffffffffa09b972b>] ptlrpc_server_handle_request+0x21b/0xa90 [ptlrpc]
[47481.731783]  [<ffffffffa09b72a8>] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc]
[47481.733583]  [<ffffffff810a9662>] ? default_wake_function+0x12/0x20
[47481.735408]  [<ffffffff810a0898>] ? __wake_up_common+0x58/0x90
[47481.737177]  [<ffffffffa09bd918>] ptlrpc_main+0xaf8/0x1ea0 [ptlrpc]
[47481.741378]  [<ffffffffa09bce20>] ? ptlrpc_register_service+0xf00/0xf00 [ptlrpc]
[47481.744096]  [<ffffffff8109739f>] kthread+0xcf/0xe0
[47481.745924]  [<ffffffff810972d0>] ? kthread_create_on_node+0x140/0x140
[47481.747826]  [<ffffffff81614f7c>] ret_from_fork+0x7c/0xb0
[47481.749626]  [<ffffffff810972d0>] ? kthread_create_on_node+0x140/0x140
[47481.751541] ---[ end trace d2044b06032067c6 ]---
[47481.753203] LDISKFS-fs: ldiskfs_free_blocks:5111: aborting transaction: error 28 in __ldiskfs_handle_dirty_metadata
[47481.755276] LDISKFS: jbd2_journal_dirty_metadata failed: handle type 5 started at line 240, credits 3/0, errcode -28
[47481.756083] LDISKFS-fs error (device dm-0) in ldiskfs_free_blocks:5123: error 28
[47481.767617] Aborting journal on device dm-0-8.
[47481.774915] LDISKFS-fs (dm-0): Remounting filesystem read-only
[47481.777496] LDISKFS-fs warning (device dm-0): ldiskfs_evict_inode:274: couldn't extend journal (err -30)
[47481.779967] LDISKFS-fs error (device dm-0) in ldiskfs_evict_inode:303: error 28
[47481.782246] ------------[ cut here ]------------
[47481.783185] kernel BUG at fs/jbd2/commit.c:582!
[47481.783185] invalid opcode: 0000 [#1] SMP 
[47481.783185] Modules linked in: loop osp(OF) mdd(OF) lod(OF) mdt(OF) lfsck(OF) mgs(OF) mgc(OF) osd_ldiskfs(OF) lquota(OF) fid(OF) fld(OF) ksocklnd(OF) ptlrpc(OF) obdclass(OF) lnet(OF) sha512_generic libcfs(OF) ldiskfs(OF) dm_mod rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd fscache xprtrdma sunrpc ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ppdev serio_raw pcspkr parport_pc parport virtio_balloon i2c_piix4 ib_addr ext4 mbcache jbd2 ata_generic pata_acpi 8139too virtio_blk cirrus syscopyarea sysfillrect sysimgblt drm_kms_helper ttm drm virtio_pci 8139cp virtio_ring mii virtio ata_piix libata i2c_core floppy
[47481.792511] CPU: 0 PID: 543 Comm: jbd2/dm-0-8 Tainted: GF       W  O--------------   3.10.0-229.4.2.el7_lustre.x86_64 #1
[47481.792511] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007
[47481.792511] task: ffff880069decfa0 ti: ffff8800799a8000 task.ti: ffff8800799a8000
[47481.792511] RIP: 0010:[<ffffffffa014b958>]  [<ffffffffa014b958>] jbd2_journal_commit_transaction+0x1938/0x19a0 [jbd2]
[47481.792511] RSP: 0018:ffff8800799abcb0  EFLAGS: 00010202
[47481.792511] RAX: 0000000000000021 RBX: ffff88006b9dd828 RCX: 0000000000000838
[47481.792511] RDX: 0000000102cfefd6 RSI: 0000000000000100 RDI: ffff88006b9dd82c
[47481.792511] RBP: ffff8800799abe40 R08: 000000000001af50 R09: ffff88007fc1af50
[47481.792511] R10: ffffffffa014dfba R11: ffffea000138c480 R12: ffff88006b9dd8c0
[47481.792511] R13: ffff88006b9dd800 R14: ffff8800572b5a40 R15: ffff8800572b5a00
[47481.792511] FS:  0000000000000000(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000
[47481.792511] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[47481.792511] CR2: 00007f542e2f1000 CR3: 000000007849d000 CR4: 00000000000006f0
[47481.792511] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[47481.792511] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[47481.792511] Stack:
[47481.792511]  00002b2f36c31cf4 ffff8800799abcf8 00000008810b1ddc ffff8800572b5a9c
[47481.792511]  ffff8800799abcf8 ffffffff810aed7e ffff880000000000 ffff88007b3e6000
[47481.792511]  0000000000000001 ffff8800799abd48 ffff8800572b5a50 ffff8800799abd18
[47481.792511] Call Trace:
[47481.792511]  [<ffffffff810aed7e>] ? account_entity_dequeue+0xae/0xd0
[47481.792511]  [<ffffffff810ad8b6>] ? __dequeue_entity+0x26/0x40
[47481.792511]  [<ffffffff810125f6>] ? __switch_to+0x136/0x4a0
[47481.792511]  [<ffffffffa014fdb9>] kjournald2+0xc9/0x270 [jbd2]
[47481.792511]  [<ffffffff81098350>] ? wake_up_bit+0x30/0x30
[47481.792511]  [<ffffffffa014fcf0>] ? commit_timeout+0x10/0x10 [jbd2]
[47481.792511]  [<ffffffff8109739f>] kthread+0xcf/0xe0
[47481.792511]  [<ffffffff810972d0>] ? kthread_create_on_node+0x140/0x140
[47481.792511]  [<ffffffff81614f7c>] ret_from_fork+0x7c/0xb0
[47481.792511]  [<ffffffff810972d0>] ? kthread_create_on_node+0x140/0x140
[47481.792511] Code: e8 ce 71 00 00 e9 46 f4 ff ff 48 8b 8d e0 fe ff ff 48 89 81 68 04 00 00 e9 47 fb ff ff 0f 0b 0f 0b 0f 0b 0f 0b 0f 0b 0f 0b 0f 0b <0f> 0b 4c 89 f7 e8 ee e7 0a e1 e9 5e ed ff ff 0f 0b 0f 0b 0f 1f 
[47481.792511] RIP  [<ffffffffa014b958>] jbd2_journal_commit_transaction+0x1938/0x19a0 [jbd2]
[47481.792511]  RSP <ffff8800799abcb0>
[47481.964364] ------------[ cut here ]------------
[47481.964364] kernel BUG at arch/x86/mm/pageattr.c:216!
[47481.964364] invalid opcode: 0000 [#2] SMP 
[47481.964364] Modules linked in: loop osp(OF) mdd(OF) lod(OF) mdt(OF) lfsck(OF) mgs(OF) mgc(OF) osd_ldiskfs(OF) lquota(OF) fid(OF) fld(OF) ksocklnd(OF) ptlrpc(OF) obdclass(OF) lnet(OF) sha512_generic libcfs(OF) ldiskfs(OF) dm_mod rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd fscache xprtrdma sunrpc ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ppdev serio_raw pcspkr parport_pc parport virtio_balloon i2c_piix4 ib_addr ext4 mbcache jbd2 ata_generic pata_acpi 8139too virtio_blk cirrus syscopyarea sysfillrect sysimgblt drm_kms_helper ttm drm virtio_pci 8139cp virtio_ring mii virtio ata_piix libata i2c_core floppy
[47481.964364] CPU: 0 PID: 543 Comm: jbd2/dm-0-8 Tainted: GF       W  O--------------   3.10.0-229.4.2.el7_lustre.x86_64 #1
[47481.964364] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007
[47481.964364] task: ffff880069decfa0 ti: ffff8800799a8000 task.ti: ffff8800799a8000
[47481.964364] RIP: 0010:[<ffffffff8105c2ef>]  [<ffffffff8105c2ef>] change_page_attr_set_clr+0x4ef/0x500
[47481.964364] RSP: 0018:ffff8800799ab060  EFLAGS: 00010046
[47481.964364] RAX: 0000000000000046 RBX: 0000000000000000 RCX: 0000000000000010
[47481.964364] RDX: 0000000000002000 RSI: 0000000000000000 RDI: 0000000080000000
[47481.964364] RBP: ffff8800799ab0f8 R08: 0000000000000004 R09: 000000000006b0ac
[47481.964364] R10: 0000000000003689 R11: 0000000000000400 R12: 0000000000000010
[47481.964364] R13: 0000000000000000 R14: 0000000000000200 R15: 0000000000000005
[47481.964364] FS:  0000000000000000(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000
[47481.964364] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[47481.964364] CR2: 00007f542e2f1000 CR3: 000000000190e000 CR4: 00000000000006f0
[47481.964364] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[47481.964364] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[47481.964364] Stack:
[47481.964364]  000000045a5a5a5a ffff880000000000 0000000000000000 ffff88004f0ca000
[47481.964364]  ffff880069decfa0 0000000000000000 0000000000000000 0000000000000010
[47481.964364]  0000000000000000 0000000500000001 000000000006b0ac 0000020000000000
[47481.964364] Call Trace:
[47481.964364]  [<ffffffff8105c646>] _set_pages_array+0xe6/0x130
[47481.964364]  [<ffffffff8105c6c3>] set_pages_array_wc+0x13/0x20
[47481.964364]  [<ffffffffa011a3af>] ttm_set_pages_caching+0x2f/0x70 [ttm]
[47481.964364]  [<ffffffffa011a4f4>] ttm_alloc_new_pages.isra.7+0xb4/0x180 [ttm]
[47481.964364]  [<ffffffffa011ae50>] ttm_pool_populate+0x3e0/0x500 [ttm]
[47481.964364]  [<ffffffffa013632e>] cirrus_ttm_tt_populate+0xe/0x10 [cirrus]
[47481.964364]  [<ffffffffa01176dd>] ttm_bo_move_memcpy+0x65d/0x6e0 [ttm]
[47481.964364]  [<ffffffff8118f6fe>] ? map_vm_area+0x2e/0x40
[47481.964364]  [<ffffffffa01132c9>] ? ttm_tt_init+0x69/0xb0 [ttm]
[47481.964364]  [<ffffffffa01362d8>] cirrus_bo_move+0x18/0x20 [cirrus]
[47481.964364]  [<ffffffffa0114de5>] ttm_bo_handle_move_mem+0x265/0x5b0 [ttm]
[47481.964364]  [<ffffffff81601994>] ? __slab_free+0x10e/0x277
[47481.964364]  [<ffffffffa011574a>] ? ttm_bo_mem_space+0x10a/0x310 [ttm]
[47481.964364]  [<ffffffffa0115e17>] ttm_bo_validate+0x247/0x260 [ttm]
[47481.964364]  [<ffffffff81059e69>] ? iounmap+0x79/0xa0
[47481.964364]  [<ffffffff81050000>] ? kgdb_arch_late+0x80/0x180
[47481.964364]  [<ffffffffa0136ac2>] cirrus_bo_push_sysram+0x82/0xe0 [cirrus]
[47481.964364]  [<ffffffffa0134c84>] cirrus_crtc_do_set_base.isra.8.constprop.10+0x84/0x430 [cirrus]
[47481.964364]  [<ffffffffa0135479>] cirrus_crtc_mode_set+0x449/0x4d0 [cirrus]
[47481.964364]  [<ffffffffa00f5939>] drm_crtc_helper_set_mode+0x2e9/0x520 [drm_kms_helper]
[47481.964364]  [<ffffffffa00f66bf>] drm_crtc_helper_set_config+0x87f/0xaa0 [drm_kms_helper]
[47481.964364]  [<ffffffff8160919b>] ? __ww_mutex_lock+0x1b/0xa0
[47481.964364]  [<ffffffffa00b6711>] drm_mode_set_config_internal+0x61/0xe0 [drm]
[47481.964364]  [<ffffffffa00fea94>] drm_fb_helper_pan_display+0x94/0xf0 [drm_kms_helper]
[47481.964364]  [<ffffffff81326259>] fb_pan_display+0xc9/0x190
[47481.964364]  [<ffffffff813352e0>] bit_update_start+0x20/0x50
[47481.964364]  [<ffffffff81334d0d>] fbcon_switch+0x39d/0x5a0
[47481.964364]  [<ffffffff813a3549>] redraw_screen+0x1a9/0x270
[47481.964364]  [<ffffffff8132645e>] ? fb_blank+0xae/0xc0
[47481.964364]  [<ffffffff8133222a>] fbcon_blank+0x22a/0x2f0
[47481.964364]  [<ffffffff81070384>] ? wake_up_klogd+0x34/0x50
[47481.964364]  [<ffffffff810705a8>] ? console_unlock+0x208/0x400
[47481.964364]  [<ffffffff8107ee63>] ? __internal_add_timer+0x113/0x130
[47481.964364]  [<ffffffff8107f057>] ? internal_add_timer+0x17/0x40
[47481.964364]  [<ffffffff81080bfd>] ? mod_timer+0x11d/0x240
[47481.964364]  [<ffffffff813a3c08>] do_unblank_screen+0xb8/0x1f0
[47481.964364]  [<ffffffff813a3d50>] unblank_screen+0x10/0x20
[47481.964364]  [<ffffffff812e4b59>] bust_spinlocks+0x19/0x40
[47481.964364]  [<ffffffff8160d6a8>] oops_end+0x38/0x150
[47481.964364]  [<ffffffff810173eb>] die+0x4b/0x70
[47481.964364]  [<ffffffff8160ce60>] do_trap+0x60/0x170
[47481.964364]  [<ffffffff81014224>] do_invalid_op+0xb4/0x130
[47481.964364]  [<ffffffffa014b958>] ? jbd2_journal_commit_transaction+0x1938/0x19a0 [jbd2]
[47481.964364]  [<ffffffff81052acf>] ? kvm_clock_read+0x1f/0x30
[47481.964364]  [<ffffffff810b2bde>] ? dequeue_task_fair+0x41e/0x620
[47481.964364]  [<ffffffff810abfd8>] ? sched_clock_cpu+0xa8/0x100
[47481.964364]  [<ffffffff810ad8b6>] ? __dequeue_entity+0x26/0x40
[47481.964364]  [<ffffffff8161675e>] invalid_op+0x1e/0x30
[47481.964364]  [<ffffffffa014dfba>] ? jbd2_journal_write_revoke_records+0xaa/0x1e0 [jbd2]
[47481.964364]  [<ffffffffa014b958>] ? jbd2_journal_commit_transaction+0x1938/0x19a0 [jbd2]
[47481.964364]  [<ffffffff810aed7e>] ? account_entity_dequeue+0xae/0xd0
[47481.964364]  [<ffffffff810ad8b6>] ? __dequeue_entity+0x26/0x40
[47481.964364]  [<ffffffff810125f6>] ? __switch_to+0x136/0x4a0
[47481.964364]  [<ffffffffa014fdb9>] kjournald2+0xc9/0x270 [jbd2]
[47481.964364]  [<ffffffff81098350>] ? wake_up_bit+0x30/0x30
[47481.964364]  [<ffffffffa014fcf0>] ? commit_timeout+0x10/0x10 [jbd2]
[47481.964364]  [<ffffffff8109739f>] kthread+0xcf/0xe0
[47481.964364]  [<ffffffff810972d0>] ? kthread_create_on_node+0x140/0x140
[47481.964364]  [<ffffffff81614f7c>] ret_from_fork+0x7c/0xb0
[47481.964364]  [<ffffffff810972d0>] ? kthread_create_on_node+0x140/0x140
[47481.964364] Code: ba 00 00 00 48 c7 c7 20 9a 81 81 89 8d 78 ff ff ff 44 89 45 80 e8 a2 21 01 00 8b 8d 78 ff ff ff 44 8b 45 80 e9 99 fd ff ff 0f 0b <0f> 0b 0f 0b 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 
[47481.964364] RIP  [<ffffffff8105c2ef>] change_page_attr_set_clr+0x4ef/0x500
[47481.964364]  RSP <ffff8800799ab060>
[47481.964364] ---[ end trace d2044b06032067c7 ]---
[47481.964364] Kernel panic - not syncing: Fatal exception
[47481.964364] drm_kms_helper: panic occurred, switching back to text console