[LU-9902] PANIC at range_tree.c:153:range_tree_destroy()

Sat, 11 Nov 2017 12:43:20 +0000

[22995.538261] Lustre: MGS: Connection restored to 8e47cd51-bdeb-bdc3-b6ec-d22daa8cfe5f (at 0@lo)
[23000.700301] Lustre: ctl-testfs-MDT0000: No data found on store. Initialize space
[23000.725840] Lustre: testfs-MDT0000: new disk, initializing
[23000.967623] Lustre: testfs-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[23000.971064] LustreError: 31913:0:(osd_oi.c:503:osd_oid()) testfs-MDT0000-osd: unsupported quota oid: 0x16
[23001.010713] Lustre: ctl-testfs-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt
[23001.254639] Lustre: Failing over testfs-MDT0000
[23001.328691] Lustre: server umount testfs-MDT0000 complete
[23029.882138] Lustre: testfs-MDT0000: Imperative Recovery not enabled, recovery window 300-900
[23029.890149] LustreError: 2524:0:(osd_oi.c:503:osd_oid()) testfs-MDT0000-osd: unsupported quota oid: 0x16
[23034.671859] Lustre: MGS: Connection restored to f4d06d1a-4da7-422b-a88b-179c1847a7b2 (at 10.14.83.12@tcp)
[23047.066047] Lustre: 9956:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1503182361/real 1503182361] req@ffff88006726cf00 x1576195361604704/t0(0) o13->testfs-OST0000-osc-MDT0000@10.14.83.12@tcp:7/4 lens 224/368 e 0 to 1 dl 1503182368 ref 1 fl Rpc:X/0/ffffffff rc 0/-1
[23047.074816] Lustre: testfs-OST0000-osc-MDT0000: Connection to testfs-OST0000 (at 10.14.83.12@tcp) was lost; in progress operations using this service will wait for recovery to complete
[23049.016270] Lustre: MGS: Connection restored to f4d06d1a-4da7-422b-a88b-179c1847a7b2 (at 10.14.83.12@tcp)
[23049.020208] Lustre: Skipped 1 previous similar message
[23053.079918] Lustre: 9954:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1503182368/real 1503182368] req@ffff880005b86a00 x1576195361604720/t0(0) o8->testfs-OST0000-osc-MDT0000@10.14.83.12@tcp:28/4 lens 520/544 e 0 to 1 dl 1503182374 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1
[23058.443321] Lustre: testfs-OST0000-osc-MDT0000: Connection restored to 10.14.83.12@tcp (at 10.14.83.12@tcp)
[23058.447380] Lustre: Skipped 1 previous similar message
[23072.080025] Lustre: testfs-MDT0000: Connection restored to 10.14.83.11@tcp (at 0@lo)
[23594.178309] Lustre: testfs-MDT0000: Connection restored to f4d06d1a-4da7-422b-a88b-179c1847a7b2 (at 10.14.83.12@tcp)
[23625.886099] Lustre: testfs-MDT0000: Connection restored to 10.14.83.11@tcp (at 0@lo)
[23625.911277] Lustre: testfs-OST0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900
[23625.926058] LustreError: 14391:0:(osd_oi.c:503:osd_oid()) testfs-OST0001-osd: unsupported quota oid: 0x16
[23766.936439] Lustre: Failing over testfs-OST0001
[23766.945146] Lustre: server umount testfs-OST0001 complete
[23769.191678] Lustre: testfs-MDT0000: Not available for connect from 10.14.83.12@tcp (stopping)
[23769.581788] LustreError: 9956:0:(client.c:1166:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff88006726c000 x1576195361609328/t0(0) o13->testfs-OST0000-osc-MDT0000@10.14.83.12@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
[23772.998699] Lustre: 15802:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1503183088/real 1503183088] req@ffff88006726de00 x1576195361609296/t0(0) o9->testfs-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 1 dl 1503183094 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[23779.091656] Lustre: 15802:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1503183094/real 1503183094] req@ffff88000cb38c00 x1576195361609424/t0(0) o251->MGC10.14.83.11@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1503183100 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1
[23779.178172] Lustre: server umount testfs-MDT0000 complete
[23779.181542] Lustre: Skipped 1 previous similar message
[23861.175060] VERIFY3(0 == rt->rt_space) failed (0 == 13824)
[23861.179068] PANIC at range_tree.c:153:range_tree_destroy()
[23861.182900] Showing stack for process 19561
[23861.186675] CPU: 1 PID: 19561 Comm: zpool Tainted: P OE ------------ 3.10.0-514.21.1.el7_lustre.x86_64 #1
[23861.190933] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
[23861.194501] ffffffffa068f783 000000001e74d978 ffff88005ee87b40 ffffffff8168717f
[23861.198197] ffff88005ee87b50 ffffffffa042d6f4 ffff88005ee87cd8 ffffffffa042d7bf
[23861.201799] 000000000027fffd 0000000000000030 ffff88005ee87ce8 ffff88005ee87c88
[23861.205344] Call Trace:
[23861.208045] [<ffffffff8168717f>] dump_stack+0x19/0x1b
[23861.211111] [<ffffffffa042d6f4>] spl_dumpstack+0x44/0x50 [spl]
[23861.214057] [<ffffffffa042d7bf>] spl_panic+0xbf/0xf0 [spl]
[23861.216819] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[23861.219491] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[23861.222163] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[23861.224843] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[23861.227480] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[23861.230089] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[23861.232720] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[23861.235305] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[23861.237644] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[23861.239956] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[23861.242369] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[23861.244724] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[23861.247104] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[23861.249380] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[23861.251658] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[23861.253835] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[23861.255997] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b
[24000.007653] INFO: task zpool:19561 blocked for more than 120 seconds.
[24000.011535] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[24000.015464] zpool D 0000000000000000 0 19561 19558 0x00000080
[24000.019239] ffff88005ee87b40 0000000000000082 ffff88007aa16dd0 ffff88005ee87fd8
[24000.022906] ffff88005ee87fd8 ffff88005ee87fd8 ffff88007aa16dd0 ffffffffa068f783
[24000.026506] 0000000000000099 ffffffffa0680520 ffffffffa068f7f8 0000000000000000
[24000.029990] Call Trace:
[24000.032499] [<ffffffff8168c849>] schedule+0x29/0x70
[24000.035328] [<ffffffffa042d7e5>] spl_panic+0xe5/0xf0 [spl]
[24000.038290] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[24000.040874] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[24000.043467] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[24000.046080] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[24000.048599] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[24000.050972] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[24000.053326] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[24000.055579] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[24000.057867] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[24000.060024] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[24000.062389] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[24000.064528] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[24000.066787] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[24000.068867] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[24000.070752] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[24000.072610] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[24000.074407] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b
[24120.076425] INFO: task zpool:19561 blocked for more than 120 seconds.
[24120.085275] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[24120.088345] zpool D 0000000000000000 0 19561 19558 0x00000080
[24120.091257] ffff88005ee87b40 0000000000000082 ffff88007aa16dd0 ffff88005ee87fd8
[24120.094286] ffff88005ee87fd8 ffff88005ee87fd8 ffff88007aa16dd0 ffffffffa068f783
[24120.097284] 0000000000000099 ffffffffa0680520 ffffffffa068f7f8 0000000000000000
[24120.100142] Call Trace:
[24120.102244] [<ffffffff8168c849>] schedule+0x29/0x70
[24120.104678] [<ffffffffa042d7e5>] spl_panic+0xe5/0xf0 [spl]
[24120.107130] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[24120.109442] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[24120.112002] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[24120.114457] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[24120.116932] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[24120.119261] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[24120.121590] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[24120.123840] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[24120.126050] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[24120.128167] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[24120.130366] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[24120.132494] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[24120.134831] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[24120.136909] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[24120.138789] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[24120.140639] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[24120.142478] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b
[24240.144639] INFO: task zpool:19561 blocked for more than 120 seconds.
[24240.152570] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[24240.155829] zpool D 0000000000000000 0 19561 19558 0x00000080
[24240.158760] ffff88005ee87b40 0000000000000082 ffff88007aa16dd0 ffff88005ee87fd8
[24240.161813] ffff88005ee87fd8 ffff88005ee87fd8 ffff88007aa16dd0 ffffffffa068f783
[24240.164872] 0000000000000099 ffffffffa0680520 ffffffffa068f7f8 0000000000000000
[24240.168117] Call Trace:
[24240.170218] [<ffffffff8168c849>] schedule+0x29/0x70
[24240.172658] [<ffffffffa042d7e5>] spl_panic+0xe5/0xf0 [spl]
[24240.175159] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[24240.177490] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[24240.179878] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[24240.182357] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[24240.184839] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[24240.187195] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[24240.189695] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[24240.191957] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[24240.194184] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[24240.196379] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[24240.198581] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[24240.200723] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[24240.202939] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[24240.205049] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[24240.206980] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[24240.208853] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[24240.210806] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b
[24360.213454] INFO: task zpool:19561 blocked for more than 120 seconds.
[24360.217743] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[24360.220949] zpool D 0000000000000000 0 19561 19558 0x00000080
[24360.224086] ffff88005ee87b40 0000000000000082 ffff88007aa16dd0 ffff88005ee87fd8
[24360.227116] ffff88005ee87fd8 ffff88005ee87fd8 ffff88007aa16dd0 ffffffffa068f783
[24360.230341] 0000000000000099 ffffffffa0680520 ffffffffa068f7f8 0000000000000000
[24360.233399] Call Trace:
[24360.235514] [<ffffffff8168c849>] schedule+0x29/0x70
[24360.237919] [<ffffffffa042d7e5>] spl_panic+0xe5/0xf0 [spl]
[24360.240397] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[24360.242850] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[24360.245252] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[24360.247702] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[24360.250174] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[24360.252734] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[24360.255114] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[24360.257357] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[24360.259564] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[24360.261779] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[24360.264080] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[24360.266193] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[24360.268403] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[24360.270500] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[24360.272499] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[24360.274518] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[24360.276318] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b
[24480.277656] INFO: task zpool:19561 blocked for more than 120 seconds.
[24480.281987] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[24480.285188] zpool D 0000000000000000 0 19561 19558 0x00000080
[24480.288329] ffff88005ee87b40 0000000000000082 ffff88007aa16dd0 ffff88005ee87fd8
[24480.291388] ffff88005ee87fd8 ffff88005ee87fd8 ffff88007aa16dd0 ffffffffa068f783
[24480.294411] 0000000000000099 ffffffffa0680520 ffffffffa068f7f8 0000000000000000
[24480.297443] Call Trace:
[24480.299605] [<ffffffff8168c849>] schedule+0x29/0x70
[24480.302325] [<ffffffffa042d7e5>] spl_panic+0xe5/0xf0 [spl]
[24480.304804] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[24480.307269] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[24480.309738] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[24480.312223] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[24480.314738] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[24480.317194] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[24480.319636] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[24480.321909] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[24480.324148] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[24480.326543] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[24480.328880] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[24480.331001] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[24480.333222] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[24480.335330] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[24480.337334] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[24480.339249] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[24480.341048] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b
[24600.343183] INFO: task zpool:19561 blocked for more than 120 seconds.
[24600.350781] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[24600.354005] zpool D 0000000000000000 0 19561 19558 0x00000080
[24600.357097] ffff88005ee87b40 0000000000000082 ffff88007aa16dd0 ffff88005ee87fd8
[24600.360090] ffff88005ee87fd8 ffff88005ee87fd8 ffff88007aa16dd0 ffffffffa068f783
[24600.363103] 0000000000000099 ffffffffa0680520 ffffffffa068f7f8 0000000000000000
[24600.365974] Call Trace:
[24600.368072] [<ffffffff8168c849>] schedule+0x29/0x70
[24600.370479] [<ffffffffa042d7e5>] spl_panic+0xe5/0xf0 [spl]
[24600.372950] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[24600.375308] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[24600.377659] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[24600.380218] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[24600.382747] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[24600.385083] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[24600.387429] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[24600.389667] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[24600.391870] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[24600.394088] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[24600.396274] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[24600.398398] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[24600.400597] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[24600.402683] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[24600.404752] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[24600.406606] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[24600.408423] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b
[24720.409861] INFO: task zpool:19561 blocked for more than 120 seconds.
[24720.416090] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[24720.419321] zpool D 0000000000000000 0 19561 19558 0x00000080
[24720.422370] ffff88005ee87b40 0000000000000082 ffff88007aa16dd0 ffff88005ee87fd8
[24720.425396] ffff88005ee87fd8 ffff88005ee87fd8 ffff88007aa16dd0 ffffffffa068f783
[24720.428426] 0000000000000099 ffffffffa0680520 ffffffffa068f7f8 0000000000000000
[24720.431461] Call Trace:
[24720.433542] [<ffffffff8168c849>] schedule+0x29/0x70
[24720.436102] [<ffffffffa042d7e5>] spl_panic+0xe5/0xf0 [spl]
[24720.438613] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[24720.441079] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[24720.443458] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[24720.445937] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[24720.448434] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[24720.450898] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[24720.453258] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[24720.455653] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[24720.457878] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[24720.460109] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[24720.462365] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[24720.464490] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[24720.466724] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[24720.468824] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[24720.470838] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[24720.472697] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[24720.474505] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b
[24840.476689] INFO: task zpool:19561 blocked for more than 120 seconds.
[24840.480923] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[24840.484142] zpool D 0000000000000000 0 19561 19558 0x00000080
[24840.487334] ffff88005ee87b40 0000000000000082 ffff88007aa16dd0 ffff88005ee87fd8
[24840.490376] ffff88005ee87fd8 ffff88005ee87fd8 ffff88007aa16dd0 ffffffffa068f783
[24840.493397] 0000000000000099 ffffffffa0680520 ffffffffa068f7f8 0000000000000000
[24840.496441] Call Trace:
[24840.498564] [<ffffffff8168c849>] schedule+0x29/0x70
[24840.500969] [<ffffffffa042d7e5>] spl_panic+0xe5/0xf0 [spl]
[24840.503430] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[24840.506031] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[24840.508433] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[24840.510902] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[24840.513385] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[24840.515835] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[24840.518229] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[24840.520487] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[24840.522703] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[24840.524919] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[24840.527226] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[24840.529508] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[24840.531716] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[24840.533795] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[24840.535793] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[24840.537718] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[24840.539541] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b
[24960.542536] INFO: task zpool:19561 blocked for more than 120 seconds.
[24960.546355] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[24960.549605] zpool D 0000000000000000 0 19561 19558 0x00000080
[24960.552695] ffff88005ee87b40 0000000000000082 ffff88007aa16dd0 ffff88005ee87fd8
[24960.555739] ffff88005ee87fd8 ffff88005ee87fd8 ffff88007aa16dd0 ffffffffa068f783
[24960.558856] 0000000000000099 ffffffffa0680520 ffffffffa068f7f8 0000000000000000
[24960.561915] Call Trace:
[24960.564068] [<ffffffff8168c849>] schedule+0x29/0x70
[24960.566490] [<ffffffffa042d7e5>] spl_panic+0xe5/0xf0 [spl]
[24960.568984] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[24960.571442] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[24960.573848] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[24960.576329] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[24960.578808] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[24960.581392] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[24960.583818] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[24960.586081] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[24960.588295] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[24960.590540] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[24960.592857] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[24960.595002] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[24960.597211] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[24960.599308] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[24960.601317] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[24960.603350] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[24960.605159] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b
[25080.606609] INFO: task zpool:19561 blocked for more than 120 seconds.
[25080.609778] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[25080.612984] zpool D 0000000000000000 0 19561 19558 0x00000080
[25080.616115] ffff88005ee87b40 0000000000000082 ffff88007aa16dd0 ffff88005ee87fd8
[25080.619226] ffff88005ee87fd8 ffff88005ee87fd8 ffff88007aa16dd0 ffffffffa068f783
[25080.622272] 0000000000000099 ffffffffa0680520 ffffffffa068f7f8 0000000000000000
[25080.625320] Call Trace:
[25080.627534] [<ffffffff8168c849>] schedule+0x29/0x70
[25080.630126] [<ffffffffa042d7e5>] spl_panic+0xe5/0xf0 [spl]
[25080.632604] [<ffffffff811dc8e1>] ? __slab_free+0x81/0x2f0
[25080.635073] [<ffffffff811dcd0b>] ? kmem_cache_free+0x1bb/0x1f0
[25080.637545] [<ffffffffa042875a>] ? spl_kmem_free+0x2a/0x40 [spl]
[25080.640013] [<ffffffffa06037ec>] range_tree_destroy+0x6c/0x70 [zfs]
[25080.642504] [<ffffffffa0600ab7>] metaslab_fini+0x137/0x1e0 [zfs]
[25080.644952] [<ffffffffa0620cd1>] vdev_metaslab_fini+0x51/0x90 [zfs]
[25080.647402] [<ffffffffa0621042>] vdev_free+0x62/0x290 [zfs]
[25080.649636] [<ffffffffa0621024>] vdev_free+0x44/0x290 [zfs]
[25080.651867] [<ffffffffa060dc7b>] spa_unload+0xcb/0x270 [zfs]
[25080.654236] [<ffffffffa060dfbb>] spa_export_common+0x19b/0x400 [zfs]
[25080.656556] [<ffffffffa060e23a>] spa_destroy+0x1a/0x20 [zfs]
[25080.658694] [<ffffffffa06474aa>] zfs_ioc_pool_destroy+0x1a/0x20 [zfs]
[25080.660896] [<ffffffffa06471ec>] zfsdev_ioctl+0x4dc/0x520 [zfs]
[25080.663005] [<ffffffff812125d5>] do_vfs_ioctl+0x2d5/0x4b0
[25080.665009] [<ffffffff8121d177>] ? __alloc_fd+0xa7/0x130
[25080.666974] [<ffffffff81212851>] SyS_ioctl+0xa1/0xc0
[25080.668779] [<ffffffff81697849>] system_call_fastpath+0x16/0x1b

Relevant processes:

19561 ?        Ds     0:00  |   \_ zpool destroy zfs_pool_scsi0QEMU_QEMU_HARDDISK_disk3

Whamcloud Community JIRA

[LU-9902] PANIC at range_tree.c:153:range_tree_destroy()