Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-2887

sanity-quota test_12a: slow due to ZFS VMs sharing single disk

    Details

    • Severity:
      3
    • Rank (Obsolete):
      6968

      Description

      This issue was created by maloo for Nathaniel Clark <nathaniel.l.clark@intel.com>

      This issue relates to the following test suite run: https://maloo.whamcloud.com/test_sets/c3a0b364-812d-11e2-b609-52540035b04c.

      The sub-test test_12a failed with the following error:

      test failed to respond and timed out

      Info required for matching: sanity-quota 12a

      Looking through test 12a, things seem to have hung up on the runas dd (with oflag=sync) at the end of the test.

      OST has threads that are blocked on disk I/O (oss dmesg):

      txg_sync      D 0000000000000000     0 24236      2 0x00000080
       ffff88005027dbc0 0000000000000046 ffff88004b906ec0 0000000000000086
       ffff88005027db70 ffff88007c7d4408 0000000000000001 ffff88007c7d4420
       ffff880052101058 ffff88005027dfd8 000000000000fb88 ffff880052101058
      Call Trace:
       [<ffffffff81090b9e>] ? prepare_to_wait_exclusive+0x4e/0x80
       [<ffffffffa016b5ac>] cv_wait_common+0x9c/0x1a0 [spl]
       [<ffffffffa02d5160>] ? zio_execute+0x0/0xf0 [zfs]
       [<ffffffff81090990>] ? autoremove_wake_function+0x0/0x40
       [<ffffffffa016b6e3>] __cv_wait+0x13/0x20 [spl]
       [<ffffffffa02d533b>] zio_wait+0xeb/0x160 [zfs]
       [<ffffffffa026b807>] dsl_pool_sync+0x2a7/0x480 [zfs]
       [<ffffffffa027e147>] spa_sync+0x397/0x9a0 [zfs]
       [<ffffffffa028fd41>] txg_sync_thread+0x2c1/0x490 [zfs]
       [<ffffffff810527f9>] ? set_user_nice+0xc9/0x130
       [<ffffffffa028fa80>] ? txg_sync_thread+0x0/0x490 [zfs]
       [<ffffffffa0164668>] thread_generic_wrapper+0x68/0x80 [spl]
       [<ffffffffa0164600>] ? thread_generic_wrapper+0x0/0x80 [spl]
       [<ffffffff81090626>] kthread+0x96/0xa0
       [<ffffffff8100c0ca>] child_rip+0xa/0x20
       [<ffffffff81090590>] ? kthread+0x0/0xa0
       [<ffffffff8100c0c0>] ? child_rip+0x0/0x20
      ll_ost_io00_0 D 0000000000000000     0 18170      2 0x00000080
       ffff8800427b9820 0000000000000046 0000000000000046 0000000000000001
       ffff8800427b98b0 0000000000000086 ffff8800427b97e0 ffff88005027dd60
       ffff8800427b7ab8 ffff8800427b9fd8 000000000000fb88 ffff8800427b7ab8
      Call Trace:
       [<ffffffff81090b9e>] ? prepare_to_wait_exclusive+0x4e/0x80
       [<ffffffffa016b5ac>] cv_wait_common+0x9c/0x1a0 [spl]
       [<ffffffff81090990>] ? autoremove_wake_function+0x0/0x40
       [<ffffffffa016b6e3>] __cv_wait+0x13/0x20 [spl]
       [<ffffffffa028f573>] txg_wait_synced+0xb3/0x190 [zfs]
       [<ffffffffa0c71015>] osd_trans_stop+0x365/0x420 [osd_zfs]
       [<ffffffffa0cb9062>] ofd_trans_stop+0x22/0x60 [ofd]
       [<ffffffffa0cbdf06>] ofd_commitrw_write+0x406/0x11b0 [ofd]
       [<ffffffffa0cbf13d>] ofd_commitrw+0x48d/0x920 [ofd]
       [<ffffffffa085b708>] obd_commitrw+0x128/0x3d0 [ost]
       [<ffffffffa0862599>] ost_brw_write+0xe49/0x14d0 [ost]
       [<ffffffff812739b6>] ? vsnprintf+0x2b6/0x5f0
       [<ffffffffa088c1f0>] ? target_bulk_timeout+0x0/0xc0 [ptlrpc]
       [<ffffffffa08680e3>] ost_handle+0x31e3/0x46f0 [ost]
       [<ffffffffa05ca154>] ? libcfs_id2str+0x74/0xb0 [libcfs]
       [<ffffffffa08dc02c>] ptlrpc_server_handle_request+0x41c/0xdf0 [ptlrpc]
       [<ffffffffa05be5de>] ? cfs_timer_arm+0xe/0x10 [libcfs]
       [<ffffffffa08d3759>] ? ptlrpc_wait_event+0xa9/0x290 [ptlrpc]
       [<ffffffff81052223>] ? __wake_up+0x53/0x70
       [<ffffffffa08dd576>] ptlrpc_main+0xb76/0x1870 [ptlrpc]
       [<ffffffffa08dca00>] ? ptlrpc_main+0x0/0x1870 [ptlrpc]
       [<ffffffff8100c0ca>] child_rip+0xa/0x20
       [<ffffffffa08dca00>] ? ptlrpc_main+0x0/0x1870 [ptlrpc]
       [<ffffffffa08dca00>] ? ptlrpc_main+0x0/0x1870 [ptlrpc]
       [<ffffffff8100c0c0>] ? child_rip+0x0/0x20
      

        Attachments

        1. txgs.1380193340.log
          55 kB
        2. txgs.1380193506.log
          55 kB
        3. txgs.1380194292.log
          55 kB

          Issue Links

            Activity

              People

              • Assignee:
                bzzz Alex Zhuravlev
                Reporter:
                maloo Maloo
              • Votes:
                0 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: