Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-2099

osd_init_iobuf()) ASSERTION( iobuf->dr_elapsed_valid == 0 ) sanity test 63a

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • Lustre 2.6.0, Lustre 2.5.2
    • Lustre 2.4.0, Lustre 2.5.0, Lustre 2.6.0
    • None
    • single node, 4 cpu cores. lustre files in /tmp that is tmpfs
    • 3
    • 4386

    Description

      Just hit this when testing with USE_OFD=yes

      [  929.726136] Lustre: DEBUG MARKER: == sanity test 63a: Verify oig_wait interruption does not crash ========= 03:34:59 (1349595299)
      [  964.438007] LustreError: 28767:0:(osd_io.c:107:osd_init_iobuf()) ASSERTION( iobuf->dr_elapsed_valid == 0 ) failed: 
      [  964.439525] LustreError: 28767:0:(osd_io.c:107:osd_init_iobuf()) LBUG
      [  964.441022] Pid: 28767, comm: ll_ost_io00_004
      [  964.442579] 
      [  964.442580] Call Trace:
      [  964.445464]  [<ffffffffa03f4915>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
      [  964.446900]  [<ffffffffa03f4f27>] lbug_with_loc+0x47/0xb0 [libcfs]
      [  964.448333]  [<ffffffffa0c41a82>] osd_init_iobuf+0xd2/0xe0 [osd_ldiskfs]
      [  964.449770]  [<ffffffffa0c44b0b>] osd_write_prep+0x17b/0x420 [osd_ldiskfs]
      [  964.451208]  [<ffffffffa0c43976>] ? osd_bufs_get+0x206/0x390 [osd_ldiskfs]
      [  964.452627]  [<ffffffffa0e26daa>] ofd_preprw+0x7da/0x11c0 [ofd]
      [  964.454077]  [<ffffffffa0781cf4>] ? sptlrpc_svc_alloc_rs+0x74/0x2d0 [ptlrpc]
      [  964.455474]  [<ffffffffa0d557fc>] obd_preprw+0x12c/0x3d0 [ost]
      [  964.456890]  [<ffffffffa0d5c932>] ost_brw_write+0x882/0x15f0 [ost]
      [  964.458284]  [<ffffffff8127a646>] ? vsnprintf+0x2b6/0x5f0
      [  964.459696]  [<ffffffffa0754cbc>] ? lustre_msg_get_version+0x8c/0x100 [ptlrpc]
      [  964.461128]  [<ffffffffa0754e18>] ? lustre_msg_check_version+0xe8/0x100 [ptlrpc]
      [  964.462513]  [<ffffffffa0d621f0>] ost_handle+0x3120/0x4550 [ost]
      [  964.463899]  [<ffffffffa0401464>] ? libcfs_id2str+0x74/0xb0 [libcfs]
      [  964.465329]  [<ffffffffa0762883>] ptlrpc_server_handle_request+0x463/0xe70 [ptlrpc]
      [  964.466745]  [<ffffffffa03f566e>] ? cfs_timer_arm+0xe/0x10 [libcfs]
      [  964.468163]  [<ffffffffa075b571>] ? ptlrpc_wait_event+0xb1/0x2a0 [ptlrpc]
      [  964.469568]  [<ffffffff81057d60>] ? default_wake_function+0x0/0x20
      [  964.470993]  [<ffffffffa076541a>] ptlrpc_main+0xb9a/0x1960 [ptlrpc]
      [  964.472399]  [<ffffffffa0764880>] ? ptlrpc_main+0x0/0x1960 [ptlrpc]
      [  964.473806]  [<ffffffff8100c14a>] child_rip+0xa/0x20
      [  964.475201]  [<ffffffffa0764880>] ? ptlrpc_main+0x0/0x1960 [ptlrpc]
      [  964.476610]  [<ffffffffa0764880>] ? ptlrpc_main+0x0/0x1960 [ptlrpc]
      [  964.477937]  [<ffffffff8100c140>] ? child_rip+0x0/0x20
      [  964.479240] 
      [  964.481682] Kernel panic - not syncing: LBUG
      [  964.482986] Pid: 28767, comm: ll_ost_io00_004 Not tainted 2.6.32-debug #6
      [  964.484296] Call Trace:
      [  964.485627]  [<ffffffff814f75e4>] ? panic+0xa0/0x168
      [  964.486964]  [<ffffffffa03f4f7b>] ? lbug_with_loc+0x9b/0xb0 [libcfs]
      [  964.488261]  [<ffffffffa0c41a82>] ? osd_init_iobuf+0xd2/0xe0 [osd_ldiskfs]
      [  964.489572]  [<ffffffffa0c44b0b>] ? osd_write_prep+0x17b/0x420 [osd_ldiskfs]
      [  964.490866]  [<ffffffffa0c43976>] ? osd_bufs_get+0x206/0x390 [osd_ldiskfs]
      [  964.492151]  [<ffffffffa0e26daa>] ? ofd_preprw+0x7da/0x11c0 [ofd]
      [  964.493512]  [<ffffffffa0781cf4>] ? sptlrpc_svc_alloc_rs+0x74/0x2d0 [ptlrpc]
      [  964.494817]  [<ffffffffa0d557fc>] ? obd_preprw+0x12c/0x3d0 [ost]
      [  964.496116]  [<ffffffffa0d5c932>] ? ost_brw_write+0x882/0x15f0 [ost]
      [  964.497432]  [<ffffffff8127a646>] ? vsnprintf+0x2b6/0x5f0
      [  964.498774]  [<ffffffffa0754cbc>] ? lustre_msg_get_version+0x8c/0x100 [ptlrpc]
      [  964.500109]  [<ffffffffa0754e18>] ? lustre_msg_check_version+0xe8/0x100 [ptlrpc]
      [  964.501424]  [<ffffffffa0d621f0>] ? ost_handle+0x3120/0x4550 [ost]
      [  964.502716]  [<ffffffffa0401464>] ? libcfs_id2str+0x74/0xb0 [libcfs]
      [  964.504014]  [<ffffffffa0762883>] ? ptlrpc_server_handle_request+0x463/0xe70 [ptlrpc]
      [  964.505319]  [<ffffffffa03f566e>] ? cfs_timer_arm+0xe/0x10 [libcfs]
      [  964.506593]  [<ffffffffa075b571>] ? ptlrpc_wait_event+0xb1/0x2a0 [ptlrpc]
      [  964.507817]  [<ffffffff81057d60>] ? default_wake_function+0x0/0x20
      [  964.509104]  [<ffffffffa076541a>] ? ptlrpc_main+0xb9a/0x1960 [ptlrpc]
      [  964.510345]  [<ffffffffa0764880>] ? ptlrpc_main+0x0/0x1960 [ptlrpc]
      [  964.511510]  [<ffffffff8100c14a>] ? child_rip+0xa/0x20
      [  964.512795]  [<ffffffffa0764880>] ? ptlrpc_main+0x0/0x1960 [ptlrpc]
      [  964.513993]  [<ffffffffa0764880>] ? ptlrpc_main+0x0/0x1960 [ptlrpc]
      [  964.515105]  [<ffffffff8100c140>] ? child_rip+0x0/0x20
      

      I have a crashdump for this instance too in case you need something from there.

      Attachments

        1. dmesg.txt
          34 kB
        2. log.gz
          0.2 kB

        Activity

          People

            bzzz Alex Zhuravlev
            green Oleg Drokin
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: