Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-7039

llog_osd.c:778:llog_osd_next_block()) ASSERTION( last_rec->lrh_index == tail->lrt_index ) failed:

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • Lustre 2.8.0
    • Lustre 2.8.0
    • None
    • Hyperion SWL test
    • 3
    • 9223372036854775807

    Description

      Running tip of master with SWL and DNE.

      2015-08-25 12:19:21 Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-450
      2015-08-25 12:19:21 LustreError: 6378:0:(llog_osd.c:778:llog_osd_next_block()) ASSERTION( last_rec->lrh_index == tail->lrt_index ) failed:
      2015-08-25 12:19:21 LustreError: 6384:0:(llog_osd.c:788:llog_osd_next_block()) lustre-MDT000b-osp-MDT0001: invalid llog tail at log id 0x3:2147484674/0 offset 3407872
      2015-08-25 12:19:21 LustreError: 6384:0:(lod_dev.c:392:lod_sub_recovery_thread()) lustre-MDT000b-osp-MDT0001 getting update log failed: rc = -22
      2015-08-25 12:19:21 LustreError: 6378:0:(llog_osd.c:778:llog_osd_next_block()) LBUG
      2015-08-25 12:19:21 Pid: 6378, comm: lod0001_rec0005
      2015-08-25 12:19:21 Aug 25 12:19:21
      2015-08-25 12:19:21 iws12 kernel: LuCall Trace:
      2015-08-25 12:19:21 streError: 6378: [<ffffffffa04a2875>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
      2015-08-25 12:19:21 0:(llog_osd.c:77 [<ffffffffa04a2e77>] lbug_with_loc+0x47/0xb0 [libcfs]
      2015-08-25 12:19:21 8:llog_osd_next_ [<ffffffffa08dad15>] llog_osd_next_block+0xb75/0xbf0 [obdclass]
      2015-08-25 12:19:21 block()) ASSERTI [<ffffffffa08ccb4e>] llog_process_thread+0xInitializing cgroup subsys cpuset
      2015-08-25 12:19:21 Initializing cgroup subsys cpu
      

      Attempting to recreate and get a dump

      Attachments

        1. console.log.bz2
          190 kB
          Frank Heckes
        2. lola-10-lustre-log.1444148492.4548-dm-minus-one.log.bz2
          1021 kB
          Frank Heckes
        3. LU-7039.llog.txt.gz
          3.53 MB
          Cliff White
        4. lustre-log.1443755187.9078
          712 kB
          Frank Heckes
        5. memory-counter-lola-11.dat.bz2
          25 kB
          Frank Heckes
        6. messages-lola-11.log.bz2
          302 kB
          Frank Heckes
        7. slab-details-lola-11.dat.bz2
          873 kB
          Frank Heckes
        8. slab-details-one-file-per-slab.tar.bz2
          617 kB
          Frank Heckes
        9. slab-total-lola-11.dat.bz2
          28 kB
          Frank Heckes
        10. vmcore-dmesg.txt.bz2
          28 kB
          Frank Heckes

        Issue Links

          Activity

            People

              di.wang Di Wang
              cliffw Cliff White (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: