Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-10419

LFSCK fails to start, hangs systems.

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • Lustre 2.12.0, Lustre 2.10.5
    • Lustre 2.11.0, Lustre 2.10.2, Lustre 2.10.3
    • Soak performance cluster - Lustre version=2.10.2_4_gb151f34
    • 3
    • 9223372036854775807

    Description

      We do OSS failover, trigger LFSCK:

      
      

      lctl lfsck_start -M soaked-MDT0000 -s 1000 -t all -A{code]

      The lfsck start hangs, lfsck is not started, the clients wedge in state 'comp' the entire system wedges. I have dumped Lustre Logs from all MDS, attached. I have crash-dumped all the MDT nodes and the dumps are available on Spirit. lfsck_layout is unkillable.

      Attachments

        1. soak-10.lustre.log.gz
          2.57 MB
        2. soak-11.lustre.log.gz
          2.22 MB
        3. soak-8.lustre.log.gz
          2.14 MB
        4. soak-9.lustre.log.gz
          2.33 MB

        Issue Links

          Activity

            [LU-10419] LFSCK fails to start, hangs systems.
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.10.5 [ 14003 ]
            yong.fan nasf (Inactive) made changes -
            Fix Version/s New: Lustre 2.12.0 [ 13495 ]
            Resolution New: Fixed [ 1 ]
            Status Original: Reopened [ 4 ] New: Resolved [ 5 ]
            pjones Peter Jones made changes -
            Resolution Original: Fixed [ 1 ]
            Status Original: Resolved [ 5 ] New: Reopened [ 4 ]
            pjones Peter Jones made changes -
            Labels Original: LTS soak New: soak
            pjones Peter Jones made changes -
            Fix Version/s Original: Lustre 2.11.0 [ 13091 ]
            Fix Version/s Original: Lustre 2.10.4 [ 13691 ]
            pjones Peter Jones made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: Reopened [ 4 ] New: Resolved [ 5 ]
            jamesanunez James Nunez (Inactive) made changes -
            Remote Link New: This issue links to "Page (HPDD Community Wiki)" [ 22479 ]
            cliffw Cliff White (Inactive) made changes -
            Resolution Original: Fixed [ 1 ]
            Status Original: Resolved [ 5 ] New: Reopened [ 4 ]
            mdiep Minh Diep made changes -
            Fix Version/s New: Lustre 2.10.4 [ 13691 ]
            pjones Peter Jones made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: In Progress [ 3 ] New: Resolved [ 5 ]

            People

              yong.fan nasf (Inactive)
              cliffw Cliff White (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: