Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-6684

lctl lfsck_stop hangs

Details

    • Bug
    • Resolution: Fixed
    • Blocker
    • Lustre 2.8.0
    • Lustre 2.7.0
    • None
    • 3
    • 9223372036854775807

    Description

      As mentioned in LU-6683, I ran into a situation where lctl lfsck_stop just hangs indefinitely.

      I have managed to reproduce this twice:

      start lfsck (using lctl lfsck_start -M play01-MDT0000 -t layout), this crashes the OSS servers, reboot the servers and restart the OSTs. Attempting to stop the lfsck in this state just hangs. I have waited >1h and it was still hanging. Unmounting the MDT in this situation also appears to be hanging (after 30 minutes I power cycled the MDS).

      Attachments

        1. 15.lctl.tgz
          631 kB
        2. lustre.dmesg.bz2
          37 kB
        3. lustre.log.bz2
          1.38 MB

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. LU-7662 lfsck don't complete

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-10321 MDS - umount hangs during failback

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          mentioned in

          [Whamcloud Community Wiki] Page Page No Confluence page found with the given URL.

          Activity

            [LU-6684] lctl lfsck_stop hangs
            yong.fan nasf (Inactive) made changes -
            Link New: This issue is related to LU-10321 [ LU-10321 ]
            pjones Peter Jones made changes -
            Link Original: This issue is related to LDEV-142 [ LDEV-142 ]
            pjones Peter Jones made changes -
            Link New: This issue is related to LDEV-367 [ LDEV-367 ]
            yong.fan nasf (Inactive) added a comment -

            Another instance found for tag 2.7.66 for Full - EL6.7 Server/EL6.7 Client
            On master, build# 3314
            https://testing.hpdd.intel.com/test_sets/35490a0c-ca6e-11e5-9215-5254006e85c2
            Date : 02/02/2016 Time: 9:20 am MST

            The patch 18082 has been landed just after new tag 2.7.66, please test the latest master.

            yong.fan nasf (Inactive) added a comment - Another instance found for tag 2.7.66 for Full - EL6.7 Server/EL6.7 Client On master, build# 3314 https://testing.hpdd.intel.com/test_sets/35490a0c-ca6e-11e5-9215-5254006e85c2 Date : 02/02/2016 Time: 9:20 am MST The patch 18082 has been landed just after new tag 2.7.66, please test the latest master.
            standan Saurabh Tandan (Inactive) made changes -
            Remote Link New: This issue links to "Page (HPDD Community Wiki)" [ 16445 ]
            standan Saurabh Tandan (Inactive) added a comment -

            Another instance found for tag 2.7.66 for Full - EL6.7 Server/EL6.7 Client
            On master, build# 3314
            https://testing.hpdd.intel.com/test_sets/35490a0c-ca6e-11e5-9215-5254006e85c2
            Date : 02/02/2016 Time: 9:20 am MST

            standan Saurabh Tandan (Inactive) added a comment - Another instance found for tag 2.7.66 for Full - EL6.7 Server/EL6.7 Client On master, build# 3314 https://testing.hpdd.intel.com/test_sets/35490a0c-ca6e-11e5-9215-5254006e85c2 Date : 02/02/2016 Time: 9:20 am MST
            yong.fan nasf (Inactive) made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: Reopened [ 4 ] New: Resolved [ 5 ]
            yong.fan nasf (Inactive) added a comment -

            The patch has been landed to master.

            yong.fan nasf (Inactive) added a comment - The patch has been landed to master.
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/18082/
            Subject: LU-6684 lfsck: set the lfsck notify as interruptable
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 069a9cf551c2e985ea254a1c570b22ed1d72d914

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/18082/ Subject: LU-6684 lfsck: set the lfsck notify as interruptable Project: fs/lustre-release Branch: master Current Patch Set: Commit: 069a9cf551c2e985ea254a1c570b22ed1d72d914
            yujian Jian Yu added a comment -

            This is blocking patch review testing on master branch:
            https://testing.hpdd.intel.com/test_sets/a29caebe-c709-11e5-9b6d-5254006e85c2
            https://testing.hpdd.intel.com/test_sets/fbfee2be-c70f-11e5-a037-5254006e85c2

            yujian Jian Yu added a comment - This is blocking patch review testing on master branch: https://testing.hpdd.intel.com/test_sets/a29caebe-c709-11e5-9b6d-5254006e85c2 https://testing.hpdd.intel.com/test_sets/fbfee2be-c70f-11e5-a037-5254006e85c2

            People

              yong.fan nasf (Inactive)
              ferner Frederik Ferner (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: