Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-8974

Сhange force_over_256tb lustre mount option to force_over_512tb for ldiskfs

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • Lustre 2.10.0
    • None
    • None
    • 9223372036854775807

    Description

      Currently attempts of creating ldisk file system with size >256TB finished with message.
      "LDISKFS-fs does not support file systems greater than 256TB and can cause data corruption.Use "force_over_256tb" mount option to override."
      Before using "force_over_256tb" parameter in production systems lustre file system software should be analyzed to point possible large disks support issues. This issue is about research of some aspects of Lustre software. Finally patch that change "force_over_256tb" to "force_over_512tb" should be landed. This gives ability use ldiskfs partitions <512tb without options.

      Attachments

        Issue Links

          Activity

            [LU-8974] Сhange force_over_256tb lustre mount option to force_over_512tb for ldiskfs

            Artem Blagodarenko (c17828@cray.com) uploaded a new patch: https://review.whamcloud.com/36705
            Subject: LU-8974 osd-ldiskfs: increase supported size to 1024tb
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: c87bbaf9063494f702c0d0b5884d11dba483e306

            gerrit Gerrit Updater added a comment - Artem Blagodarenko (c17828@cray.com) uploaded a new patch: https://review.whamcloud.com/36705 Subject: LU-8974 osd-ldiskfs: increase supported size to 1024tb Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: c87bbaf9063494f702c0d0b5884d11dba483e306

            Patch landed to 2.10.

            adilger Andreas Dilger added a comment - Patch landed to 2.10.

            Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/24524/
            Subject: LU-8974 osd-ldiskfs: increase supported ldiskfs fs size
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: cfa981f3bf06d602aee998e64d4758e13f48aab8

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/24524/ Subject: LU-8974 osd-ldiskfs: increase supported ldiskfs fs size Project: fs/lustre-release Branch: master Current Patch Set: Commit: cfa981f3bf06d602aee998e64d4758e13f48aab8

            Some researched aspects

            META_BG
            (required)
            Without the option META_BG, for safety concerns, all block group descriptors copies are kept in the first block group. Given the default 128MiB(2^27 bytes) block group size and 64-byte group descriptors, ext4 can have at most 2^27/64 = 2^21 block groups. This limits the entire filesystem size to 2^21 ∗ 2^27 = 2^48 bytes or 256TiB.
            The solution to this problem is to use the metablock group feature (META_BG), which is already in ext3 for all 2.6 releases. Some issues found during testing
            LU-8443 "Can't create Lustre FS with enabled meta_bg option". Patch is landed.
            LU-8976 "Cannot create filesystem with requested number of inodes while setting up superblock" Patch from upstream must be cherrypicked to solve the issue.

            large dir
            (useful in case of many files in the directory)
            LU-1365 "Implement ldiskfs LARGEDIR support for e2fsprogs" Sending upstream.

            xattr external inode referance
            (tested, landing for regression testing)
            LU-8444 the patch from LU-7325 fixes this issue: "Hitting "LDISKFS-fs error (device md66): ldiskfs_xattr_inode_iget: error while reading EA inode -2147483347" Inspection

            artem_blagodarenko Artem Blagodarenko (Inactive) added a comment - Some researched aspects META_BG (required) Without the option META_BG, for safety concerns, all block group descriptors copies are kept in the first block group. Given the default 128MiB(2^27 bytes) block group size and 64-byte group descriptors, ext4 can have at most 2^27/64 = 2^21 block groups. This limits the entire filesystem size to 2^21 ∗ 2^27 = 2^48 bytes or 256TiB. The solution to this problem is to use the metablock group feature (META_BG), which is already in ext3 for all 2.6 releases. Some issues found during testing LU-8443 "Can't create Lustre FS with enabled meta_bg option". Patch is landed. LU-8976 "Cannot create filesystem with requested number of inodes while setting up superblock" Patch from upstream must be cherrypicked to solve the issue. large dir (useful in case of many files in the directory) LU-1365 "Implement ldiskfs LARGEDIR support for e2fsprogs" Sending upstream. xattr external inode referance (tested, landing for regression testing) LU-8444 the patch from LU-7325 fixes this issue: "Hitting "LDISKFS-fs error (device md66): ldiskfs_xattr_inode_iget: error while reading EA inode -2147483347" Inspection

            Artem Blagodarenko (artem.blagodarenko@seagate.com) uploaded a new patch: https://review.whamcloud.com/24524
            Subject: LU-8974 osd-ldiskfs: increase supported ldiskfs fs size
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: b203e05a88d6c02b7f655598aacabfeb946aed66

            gerrit Gerrit Updater added a comment - Artem Blagodarenko (artem.blagodarenko@seagate.com) uploaded a new patch: https://review.whamcloud.com/24524 Subject: LU-8974 osd-ldiskfs: increase supported ldiskfs fs size Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: b203e05a88d6c02b7f655598aacabfeb946aed66

            People

              adilger Andreas Dilger
              artem_blagodarenko Artem Blagodarenko (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: