Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-1720

Quota doesn't work over 4TB on single OST

Details

    • Bug
    • Resolution: Fixed
    • Major
    • Lustre 2.1.4, Lustre 1.8.9
    • Lustre 1.8.8
    • None
    • CentOS5.8 Lustre-1.8.8-wc1
    • 2
    • 4061

    Description

      We set quota "ug3" to all OSTs and MDT, then an also set 5TB quota limitation to a user. But, if user1 writes files to single OST, it exceeds quota limitation when total file size gets 4TB.

      # lfs quota -v -u user1 /lustre/
      Disk quotas for user user1 (uid 1000):
           Filesystem  kbytes   quota   limit   grace   files   quota   limit   grace
             /lustre/ 4295057504       0 5368709120       -      13       0       0       -
      lustre-MDT0000_UUID
                            4       -    1024       -      13       -       0       -
      lustre-OST0000_UUID
                            0       -    1024       -       -       -       -       -
      lustre-OST0001_UUID
                      4295057500*      - 4294959104       -       -       -       -       -
      lustre-OST0002_UUID
                            0       -    1024       -       -       -       -       -
      lustre-OST0003_UUID
                            0       -    1024       -       -       -       -       -
      ..
      ..
      
      # lctl get_param lquota.*.quota_type
      lquota.lustre-OST0001.quota_type=ug3
      lquota.lustre-OST0004.quota_type=ug3
      lquota.lustre-OST0008.quota_type=ug3
      lquota.lustre-OST000c.quota_type=ug3
      lquota.lustre-OST0011.quota_type=ug3
      lquota.lustre-OST0015.quota_type=ug3
      lquota.lustre-OST0019.quota_type=ug3
      lquota.lustre-OST001d.quota_type=ug3
      lquota.lustre-OST0021.quota_type=ug3
      lquota.lustre-OST0025.quota_type=ug3
      lquota.lustre-OST0028.quota_type=ug3
      lquota.lustre-OST002d.quota_type=ug3
      lquota.lustre-OST0031.quota_type=ug3
      lquota.lustre-OST0035.quota_type=ug3
      lquota.lustre-OST0039.quota_type=ug3
      
      # lctl get_param lquota.*.quota_type
      lquota.lustre-MDT0000.quota_type=ug3
      

      Attachments

        1. debuglog.txt.gz
          3.78 MB
          Shuichi Ihara
        2. reproducer.sh
          0.4 kB
          Shuichi Ihara
        3. setlimit_err_msg.patch
          0.8 kB
          Niu Yawei
        4. setlimit_err_msg.patch
          0.8 kB
          Niu Yawei

        Issue Links

          Activity

            [LU-1720] Quota doesn't work over 4TB on single OST
            ys Yang Sheng made changes -
            Link New: This issue is related to HP-137 [ HP-137 ]
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 1.8.9 [ 10204 ]
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.1.4 [ 10158 ]
            ys Yang Sheng made changes -
            Resolution New: Fixed [ 1 ]
            Status Original: Open [ 1 ] New: Resolved [ 5 ]
            ys Yang Sheng added a comment -

            Patch landed to all branch. Close bug.

            ys Yang Sheng added a comment - Patch landed to all branch. Close bug.
            pjones Peter Jones added a comment -

            Landed to b1_8. Still needs to land to 2.x branches

            pjones Peter Jones added a comment - Landed to b1_8. Still needs to land to 2.x branches

            Hi, I've confirmed the patch LU-1720 solves this problem, would you please merge if the review is finished?

            ihara Shuichi Ihara (Inactive) added a comment - Hi, I've confirmed the patch LU-1720 solves this problem, would you please merge if the review is finished?

            I reproduced this problem with lustre-1.8.8 on RHEL5 and confirmed it's fixed by kernel patch on LU-1720. Also confirmed fixing on lustre-2.1.2 with RHEL5 and the problem doesn't happen on RHEL6 even without patches.

            ihara Shuichi Ihara (Inactive) added a comment - I reproduced this problem with lustre-1.8.8 on RHEL5 and confirmed it's fixed by kernel patch on LU-1720 . Also confirmed fixing on lustre-2.1.2 with RHEL5 and the problem doesn't happen on RHEL6 even without patches.
            ys Yang Sheng added a comment - patch for b1_8: http://review.whamcloud.com/3599
            ys Yang Sheng added a comment - - edited
            ys Yang Sheng added a comment - - edited patch for b2_1: http://review.whamcloud.com/3600

            People

              ys Yang Sheng
              ihara Shuichi Ihara (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: