[LU-4017] Add project quota support feature

• Type: New Feature
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.10.0
• Labels: patch
• Assignee: Niu Yawei (Inactive)
• Reporter: Li Xi (Inactive)

Description

OST (or MDT) pool feature enables users to group OSTs together to make object placement more flexible which is a very useful mechanism for system management. However the pool support of quota is not completed now which limits the use of it. Luckily current quota framework is really powerful and flexible which makes it possible to add new extension.

We believe that pool support of quota will be helpful for a lot of use cases, so we are trying to complete it. With the help from the community, we've made some progress. The full patch will be a big one which involves quite a lot of components of Lustre. Any advice or feedback about the implementation will be really helpful.

Issue Links

• is cloned by: LU-11023 OST Pool Quotas
• is related to: LU-9554 upgrade to Lustre 2.10 breaks quota if project quota is not enabled
• is related to: LU-12056 tar doesn't support project id
• is related to: LU-12160 use-after-free in osd_object_delete()
• is related to: LUDOC-202 Lustre Manual Documentation for project quota feature
• is related to: LU-7991 Add project quota for ZFS
• is related to: LU-9555 "df /path/to/project" should return projid-specific values
• is related to: LU-9339 fix RHEL 7.2 project quota build error
• is related to: LU-9355 remove obsolete OBD_FL_LOCAL_MASK

Comments

[James A Simmons]

Since RHEL tends to use 5 year old stacks we are looking at 2021 when we don't need patched kernels

[Shuichi Ihara (Inactive)]

Yes. That is true at this point. We are scoping out what is required to extend this work further.

Exactly. SInce all ldiskfs (ext4) and kernel patches were merged in upstream linux kernel (linux-4.5), once lustre server supprots 4.5 kernel or above, we don't need patched server for project quota anymore. Meantime, ldisfks patches are still backportable for other kernel e.g. SLES12SP2 in the future work.
Also, once zfs supports project id, project quota will be extanable to supoprt osd-zfs.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/23955/
Subject: LU-4017 quota: add project quota support to lfs quota/setquota
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 04fb37c5d93162e5e268baf78f796a0140de403f

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/23954/
Subject: LU-4017 quota: enable project quota limits
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 1398ed438568d2a07f09a59da8b7b23ff04ed4ea

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/26202/
Subject: LU-4017 quota: add setting/getting project id function
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 39f63cf54c624d89439b5b473035c1afe35e10fa

[Peter Jones]

Yes. That is true at this point. We are scoping out what is required to extend this work further.

[James A Simmons]

Yes it appears this is not supported on any SLES systems as well. Project Quota appears to only be supported on RHEL systems with ldiskfs

[Bob Glossman (Inactive)]

Does support for this new feature only exist on el7 servers with ldiskfs?

[James A Simmons]

I just noticed with this work its no longer possible to have patchless kernels for lustre server side.

[Gerrit Updater]

Wang Shilong ([e-mail]) uploaded a new patch: https://review.whamcloud.com/26581
Subject: LU-4017 tune2fs: fix BUGs of tuning project quota
Project: tools/e2fsprogs
Branch: master-lustre
Current Patch Set: 1
Commit: 0ee8257e2b538ce9d74e20511ba0a5c71d3cf542

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25812/
Subject: LU-4017 quota: add project id support
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 97fbb61dbe261a389897779ae376cfc3808442cf