[LU-7991] Add project quota for ZFS Created: 06/Apr/16  Updated: 16/May/18  Resolved: 24/Nov/17

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.10.0
Fix Version/s: Lustre 2.11.0, Lustre 2.10.3

Type: Improvement Priority: Critical
Reporter: Andreas Dilger Assignee: nasf (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Duplicate
is duplicated by LU-9790 ost-pools test_23a: Quota failed to e... Resolved
Related
is related to LU-9408 Client fails to mount with ZFS master... Resolved
is related to LU-2435 inode accounting in osd-zfs is racy Resolved
is related to LU-4017 Add project quota support feature Resolved
is related to LU-9554 upgrade to Lustre 2.10 breaks quota i... Resolved
is related to LU-9960 Rolling downgrade master to 2.10 - un... Resolved
is related to LU-11024 Broken inode accounting of MDT on ZFS Resolved
is related to LU-2435 inode accounting in osd-zfs is racy Resolved
is related to LU-5638 sanity-quota test_33 for ZFS-based ba... Closed
Severity: 3
Rank (Obsolete): 9223372036854775807

 Comments   
Comment by Gerrit Updater [ 12/May/17 ]

Fan Yong (fan.yong@intel.com) uploaded a new patch: https://review.whamcloud.com/27093
Subject: LU-7991 quota: project quota on ZFS
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 61f212d2c507b3c4a723e478f9b7a2853137e0aa

Comment by nasf (Inactive) [ 12/May/17 ]

The patch for ZFS part: https://review.whamcloud.com/#/c/27096/

Comment by Gerrit Updater [ 15/Jun/17 ]

Fan Yong (fan.yong@intel.com) uploaded a new patch: https://review.whamcloud.com/27661
Subject: LU-7991 osd-zfs: remove obsolete quota code
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 0aa161437b134f0a1862a9c3d68baf08928718f2

Comment by nasf (Inactive) [ 30/Jun/17 ]

The patch has been pushed to ZFS community for further review:
https://github.com/zfsonlinux/zfs/pull/6290

Comment by Nathaniel Clark [ 28/Jul/17 ]

Patch #27661 did not seem to fix LU-9790 issue:
https://testing.hpdd.intel.com/test_sets/f95e1fb2-70e5-11e7-9a38-5254006e85c2
CORRECTION:
This fixed the ost-pools/23a issue, but didn't fix the conf-sanity/32b issue.

Is there any code for conversion from old to new quota accounting?

Comment by nasf (Inactive) [ 29/Jul/17 ]

Another to the log https://testing.hpdd.intel.com/test_logs/fc114db0-70e5-11e7-9a38-5254006e85c2/show_text, the conf_sanity test_32b falild as:

dd: failed to open '/tmp/t32/mnt/lustre/tmp_file': No space left on device
conf-sanity test_32b: @@@@@@ FAIL: dd failed

It is out of space, why do you think it quota trouble?

Is there any code for conversion from old to new quota accounting?

When upgrade to zfs-0.7.0, the backend needs to upgrade firstly to account the objects by itself (not by Lustre), after that the osd-zfs can directly use the backend accounting. The old accounting maintained by Lustre will be useless any longer. I do not think we need convert the old one.

Comment by Gerrit Updater [ 01/Aug/17 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/27661/
Subject: LU-7991 osd-zfs: remove obsolete quota code
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 9fdbfed4ce20aaf7ac0e6b5001f323428d9d3893

Comment by Gerrit Updater [ 11/Aug/17 ]

Minh Diep (minh.diep@intel.com) uploaded a new patch: https://review.whamcloud.com/28481
Subject: LU-7991 osd-zfs: remove obsolete quota code
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: 536460746468226b632d6a9d9c8ef17fb2f54407

Comment by Gerrit Updater [ 18/Aug/17 ]

John L. Hammond (john.hammond@intel.com) merged in patch https://review.whamcloud.com/28481/
Subject: LU-7991 osd-zfs: remove obsolete quota code
Project: fs/lustre-release
Branch: b2_10
Current Patch Set:
Commit: fef6a85a467975368d9fea5794cfcb225b1b09a7

Comment by Gerrit Updater [ 24/Aug/17 ]

Jinshan Xiong (jinshan.xiong@intel.com) uploaded a new patch: https://review.whamcloud.com/28700
Subject: LU-7991 osd: make osd_write_lock to be recursive
Project: fs/lustre-dev
Branch: flr
Current Patch Set: 1
Commit: 39af5a0e4d22675d0da08e2857434d749d54c21a

Comment by Gerrit Updater [ 27/Aug/17 ]

Jinshan Xiong (jinshan.xiong@intel.com) uploaded a new patch: https://review.whamcloud.com/28735
Subject: LU-7991 osd: make osd_write_lock to be recursive
Project: fs/lustre-dev
Branch: flr2
Current Patch Set: 1
Commit: 7e2bd496429a4877b90de55da5e72d4fff4a4ad5

Comment by Gerrit Updater [ 09/Nov/17 ]

Oleg Drokin (oleg.drokin@intel.com) merged in patch https://review.whamcloud.com/27093/
Subject: LU-7991 quota: project quota against ZFS backend
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: a046e879fcadd601c9a19fd906f82ecbd2d4efd5

Comment by Peter Jones [ 24/Nov/17 ]

So is everything now in place on master so that this feature will be usable once running against a version of ZFS containing the necessary changes?

Comment by nasf (Inactive) [ 24/Nov/17 ]

You are right.

Comment by Peter Jones [ 24/Nov/17 ]

Landed for 2.11

Comment by Gerrit Updater [ 14/Dec/17 ]

Minh Diep (minh.diep@intel.com) uploaded a new patch: https://review.whamcloud.com/30540
Subject: LU-7991 quota: project quota against ZFS backend
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: 5434423868aaf90e22eba668a272fc151604f966

Comment by Gerrit Updater [ 20/Dec/17 ]

John L. Hammond (john.hammond@intel.com) merged in patch https://review.whamcloud.com/30540/
Subject: LU-7991 quota: project quota against ZFS backend
Project: fs/lustre-release
Branch: b2_10
Current Patch Set:
Commit: c5d4599cc56729281ce6d4fc59d17694c84333c8

Comment by Gerrit Updater [ 16/May/18 ]

Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: https://review.whamcloud.com/32418
Subject: LU-7991 osd-zfs: properly detect ZFS dnode accounting
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 1fac52e0b70da74b6098ba4ade35110d40d5d6e2

Generated at Sat Feb 10 02:13:41 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.