https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-3861 Lustre <p>filesystem was create with lustre 2.1.4 with quota off. Files were created. The the filesystem was upgraded. </p> <p>Did run tunefs.lustre --quota on all osts and mdt. <br/> and lctl conf_param fsname.quota.ost|mdt=u|g|ug|none</p> <p>inode quota doesn't release when you go over the remove the files. Also how do you run a "quotacheck" to account for all the files created when quota was off</p> LU-3861

Quota issues after upgrade from 2.1.4 to 2.4

Bug Major Resolved Not a Bug Niu Yawei Mahmoud Hanafi Thu, 29 Aug 2013 22:28:13 +0000 Tue, 29 Oct 2013 18:30:42 +0000 Tue, 29 Oct 2013 18:30:42 +0000 Lustre 2.4.0 0 7 <p>ok we figured out why this was. inodes are aquired 1024 at a time. But the other question remains why is not account for the files that where created before the upgrade.</p> <p>Niu</p> <p>Could you please advise here?</p> <p>Thanks</p> <p>Peter</p> <blockquote> <p>ok we figured out why this was. inodes are aquired 1024 at a time. But the other question remains why is not account for the files that where created before the upgrade.</p></blockquote> <p>The 'quotacheck' would be run when you enable the quota feature by 'tunefs.lustre --quota', and quota accounting will always be enabled form then on.</p> <p>Do you mean the files created before upgrade were not accounted? Could you show me the out of 'lfs quota' and the real file count?</p> <p>yes files created pre-upgrade are not accounted for in the inode count. As you can see I have &gt; 20 files but lfs quota says i have 4. And those are the 4 I created post upgrade.</p> <p>pfe21 /nobackupp7 # find /nobackupp7 -user mhanafi -type f | wc -l<br/> 24615<br/> pfe21 /nobackupp7 # lfs quota -u mhanafi /nobackupp7<br/> Disk quotas for user mhanafi (uid 11312):<br/> Filesystem kbytes quota limit grace files quota limit grace<br/> /nobackupp7 34640729864 0 346350607480 - 4 4000 5000 -</p> <p>What's the e2fsprogs version on MDS? Was there any error messages when running 'tune2fs.lustre --quota'? Could you paste the output of 'dumpe2fs met_device' and try to collect debug log when start mdt and when running 'lfs quota'?</p> <p>I believe it's the same problem described in <a href="https://jira.whamcloud.com/browse/LU-3784" title="Quota issue on system upgraded to 2.4.x" class="issue-link" data-issue-key="LU-3784"><del>LU-3784</del></a>.</p> <p>No errors where seen during the tune2fs.lustre --quota.<br/> Running version of e2fsprogs are<br/> nbp7-mds1 ~ # rpm -qa |grep e2fs<br/> e2fsprogs-debuginfo-1.42.6.wc2-7.el6.x86_64<br/> e2fsprogs-devel-1.42.7.wc1-7.el6.x86_64<br/> e2fsprogs-1.42.7.wc1-7.el6.x86_64<br/> e2fsprogs-static-1.42.7.wc1-7.el6.x86_64<br/> e2fsprogs-libs-1.42.7.wc1-7.el6.x86_64</p> <p>attach is debug logs while running quota command</p> <p>Hi, Mahmoud</p> <p>Could install the e2fsprogs from <a href="http://build.whamcloud.com/job/e2fsprogs-reviews/173/" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/e2fsprogs-reviews/173/</a> (see <a href="http://review.whamcloud.com/#/c/7556/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/7556/</a>), and disable/enable quota for all your mdt and ost devices by:</p> <ul class="alternate" type="square"> <li>tune2fs -O ^quota $dev</li> <li>tune2fs -O quota $dev</li> </ul> <p>Then setup lustre to see if the problem is resloved? Thanks.</p> <p>Which branch should I use to build for lustre-2.4? Thanks!</p> <p>Please ignore my question earlier wrt branch of e2fsprogs git.</p> <p>I pulled things down and did a 'make rpm'. It failed here...</p> <p>154 tests succeeded 1 tests failed<br/> Tests failed: m_quota <br/> make<span class="error">&#91;2&#93;</span>: *** <span class="error">&#91;test_post&#93;</span> Error 1<br/> make<span class="error">&#91;2&#93;</span>: Leaving directory `/usr/src/redhat/BUILD/e2fsprogs-1.42.7.wc1/tests'<br/> make<span class="error">&#91;1&#93;</span>: *** <span class="error">&#91;check-recursive&#93;</span> Error 1<br/> make<span class="error">&#91;1&#93;</span>: Leaving directory `/usr/src/redhat/BUILD/e2fsprogs-1.42.7.wc1'<br/> error: Bad exit status from /var/tmp/rpm-tmp.10sTlL (%check)</p> <p>What mistake could I have made? Please advise. Thanks!</p> <p>The tests/m_quota/expect.1 file generated during 'make rpm'. This test failed.</p> <p>The source is at <a href="https://github.com/jlan/e2fsprogs-nas" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/jlan/e2fsprogs-nas</a>. Branch nas-2.4.0.</p> <p>Hi, Jay</p> <p>You can download rpm from <a href="http://build.whamcloud.com/job/e2fsprogs-reviews/173/" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/e2fsprogs-reviews/173/</a> directly. If you want to build by yourself, you'd build patchset2, and if m_quota test failed, it probably because the users/groups on your building system is different with ours, you can just check the m_quota.failed file and correct the m_quota/expect.1.</p> <p>Attached the m_quota.failed file. It does not seem to be the users/groups ID problem. Can you check the file and let me know what the failure was about? Thanks!</p> <p>Jay, you can just correct your m_quota/expect.1 as the m_quota.failed shows.</p> <p>Hi Niu, yeah, that worked. Thanks!</p> <p>Hmm, I would assume the tests/m_quota/expect.1 file specifies expected values out of a good test run. If I change the expected values to get tests passed, I am wondering what's the point of running the tests?</p> <p>I'm not quite sure why the free blocks are not constant on different building system when quota feature enabled.</p> <p>Installing the new e2fsprogs and running tune2fs -O ^quota $device/tune2fs -O quota $device had fixed the issue. lfs quota is now reporting correctly.</p> <p>mhanafi@pfe21:~&gt; lfs quota -u mhanafi /nobackupp7<br/> Disk quotas for user mhanafi (uid 11312):<br/> Filesystem kbytes quota limit grace files quota limit grace<br/> /nobackupp7 34640747452 0 346350607480 - 24751* 4000 5000 -</p> <p>This case can be closed</p> <p>Thanks Mahmoud</p> Related LU-3784 Development Rank 1|hzvzon: Rank (Obsolete) 10014 Severity