https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-5801 Lustre <p>During internal tests it appeared that dd process get killed by OOM-Killer when it belongs to a cgroup with memory enforcement.</p> <p>In our scenario we use dd to write 10G file:<br/> dd if=/dev/zero of=./testing bs=1M count=10000<br/> Parent shell belongs to a cgroup with memory limit set to 1.5GB</p> <p>Our tests on local filesystems and GPFS were fine - no oom killer invocations have been seen. Only Lustre operations tend to fail due to memory excess</p> <p>I'm attaching oom details from dmesg</p> <p>&#8211;<br/> Lukasz Flis <br/> ACC Cyfronet</p> Scientific Linux 6.5 LU-5801

client 2.5.2 - cgroups compatibility problem

Bug Minor Open Unresolved WC Triage Lukasz Flis Thu, 23 Oct 2014 22:25:06 +0000 Thu, 24 Nov 2022 00:07:21 +0000 Lustre 2.7.0 Lustre 2.5.2 1 11 <p>As yet, we haven't done any testing with Lustre and cgroups. I suspect this relates to the way that clients determine the cache limits based on the total RAM and not on the memory available to the cgroup. I suspect that this needs fixing in several places (max_dirty_mb, max_cached_mb, lu_cache limits, DLM pool limits, etc) to check the cgroup available memory instead of <tt>totalram_pages</tt>. That said, I don't know enough about cgroups yet to know what to check...</p> <p>I was looking for workaround and tried setting lustre.max_dirty_mb below the cgroup limit. Unfortunately no luck this time.</p> <p>Hello</p> <p>Since cgroups memory limiting is quite important functionality for us I'd like to ask if the fix is likely to appear in 2.5.x line?</p> <p>Best Regards<br/> &#8211;<br/> Lukasz Flis</p> <p>All new features will appear in master before possibly being backported to a maintenance branch. Since master is currently in feature freeze for 2.7.0 it is unlikely that this feature would be implemented in the next few months.</p> <p>Hello Andreas,</p> <p>Are there any news regarding the memory cgroup support in new Lustre client versions?</p> <p>Just adding another voice here for this bug to get some TLC as we've (Compute Canada) ran into it in a couple of cases with our users now. Would be great if it could get addressed.</p> <p>Thanks! -Tyson</p> <p>Has this issue been seen running on a current 2.10.x LTS release?</p> <p>Peter,</p> <p>You can check with Andreas, but I'm pretty confident the problem still exists. It's both a design issue and a design question. (I recall discussing it with Andreas in a JIRA at one point, but either my memory is bad or it was another JIRA.) We may not want to solve the problem in the way the reporter requested, but we haven't changed things here yet either.</p> Related Development Rank 1|hzwzdr: Rank (Obsolete) 16267 Severity