https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-10056 Lustre <p>Console log on MDS:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> Lustre: 32199:0:(llog_test.c:1018:llog_test_7_sub()) 7_sub: records are not aligned, written 64071 from 64767 Lustre: 32199:0:(llog_test.c:1124:llog_test_7()) 7f: test llog_changelog_user_rec sssd_ssh invoked oom-killer: gfp_mask=0x200da, order=0, oom_score_adj=0 sssd_ssh cpuset=/ mems_allowed=0 CPU: 0 PID: 665 Comm: sssd_ssh Tainted: P OE ------------ 3.10.0-693.1.1.el7_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007 ffff88003690dee0 000000007415b4cd ffff88007a0b39f0 ffffffff816a3d6d ffff88007a0b3a80 ffffffff8169f186 ffff88007a0b3ae8 ffff88007a0b3a40 ffffffff816b04dc ffffffff81a6ea00 0000000000000000 0000000000000000 Call Trace: [&lt;ffffffff816a3d6d&gt;] dump_stack+0x19/0x1b [&lt;ffffffff8169f186&gt;] dump_header+0x90/0x229 [&lt;ffffffff816b04dc&gt;] ? notifier_call_chain+0x4c/0x70 [&lt;ffffffff810b6ab8&gt;] ? __blocking_notifier_call_chain+0x58/0x70 [&lt;ffffffff8118653e&gt;] check_panic_on_oom+0x2e/0x60 [&lt;ffffffff8118695b&gt;] out_of_memory+0x23b/0x4f0 [&lt;ffffffff8169fc8a&gt;] __alloc_pages_slowpath+0x5d6/0x724 [&lt;ffffffff8118cd85&gt;] __alloc_pages_nodemask+0x405/0x420 [&lt;ffffffff811d412f&gt;] alloc_pages_vma+0xaf/0x1f0 [&lt;ffffffff811c3830&gt;] ? end_swap_bio_write+0x80/0x80 [&lt;ffffffff811c453d&gt;] read_swap_cache_async+0xed/0x160 [&lt;ffffffff811c4658&gt;] swapin_readahead+0xa8/0x110 [&lt;ffffffff811b235b&gt;] handle_mm_fault+0xadb/0xfa0 [&lt;ffffffff8109ea4c&gt;] ? signal_setup_done+0x3c/0x60 [&lt;ffffffff816affb4&gt;] __do_page_fault+0x154/0x450 [&lt;ffffffff816b02e5&gt;] do_page_fault+0x35/0x90 [&lt;ffffffff816ac508&gt;] page_fault+0x28/0x30 </pre> </div></div> <p>Maloo reports:<br/> <a href="https://testing.hpdd.intel.com/test_sessions/2a0ab571-1893-4650-bdbf-4b24c85e8367" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sessions/2a0ab571-1893-4650-bdbf-4b24c85e8367</a><br/> <a href="https://testing.hpdd.intel.com/test_sessions/9e63bf6c-094f-4c49-8823-de2ad48b5302" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sessions/9e63bf6c-094f-4c49-8823-de2ad48b5302</a></p> LU-10056

sanity test_60a invokes oom-killer in subtest 7f and times out

Bug Minor Open Unresolved WC Triage Jian Yu Mon, 2 Oct 2017 18:16:41 +0000 Sat, 27 Jan 2018 22:27:45 +0000 Lustre 2.11.0 0 4 <p>+1 at <a href="https://testing.hpdd.intel.com/test_sets/68e44f30-b87d-11e7-9abd-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/68e44f30-b87d-11e7-9abd-52540065bddc</a></p> <p>I have done some debug on the associated MDS crash-dump due to OOM. It looks like again, the kmalloc-512 kmem_cache's Slabs consume almost all available memory (&gt;1.2GB vs 1.6GB), like for <a href="https://jira.whamcloud.com/browse/LU-7329" title="sanity test_60a timeouts with “* invoking oom-killer” " class="issue-link" data-issue-key="LU-7329"><del>LU-7329</del></a> and <a href="https://jira.whamcloud.com/browse/LU-7883" title="sanity test_60a invokes oom-killer in subtest 10b and times out" class="issue-link" data-issue-key="LU-7883"><del>LU-7883</del></a> but this time at earlier llog_test/llog_test_7() step than llog_test_10() before!</p> <p>Could it be that something in the auto-test VMs/OS/daemons/... configs has changed ?? And thus we need to apply the same fix (dt_sync() calls to flush journal callbacks) to prior log_test's sub-tests than only in llog_test_10() ??</p> <p>This has been hit a few more times in the past 4 weeks.</p> <p>another on b2_10:<br/> <a href="https://testing.hpdd.intel.com/test_sets/975629ee-0385-11e8-a7cd-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.hpdd.intel.com/test_sets/975629ee-0385-11e8-a7cd-52540065bddc</a></p> Related LU-7329 LU-7883 Development Rank 1|hzzl3z: Rank (Obsolete) 9223372036854775807 Severity