https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-11803 Lustre <p>sanity test_255c fails with 'Ladvise test 12, bad lock count, returned 1, actual 0'. It looks like this is only impacting Ubuntu 18.04 client testing. </p> <p>Looking at the client test_log from <a href="https://testing.whamcloud.com/test_sets/d1b23f66-fdd4-11e8-a97c-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/d1b23f66-fdd4-11e8-a97c-52540065bddc</a> , a problem is that we can’t find lock_unused_count </p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== sanity test 255c: suite of ladvise lockahead tests ================================================ 19:46:58 (1544471218) CMD: trevis-19vm3 /usr/sbin/lctl get_param -n version 2&gt;/dev/null || /usr/sbin/lctl lustre_build_version 2&gt;/dev/null || /usr/sbin/lctl --version 2&gt;/dev/null | cut -d' ' -f2 Starting test test10 at 1544471219 Finishing test test10 at 1544471219 CMD: trevis-19vm3 /usr/sbin/lctl get_param -n ost.OSS.ost.stats Starting test test11 at 1544471219 Finishing test test11 at 1544471219 CMD: trevis-19vm3 /usr/sbin/lctl get_param -n ost.OSS.ost.stats error: get_param: param_path 'ldlm/namespaces/lustre-OST0000*osc-f*/lock_unused_count': No such file or directory Starting test test12 at 1544471220 Finishing test test12 at 1544471220 error: get_param: param_path 'ldlm/namespaces/lustre-OST0000*osc-f*/lock_unused_count': No such file or directory </pre> </div></div> <p>There are several example of this failure all for Ubuntu at<br/> <a href="https://testing.whamcloud.com/test_sets/bd048afa-f713-11e8-b67f-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/bd048afa-f713-11e8-b67f-52540065bddc</a><br/> <a href="https://testing.whamcloud.com/test_sets/b223ccee-f778-11e8-b67f-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/b223ccee-f778-11e8-b67f-52540065bddc</a><br/> <a href="https://testing.whamcloud.com/test_sets/50f5970e-fa16-11e8-8a18-52540065bddc" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/50f5970e-fa16-11e8-8a18-52540065bddc</a></p> Ubuntu 18.04 clients LU-11803

sanity test 255c fails with 'Ladvise test 12, bad lock count, returned 1, actual 0'

Bug Critical Resolved Fixed James A Simmons James Nunez ubuntu Tue, 18 Dec 2018 02:57:39 +0000 Fri, 1 May 2020 08:14:26 +0000 Thu, 23 Jan 2020 12:03:07 +0000 Lustre 2.12.0 Lustre 2.14.0 0 5 <p>Since this is a similar failure, we are also seeing sanity-flr tests 0g and 31 fail with similar issues</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== sanity-flr test 0g: lfs mirror create flags support =============================================== 00:45:20 (1544489120) osc.lustre-OST0000-osc- (ptrval).stats=clear osc.lustre-OST0001-osc- (ptrval).stats=clear osc.lustre-OST0002-osc- (ptrval).stats=clear osc.lustre-OST0003-osc- (ptrval).stats=clear osc.lustre-OST0004-osc- (ptrval).stats=clear osc.lustre-OST0005-osc- (ptrval).stats=clear osc.lustre-OST0006-osc- (ptrval).stats=clear error: get_param: param_path 'osc/lustre-OST0000-osc-ffff*/stats': No such file or directory sanity-flr test_0g: @@@@@@ FAIL: read was not provided by OST1 </pre> </div></div> <p>and</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== sanity-flr test 31: make sure glimpse request can be retried ====================================== 00:46:46 (1544489206) fail_loc=0x1A00 CMD: trevis-19vm3 grep -c /mnt/lustre-ost1' ' /proc/mounts || true Stopping /mnt/lustre-ost1 (opts:) on trevis-19vm3 CMD: trevis-19vm3 umount -d /mnt/lustre-ost1 CMD: trevis-19vm3 lsmod | grep lnet &gt; /dev/null &amp;&amp; lctl dl | grep ' ST ' || true CMD: trevis-19vm1.trevis.whamcloud.com lctl get_param -n at_min can't get osc.lustre-OST0000-osc-ffff*.ost_server_uuid in 40 secs error: get_param: param_path 'ldlm/namespaces/lustre-OST0000-osc-ffff*/lock_count': No such file or directory error: get_param: param_path 'ldlm/namespaces/lustre-OST0001-osc-ffff*/lock_count': No such file or directory sanity-flr test_31: @@@@@@ FAIL: OST 1: no glimpse request was sent </pre> </div></div> <p><a href="https://jira.whamcloud.com/secure/ViewProfile.jspa?name=simmonsja" class="user-hover" rel="simmonsja">simmonsja</a> this looks like fallout from moving parameters from /proc to /sys? The Ubuntu kernel is 4.15, which is definitely the newest one we have running, so may be more likely to be affected by these changes.</p> <p>Let me look</p> <p>Its the uuid issue. So newer kernels no long allow you to expose the pointer address to user land. We need to create a new UUID method that is not the pointer of an internal kernel object</p> <p>I see the issue. Its a test problem in this case. The people that wrote these test assume the obd device name is of the format $FSNAME-OST0000-osc-ffff* but that is not always the case. In newer kernels the ffff is filtered out. This also impacts older kernels running on non x86 platforms. For example on Power8 is lustre-OST0000-osc-c000001e4de63000. I will push a patch to fix this.</p> <p>James Simmons (uja.ornl@yahoo.com) uploaded a new patch: <a href="https://review.whamcloud.com/33894" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33894</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11803" title="sanity test 255c fails with &#39;Ladvise test 12, bad lock count, returned 1, actual 0&#39;" class="issue-link" data-issue-key="LU-11803"><del>LU-11803</del></a> tests: don't assume obd device name<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: ce075a8726fe822803f24d1b336301ad87e9ce12</p> <p>James Simmons (uja.ornl@yahoo.com) uploaded a new patch: <a href="https://review.whamcloud.com/33916" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33916</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11803" title="sanity test 255c fails with &#39;Ladvise test 12, bad lock count, returned 1, actual 0&#39;" class="issue-link" data-issue-key="LU-11803"><del>LU-11803</del></a> llite: use sget() to find client super block<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 9df5133ac346b807bcb671fdea0adb7ccb628a5e</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/33894/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33894/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11803" title="sanity test 255c fails with &#39;Ladvise test 12, bad lock count, returned 1, actual 0&#39;" class="issue-link" data-issue-key="LU-11803"><del>LU-11803</del></a> tests: don't assume obd device name<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: b8e6c8bdca9bd0e12d78cd4a06800c13f4293325</p> <p>Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/34783" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/34783</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11803" title="sanity test 255c fails with &#39;Ladvise test 12, bad lock count, returned 1, actual 0&#39;" class="issue-link" data-issue-key="LU-11803"><del>LU-11803</del></a> tests: don't assume obd device name<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: 1<br/> Commit: 2ab9df22c74f2404ac0d8e2632073f11d167eeba</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/33916/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/33916/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11803" title="sanity test 255c fails with &#39;Ladvise test 12, bad lock count, returned 1, actual 0&#39;" class="issue-link" data-issue-key="LU-11803"><del>LU-11803</del></a> obd: replace class_uuid with linux kernel version.<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 604c266a175b72500ef99793652b64ed4f842b2c</p> <p>Some more work is needed.</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/34783/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/34783/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11803" title="sanity test 255c fails with &#39;Ladvise test 12, bad lock count, returned 1, actual 0&#39;" class="issue-link" data-issue-key="LU-11803"><del>LU-11803</del></a> tests: don't assume obd device name<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: <br/> Commit: 0909a1c8d7aa4d9e4f95077da4b3b31e3d4c392f</p> <p>Minh Diep (mdiep@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/35480" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/35480</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-11803" title="sanity test 255c fails with &#39;Ladvise test 12, bad lock count, returned 1, actual 0&#39;" class="issue-link" data-issue-key="LU-11803"><del>LU-11803</del></a> obd: replace class_uuid with linux kernel version.<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: 1<br/> Commit: b4f322de10fbaf05c564643e8f42da770d2987c8</p> <p>We can migrate the remaining work to <a href="https://jira.whamcloud.com/browse/LU-13118" title="change client instance to respect ASLR" class="issue-link" data-issue-key="LU-13118">LU-13118</a></p> Duplicate LU-11806 LU-11808 LU-11823 LU-12247 Related LU-8066 LU-11838 LU-13499 LU-11809 LU-13118 LU-12521 Development Rank 1|i0089z: Rank (Obsolete) 9223372036854775807 Severity