https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-16307 Lustre <p>This issue was created by maloo for James Simmons &lt;uja.ornl@gmail.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://testing.whamcloud.com/test_sets/9226f4b3-5eba-49de-b55c-934d02bd243f" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/9226f4b3-5eba-49de-b55c-934d02bd243f</a></p> <p>sanity-sec test_31 failed with:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>CMD: onyx-82vm1.onyx.whamcloud.com mkdir -p /mnt/lustre CMD: onyx-82vm1.onyx.whamcloud.com mount -t lustre -o user_xattr,flock,network=tcp999 10.240.26.219@tcp999:/lustre /mnt/lustre mount.lustre: mount 10.240.26.219@tcp999:/lustre at /mnt/lustre failed: Invalid argument This may have multiple causes. Is 'lustre' the correct filesystem name? Are the mount options correct? Check the syslog for more info. missing mandatory parameters in NI config: 'interface'Starting client: onyx-82vm1.onyx.whamcloud.com: -o user_xattr,flock,network=tcp999 10.240.26.219@tcp999:/lustre /mnt/lustre CMD: onyx-82vm1.onyx.whamcloud.com mkdir -p /mnt/lustre CMD: onyx-82vm1.onyx.whamcloud.com mount -t lustre -o user_xattr,flock,network=tcp999 10.240.26.219@tcp999:/lustre /mnt/lustre CMD: onyx-82vm4 lctl get_param -n *.MGS*.exports.'10.240.26.216@tcp'.uuid 2&gt;/dev/null | grep -q - sanity-sec test_31: @@@@@@ FAIL: export for 10.240.26.216@tcp on MGS should not exist </pre> </div></div> <p>VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV<br/> sanity-sec test_31 - export for</p> LU-16307

sanity-sec: test_31: export for 10.240.26.216@tcp on MGS should not exist

Bug Minor Open Unresolved James A Simmons Maloo Thu, 10 Nov 2022 19:11:40 +0000 Mon, 29 Jan 2024 08:56:08 +0000 0 5 <p>James, when using the "<tt><span class="error">&#91;Raise bug...&#93;</span></tt>" option in Maloo, please do so on the <b>subtest</b> (i.e. under <tt>test_31</tt>) so that Maloo can generate a proper matching string for the failure, and also include additional information into the ticket (e.g. the error messages, etc.). This current bug description "<tt>sanity-sec</tt>" isn't very useful as it currently stands. Also, it is important to have a good bug summary in the initial submission, since Maloo will cache this initial summary line and not update it if it is later changed.</p> <p>It looks like this failure started on 2022-11-08. There were a number of patches landed on that date:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>ed71af843d LU-16280 tests: conf-sanity/117 call setup when FS is not mounted 9a0a89520e LU-16251 obdclass: fill jobid in a safe way b104c0a277 LU-14377 tests: make parallel-scale/rr_alloc less strict 38a52f2fc3 LU-16243 tests: Specify ping source in test_218 d55fe25a95 LU-16215 kfilnd: Use immediate for routed GETs 78c681d9f4 LU-16207 build: add rpm-build BuildRequires for SLES15 SP3 95f7ef6094 LU-16111 build: Fix include of stddef.h 0171801df5 LU-8151 obd: Show correct shadow mountpoints for server 26e765e0d2 LU-15011 tests: additional checks for pool spilling 41610e6207 LU-8837 mgc: move server-only code out of mgc_request.c f32bdde057 LU-8837 lustre: make ldlm and target file lists ef90a02d12 LU-13135 quota: improve checks in OSDs to ignore quota 896cd5b7bc LU-10391 lnet: fix build issue when IPv6 is disabled. 122644ae19 LU-15847 target: report multiple transno to debug log cf121b1668 LU-16203 llog: skip bad records in llog 53b3d1de99 LU-16152 utils: fix integer overflow in cYAML parser db0fb8f2b6 LU-10391 lnet: allow ping packet to contain large nids 5243630b09 LU-15947 obdclass: improve precision of wakeups for mod_rpcs 8f8f6e2f36 LU-10003 lnet: use Netlink to support old and new NI APIs. 85941b9fb9 LU-15117 ofd: no lock for dt_bufs_get() in read path </pre> </div></div> <p>The patch that seems the most likely to cause this problem is:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>8f8f6e2f36 LU-10003 lnet: use Netlink to support old and new NI APIs. </pre> </div></div> <p>since it also failed in this same way once on 2022-10-11 before it landed.</p> <p>James, it looks like this failure relates to your netlink patch, per my previous comment.</p> <p>It also looks like this is causing a 100% test failure for any patches including this change. The few passes since 2022-11-08 have been based on commit 293844d132 "<tt><a href="https://jira.whamcloud.com/browse/LU-16222" title="RHEL 8.7 support" class="issue-link" data-issue-key="LU-16222"><del>LU-16222</del></a> kernel: RHEL 8.7 client and server support</tt>", or an earlier parent.</p> <p>As such, I'm going to push a revert patch to start it testing, but you are free to also work on a fix in parallel if you have an idea how to fix it.</p> <p><del>"Andreas Dilger &lt;adilger@whamcloud.com&gt;" uploaded a new patch:</del> <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49111" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49111</a><br/> <del>Subject: <a href="https://jira.whamcloud.com/browse/LU-16307" title="sanity-sec: test_31: export for 10.240.26.216@tcp on MGS should not exist" class="issue-link" data-issue-key="LU-16307">LU-16307</a>: Revert "<a href="https://jira.whamcloud.com/browse/LU-10003" title="lnetctl error &quot;cannot add network: invalid argument&quot;" class="issue-link" data-issue-key="LU-10003">LU-10003</a> lnet: use Netlink to support old and new NI APIs."</del><br/> <del>Project: fs/lustre-release</del><br/> <del>Branch: master</del><br/> <del>Current Patch Set: 1</del><br/> <del>Commit: 15f994bbdc7e4068cd752772bc40f5d426cfadab</del></p> <p>Why didn't this show up before? Let me see if I can reproduce it and get a fix out.</p> <p>"Andreas Dilger &lt;adilger@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49127" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49127</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16307" title="sanity-sec: test_31: export for 10.240.26.216@tcp on MGS should not exist" class="issue-link" data-issue-key="LU-16307">LU-16307</a> tests: run sanity-sec test_31 in sanity-lnet<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 3232417e9a8a63676be8a1dc0e04f34346b3b24d</p> <blockquote> <p>Why didn't this show up before? Let me see if I can reproduce it and get a fix out.</p></blockquote> <p>Because the test failure was in <tt>sanity-sec.sh test_31</tt> but "<tt>Test-Parameters: trivial</tt>" does not run sanity-sec. This subest is doing funky things with <tt>lnetctl</tt> so it really should be run whenever LNet changes are made. I've pushed patch 49127 so that this one subtest is always run when <tt>sanity-lnet.sh</tt> is run.</p> <p>Also I found this test is not run when it is run from the source tree or its all run on the local node. This explains why Oleg never saw an issue.</p> <p>I found the source of the bug. I was a bit to aggressive in testing conditions in lnetctl. Testing the fix now.</p> <p>It looks like the lack of local testing is because "lnet/utils" is not added to the <tt>PATH</tt> when run from the local tree. That should also be fixed in your patch, so this test is run more regularly.</p> <p>"James Simmons &lt;jsimmons@infradead.org&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49129" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49129</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16307" title="sanity-sec: test_31: export for 10.240.26.216@tcp on MGS should not exist" class="issue-link" data-issue-key="LU-16307">LU-16307</a> util: fix lnetctl bugs that break sanity-sec<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 6b68cfd683e9c067c3ee6f395be54ff663952246</p> <p>"James Simmons &lt;jsimmons@infradead.org&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49143" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49143</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16307" title="sanity-sec: test_31: export for 10.240.26.216@tcp on MGS should not exist" class="issue-link" data-issue-key="LU-16307">LU-16307</a> test: expand sanity-lnet 301 test<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 7394af8e41f95fa2de17f9d55b9b450477301907</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49129/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49129/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16307" title="sanity-sec: test_31: export for 10.240.26.216@tcp on MGS should not exist" class="issue-link" data-issue-key="LU-16307">LU-16307</a> util: fix lnetctl bugs that break sanity-sec<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 5055381d9e766c0353d3881119a300b6fa60c10b</p> <p>"Cyril Bordage &lt;cbordage@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49425" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49425</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16307" title="sanity-sec: test_31: export for 10.240.26.216@tcp on MGS should not exist" class="issue-link" data-issue-key="LU-16307">LU-16307</a> tests: run sanity-sec test_31 in sanity-lnet<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: a9877fe045daf923a9d7b56cc5589a9cc5409836</p> <p>+1 on master: <a href="https://testing.whamcloud.com/test_sets/d3ab6e4e-d9cc-4cfd-819d-8dc068bb9ad5" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/d3ab6e4e-d9cc-4cfd-819d-8dc068bb9ad5</a></p> <p>"Sebastien Buisson &lt;sbuisson@ddn.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/53818" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/53818</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16307" title="sanity-sec: test_31: export for 10.240.26.216@tcp on MGS should not exist" class="issue-link" data-issue-key="LU-16307">LU-16307</a> tests: fix sanity-sec test_31<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: f4a96799159fd662855542d471197ac4060d3295</p> Related LU-10003 Development Rank 1|i035ef: Rank (Obsolete) 9223372036854775807 Severity