<!-- 
RSS generated by JIRA (9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c) at Sat Feb 10 03:08:30 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>Whamcloud Community JIRA</title>
    <link>https://jira.whamcloud.com</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.4.14</version>
        <build-number>940014</build-number>
        <build-date>05-12-2023</build-date>
    </build-info>


<item>
            <title>[LU-14294] parallel-scale-nfsv4 fails to start with &#8220;setup nfs failed! &#8220; for RHEL8.3</title>
                <link>https://jira.whamcloud.com/browse/LU-14294</link>
                <project id="10000" key="LU">Lustre</project>
                    <description>&lt;p&gt;The parallel-scale-nfsv4 test suite is failing in NFS setup and, thus, no tests are run. We are seeing this for RHEL8.3 servers. &lt;/p&gt;

&lt;p&gt;Looking at a recent failure at &lt;a href=&quot;https://testing.whamcloud.com/test_sets/d76032dc-6074-406f-824c-a7f3676496cb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://testing.whamcloud.com/test_sets/d76032dc-6074-406f-824c-a7f3676496cb&lt;/a&gt;, we see &lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;CMD: trevis-202vm4 { [[ -e /etc/SuSE-release ]] &amp;amp;&amp;amp;
				 service nfsserver restart; } ||
				 service nfs restart ||
				 service nfs-server restart
trevis-202vm4: Redirecting to /bin/systemctl restart nfs.service
trevis-202vm4: Failed to restart nfs.service: Unit nfs.service not found.
trevis-202vm4: Redirecting to /bin/systemctl restart nfs-server.service
trevis-202vm4: Job for nfs-server.service canceled.
pdsh@trevis-202vm1: trevis-202vm4: ssh exited with exit code 1
 parallel-scale-nfsv4 : @@@@@@ FAIL: setup nfs failed! 
  Trace dump:
  = /usr/lib64/lustre/tests/test-framework.sh:6273:error()
  = /usr/lib64/lustre/tests/parallel-scale-nfs.sh:68:main()
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;When we see this failure, so far, it is when node-provisioning/lustre-initialization takes place right before parallel-scale-nfsv4 is run.&lt;/p&gt;

&lt;p&gt;Logs for failures&lt;br/&gt;
&lt;a href=&quot;https://testing.whamcloud.com/test_sets/fe77403a-33b6-4c9b-9fb3-51cc04edd4aa&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://testing.whamcloud.com/test_sets/fe77403a-33b6-4c9b-9fb3-51cc04edd4aa&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;https://testing.whamcloud.com/test_sets/3f882eb8-2355-4108-adce-ed73e10f054c&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://testing.whamcloud.com/test_sets/3f882eb8-2355-4108-adce-ed73e10f054c&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;https://testing.whamcloud.com/test_sets/d76032dc-6074-406f-824c-a7f3676496cb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://testing.whamcloud.com/test_sets/d76032dc-6074-406f-824c-a7f3676496cb&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;https://testing.whamcloud.com/test_sets/4d2fe1de-af46-4313-933d-7c36b9024138&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://testing.whamcloud.com/test_sets/4d2fe1de-af46-4313-933d-7c36b9024138&lt;/a&gt;&lt;/p&gt;</description>
                <environment>RHEL8.3 server</environment>
        <key id="62212">LU-14294</key>
            <summary>parallel-scale-nfsv4 fails to start with &#8220;setup nfs failed! &#8220; for RHEL8.3</summary>
                <type id="1" iconUrl="https://jira.whamcloud.com/secure/viewavatar?size=xsmall&amp;avatarId=11303&amp;avatarType=issuetype">Bug</type>
                                            <priority id="4" iconUrl="https://jira.whamcloud.com/images/icons/priorities/minor.svg">Minor</priority>
                        <status id="5" iconUrl="https://jira.whamcloud.com/images/icons/statuses/resolved.png" description="A resolution has been taken, and it is awaiting verification by reporter. From here issues are either reopened, or are closed.">Resolved</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="1">Fixed</resolution>
                                        <assignee username="Deiter">Alex Deiter</assignee>
                                    <reporter username="jamesanunez">James Nunez</reporter>
                        <labels>
                            <label>rhel8</label>
                            <label>rhel8.3</label>
                    </labels>
                <created>Tue, 5 Jan 2021 19:47:26 +0000</created>
                <updated>Wed, 2 Aug 2023 12:58:53 +0000</updated>
                            <resolved>Fri, 19 May 2023 12:36:31 +0000</resolved>
                                    <version>Lustre 2.14.0</version>
                    <version>Lustre 2.15.1</version>
                    <version>Lustre 2.15.3</version>
                                    <fixVersion>Lustre 2.16.0</fixVersion>
                    <fixVersion>Lustre 2.15.4</fixVersion>
                                        <due></due>
                            <votes>0</votes>
                                    <watches>6</watches>
                                                                            <comments>
                            <comment id="288714" author="adilger" created="Tue, 5 Jan 2021 20:09:59 +0000"  >&lt;p&gt;Have the NFS tools RPMs been installed?&lt;/p&gt;</comment>
                            <comment id="288719" author="jamesanunez" created="Tue, 5 Jan 2021 20:30:55 +0000"  >&lt;p&gt;parallel-scale-nfsv3 runs before parallel-scale-nfsv4, actually parallel-scale-nfsv3 runs and hangs which causes the cluster to run node-provisioning/lustre-initialization, and parallel-scale-nfsv3 does start the NFS servers. &lt;/p&gt;

&lt;p&gt;Looking at the suite_log for parallel-scale-nfsv3, at &lt;a href=&quot;https://testing.whamcloud.com/test_sets/bc5183ad-2cad-4b97-aba4-604b73b9765f&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://testing.whamcloud.com/test_sets/bc5183ad-2cad-4b97-aba4-604b73b9765f&lt;/a&gt;, the NFS server starts&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;CMD: trevis-202vm4 { [[ -e /etc/SuSE-release ]] &amp;amp;&amp;amp;
				 service nfsserver restart; } ||
				 service nfs restart ||
				 service nfs-server restart
trevis-202vm4: Redirecting to /bin/systemctl restart nfs.service
trevis-202vm4: Failed to restart nfs.service: Unit nfs.service not found.
trevis-202vm4: Redirecting to /bin/systemctl restart nfs-server.service
CMD: trevis-202vm1.trevis.whamcloud.com,trevis-202vm2 chkconfig --list rpcidmapd 2&amp;gt;/dev/null |
			       grep -q rpcidmapd &amp;amp;&amp;amp; service rpcidmapd restart ||
			       true

Mounting NFS clients (version 3)...
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;Looking at the MDS (vm4) console log, we see acknowledgment from NFSD before parallel-scale-nfsv3 starts running tests&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;[64667.180020] Lustre: DEBUG MARKER: { [[ -e /etc/SuSE-release ]] &amp;amp;&amp;amp;
[64667.180020] 				 service nfsserver restart; } ||
[64667.180020] 				 service nfs restart ||
[64667.180020] 				 service nfs-server restart
[64667.719483] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
[64668.019298] NFSD: Using nfsdcld client tracking operations.
[64668.020325] NFSD: no clients to reclaim, skipping NFSv4 grace period (net f0000098)
[64671.281631] Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests: 
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;Before parallel-scale-nfsv4 starts, we don&apos;t see the same&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;[  344.752738] Lustre: DEBUG MARKER: { [[ -e /etc/SuSE-release ]] &amp;amp;&amp;amp;
[  344.752738] 				 service nfsserver restart; } ||
[  344.752738] 				 service nfs restart ||
[  344.752738] 				 service nfs-server restart
[  345.178077] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
[  345.638306] Lustre: DEBUG MARKER: /usr/sbin/lctl mark  parallel-scale-nfsv4 : @@@@@@ FAIL: setup nfs failed! 
[  346.014296] Lustre: DEBUG MARKER: parallel-scale-nfsv4 : @@@@@@ FAIL: setup nfs failed!&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;p&gt;So, the NFS RPMs were loaded on the servers.&lt;/p&gt;</comment>
                            <comment id="329990" author="sarah" created="Wed, 23 Mar 2022 17:19:32 +0000"  >&lt;p&gt;+1 in interop testing between master(el8.5) and 2.12 client(el7.9) in nfsv3 testing&lt;br/&gt;
&lt;a href=&quot;https://testing.whamcloud.com/test_sets/6f42d6c1-3777-463a-aed3-ce12f028983c&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://testing.whamcloud.com/test_sets/6f42d6c1-3777-463a-aed3-ce12f028983c&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="352007" author="gerrit" created="Mon, 7 Nov 2022 17:55:23 +0000"  >&lt;p&gt;&quot;Alex Deiter &amp;lt;alex.deiter@gmail.com&amp;gt;&quot; uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/c/fs/lustre-release/+/49062&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/c/fs/lustre-release/+/49062&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14294&quot; title=&quot;parallel-scale-nfsv4 fails to start with &#8220;setup nfs failed! &#8220; for RHEL8.3&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14294&quot;&gt;&lt;del&gt;LU-14294&lt;/del&gt;&lt;/a&gt; tests: fixed NFS configuration issue&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: f63c4399c084f9c3380ceb2990722c3f477a297b&lt;/p&gt;</comment>
                            <comment id="372815" author="gerrit" created="Fri, 19 May 2023 07:03:46 +0000"  >&lt;p&gt;&quot;Oleg Drokin &amp;lt;green@whamcloud.com&amp;gt;&quot; merged in patch &lt;a href=&quot;https://review.whamcloud.com/c/fs/lustre-release/+/49062/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/c/fs/lustre-release/+/49062/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14294&quot; title=&quot;parallel-scale-nfsv4 fails to start with &#8220;setup nfs failed! &#8220; for RHEL8.3&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14294&quot;&gt;&lt;del&gt;LU-14294&lt;/del&gt;&lt;/a&gt; tests: fixed NFS configuration issue&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: 1a8fe55b17ac2bc2195aaba446467ccdac67b564&lt;/p&gt;</comment>
                            <comment id="372872" author="pjones" created="Fri, 19 May 2023 12:36:31 +0000"  >&lt;p&gt;Landed for 2.16&lt;/p&gt;</comment>
                            <comment id="375146" author="gerrit" created="Mon, 12 Jun 2023 22:02:35 +0000"  >&lt;p&gt;&quot;Alex Deiter &amp;lt;alex.deiter@gmail.com&amp;gt;&quot; uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/c/fs/lustre-release/+/51283&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/c/fs/lustre-release/+/51283&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14294&quot; title=&quot;parallel-scale-nfsv4 fails to start with &#8220;setup nfs failed! &#8220; for RHEL8.3&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14294&quot;&gt;&lt;del&gt;LU-14294&lt;/del&gt;&lt;/a&gt; tests: fixed NFS configuration issue&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: b2_15&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: dfbddc3a4367eb1096134233b8ef3d80c981b78a&lt;/p&gt;</comment>
                            <comment id="381018" author="gerrit" created="Wed, 2 Aug 2023 06:17:12 +0000"  >&lt;p&gt;&quot;Oleg Drokin &amp;lt;green@whamcloud.com&amp;gt;&quot; merged in patch &lt;a href=&quot;https://review.whamcloud.com/c/fs/lustre-release/+/51283/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/c/fs/lustre-release/+/51283/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14294&quot; title=&quot;parallel-scale-nfsv4 fails to start with &#8220;setup nfs failed! &#8220; for RHEL8.3&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14294&quot;&gt;&lt;del&gt;LU-14294&lt;/del&gt;&lt;/a&gt; tests: fixed NFS configuration issue&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: b2_15&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: cef89c354f22f873f1f2e09536de7c690852828b&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                                                <inwardlinks description="is duplicated by">
                                        <issuelink>
            <issuekey id="55507">LU-12231</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10011">
                    <name>Related</name>
                                            <outwardlinks description="is related to ">
                                        <issuelink>
            <issuekey id="47879">LU-9892</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="55506">LU-12230</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="58027">LU-13219</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                            <customfield id="customfield_10890" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10390" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i01iiv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10090" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10060" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Severity</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10022"><![CDATA[3]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        </customfields>
    </item>
</channel>
</rss>