https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-9752 Lustre <p>when trying to format zfs osts we get the following error:<br/> mkfs.lustre --reformat --mdt --mgs --servicenode= 211@o2ib --backfstype=zfs --fsname=tempAA --index=0 mgs/mdt</p> <p>Permanent disk data:<br/> Target: tempAA:MDT0000<br/> Index: 0<br/> Lustre FS: tempAA<br/> Mount type: zfs<br/> Flags: 0x1065<br/> (MDT MGS first_time update no_primnode )<br/> Persistent mount opts:<br/> Parameters: failover.node=10.10.10.213@o2ib:10.10.10.211@o2ib</p> <p>mkfs.lustre FATAL: spl_hostid not set. See mkfs.lustre(8)<br/> mkfs.lustre FATAL: mkfs failed 22<br/> mkfs.lustre: exiting with 22 (Invalid argument)</p> SLES12 SP2<br/> Lustre community pre-release 2.10 LU-9752

Unable to format zfs osts

Bug Major Resolved Fixed Nathaniel Clark Abe zfs Fri, 7 Jul 2017 22:51:25 +0000 Wed, 15 Nov 2017 20:07:52 +0000 Thu, 19 Oct 2017 11:56:31 +0000 Lustre 2.10.0 Lustre 2.11.0 Lustre 2.10.2 0 7 <p>Nathaniel</p> <p>Can you please advise?</p> <p>Peter</p> <p>Ignoring, for the moment, the <tt>--servicenode</tt> option having an invalid IPv4 address for the NID, the error returned by mkfs is stating that the server's hostid is not set persistently. This is needed in order to reduce the chances of double-importing a ZFS pool across multiple servers. </p> <p>This is a recent change in behaviour for the mkfs.lustre command, designed to ensure that additional protection of the ZFS storage pools is in place before creating the file system target.</p> <p> Try running the following command:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">genhostid </pre> </div></div> <p>This will create a file, <tt>/etc/hostid</tt>, containing a persistent hostid for the server. To activate, either reload the spl.ko module, or reboot the server. In my experience, the server usually needs to be rebooted, but that may have been fixed in the most recent ZFS versions. When the reboot is complete, the SPL kernel module will pick up the hostid automatically when it is loaded. This will allow the format command to complete.</p> <p>Once rebooted, you can verify that the hostid is set properly by comparing the output of the hostid command to the content of /etc/hostid. For example:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">[root@ct73-oss2 ~]# hostid 000bea11 [root@ct73-oss2 ~]# od -An -tx /etc/hostid 000bea11 </pre> </div></div> <p> The hostid needs to be set for all Lustre servers with ZFS storage targets.</p> <p>Hi Malcom,<br/> I had to manually the hostid file since there is no genhostid cli on suse linux.<br/> It is solved the problem, pls go ahead and close this ticket..</p> <p>thank you<br/> Abe</p> <p>Thanks for the update. I did not realise that genhostid is not available on SLES. I did discover the following alternative method using BASH, for future reference:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">h=`hostid`; a=${h:6:2}; b=${h:4:2}; c=${h:2:2}; d=${h:0:2} sudo sh -c <span class="code-quote">"echo -ne \"</span>\x$a\x$b\x$c\x$d\<span class="code-quote">" &gt; /etc/hostid"</span> </pre> </div></div> <p>For example:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">vagrant@sl12sp2-b:~&gt; hostid 007f0100 vagrant@sl12sp2-b:~&gt; h=`hostid`; a=${h:6:2}; b=${h:4:2}; c=${h:2:2}; d=${h:0:2} vagrant@sl12sp2-b:~&gt; sudo sh -c <span class="code-quote">"echo -ne \"</span>\x$a\x$b\x$c\x$d\<span class="code-quote">" &gt; /etc/hostid"</span> vagrant@sl12sp2-b:~&gt; od -An -tx /etc/hostid 007f0100 </pre> </div></div> <p> </p> <p>I wonder if it makes sense to add the above script into a <tt>genhostid</tt> command as part of <tt>osd-zfs-mount.rpm</tt> for SLES, so that users don't run into this problem?</p> <p>The <tt>genhostid</tt> command is part of the RHEL <tt>initscripts</tt> package, while <tt>hostid</tt> is part of <tt>coreutils</tt>, so it does appear that <tt>genhostid</tt> is unique to RHEL, but it would be convenient to have this available on SLES as well.</p> <p>Has this become irrelevant with ZFS 0.7.0's MMP? Since hostid isn't used for that?</p> <p>The ZFS MMP implementation still depends on hostid to determine if the pool is being imported on the same node. There is a patch to create a <tt>zgenhostid</tt> command to make up for the lack of <tt>genhostid</tt> on SLES and Ubuntu, but that may only become available with ZFS 0.8.0, so I still think it makes sense for us to add our own <tt>genhostid</tt> command for those distros until it becomes available. At that point, we should consider changing our documentation to reference <tt>zgenhostid</tt>, since the upstream <tt>genhostid</tt> maintainer has said the command may be removed from RHEL completely. </p> <p><tt>zgenhostid</tt> made it into 0.7.0.</p> <p>Nathaniel, could you please submit a patch that updates our references to <tt>zgenhostid</tt> instead of <tt>genhostid</tt> in the <tt>mkfs.lustre.8</tt> and <tt>tunefs.lustre.8</tt> man pages. </p> <p>Nathaniel Clark (nathaniel.l.clark@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/29327" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/29327</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9752" title="Unable to format zfs osts" class="issue-link" data-issue-key="LU-9752"><del>LU-9752</del></a> man: Reference zgenhostid instead of genhostid<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: bbb792bc4373a999f0bbc1fd0dba62faf475b7f7</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="https://review.whamcloud.com/29327/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/29327/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9752" title="Unable to format zfs osts" class="issue-link" data-issue-key="LU-9752"><del>LU-9752</del></a> man: Reference zgenhostid instead of genhostid<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: a1eb6de081473545fbd5c1fe33e209fe391bf708</p> <p>Landed for 2.11</p> <p>Minh Diep (minh.diep@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/29805" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/29805</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9752" title="Unable to format zfs osts" class="issue-link" data-issue-key="LU-9752"><del>LU-9752</del></a> man: Reference zgenhostid instead of genhostid<br/> Project: fs/lustre-release<br/> Branch: b2_10<br/> Current Patch Set: 1<br/> Commit: 58b218547b24069fffef45eb22a08439b632e548</p> <p>John L. Hammond (john.hammond@intel.com) merged in patch <a href="https://review.whamcloud.com/29805/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/29805/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9752" title="Unable to format zfs osts" class="issue-link" data-issue-key="LU-9752"><del>LU-9752</del></a> man: Reference zgenhostid instead of genhostid<br/> Project: fs/lustre-release<br/> Branch: b2_10<br/> Current Patch Set: <br/> Commit: 3dd7a41a9262635c42b8ba575d743b60e27ddbae</p> Development Epic zfs Epic/Theme zfs Rank 1|hzzgav: Rank (Obsolete) 9223372036854775807 Severity