https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-350 Lustre <p>for newly formatted Lustre system, the MDT must be started before OST, or it will cause clients can't mount the Lustre <br/> for the filesystem configuration will be erased when the MDT registers itself in MGS. currently , the script tool "lustre_start"<br/> uses the wrong order (it start OST before MDT) and cause clients can't mount.</p> LU-350

port bug24050 to master("lustre_start" caused client nodes failed to mount.)

Bug Minor Resolved Fixed Hongchao Zhang Hongchao Zhang Fri, 20 May 2011 02:26:42 +0000 Thu, 18 Aug 2011 02:07:16 +0000 Thu, 18 Aug 2011 02:07:16 +0000 Lustre 2.1.0 Lustre 2.1.0 0 3 <p>So, is the bug here the wrong order being used in lustre_start or is the actual bug the requirement that the MDT be mounted first for a newly formatted filesystem?</p> <p>To be sure, one has always been able to mount the servers in any order (for non-newly formatted filesystems at least) but I don't recall if that flexibility also applies/applied to newly formatted filesystems. We probably need somebody with a clearer picture (and/or memory) than I to chime in with an opinion on that in order to determine which is the real bug here.</p> <p><a href="http://review.whamcloud.com/#change,595" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,595</a></p> <p>paste comments in Gerrit for future reference</p> <p>Oleg Drokin:</p> <p>Huh? I think the entire point of starting MGS first then OSTs was so that MDS will start and be able to connect to all OSTs.</p> <p>Why would MDT erase any config on MGS at all? That sounds like a different problem that needs to be solved differently I think.</p> <p>Yu Jian:</p> <p>I also doubted this in bug 24050 comment #30, #48, #51, #57 and got a partial answer from Johann in comment #55. I think the fix of lustre_start utility was just a workaround, not fixing the Lustre issue. Lustre really supported the starting order of MGS-&gt;OST-&gt;MDT before. So, Hongchao, could you please investigate this? We need figure out the real issue.</p> <p>Oleg Drokin:</p> <p>The comment in bugzilla indicates that this order only needs to happen on first mount which I guess I can believe even though it is still somewhat strange that first MDT connect would wipe config data.</p> <p>Perhaps we just need to incorporate a real mount in MGS-&gt;MDT-&gt;OST) order in our formatting scripts instead?</p> <p>this problem is introduced by the patch in bug22464, which add "writeconf" option during formatting the disk, but it only cause problem in b1_8, <br/> in master, there is another condition "mti-&gt;mti_stripe_index == 0" to determine whether the whole log can be erased.</p> <p>but I try to start Lustre by MGS-OST-MDS order at master, it still fails for there are bugs in "mgs_steal_llog_for_mdt_from_client", the problem is <br/> the "index" and "svname" of the OST are missed when MDT call "mgs_steal_llog_for_mdt_from_client" to add the corresponding OSCs into its LOV.<br/> Lustre mounts successfully after applying the following patch</p> <p>diff --git a/lustre/mgs/mgs_llog.c b/lustre/mgs/mgs_llog.c<br/> index a8bb398..1ce2f85 100644<br/> &#8212; a/lustre/mgs/mgs_llog.c<br/> +++ b/lustre/mgs/mgs_llog.c<br/> @@ -1124,7 +1124,12 @@ static int mgs_steal_llog_handler(struct llog_handle *llh,<br/> marker = lustre_cfg_buf(lcfg, 1);<br/> if (!strncmp(marker-&gt;cm_comment,"add osc",7) &amp;&amp;<br/> (marker-&gt;cm_flags &amp; CM_START)){<br/> + char *osc_svname;<br/> + name_create(&amp;osc_svname, marker-&gt;cm_tgtname, "");<br/> +<br/> got_an_osc_or_mdc = 1;<br/> + strncpy(tmti-&gt;mti_svname, osc_svname, <br/> + sizeof(tmti-&gt;mti_svname));<br/> rc = record_start_log(obd, &amp;mdt_llh, mti-&gt;mti_svname);<br/> rc = record_marker(obd, mdt_llh, fsdb, CM_START,<br/> mti-&gt;mti_svname,"add osc(copied)");<br/> @@ -1208,6 +1213,7 @@ static int mgs_steal_llog_handler(struct llog_handle *llh,<br/> name_create_mdt_and_lov(&amp;logname, &amp;lovname, fsdb, mti-&gt;mti_stripe_index);<br/> sprintf(mdt_index, "<del>MDT%04x", mti</del>&gt;mti_stripe_index);</p> <p>+ sscanf(lustre_cfg_buf(lcfg, 2), "%d", &amp;tmti-&gt;mti_stripe_index);<br/> mgs_write_log_osc_to_lov(obd, fsdb, tmti, logname,<br/> mdt_index, lovname,<br/> LUSTRE_SP_MDT, 0);</p> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=ofa/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,ofa #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el6,ib_stack=inkernel/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el6,inkernel #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=inkernel/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,inkernel #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=inkernel/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,inkernel #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el6,inkernel #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el6,ib_stack=inkernel/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el6,inkernel #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el6,inkernel #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=sles11,ib_stack=inkernel/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,sles11,inkernel #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=ofa/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,ofa #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=inkernel/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,inkernel #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=ubuntu1004,ib_stack=inkernel/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,ubuntu1004,inkernel #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=ofa/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,ofa #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=ofa/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,ofa #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=inkernel/246/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,inkernel #246</a><br/> <a href="https://jira.whamcloud.com/browse/LU-350" title="port bug24050 to master(&quot;lustre_start&quot; caused client nodes failed to mount.)" class="issue-link" data-issue-key="LU-350"><del>LU-350</del></a> fix bug in mgs to allow starting OST before MDT</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=3227436e11b4bc77ffd261e8f13adf905fae2353" class="external-link" target="_blank" rel="nofollow noopener">3227436e11b4bc77ffd261e8f13adf905fae2353</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_llog.c</li> </ul> Bugzilla ID 24050.0 Development Rank 1|hzv8lj: Rank (Obsolete) 4927 Severity