https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-699 Lustre <p>v2_1_0_RC2 testing</p> <p>Report: <a href="https://maloo.whamcloud.com/test_sets/396f9254-e440-11e0-9909-52540025f9af" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/396f9254-e440-11e0-9909-52540025f9af</a></p> <p>== replay-dual test 1: |X| simple create == 06:21:32 (1316524892)<br/> Filesystem 1K-blocks Used Available Use% Mounted on<br/> fat-intel-1vm3@tcp:/lustre<br/> 79724848 3154788 72568440 5% /mnt/lustre<br/> Failing mds on node fat-intel-1vm3<br/> Stopping /mnt/mds (opts<img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/><br/> affected facets: mds<br/> df pid is 14339<br/> Failover mds to fat-intel-1vm3<br/> 06:21:50 (1316524910) waiting for fat-intel-1vm3 network 900 secs ...<br/> 06:21:50 (1316524910) network interface is UP<br/> Starting mds: -o user_xattr,acl /dev/lvm/P0 /mnt/mds<br/> fat-intel-1vm3: mount.lustre: mount /dev/mapper/lvm-P0 at /mnt/mds failed: No such file or directory<br/> fat-intel-1vm3: Is the MGS specification correct?<br/> fat-intel-1vm3: Is the filesystem name correct?<br/> fat-intel-1vm3: If upgrading, is the copied client log valid? (see upgrade docs)<br/> mount -t lustre /dev/lvm/P0 /mnt/mds<br/> Start of /dev/lvm/P0 on mds failed 2<br/> replay-dual test_1: @@@@@@ FAIL: Restart of mds failed! <br/> Dumping lctl log to /logdir/test_logs/2011-09-19/lustre-mixed-el6-x86_64_<em>283</em>_-7f6a2ad2c9e0/replay-dual.test_1.*.1316524910.log</p> <p>MDS console shows</p> <p>06:21:42:Lustre: server umount lustre-MDT0000 complete<br/> 06:21:51:LDISKFS-fs warning (device dm-0): ldiskfs_fill_super: extents feature not enabled on this filesystem, use tune2fs.<br/> 06:21:52:LDISKFS-fs (dm-0): recovery complete<br/> 06:21:52:LDISKFS-fs (dm-0): mounted filesystem with ordered data mode<br/> 06:21:52:LustreError: 8035:0:(obd_mount.c:294:ldd_parse()) cannot open CONFIGS/mountdata: rc = -2<br/> 06:21:52:LustreError: 8035:0:(obd_mount.c:1373:server_kernel_mount()) premount parse options failed: rc = -2<br/> 06:21:52:LustreError: 8035:0:(obd_mount.c:1681:server_fill_super()) Unable to mount device /dev/mapper/lvm-P0: -2<br/> 06:21:52:LustreError: 8035:0:(obd_mount.c:2160:lustre_fill_super()) Unable to mount (-2)<br/> 06:21:52:Lustre: DEBUG MARKER: replay-dual test_1: @@@@@@ FAIL: Restart of mds failed!</p> Lustre Clients: <br/> Tag: 1.8.6-wc1 <br/> Distro/Arch: RHEL6/x86_64 (kernel version: 2.6.32_131.2.1.el6) <br/> Build: <a href="http://newbuild.whamcloud.com/job/lustre-b1_8/100/arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/">http://newbuild.whamcloud.com/job/lustre-b1_8/100/arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/</a> <br/> Network: TCP<br/> ENABLE_QUOTA=yes <br/> <br/> Lustre Servers: <br/> Tag: v2_1_0_0_RC2 <br/> Distro/Arch: RHEL6/x86_64 (kernel version: 2.6.32-131.6.1.el6_lustre.g65156ed.x86_64)<br/> Build: <a href="http://newbuild.whamcloud.com/job/lustre-master/228/arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/">http://newbuild.whamcloud.com/job/lustre-master/228/arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/</a> <br/> Network: TCP LU-699

replay-dual test_1 fails to remount mdt

Bug Minor Resolved Fixed Jinshan Xiong Minh Diep Wed, 21 Sep 2011 14:52:10 +0000 Fri, 3 Jun 2016 07:52:28 +0000 Fri, 3 Jun 2016 07:52:28 +0000 Lustre 2.1.0 Lustre 1.8.7 Lustre 2.2.0 0 7 <p>&gt; 06:21:51:LDISKFS-fs warning (device dm-0): ldiskfs_fill_super: extents feature not enabled on this filesystem, use tune2fs.</p> <p>FYI, this message is a complete red herring for the MDT (i.e. unrelated to this or any problem, in case there was any uncertainty), and we should remove it from our ldiskfs filesystems. I don't think that extents on the MDT can possibly help, and will likely hurt performance since directory blocks are allocated one-at-a-time and storing them as extents is less efficient.</p> <p>Lustre Clients:<br/> Tag: 1.8.6-wc1<br/> Distro/Arch: RHEL6/x86_64 (kernel version: 2.6.32_131.2.1.el6)<br/> Build: <a href="http://newbuild.whamcloud.com/job/lustre-b1_8/100/arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/" class="external-link" target="_blank" rel="nofollow noopener">http://newbuild.whamcloud.com/job/lustre-b1_8/100/arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/</a><br/> Network: TCP (1GigE)<br/> ENABLE_QUOTA=yes</p> <p>Lustre Servers:<br/> Tag: v2_1_0_0_RC2<br/> Distro/Arch: RHEL6/x86_64 (kernel version: 2.6.32-131.6.1.el6_lustre)<br/> Build: <a href="http://newbuild.whamcloud.com/job/lustre-master/283/arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/" class="external-link" target="_blank" rel="nofollow noopener">http://newbuild.whamcloud.com/job/lustre-master/283/arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/</a></p> <p>replay-dual test passed in manual run: <a href="https://maloo.whamcloud.com/test_sets/a60c9bd8-e5c5-11e0-9909-52540025f9af" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/a60c9bd8-e5c5-11e0-9909-52540025f9af</a></p> <p>Another failure on lustre-2.1:</p> <p><a href="https://maloo.whamcloud.com/test_sets/3055c2c6-f6bd-11e0-a451-52540025f9af" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/3055c2c6-f6bd-11e0-a451-52540025f9af</a></p> <p>I took a close look at this problem because it may block my IR landings.</p> <p>Obviously the problem is due to the corruption on lustre_disk_data. When we're modifying lustre_disk_data, we just wait for log to be committed but NOT data to actually write to disk. So in this test case, if the data is not written into disk when we mark the device as readonly, we will be in trouble because we'll lose updated lustre_disk_data.</p> <p>I'm going to fix this problem by using O_SYNC to update lustre_disk_data if this is hit in the test.</p> <p>patch is at: <a href="http://review.whamcloud.com/1557" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/1557</a></p> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=ofa/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,ofa #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=inkernel/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,inkernel #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el6,inkernel #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el6,ib_stack=inkernel/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el6,inkernel #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el6,inkernel #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=ubuntu1004,ib_stack=inkernel/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,ubuntu1004,inkernel #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=ofa/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,ofa #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=inkernel/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,inkernel #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el6,ib_stack=inkernel/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el6,inkernel #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=ofa/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,ofa #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=inkernel/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,inkernel #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=inkernel/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,inkernel #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=ofa/305/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,ofa #305</a><br/> <a href="https://jira.whamcloud.com/browse/LU-699" title="replay-dual test_1 fails to remount mdt" class="issue-link" data-issue-key="LU-699"><del>LU-699</del></a> tests: replay-dual test_1 failure</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=886e67d4fe87d293952a11e7f41b98a8c3abeddd" class="external-link" target="_blank" rel="nofollow noopener">886e67d4fe87d293952a11e7f41b98a8c3abeddd</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_mount.c</li> </ul> <p>I seemed to hit the data corruption problem in REPLAY_DUAL test 16 and 20.</p> <p>Why did this ticket not marked RESOLVED?</p> <p>I rebuilt the lustre server with this patch. It still failed, on a different way<br/> though.</p> Duplicate LU-1012 Development Rank 1|hzv8bz: Rank (Obsolete) 4884 Severity