https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-2606 Lustre <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre></pre> </div></div> <p>[ 363.060205] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. quota=off. Opts: <br/> [ 363.108765] Lustre: MGC192.168.69.5@tcp: Reactivating import<br/> Jan 11 11:15:42 rhel6-64 kernel: [ 363.108765] Lustre: MGC192.168.69.5@tcp: Reactivating import<br/> [ 364.599695] Lustre: lustre-MDT0000: used disk, loading<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 364.599695] Lustre: lustre-MDT0000: used disk, loading<br/> [ 364.611720] Lustre: 12041:0:(mdt_lproc.c:418:lprocfs_wr_identity_upcall()) lustre-MDT0000: identity upcall set to /Users/shadow/work/lustre/work/BUGS/MRP-509/lustre.13/lustre/utils/l_getident<br/> ity<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 364.611720] Lustre: 12041:0:(mdt_lproc.c:418:lprocfs_wr_identity_upcall()) lustre-MDT0000: identity upcall set to /Users/shadow/work/lustre/work/BUGS/MRP-509/<br/> lustre.13/lustre/utils/l_getidentity<br/> [ 364.643496] Lustre: lustre-MDT0000: Temporarily refusing client connection from 0@lo<br/> [ 364.647787] LustreError: 11-0: an error occurred while communicating with 0@lo. The mds_connect operation failed with -11<br/> Jan 11 11:15:44 [ 364.650814] Lustre: lustre-MDT0000: No usr space accounting support. Please consider running tunefs.lustre --quota on an unmounted filesystem to enable quota accounting.<br/> rhel6-64 kernel: [ 364.643496] [ 364.656135] Lustre: lustre-MDT0000: No grp space accounting support. Please consider running tunefs.lustre --quota on an unmounted filesystem to enable quota a<br/> ccounting.<br/> Lustre: lustre-MDT0000: Temporarily refusing client connection from 0@lo<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 364.647787] LustreError: 11-0: an error occurred while communicating with 0@lo. The mds_connect operation failed with -11<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 364.650814] Lustre: lustre-MDT0000: No usr space accounting support. Please consider running tunefs.lustre --quota on an unmounted filesystem to enable quota <br/> accounting.<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 364.656135] Lustre: lustre-MDT0000: No grp space accounting support. Please consider running tunefs.lustre --quota on an unmounted filesystem to enable quota <br/> accounting.<br/> [ 364.875511] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=off. Opts: <br/> Jan 11 11:15:44 rhel6-64 kernel: [ 364.875511] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. quota=off. Opts: <br/> [ 365.137956] LustreError: 12167:0:(ofd_fs.c:254:ofd_groups_init()) groups file is corrupted? size = 4<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.137956] LustreError: 12167:0:(ofd_fs.c:254:ofd_groups_init()) groups file is corrupted? size = 4<br/> [ 365.144003] LustreError: 12167:0:(obd_config.c:572:class_setup()) setup lustre-OST0000 failed (-5)<br/> [ 365.146446] LustreError: 12167:0:(obd_config.c:1546:class_config_llog_handler()) MGC192.168.69.5@tcp: cfg command failed: rc = -5<br/> Jan 11 11:15:44 [ 365.150286] Lustre: cmd=cf003 0:lustre-OST0000 1:dev 2:0 3:f <br/> rhel6-64 kernel: [ 365.144003] [ 365.152806] LustreError: 15c-8: MGC192.168.69.5@tcp: The configuration from log 'lustre-OST0000' failed (-5). This may be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information.<br/> LustreError: 12167:0:(obd_config.c:572:class_setup()) setup lust[ 365.162154] LustreError: 12130:0:(obd_mount.c:1848:server_start_targets()) failed to start server lustre-OST0000: -5<br/> re-OST0000 failed (-5)<br/> Jan 11 11[ 365.165806] LustreError: 12130:0:(obd_mount.c:2400:server_fill_super()) Unable to start targets: -5<br/> :15:44 rhel6-64 kernel: [ 365.1[ 365.168976] LustreError: 12130:0:(obd_mount.c:1352:lustre_disconnect_osp()) Can't end config log lustre<br/> 46446] LustreError: 12167:0:(obd[ 365.172533] LustreError: 12130:0:(obd_mount.c:2114:server_put_super()) lustre-OST0000: failed to disconnect osp-on-ost (rc=-2)!<br/> _config.c:1546:class_config_llog[ 365.177472] LustreError: 12130:0:(obd_config.c:619:class_cleanup()) Device 13 not setup<br/> _handler()) MGC192.168.69.5@tcp:[ 365.180974] LustreError: 12130:0:(obd_mount.c:1420:lustre_stop_osp()) Can not find osp-on-ost lustre-MDT0000-osp-OST0000<br/> cfg command failed: rc = -5<br/> Jan[ 365.184942] LustreError: 12130:0:(obd_mount.c:2159:server_put_super()) lustre-OST0000: Fail to stop osp-on-ost!<br/> 11 11:15:44 rhel6-64 kernel: [ 365.150286] Lustre: cmd=cf00[ 365.191390] Lustre: server umount lustre-OST0000 complete<br/> 3 0:lustre-OST00[ 365.193673] LustreError: 12130:0:(obd_mount.c:2988:lustre_fill_super()) Unable to mount /dev/loop1 (-5)<br/> 00 1:dev 2:0 3:f <br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.152806] LustreError: 15c-8: MGC192.168.69.5@tcp: The configuration from log 'lustre-OST0000' failed (-5). This may be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information.<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.162154] LustreError: 12130:0:(obd_mount.c:1848:server_start_targets()) failed to start server lustre-OST0000: -5<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.165806] LustreError: 12130:0:(obd_mount.c:2400:server_fill_super()) Unable to start targets: -5<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.168976] LustreError: 12130:0:(obd_mount.c:1352:lustre_disconnect_osp()) Can't end config log lustre<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.172533] LustreError: 12130:0:(obd_mount.c:2114:server_put_super()) lustre-OST0000: failed to disconnect osp-on-ost (rc=-2)!<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.177472] LustreError: 12130:0:(obd_config.c:619:class_cleanup()) Device 13 not setup<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.180974] LustreError: 12130:0:(obd_mount.c:1420:lustre_stop_osp()) Can not find osp-on-ost lustre-MDT0000-osp-OST0000<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.184942] LustreError: 12130:0:(obd_mount.c:2159:server_put_super()) lustre-OST0000: Fail to stop osp-on-ost!<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.191390] Lustre: server umount lustre-OST0000 complete<br/> Jan 11 11:15:44 rhel6-64 kernel: [ 365.193673] LustreError: 12130:0:(obd_mount.c:2988:lustre_fill_super()) Unable to mount /dev/loop1 (-5)</p> LU-2606

lustre 2.4 don't able to start on 2.1 disks

Bug Blocker Resolved Fixed Di Wang Alexey Lyashkov HB Fri, 11 Jan 2013 10:57:03 +0000 Mon, 27 Jul 2015 08:19:18 +0000 Thu, 7 Feb 2013 10:40:54 +0000 Lustre 2.4.0 Lustre 2.4.0 0 6 <p>I think that this problem will be fixed as soon as the next patches in the DNE series land, since the group file is no longer used?</p> <p>If that isn't the case, Di can you make the code able to accept a 4-byte file and just treat it as a __u32 instead of a __u64?</p> <p>a bit unexpected because we do have a test for the case in conf-sanity.sh</p> <p>Yes, we would not need group file anymore after that patch is landed. I just checked our disk2_1-ldiskfs.tar.bz2 (under tests), it seems <br/> LAST_GROUPS size is zero, that is why conf-sanity.sh did not find out this error. </p> <p><span class="error">&#91;root@testnode tests&#93;</span># mount -t ldiskfs -o loop ./ost /mnt/mds1<br/> <span class="error">&#91;root@testnode tests&#93;</span># ls /mnt/mds1/<br/> CONFIGS health_check LAST_GROUP last_rcvd lost+found O<br/> <span class="error">&#91;root@testnode tests&#93;</span># ls /mnt/mds1/LAST_GROUP -l<br/> <del>rwx</del>----- 1 root root 0 Mar 14 2012 /mnt/mds1/LAST_GROUP<br/> <span class="error">&#91;root@testnode tests&#93;</span># od -x /mnt/mds1/LAST_GROUP <br/> 0000000<br/> <span class="error">&#91;root@testnode tests&#93;</span># stat /mnt/mds1/LAST_GROUP <br/> File: `/mnt/mds1/LAST_GROUP'<br/> Size: 0 Blocks: 0 IO Block: 4096 regular empty file<br/> Device: 700h/1792d Inode: 17 Links: 1<br/> Access: (0700/<del>rwx</del>-----) Uid: ( 0/ root) Gid: ( 0/ root)<br/> Access: 2013-10-28 05:59:59.362696108 -0700<br/> Modify: 2012-03-14 23:16:54.069859989 -0700<br/> Change: 2012-03-14 23:16:54.069859989 -0700</p> <p>Apparently, we need to make a better disk image here.</p> <p>Di, could you please make a patch for this, and also fix the test image at the same time.</p> <p>this patch <a href="http://review.whamcloud.com/#change,4325" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,4325</a> (already merged) should fix this problem. I will update the test image later.</p> <p>I will retest today.</p> <p>Shadow, any update from your testing of the patch?</p> <p>Are there any updates on the test of this patch?</p> <p>Closing bug per Di's comment that the fix has been merged.</p> <p>Alexander Boyko (alexander.boyko@seagate.com) uploaded a new patch: <a href="http://review.whamcloud.com/15731" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/15731</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-2606" title="lustre 2.4 don&#39;t able to start on 2.1 disks" class="issue-link" data-issue-key="LU-2606"><del>LU-2606</del></a> osp: add procfs values for OST reserved size<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: a69eed85d902e2b15a960430e4652fbcc3c0bc33</p> Related LU-1445 Development Rank 1|hzvf0v: Rank (Obsolete) 6079 Severity