Whamcloud Community JIRA

Whamcloud Community JIRA https://jira.whamcloud.com This file is an XML representation of an issue en-us

9.4.14

940014

05-12-2023

[LU-4284] Unable to provision SLES SP2 as a Lustre server https://jira.whamcloud.com/browse/LU-4284 Lustre <p>Unable to install the SLES builds of Lustre. Dependency missing.</p> <p>Malcolm found that the RHEL spec file for e2fsprogs has:<br/> Provides: ldiskfsprogs = %</p> {version} <p>This was not found in the SLES version.</p> LU-4284

Unable to provision SLES SP2 as a Lustre server

Bug Critical Closed Fixed Bob Glossman Brett Lee Wed, 20 Nov 2013 22:46:24 +0000 Tue, 4 Mar 2014 05:32:47 +0000 Tue, 4 Mar 2014 05:32:47 +0000 0 2 <p>To be a little more explicit, the top level file in the source tree e2fsprogs-SUSE_LINUX-11.spec.in is missing the line</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Provides: ldiskfsprogs = %{version} </pre> </div></div> <p>that is found in the file e2fsprogs-RHEL-6.spec.in</p> <p>Since the .spec file used in the rpmbuild command line in our SUSE package builds for e2fsprogs is e2fsprogs-SUSE_LINUX-11.spec I strongly suspect that adding that line to e2fsprogs-SUSE_LINUX-11.spec.in will put the necessary addition in our built RPMs for SLES 11 SP2 and SP3.</p> <p>proposed fix: <a href="http://review.whamcloud.com/8367" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/8367</a></p> <p>Restarted the entire process to ensure a clean bug report.<br/> OS is SLES 11 SP2 for SAP.<br/> Machine is a KVM VM - 2 GB RAM.</p> <p>Seems to have at least two problems:<br/> 1. The "nothing provides" ldiskfsprogs as noted previously.<br/> 2. Upon reboot into the Lustre kernel, the root <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/check.png" height="16" width="16" align="absmiddle" alt="" border="0"/> file system could not be mounted or fsck'd.<br/> 3. Perhaps due to what I installed, after the "grub update" there were two entries referring to the Lustre kernel, and none for the original kernel. Thus, could not roll back to the <b>Failsafe</b> kernel.</p> <p>Captured some notes. A bit verbose, but as this is a new OS for the Lustre server it seemed reasonable to capture.</p> <p>sles11sp2:~/lustre/# cat sles-lustre-install.txt<br/> Lustre on SLES 11 SP 2</p> <p>Get "Lustre" from here:<br/> <a href="http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/</a></p> <p>Get "e2fsprogs" from here:<br/> <a href="http://build.whamcloud.com/job/e2fsprogs-master/arch=x86_64,distro=sles11/" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/e2fsprogs-master/arch=x86_64,distro=sles11/</a></p> <p>Scripted to reproduce easier:</p> <p>wget \<br/> \<br/> <a href="http://build.whamcloud.com/job/e2fsprogs-master/arch=x86_64,distro=sles11/lastSuccessfulBuild/artifact/_topdir/RPMS/x86_64/e2fsprogs-1.42.7.wc2-0suse.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/e2fsprogs-master/arch=x86_64,distro=sles11/lastSuccessfulBuild/artifact/_topdir/RPMS/x86_64/e2fsprogs-1.42.7.wc2-0suse.x86_64.rpm</a> \<br/> \<br/> <a href="http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/kernel-default-3.0.93-0.5_lustre.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/kernel-default-3.0.93-0.5_lustre.x86_64.rpm</a> \<br/> <a href="http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/kernel-default-base-3.0.93-0.5_lustre.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/kernel-default-base-3.0.93-0.5_lustre.x86_64.rpm</a> \<br/> <a href="http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/lustre-2.5.0-3.0.93_0.5_lustre_default.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/lustre-2.5.0-3.0.93_0.5_lustre_default.x86_64.rpm</a> \<br/> <a href="http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/lustre-modules-2.5.0-3.0.93_0.5_lustre_default.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/lustre-modules-2.5.0-3.0.93_0.5_lustre_default.x86_64.rpm</a> \<br/> <a href="http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://build.whamcloud.com/job/lustre-b2_5/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default.x86_64.rpm</a></p> <p>RC=$?<br/> echo $RC</p> <p>Install e2fsprogs:</p> <p>sles11sp2:~/lustre/e2fsprogs # ll<br/> total 1316<br/> <del>rw-r</del><del>r</del>- 1 root root 1342882 Nov 22 01:56 e2fsprogs-1.42.7.wc2-0suse.x86_64.rpm<br/> sles11sp2:~/lustre/e2fsprogs # zypper install *.rpm<br/> Loading repository data...<br/> Reading installed packages...<br/> Resolving package dependencies...</p> <p>The following package is going to be upgraded:<br/> e2fsprogs</p> <p>The following package is going to change vendor:<br/> e2fsprogs SUSE LINUX Products GmbH, Nuernberg, Germany -></p> <p>The following package is not supported by its vendor:<br/> e2fsprogs</p> <p>1 package to upgrade, 1 to change vendor.<br/> Overall download size: 1.3 MiB. After the operation, additional 3.0 MiB will be used.<br/> Continue? <span class="error">[y/n/?]</span> <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/thumbs_up.png" height="16" width="16" align="absmiddle" alt="" border="0"/>: y<br/> Retrieving package e2fsprogs-1.42.7.wc2-0suse.x86_64 (1/1), 1.3 MiB (4.9 MiB unpacked)<br/> Retrieving package e2fsprogs-1.42.7.wc2-0suse.x86_64 (1/1), 1.3 MiB (4.9 MiB unpacked)<br/> Installing: e2fsprogs-1.42.7.wc2-0suse <span class="error">[done]</span><br/> sles11sp2:~/lustre/e2fsprogs #</p> <p>Install Lustre (ignore the dep, it should be included but not marked as such):</p> <p>sles11sp2:~/lustre/lustre # ll<br/> total 40068<br/> <del>rw-r</del><del>r</del>- 1 root root 18410610 Nov 11 11:53 kernel-default-3.0.93-0.5_lustre.x86_64.rpm<br/> <del>rw-r</del><del>r</del>- 1 root root 10930548 Nov 11 11:53 kernel-default-base-3.0.93-0.5_lustre.x86_64.rpm<br/> <del>rw-r</del><del>r</del>- 1 root root 7800341 Nov 11 12:13 lustre-2.5.0-3.0.93_0.5_lustre_default.x86_64.rpm<br/> <del>rw-r</del><del>r</del>- 1 root root 3443661 Nov 11 12:13 lustre-modules-2.5.0-3.0.93_0.5_lustre_default.x86_64.rpm<br/> <del>rw-r</del><del>r</del>- 1 root root 374587 Nov 11 12:13 lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default.x86_64.rpm<br/> sles11sp2:~/lustre/lustre # zypper install *.rpm<br/> Loading repository data...<br/> Reading installed packages...<br/> Resolving package dependencies...<br/> 2 Problems:<br/> Problem: nothing provides ldiskfsprogs >= 1.42.7.wc1 needed by lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default.x86_64<br/> Problem: nothing provides ldiskfsprogs >= 1.42.7.wc1 needed by lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default.x86_64</p> <p>Problem: nothing provides ldiskfsprogs >= 1.42.7.wc1 needed by lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default.x86_64<br/> Solution 1: do not install lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default.x86_64<br/> Solution 2: break lustre-osd-ldiskfs by ignoring some of its dependencies</p> <p>Choose from above solutions by number or skip, retry or cancel <span class="error">[1/2/s/r/c]</span> (c): 2</p> <p>Problem: nothing provides ldiskfsprogs >= 1.42.7.wc1 needed by lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default.x86_64<br/> Solution 1: do not install lustre-2.5.0-3.0.93_0.5_lustre_default.x86_64<br/> Solution 2: break lustre-osd-ldiskfs by ignoring some of its dependencies</p> <p>Choose from above solutions by number or skip, retry or cancel <span class="error">[1/2/s/r/c]</span> (c): 2<br/> Resolving dependencies...<br/> Resolving package dependencies...</p> <p>The following NEW packages are going to be installed:<br/> lustre lustre-modules lustre-osd-ldiskfs</p> <p>The following packages are going to be upgraded:<br/> kernel-default kernel-default-base</p> <p>The following packages are going to change vendor:<br/> kernel-default SUSE LINUX Products GmbH, Nuernberg, Germany -><br/> kernel-default-base SUSE LINUX Products GmbH, Nuernberg, Germany -></p> <p>The following packages are not supported by their vendor:<br/> kernel-default kernel-default-base lustre lustre-modules lustre-osd-ldiskfs</p> <p>2 packages to upgrade, 3 new, 2 to change vendor.<br/> Overall download size: 39.1 MiB. After the operation, additional 63.7 MiB will be used.<br/> Continue? <span class="error">[y/n/?]</span> <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/thumbs_up.png" height="16" width="16" align="absmiddle" alt="" border="0"/>: y<br/> Retrieving package kernel-default-base-3.0.93-0.5_lustre.x86_64 (1/5), 10.4 MiB (22.3 MiB unpacked)<br/> Retrieving package kernel-default-3.0.93-0.5_lustre.x86_64 (2/5), 17.6 MiB (78.8 MiB unpacked)<br/> Retrieving package lustre-modules-2.5.0-3.0.93_0.5_lustre_default.x86_64 (3/5), 3.3 MiB (20.3 MiB unpacked)<br/> Retrieving package lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default.x86_64 (4/5), 366.0 KiB (1.6 MiB unpacked)<br/> Retrieving package lustre-2.5.0-3.0.93_0.5_lustre_default.x86_64 (5/5), 7.4 MiB (40.0 MiB unpacked)<br/> Retrieving package kernel-default-base-3.0.93-0.5_lustre.x86_64 (1/5), 10.4 MiB (22.3 MiB unpacked)<br/> Installing: kernel-default-base-3.0.93-0.5_lustre <span class="error">[done]</span><br/> Additional rpm output:<br/> Scanning scripts ...<br/> Resolve dependencies ...<br/> Install symlinks in /lib/mkinitrd/setup ...<br/> Install symlinks in /lib/mkinitrd/boot ...</p> <p>Kernel image: /boot/vmlinuz-3.0.93-0.5_lustre-default<br/> Initrd image: /boot/initrd-3.0.93-0.5_lustre-default<br/> Root device: /dev/vda2 (mounted on / as ext3)<br/> Resume device: /dev/vda1<br/> find: `/lib/modules/3.0.93-0.5_lustre-default/kernel/drivers/scsi/device_handler': No such file or directory<br/> modprobe: Module thermal not found.<br/> WARNING: no dependencies for kernel module 'thermal' found.<br/> modprobe: Module processor not found.<br/> WARNING: no dependencies for kernel module 'processor' found.<br/> modprobe: Module fan not found.<br/> WARNING: no dependencies for kernel module 'fan' found.<br/> modprobe: Module virtio_blk not found.<br/> WARNING: no dependencies for kernel module 'virtio_blk' found.<br/> modprobe: Module ata_generic not found.<br/> WARNING: no dependencies for kernel module 'ata_generic' found.<br/> modprobe: Module virtio_pci not found.<br/> WARNING: no dependencies for kernel module 'virtio_pci' found.<br/> modprobe: Module virtio:d00000002v00001AF4 not found.<br/> WARNING: no dependencies for kernel module 'virtio:d00000002v00001AF4' found.<br/> modprobe: Module usbhid not found.<br/> WARNING: no dependencies for kernel module 'usbhid' found.<br/> Kernel Modules: scsi_mod libata ata_piix mbcache jbd ext3 usb-common usbcore ohci-hcd uhci-hcd ehci-hcd crc-t10dif sd_mod<br/> Features: acpi block usb resume.userspace resume.kernel<br/> 36915 blocks<br/> >>> Network: auto<br/> >>> Calling mkinitrd -B -k /boot/vmlinuz-3.0.93-0.5_lustre-default -i /boot/initrd-3.0.93-0.5_lustre-default-kdump -f 'kdump network' -s ''<br/> Regenerating kdump initrd ...</p> <p>Kernel image: /boot/vmlinuz-3.0.93-0.5_lustre-default<br/> Initrd image: /boot/initrd-3.0.93-0.5_lustre-default-kdump<br/> Root device: /dev/vda2 (mounted on / as ext3)<br/> Resume device: /dev/vda1<br/> find: `/lib/modules/3.0.93-0.5_lustre-default/kernel/drivers/scsi/device_handler': No such file or directory<br/> modprobe: Module thermal not found.<br/> WARNING: no dependencies for kernel module 'thermal' found.<br/> modprobe: Module processor not found.<br/> WARNING: no dependencies for kernel module 'processor' found.<br/> modprobe: Module fan not found.<br/> WARNING: no dependencies for kernel module 'fan' found.<br/> modprobe: Module virtio_blk not found.<br/> WARNING: no dependencies for kernel module 'virtio_blk' found.<br/> modprobe: Module ata_generic not found.<br/> WARNING: no dependencies for kernel module 'ata_generic' found.<br/> modprobe: Module virtio_pci not found.<br/> WARNING: no dependencies for kernel module 'virtio_pci' found.<br/> modprobe: Module virtio:d00000002v00001AF4 not found.<br/> WARNING: no dependencies for kernel module 'virtio:d00000002v00001AF4' found.<br/> modprobe: Module usbhid not found.<br/> WARNING: no dependencies for kernel module 'usbhid' found.<br/> modprobe: Module virtio:d00000001v00001AF4 not found.<br/> WARNING: no dependencies for kernel module 'virtio:d00000001v00001AF4' found.<br/> modprobe: Module nls_utf8 not found.<br/> WARNING: no dependencies for kernel module 'nls_utf8' found.<br/> Kernel Modules: scsi_mod libata ata_piix mbcache jbd ext3 usb-common usbcore ohci-hcd uhci-hcd ehci-hcd af_packet crc-t10dif sd_mod<br/> Features: acpi block usb network resume.userspace resume.kernel kdump<br/> 50530 blocks<br/> Don't refresh the bootloader. You may have to do that manually!</p> <p>Retrieving package kernel-default-3.0.93-0.5_lustre.x86_64 (2/5), 17.6 MiB (78.8 MiB unpacked)<br/> Installing: kernel-default-3.0.93-0.5_lustre <span class="error">[done]</span><br/> Additional rpm output:</p> <p>Kernel image: /boot/vmlinuz-3.0.93-0.5_lustre-default<br/> Initrd image: /boot/initrd-3.0.93-0.5_lustre-default<br/> Root device: /dev/vda2 (mounted on / as ext3)<br/> Resume device: /dev/vda1<br/> Kernel Modules: hwmon thermal_sys thermal processor fan virtio_ring virtio virtio_blk scsi_mod libata ata_piix ata_generic virtio_pci scsi_dh scsi_dh_hp_sw scsi_dh_rdac scsi_dh_alua scsi_dh_emc mbcache jbd ext3 usb-common usbcore ohci-hcd uhci-hcd ehci-hcd hid usbhid crc-t10dif sd_mod<br/> Features: acpi block usb resume.userspace resume.kernel<br/> 38137 blocks<br/> >>> Network: auto<br/> >>> Calling mkinitrd -B -k /boot/vmlinuz-3.0.93-0.5_lustre-default -i /boot/initrd-3.0.93-0.5_lustre-default-kdump -f 'kdump network' -s ''<br/> Regenerating kdump initrd ...</p> <p>Kernel image: /boot/vmlinuz-3.0.93-0.5_lustre-default<br/> Initrd image: /boot/initrd-3.0.93-0.5_lustre-default-kdump<br/> Root device: /dev/vda2 (mounted on / as ext3)<br/> Resume device: /dev/vda1<br/> Kernel Modules: hwmon thermal_sys thermal processor fan virtio_ring virtio virtio_blk scsi_mod libata ata_piix ata_generic virtio_pci scsi_dh scsi_dh_hp_sw scsi_dh_rdac scsi_dh_alua scsi_dh_emc mbcache jbd ext3 usb-common usbcore ohci-hcd uhci-hcd ehci-hcd hid usbhid af_packet virtio_net nls_utf8 crc-t10dif sd_mod<br/> Features: acpi block usb network resume.userspace resume.kernel kdump<br/> 51833 blocks<br/> Don't refresh the bootloader. You may have to do that manually!</p> <p>Retrieving package lustre-modules-2.5.0-3.0.93_0.5_lustre_default.x86_64 (3/5), 3.3 MiB (20.3 MiB unpacked)<br/> Installing: lustre-modules-2.5.0-3.0.93_0.5_lustre_default <span class="error">[done]</span><br/> Retrieving package lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default.x86_64 (4/5), 366.0 KiB (1.6 MiB unpacked)<br/> Installing: lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default <span class="error">[done]</span><br/> Retrieving package lustre-2.5.0-3.0.93_0.5_lustre_default.x86_64 (5/5), 7.4 MiB (40.0 MiB unpacked)<br/> Installing: lustre-2.5.0-3.0.93_0.5_lustre_default <span class="error">[done]</span><br/> sles11sp2:~/lustre/lustre #</p> <p>sles11sp2:~/lustre/lustre # rpm -qa|egrep 'kernel-default|lustre|e2fs'|sort<br/> e2fsprogs-1.42.7.wc2-0suse<br/> kernel-default-3.0.93-0.5_lustre<br/> kernel-default-base-3.0.93-0.5_lustre<br/> kernel-default-devel-3.0.13-0.27.1<br/> lustre-2.5.0-3.0.93_0.5_lustre_default<br/> lustre-modules-2.5.0-3.0.93_0.5_lustre_default<br/> lustre-osd-ldiskfs-2.5.0-3.0.93_0.5_lustre_default<br/> sles11sp2:~/lustre/lustre #</p> <p>sles11sp2:/boot/grub # cat menu.lst</p> <ol> <li>Modified by YaST2. Last modification on Fri Nov 22 12:43:41 MST 2013<br/> default 0<br/> timeout 8<br/> ##YaST - generic_mbr<br/> ##YaST - activate</li> </ol> <p>###Don't change this comment - YaST2 identifier: Original name: linux###<br/> title SLES for SAP Applications - 3.0.93-0.5_lustre<br/> root (hd0,1)<br/> kernel /boot/vmlinuz-3.0.93-0.5_lustre-default root=/dev/vda2 resume=/dev/vda1 splash=silent crashkernel=256M-:128M text console=ttyS0,115200 sshd=1<br/> showopts<br/> initrd /boot/initrd-3.0.93-0.5_lustre-default</p> <p>###Don't change this comment - YaST2 identifier: Original name: failsafe###<br/> title Failsafe – SLES for SAP Applications - 3.0.93-0.5_lustre<br/> root (hd0,1)<br/> kernel /boot/vmlinuz-3.0.93-0.5_lustre-default root=/dev/vda2 showopts ide=nodma apm=off noresume edd=off powersaved=off nohz=off highres=off proces<br/> sor.max_cstate=1 nomodeset x11failsafe<br/> initrd /boot/initrd-3.0.93-0.5_lustre-default<br/> sles11sp2:/boot/grub #</p> <p>sles11sp2:~ # uname -a<br/> Linux sles11sp2 3.0.13-0.27-default #1 SMP Wed Feb 15 13:33:49 UTC 2012 (d73692b) x86_64 x86_64 x86_64 GNU/Linux<br/> sles11sp2:~ # reboot</p> <p>...<br/> ...<br/> ...</p> <p>Start Unicode mode done</p> <p>fsck failed. Please repair manually and reboot. The root<br/> file system is currently mounted read-only. To remount it<br/> read-write do:</p> <p> bash# mount -n -o remount,rw /</p> <p>Attention: Only CONTROL-D will reboot the system in this<br/> maintanance mode. shutdown or reboot will not work.</p> <p>Give root password for maintenance<br/> (or type Control-D to continue):<br/> (repair filesystem) # mount -n -o remount,rw /<br/> [ 135.376104] EXT3-fs (vda2): using internal journal<br/> (repair filesystem) # fsck -yv /<br/> fsck from util-linux 2.19.1<br/> fsck.ext3: symbol lookup error: fsck.ext3: undefined symbol: set_com_err_gettext<br/> (repair filesystem) #</p> <p>Resolved.</p> Development Rank 1|hzw9u7: Rank (Obsolete) 11759 Severity