Details

    • New Feature
    • Resolution: Fixed
    • Minor
    • Lustre 2.5.0
    • None
    • None
    • 7510

    Description

      We are very close to having all necessary lustre changes to allow server builds of lustre on sles11sp2 to work landed in master. This ticket is being filed in advance to allow us to track progress and process toward enabling sles11sp2 server builds in our build and test framework.

      Attachments

        Issue Links

          Activity

            [LU-3337] enable server builds for sles11sp2

            There's something fundamentally missing in the lbuild scripts for SLES11. The expectation is that the function prepare_and_build_srpm() builds a kernel binary rpm that provides "kernel = something". This isn't true in the current scripts. Only kernel-source* rpms get built. No rpms like kernel-default, kernel-default-base, kernel-default-devel get created.

            I think I need help from somebody who better understands lbuild and SLES packaging than I do.

            bogl Bob Glossman (Inactive) added a comment - There's something fundamentally missing in the lbuild scripts for SLES11. The expectation is that the function prepare_and_build_srpm() builds a kernel binary rpm that provides "kernel = something". This isn't true in the current scripts. Only kernel-source* rpms get built. No rpms like kernel-default, kernel-default-base, kernel-default-devel get created. I think I need help from somebody who better understands lbuild and SLES packaging than I do.

            A few more changes to lbuild files and build #57 almost works. Looks like it's missing necessary changes from LU-3292, required with 3.0.74 kernel. patch is in http://review.whamcloud.com/#change,6293

            bogl Bob Glossman (Inactive) added a comment - A few more changes to lbuild files and build #57 almost works. Looks like it's missing necessary changes from LU-3292 , required with 3.0.74 kernel. patch is in http://review.whamcloud.com/#change,6293

            Bob: Try it now.

            chris Chris Gearing (Inactive) added a comment - Bob: Try it now.
            bogl Bob Glossman (Inactive) added a comment - Console output was from http://build.whamcloud.com/job/lustre-reviews-sles11sp-server/51/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/console

            Bob: Which build has that in it. I can't find a failure with that text in it. A reference to the original would be good.

            chris Chris Gearing (Inactive) added a comment - Bob: Which build has that in it. I can't find a failure with that text in it. A reference to the original would be good.

            I'll have a look but I think for some reason location is not correct - I kind of need an old build that works, location should be local.

            chris Chris Gearing (Inactive) added a comment - I'll have a look but I think for some reason location is not correct - I kind of need an old build that works, location should be local.
            bogl Bob Glossman (Inactive) added a comment - - edited

            Chris - I think this may be back in your ballpark.

            I have tweaked the target.in file again and the build seems to be getting a bit farther, but still fails. Now it looks like it can't find the kernel source rpm, and is trying and failing to download it from http://downloads.lustre.org. No 3.0 kernels found there at all. extract from console output of build:

            ++ '[' -n /var/lib/jenkins/lbuild-data/reusebuild ']'
            +++ echo -en
            +++ echo 6.0.0
            +++ cat /var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD/lustre/lustre/kernel_patches/kernel_configs/kernel-3.0-3.0-sles11-x86_64.config /var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD/lustre/lustre/kernel_patches/targets/3.0-sles11.target /var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD/lustre-kernel-3.0-sles11-74-0.6.6_lustre.ge52a257.patch
            +++ cut '-d ' -f1
            +++ md5sum
            +++ cat ../build/lbuild ../build/lbuild-sles11
            cat: ../build/lbuild-sles11: No such file or directory
            ++++ set +x
            ++ local REUSE_SIGNATURE=1b897384b4f974e0ed6081602ef3500d
            ++ local CAN_LINK_FOR_REUSE=false
            ++ touch /var/lib/jenkins/lbuild-data/reusebuild/13747
            ++ cp -al /var/lib/jenkins/lbuild-data/reusebuild/13747 /var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD/
            ++ CAN_LINK_FOR_REUSE=true
            ++ rm /var/lib/jenkins/lbuild-data/reusebuild/13747
            ++ local kernel_extra_version=
            ++ true
            ++ reuse kernel /var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD true 1b897384b4f974e0ed6081602ef3500d
            ++ local module=kernel
            ++ local dest=/var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD
            ++ local use_links=true
            ++ local signature=1b897384b4f974e0ed6081602ef3500d
            ++ '[' -n /var/lib/jenkins/lbuild-data/reusebuild ']'
            ++ '[' -d /var/lib/jenkins/lbuild-data/reusebuild/1b897384b4f974e0ed6081602ef3500d/kernel ']'
            ++ return 1
            ++ '[' '!' -r /var/lib/jenkins/lbuild-data/kerneltree/3.0/kernel-source-3.0.74-0.6.6.2.src.rpm ']'
            ++ echo 'Downloading kernel SRPM'
            Downloading kernel SRPM
            ++ download_srpm sles11 kernel-source-3.0.74-0.6.6.2.src.rpm
            ++ local target=sles11
            ++ local srpm=kernel-source-3.0.74-0.6.6.2.src.rpm
            ++ local force=false
            ++ false
            ++ '[' '!' -r /var/lib/jenkins/lbuild-data/kerneltree/3.0/kernel-source-3.0.74-0.6.6.2.src.rpm ']'
            ++ true
            ++ local location=http://downloads.lustre.org/public/kernels/sles11/old
            ++ type -p kernel_srpm_location
            ++ echo 'Downloading http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm...'
            Downloading http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm...
            ++ fetch_url http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm /var/lib/jenkins/lbuild-data/kerneltree/3.0/kernel-source-3.0.74-0.6.6.2.src.rpm
            ++ local url=http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm
            ++ local target=/var/lib/jenkins/lbuild-data/kerneltree/3.0/kernel-source-3.0.74-0.6.6.2.src.rpm
            ++ local rc=0
            ++ which wget
            ++ wget -nv http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm -O /var/lib/jenkins/lbuild-data/kerneltree/3.0/kernel-source-3.0.74-0.6.6.2.src.rpm
            http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm:
            2013-05-15 10:34:14 ERROR 404: Not Found.
            
            bogl Bob Glossman (Inactive) added a comment - - edited Chris - I think this may be back in your ballpark. I have tweaked the target.in file again and the build seems to be getting a bit farther, but still fails. Now it looks like it can't find the kernel source rpm, and is trying and failing to download it from http://downloads.lustre.org . No 3.0 kernels found there at all. extract from console output of build: ++ '[' -n /var/lib/jenkins/lbuild-data/reusebuild ']' +++ echo -en +++ echo 6.0.0 +++ cat /var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD/lustre/lustre/kernel_patches/kernel_configs/kernel-3.0-3.0-sles11-x86_64.config /var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD/lustre/lustre/kernel_patches/targets/3.0-sles11.target /var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD/lustre-kernel-3.0-sles11-74-0.6.6_lustre.ge52a257.patch +++ cut '-d ' -f1 +++ md5sum +++ cat ../build/lbuild ../build/lbuild-sles11 cat: ../build/lbuild-sles11: No such file or directory ++++ set +x ++ local REUSE_SIGNATURE=1b897384b4f974e0ed6081602ef3500d ++ local CAN_LINK_FOR_REUSE=false ++ touch /var/lib/jenkins/lbuild-data/reusebuild/13747 ++ cp -al /var/lib/jenkins/lbuild-data/reusebuild/13747 /var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD/ ++ CAN_LINK_FOR_REUSE=true ++ rm /var/lib/jenkins/lbuild-data/reusebuild/13747 ++ local kernel_extra_version= ++ true ++ reuse kernel /var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD true 1b897384b4f974e0ed6081602ef3500d ++ local module=kernel ++ local dest=/var/lib/jenkins/workspace/lustre-reviews-sles11sp-server/arch/x86_64/build_type/server/distro/sles11sp2/ib_stack/inkernel/BUILD ++ local use_links=true ++ local signature=1b897384b4f974e0ed6081602ef3500d ++ '[' -n /var/lib/jenkins/lbuild-data/reusebuild ']' ++ '[' -d /var/lib/jenkins/lbuild-data/reusebuild/1b897384b4f974e0ed6081602ef3500d/kernel ']' ++ return 1 ++ '[' '!' -r /var/lib/jenkins/lbuild-data/kerneltree/3.0/kernel-source-3.0.74-0.6.6.2.src.rpm ']' ++ echo 'Downloading kernel SRPM' Downloading kernel SRPM ++ download_srpm sles11 kernel-source-3.0.74-0.6.6.2.src.rpm ++ local target=sles11 ++ local srpm=kernel-source-3.0.74-0.6.6.2.src.rpm ++ local force=false ++ false ++ '[' '!' -r /var/lib/jenkins/lbuild-data/kerneltree/3.0/kernel-source-3.0.74-0.6.6.2.src.rpm ']' ++ true ++ local location=http://downloads.lustre.org/public/kernels/sles11/old ++ type -p kernel_srpm_location ++ echo 'Downloading http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm...' Downloading http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm... ++ fetch_url http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm /var/lib/jenkins/lbuild-data/kerneltree/3.0/kernel-source-3.0.74-0.6.6.2.src.rpm ++ local url=http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm ++ local target=/var/lib/jenkins/lbuild-data/kerneltree/3.0/kernel-source-3.0.74-0.6.6.2.src.rpm ++ local rc=0 ++ which wget ++ wget -nv http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm -O /var/lib/jenkins/lbuild-data/kerneltree/3.0/kernel-source-3.0.74-0.6.6.2.src.rpm http://downloads.lustre.org/public/kernels/sles11/old/kernel-source-3.0.74-0.6.6.2.src.rpm: 2013-05-15 10:34:14 ERROR 404: Not Found.
            chris Chris Gearing (Inactive) added a comment - So we have the 3.0.74.0.6.6 kernel but still the build fails; http://build.whamcloud.com/job/lustre-master-sles11sp-server/arch=x86_64,build_type=server,distro=sles11sp2,ib_stack=inkernel/38/console
            bogl Bob Glossman (Inactive) added a comment - - edited

            here's the full list of repos reported by 'zypper lr'. not sure which one they are coming from.

            #  | Alias                                                             | Name                                                  | Enabled | Refresh
            ---+-------------------------------------------------------------------+-------------------------------------------------------+---------+--------
             1 | SUSE-Linux-Enterprise-Server-11-SP2 11.2.2-1.234                  | SUSE-Linux-Enterprise-Server-11-SP2 11.2.2-1.234      | No      | No     
             2 | SUSE-Linux-Enterprise-Software-Development-Kit-11-SP2_11.2.2-1.66 | SUSE Linux Enterprise Software Development Kit 11 SP2 | No      | No     
             3 | nu_novell_com:SLE11-SDK-SP1-Pool                                  | SLE11-SDK-SP1-Pool                                    | Yes     | Yes    
             4 | nu_novell_com:SLE11-SDK-SP1-Updates                               | SLE11-SDK-SP1-Updates                                 | Yes     | Yes    
             5 | nu_novell_com:SLE11-SDK-SP2-Core                                  | SLE11-SDK-SP2-Core                                    | Yes     | Yes    
             6 | nu_novell_com:SLE11-SDK-SP2-Updates                               | SLE11-SDK-SP2-Updates                                 | Yes     | Yes    
             7 | nu_novell_com:SLE11-SP1-Debuginfo-Pool                            | SLE11-SP1-Debuginfo-Pool                              | No      | Yes    
             8 | nu_novell_com:SLE11-SP1-Debuginfo-Updates                         | SLE11-SP1-Debuginfo-Updates                           | No      | Yes    
             9 | nu_novell_com:SLE11-SP2-Debuginfo-Core                            | SLE11-SP2-Debuginfo-Core                              | No      | Yes    
            10 | nu_novell_com:SLE11-SP2-Debuginfo-Updates                         | SLE11-SP2-Debuginfo-Updates                           | No      | Yes    
            11 | nu_novell_com:SLE11-WebYaST-SP2-Pool                              | SLE11-WebYaST-SP2-Pool                                | No      | Yes    
            12 | nu_novell_com:SLE11-WebYaST-SP2-Updates                           | SLE11-WebYaST-SP2-Updates                             | No      | Yes    
            13 | nu_novell_com:SLES11-Extras                                       | SLES11-Extras                                         | No      | Yes    
            14 | nu_novell_com:SLES11-SP1-Pool                                     | SLES11-SP1-Pool                                       | Yes     | Yes    
            15 | nu_novell_com:SLES11-SP1-Updates                                  | SLES11-SP1-Updates                                    | Yes     | Yes    
            16 | nu_novell_com:SLES11-SP2-Core                                     | SLES11-SP2-Core                                       | Yes     | Yes    
            17 | nu_novell_com:SLES11-SP2-Extension-Store                          | SLES11-SP2-Extension-Store                            | Yes     | Yes    
            18 | nu_novell_com:SLES11-SP2-Updates                                  | SLES11-SP2-Updates                                    | Yes     | Yes    
            
            bogl Bob Glossman (Inactive) added a comment - - edited here's the full list of repos reported by 'zypper lr'. not sure which one they are coming from. # | Alias | Name | Enabled | Refresh ---+-------------------------------------------------------------------+-------------------------------------------------------+---------+-------- 1 | SUSE-Linux-Enterprise-Server-11-SP2 11.2.2-1.234 | SUSE-Linux-Enterprise-Server-11-SP2 11.2.2-1.234 | No | No 2 | SUSE-Linux-Enterprise-Software-Development-Kit-11-SP2_11.2.2-1.66 | SUSE Linux Enterprise Software Development Kit 11 SP2 | No | No 3 | nu_novell_com:SLE11-SDK-SP1-Pool | SLE11-SDK-SP1-Pool | Yes | Yes 4 | nu_novell_com:SLE11-SDK-SP1-Updates | SLE11-SDK-SP1-Updates | Yes | Yes 5 | nu_novell_com:SLE11-SDK-SP2-Core | SLE11-SDK-SP2-Core | Yes | Yes 6 | nu_novell_com:SLE11-SDK-SP2-Updates | SLE11-SDK-SP2-Updates | Yes | Yes 7 | nu_novell_com:SLE11-SP1-Debuginfo-Pool | SLE11-SP1-Debuginfo-Pool | No | Yes 8 | nu_novell_com:SLE11-SP1-Debuginfo-Updates | SLE11-SP1-Debuginfo-Updates | No | Yes 9 | nu_novell_com:SLE11-SP2-Debuginfo-Core | SLE11-SP2-Debuginfo-Core | No | Yes 10 | nu_novell_com:SLE11-SP2-Debuginfo-Updates | SLE11-SP2-Debuginfo-Updates | No | Yes 11 | nu_novell_com:SLE11-WebYaST-SP2-Pool | SLE11-WebYaST-SP2-Pool | No | Yes 12 | nu_novell_com:SLE11-WebYaST-SP2-Updates | SLE11-WebYaST-SP2-Updates | No | Yes 13 | nu_novell_com:SLES11-Extras | SLES11-Extras | No | Yes 14 | nu_novell_com:SLES11-SP1-Pool | SLES11-SP1-Pool | Yes | Yes 15 | nu_novell_com:SLES11-SP1-Updates | SLES11-SP1-Updates | Yes | Yes 16 | nu_novell_com:SLES11-SP2-Core | SLES11-SP2-Core | Yes | Yes 17 | nu_novell_com:SLES11-SP2-Extension-Store | SLES11-SP2-Extension-Store | Yes | Yes 18 | nu_novell_com:SLES11-SP2-Updates | SLES11-SP2-Updates | Yes | Yes

            Bob, we pull from SLES updates but they did not seem to appear when I did that. If you are fetching from there then I will have a look, can you confirm which repo zypper is finding them in?

            chris Chris Gearing (Inactive) added a comment - Bob, we pull from SLES updates but they did not seem to appear when I did that. If you are fetching from there then I will have a look, can you confirm which repo zypper is finding them in?

            With a little effort I can probably get hold of the raw, uninstalled kernel rpms. zypper has a -d option that downloads but doesn't install rpms. Might be better if you can figure out some systematic way to update our local repos from the SuSE ones.

            bogl Bob Glossman (Inactive) added a comment - With a little effort I can probably get hold of the raw, uninstalled kernel rpms. zypper has a -d option that downloads but doesn't install rpms. Might be better if you can figure out some systematic way to update our local repos from the SuSE ones.

            People

              bogl Bob Glossman (Inactive)
              bogl Bob Glossman (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: