Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-5334

Lustre-2.5.2 build fail with intel-mic-ofed-compat-rdma-3.5-OFED.3.5.2.MIC.beta1.2.6.32_431.17.1.el6.x86_64.x86_64

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • Lustre 2.7.0, Lustre 2.5.3
    • None
    • None
    • 2
    • 3
    • 14886

    Description

      HI Team,

      We are using centos 6.5 + intel-mic-ofed-compat-rdma-3.5-OFED.3.5.2.MIC.beta1.2.6.32_431.17.1.el6.x86_64.x86_64

      but we are unable to load the lustre module.
      Details :--
      2.6.32-431.17.1.el6.x86_64
      lustre-client-2.6.50-2.6.32_431.17.1.el6.x86_64_gdbe7a32.x86_64.rpm
      lustre-client-mic-2.6.50-2.6.38.8+mpss3.2.3_gdbe7a32.x86_64.rpm
      intel-mic-ofed-compat-rdma-3.5-OFED.3.5.2.MIC.beta1.2.6.32_431.17.1.el6.x86_64.x86_64

      Error
      [root@phi2 lustre-release]# modprobe lustre
      WARNING: Error inserting fld (/lib/modules/2.6.32-431.17.1.el6.x86_64/extra/kernel/fs/lustre/fld.ko): Input/output error
      WARNING: Error inserting lmv (/lib/modules/2.6.32-431.17.1.el6.x86_64/extra/kernel/fs/lustre/lmv.ko): Input/output error
      WARNING: Error inserting fid (/lib/modules/2.6.32-431.17.1.el6.x86_64/extra/kernel/fs/lustre/fid.ko): Input/output error
      WARNING: Error inserting mdc (/lib/modules/2.6.32-431.17.1.el6.x86_64/extra/kernel/fs/lustre/mdc.ko): Input/output error
      WARNING: Error inserting lov (/lib/modules/2.6.32-431.17.1.el6.x86_64/extra/kernel/fs/lustre/lov.ko): Input/output error
      FATAL: Error inserting lustre (/lib/modules/2.6.32-431.17.1.el6.x86_64/extra/kernel/fs/lustre/lustre.ko): Input/output error

      Attachments

        1. 1.patch
          0.6 kB
        2. config.log
          69 kB

        Issue Links

          Activity

            [LU-5334] Lustre-2.5.2 build fail with intel-mic-ofed-compat-rdma-3.5-OFED.3.5.2.MIC.beta1.2.6.32_431.17.1.el6.x86_64.x86_64
            atulyadavtech Atul Yadav added a comment -

            Dear Sir,

            Now patch is working ,,,

            After building and testing the lustre we will update you... soon....

            Thank You
            Atul Yadav

            atulyadavtech Atul Yadav added a comment - Dear Sir, Now patch is working ,,, After building and testing the lustre we will update you... soon.... Thank You Atul Yadav
            atulyadavtech Atul Yadav added a comment -

            Dear Sir,

            Can you please provide the steps for patching also, because i am not able to patch the file..

            Thank YOu

            atulyadavtech Atul Yadav added a comment - Dear Sir, Can you please provide the steps for patching also, because i am not able to patch the file.. Thank YOu

            Ops... Sorry, there is no autogen.sh file in packages. You need an original sources. You can get them from public git repository.

            git clone git://git.whamcloud.com/fs/lustre-release.git
            git checkout 2.5.2
            
            dmiter Dmitry Eremin (Inactive) added a comment - Ops... Sorry, there is no autogen.sh file in packages. You need an original sources. You can get them from public git repository. git clone git://git.whamcloud.com/fs/lustre-release.git git checkout 2.5.2
            atulyadavtech Atul Yadav added a comment -

            Dear Sir,

            Can you please share the download link for lustre-2.5.2 source.
            Because in my directory auto gen file is not present.

            Thank You
            Atul Yadav

            atulyadavtech Atul Yadav added a comment - Dear Sir, Can you please share the download link for lustre-2.5.2 source. Because in my directory auto gen file is not present. Thank You Atul Yadav

            Thanks for attachment. From the log file I see that the patch is absent in this run. Probably you forgot to do the following command:

            $ sh ./autogen.sh
            

            This command generate new version of ./configure with patch. Or probably you patch wrong version of sources.

            Please try again the following sequence:

            # apply the patch to sources in current directory and then do:
            $ sh ./autogen.sh
            $ ./configure --disable-server --with-o2ib=/usr/src/intel-mic-ofed-compat-rdma
            
            dmiter Dmitry Eremin (Inactive) added a comment - Thanks for attachment. From the log file I see that the patch is absent in this run. Probably you forgot to do the following command: $ sh ./autogen.sh This command generate new version of ./configure with patch. Or probably you patch wrong version of sources. Please try again the following sequence: # apply the patch to sources in current directory and then do : $ sh ./autogen.sh $ ./configure --disable-server --with-o2ib=/usr/src/intel-mic-ofed-compat-rdma
            atulyadavtech Atul Yadav added a comment -

            Dear Sir,
            As per your request we are sharing the config log file.

            please go through it

            Thank You
            Atul Yadav

            atulyadavtech Atul Yadav added a comment - Dear Sir, As per your request we are sharing the config log file. please go through it Thank You Atul Yadav
            atulyadavtech Atul Yadav added a comment -

            Dear Sir,
            As per your request we are sharing the config log file.

            please go through it

            Thank You
            Atul Yadav

            atulyadavtech Atul Yadav added a comment - Dear Sir, As per your request we are sharing the config log file. please go through it Thank You Atul Yadav

            Hmm. Could you attach config.log after this error please?

            dmiter Dmitry Eremin (Inactive) added a comment - Hmm. Could you attach config.log after this error please?
            atulyadavtech Atul Yadav added a comment -

            Dear Sir,

            Getting same error ........
            [root@mic2 lustre-2.5.2]# ./configure --disable-server --with-o2ib=/usr/src/intel-mic-ofed-compat-rdma 2>&1 | tee make1.log
            checking build system type... x86_64-unknown-linux-gnu
            checking host system type... x86_64-unknown-linux-gnu
            checking target system type... x86_64-unknown-linux-gnu
            checking for a BSD-compatible install... /usr/bin/install -c
            checking whether build environment is sane... yes
            checking for a thread-safe mkdir -p... /bin/mkdir -p
            checking for gawk... gawk
            checking whether make sets $(MAKE)... yes
            checking how to create a ustar tar archive... gnutar
            checking whether to disable maintainer-specific portions of Makefiles... yes
            checking for gcc... gcc
            checking for C compiler default output file name... a.out
            checking whether the C compiler works... yes
            checking whether we are cross compiling... no
            checking for suffix of executables...
            checking for suffix of object files... o
            checking whether we are using the GNU C compiler... yes
            checking whether gcc accepts -g... yes
            checking for gcc option to accept ISO C89... none needed
            checking for style of include used by make... GNU
            checking dependency style of gcc... gcc3
            checking dependency style of gcc... gcc3
            checking for ar... ar
            checking how to run the C preprocessor... gcc -E
            checking for grep that handles long lines and -e... /bin/grep
            checking for egrep... /bin/grep -E
            checking for ANSI C header files... yes
            checking for sys/types.h... yes
            checking for sys/stat.h... yes
            checking for stdlib.h... yes
            checking for string.h... yes
            checking for memory.h... yes
            checking for strings.h... yes
            checking for inttypes.h... yes
            checking for stdint.h... yes
            checking for unistd.h... yes
            checking whether to configure just enough for make dist... no
            checking if this distro uses dpkg... no
            checking for buildid... (from META file)
            checking for ranlib... ranlib
            checking for ld... ld
            checking for objdump... objdump
            checking for strip... strip
            checking size of unsigned long long... 8
            ---> size SIZEOF
            ---> size SIZEOF 8
            checking for osd... no
            checking whether to build docs... no
            checking whether to build utilities... yes
            checking whether to install init scripts... yes
            checking whether to build Lustre tests... yes
            checking whether to build Lustre client support... yes
            checking whether to build kernel modules... yes (linux-gnu)
            /usr/src/kernels/2.6.32-431.el6.x86_64
            /usr/src/kernels/2.6.32-431.el6.x86_64
            checking for Linux sources... /lib/modules/2.6.32-431.el6.x86_64/source
            checking for /lib/modules/2.6.32-431.el6.x86_64/source... yes
            checking for Linux objects dir... /lib/modules/2.6.32-431.el6.x86_64/build
            checking for /boot/kernel.h... no
            checking for /var/adm/running-kernel.h... no
            checking for /lib/modules/2.6.32-431.el6.x86_64/build/.config... yes
            checking for /lib/modules/2.6.32-431.el6.x86_64/build/include/generated/autoconf.h... no
            checking for /lib/modules/2.6.32-431.el6.x86_64/build/include/linux/autoconf.h... yes
            checking for /lib/modules/2.6.32-431.el6.x86_64/build/include/linux/version.h... yes
            checking for /lib/modules/2.6.32-431.el6.x86_64/build/include/linux/kconfig.h... yes
            checking for cross compilation... no
            checking for external module build support... yes
            checking that modules can be built at all... yes
            checking kernel source version... 2.6.32-431.el6.x86_64
            checking for Lustre release... 2.6.32_431.el6.x86_64_
            checking for RedHat kernel version... 2.6.32-431
            checking for kernel module package directory... extra
            checking Linux kernel architecture... x86_64
            checking name of module symbol version file... Module.symvers
            checking if Linux was built with CONFIG_MODULES... yes
            checking if Linux was built with CONFIG_MODVERSIONS... yes
            checking if Linux was built with CONFIG_KALLSYMS... yes
            checking if kernel module loading is possible... yes
            checking for tunable panic_dumplog support... no
            checking kernel __u64 is long long type... yes
            checking for CTL_UNNUMBERED... yes
            checking if Linux was built with symbol dump_trace exported... yes
            checking whether we can really use dump_trace... yes
            checking whether print_trace_address has reliable argument... yes
            checking whether stacktrace_ops.warning is exist... yes
            checking dump_trace want address... no
            checking for /lib/modules/2.6.32-431.el6.x86_64/source/include/linux/key-type.h... yes
            checking sock_map_fd have second argument... yes
            checking if 'struct stacktrace_ops' has 'walk_stack' field... yes
            checking shrinker want self pointer in handler... yes
            checking if ctl_table has a ctl_name field... yes
            checking if __add_wait_queue_exclusive exists... no
            checking if kernel has sk_sleep... no
            checking shrink_control is present... no
            checking sock_alloc_file is exported... checking if Linux was built with symbol sock_alloc_file exported... no
            checking if dev_get_by_name has two args... yes
            checking for CPU affinity support... yes
            checking for tunable backoff TCP support... no (no kernel support)
            checking for QsNet sources... /lib/modules/2.6.32-431.el6.x86_64/source
            checking if quadrics kernel headers are present... no
            checking whether to use Compat RDMA... yes
            checking whether to use any OFED backport headers... no
            checking whether to enable OpenIB gen2 support... no
            configure: error: can't compile with OpenIB gen2 headers under /usr/src/intel-mic-ofed-compat-rdma
            [root@mic2 lustre-2.5.2]#

            Thank You
            Atul Yadav

            atulyadavtech Atul Yadav added a comment - Dear Sir, Getting same error ........ [root@mic2 lustre-2.5.2] # ./configure --disable-server --with-o2ib=/usr/src/intel-mic-ofed-compat-rdma 2>&1 | tee make1.log checking build system type... x86_64-unknown-linux-gnu checking host system type... x86_64-unknown-linux-gnu checking target system type... x86_64-unknown-linux-gnu checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for a thread-safe mkdir -p... /bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking how to create a ustar tar archive... gnutar checking whether to disable maintainer-specific portions of Makefiles... yes checking for gcc... gcc checking for C compiler default output file name... a.out checking whether the C compiler works... yes checking whether we are cross compiling... no checking for suffix of executables... checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking for gcc option to accept ISO C89... none needed checking for style of include used by make... GNU checking dependency style of gcc... gcc3 checking dependency style of gcc... gcc3 checking for ar... ar checking how to run the C preprocessor... gcc -E checking for grep that handles long lines and -e... /bin/grep checking for egrep... /bin/grep -E checking for ANSI C header files... yes checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking whether to configure just enough for make dist... no checking if this distro uses dpkg... no checking for buildid... (from META file) checking for ranlib... ranlib checking for ld... ld checking for objdump... objdump checking for strip... strip checking size of unsigned long long... 8 ---> size SIZEOF ---> size SIZEOF 8 checking for osd... no checking whether to build docs... no checking whether to build utilities... yes checking whether to install init scripts... yes checking whether to build Lustre tests... yes checking whether to build Lustre client support... yes checking whether to build kernel modules... yes (linux-gnu) /usr/src/kernels/2.6.32-431.el6.x86_64 /usr/src/kernels/2.6.32-431.el6.x86_64 checking for Linux sources... /lib/modules/2.6.32-431.el6.x86_64/source checking for /lib/modules/2.6.32-431.el6.x86_64/source... yes checking for Linux objects dir... /lib/modules/2.6.32-431.el6.x86_64/build checking for /boot/kernel.h... no checking for /var/adm/running-kernel.h... no checking for /lib/modules/2.6.32-431.el6.x86_64/build/.config... yes checking for /lib/modules/2.6.32-431.el6.x86_64/build/include/generated/autoconf.h... no checking for /lib/modules/2.6.32-431.el6.x86_64/build/include/linux/autoconf.h... yes checking for /lib/modules/2.6.32-431.el6.x86_64/build/include/linux/version.h... yes checking for /lib/modules/2.6.32-431.el6.x86_64/build/include/linux/kconfig.h... yes checking for cross compilation... no checking for external module build support... yes checking that modules can be built at all... yes checking kernel source version... 2.6.32-431.el6.x86_64 checking for Lustre release... 2.6.32_431.el6.x86_64_ checking for RedHat kernel version... 2.6.32-431 checking for kernel module package directory... extra checking Linux kernel architecture... x86_64 checking name of module symbol version file... Module.symvers checking if Linux was built with CONFIG_MODULES... yes checking if Linux was built with CONFIG_MODVERSIONS... yes checking if Linux was built with CONFIG_KALLSYMS... yes checking if kernel module loading is possible... yes checking for tunable panic_dumplog support... no checking kernel __u64 is long long type... yes checking for CTL_UNNUMBERED... yes checking if Linux was built with symbol dump_trace exported... yes checking whether we can really use dump_trace... yes checking whether print_trace_address has reliable argument... yes checking whether stacktrace_ops.warning is exist... yes checking dump_trace want address... no checking for /lib/modules/2.6.32-431.el6.x86_64/source/include/linux/key-type.h... yes checking sock_map_fd have second argument... yes checking if 'struct stacktrace_ops' has 'walk_stack' field... yes checking shrinker want self pointer in handler... yes checking if ctl_table has a ctl_name field... yes checking if __add_wait_queue_exclusive exists... no checking if kernel has sk_sleep... no checking shrink_control is present... no checking sock_alloc_file is exported... checking if Linux was built with symbol sock_alloc_file exported... no checking if dev_get_by_name has two args... yes checking for CPU affinity support... yes checking for tunable backoff TCP support... no (no kernel support) checking for QsNet sources... /lib/modules/2.6.32-431.el6.x86_64/source checking if quadrics kernel headers are present... no checking whether to use Compat RDMA... yes checking whether to use any OFED backport headers... no checking whether to enable OpenIB gen2 support... no configure: error: can't compile with OpenIB gen2 headers under /usr/src/intel-mic-ofed-compat-rdma [root@mic2 lustre-2.5.2] # Thank You Atul Yadav

            I suppose the command line should be:

            ./configure --disable-server --with-o2ib=/usr/src/intel-mic-ofed-compat-rdma
            
            dmiter Dmitry Eremin (Inactive) added a comment - I suppose the command line should be: ./configure --disable-server --with-o2ib=/usr/src/intel-mic-ofed-compat-rdma
            atulyadavtech Atul Yadav added a comment -

            Dear Team,
            After downloading the "lustre-client-2.6.50-2.6.32_431.20.3.el6.x86_64_gd934c32.src.rpm" we are able to build successfully.

            But when replace the lnet file in lustre-2.5.2.tar.gz, as per the patch shared by you, we are getting error.
            cp lustre-lnet_new-0b2a295ecdfc7e23022a64bd2868dd181a640c57.m4 /opt//lustre-2.5.2/lnet/autoconf/lustre-lnet.m4

            ./configure --disable-server --with-o2ib=/usr/src/intel-mic-ofed-compat-rdma-3.5
            ...
            ...
            checking for tunable backoff TCP support... no (no kernel support)
            checking for QsNet sources... /lib/modules/2.6.32-431.el6.x86_64/source
            checking if quadrics kernel headers are present... no
            checking whether to use Compat RDMA... yes
            checking whether to use any OFED backport headers... no
            checking whether to enable OpenIB gen2 support... no
            configure: error: can't compile with OpenIB gen2 headers under /usr/src/intel-mic-ofed-compat-rdma-3.5

            Can we use lustre 2.6.0 client with lustre 2.5.2 server in our setup...

            Thank You
            Atul Yadav

            atulyadavtech Atul Yadav added a comment - Dear Team, After downloading the "lustre-client-2.6.50-2.6.32_431.20.3.el6.x86_64_gd934c32.src.rpm" we are able to build successfully. But when replace the lnet file in lustre-2.5.2.tar.gz, as per the patch shared by you, we are getting error. cp lustre-lnet_new-0b2a295ecdfc7e23022a64bd2868dd181a640c57.m4 /opt//lustre-2.5.2/lnet/autoconf/lustre-lnet.m4 ./configure --disable-server --with-o2ib=/usr/src/intel-mic-ofed-compat-rdma-3.5 ... ... checking for tunable backoff TCP support... no (no kernel support) checking for QsNet sources... /lib/modules/2.6.32-431.el6.x86_64/source checking if quadrics kernel headers are present... no checking whether to use Compat RDMA... yes checking whether to use any OFED backport headers... no checking whether to enable OpenIB gen2 support... no configure: error: can't compile with OpenIB gen2 headers under /usr/src/intel-mic-ofed-compat-rdma-3.5 Can we use lustre 2.6.0 client with lustre 2.5.2 server in our setup... Thank You Atul Yadav

            People

              dmiter Dmitry Eremin (Inactive)
              atulyadavtech Atul Yadav
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: