[LU-9612] Unable to create rpm-dkms for zfs

• Type: Bug
• Resolution: Done
• Priority: Major
• Affects Version/s: Lustre 2.10.0

Environment

OS SLES12 SP2
kernel-default-4.4.21-69.1.x86_64
nfs-kernel-server-1.3.0-26.3.x86_64
kernel-macros-4.4.21-69.1.noarch
kernel-default-devel-4.4.21-69.1.x86_64
kernel-devel-4.4.21-69.1.noarch
kernel-firmware-20160516git-17.6.noarch
kernel-source-4.4.21-69.1.noarch

Epic/Theme

zfs

• Severity: 2
• Assignee: Malcolm Cowe (Inactive)
• Reporter: Abe (Inactive)

Description

Going through the instructions on http://wiki.lustre.org/Compiling_Lustre zfs build section:

Prepare the build
Run the configure script:
cd $HOME/zfs

1. For RHEL and CentOS only, set the --spec=redhat flag.
   ./configure [--with-spec=redhat] \
   [--with-spl=<path to spl-devel> \
   [--with-linux=<path to kernel-devel>] \
   [--with-linux-obj=<path to kernel obj>]

I issued the following configure command script for suse linux os after build the spl package:

./configure --with-spec=suse --with-spl=/usr/src/spl-0.7.0 --with-linux=/usr/src/linux-4.4.21-69/kernel

It does not create zfs spec under suse folder as it only create these under redhat and generic folders:
config.status: creating rpm/Makefile
config.status: creating rpm/redhat/Makefile
config.status: creating rpm/redhat/zfs.spec
config.status: creating rpm/redhat/zfs-kmod.spec
config.status: creating rpm/redhat/zfs-dkms.spec
config.status: creating rpm/generic/Makefile
config.status: creating rpm/generic/zfs.spec
config.status: creating rpm/generic/zfs-kmod.spec
config.status: creating rpm/generic/zfs-dkms.spec
config.status: creating zfs-script-config.sh
config.status: creating zfs.release
config.status: creating zfs_config.h
config.status: executing depfiles commands
config.status: executing libtool commands

This causes the make rpm-dkms to fail as there are no spec files configured under rpm/suse folder:

make rpm-dkms errors snapshot:cp: cannot stat 'rpm/suse/zfs-dkms.spec': No such file or directory
Makefile:1149: recipe for target 'rpm-local' failed
make[2]: *** [rpm-local] Error 1
make[2]: Leaving directory '/root/zfs'
Makefile:1167: recipe for target 'srpm-common' failed
make[1]: *** [srpm-common] Error 1
make[1]: Leaving directory '/root/zfs'
Makefile:1123: recipe for target 'srpm-dkms' failed
make: *** [srpm-dkms] Error 2

This works for spl packages and not zfs

Issue Links

• is related to: LU-9675 SLES 12 SP2 server build fails when ZFS and LDISKFS OSDs are both enabled

Comments

[Abe (Inactive)]

The lib,zfs,zfs-dracut rpm are missing, the configure script should have generated these right ?

SBB-02:~/releases/zfs-spl # sudo rpm ivh kmod-spl* spl-.x86_64.rpm kmod-zfs-[0-9].default.x86_64.rpm kmod-zfs-devel-[0-9]..x86_64.rpm lib*.x86_64.rpm zfs-[0-9]..x86_64.rpm zfs-dracut-[0-9]..x86_64.rpm
error: File not found by glob: lib*.x86_64.rpm
error: File not found by glob: zfs-[0-9].*.x86_64.rpm
error: File not found by glob: zfs-dracut-[0-9].*.x86_64.rpm

[Malcolm Cowe (Inactive)]

run the following command:

rpm -qi libzfs2-devel

If the package is not installed then run, from the directory containing the ZFS RPMs you created:

sudo rpm -ivh libzfs2-devel-*.rpm

If that fails, then likely, you need to install all the library packages in the release directory. The simplest way to do that is:

sudo rpm -ivh lib*.rpm

From the output of your commands, the user-space tools might not be installed, either.  

The lustre.org documentation uses the following command to install all the pre-requisite ZFS packages:

cd $HOME/releases/zfs-spl
sudo rpm -ivh kmod-spl-* spl-*.x86_64.rpm \
kmod-zfs-[0-9].*-default-*.x86_64.rpm \
kmod-zfs-devel-[0-9].*.x86_64.rpm \
lib*.x86_64.rpm \
zfs-[0-9].*.x86_64.rpm \
zfs-dracut-[0-9].*.x86_64.rpm

 

[Abe (Inactive)]

Hi Malcom,

your are right, the zfs rpm install is failing, but the spl packages are all installed:

for spl commands used:

sudo zypper install kmod-spl-4.4.21-69-default-0.7.0-rc4.x86_64.rpm kmod-spl-devel-0.7.0-rc4.x86_64.rpm spl-0.7.0-rc4.x86_64.rpm

sudo zypper install kmod-spl-devel-4.4.21-69-default-0.7.0-rc4.x86_64.rpm

SBB-02:~/releases/zfs-spl # rpm -qa | grep spl
kmod-spl-4.4.21-69-default-0.7.0-rc4.x86_64
kmod-spl-devel-0.7.0-rc4.x86_64
libply-splash-core4-0.9.2-29.5.x86_64
libply-splash-graphics4-0.9.2-29.5.x86_64
spl-0.7.0-rc4.x86_64
kmod-spl-devel-4.4.21-69-default-0.7.0-rc4.x86_64

for zfs:

SBB-02:~/releases/zfs-spl # sudo zypper install kmod-zfs-4.4.21-69-default-0.7.0-rc4.x86_64 kmod-zfs-devel-0.7.0-rc4.x86_64 zfs-0.7.0-rc4.src.rpm
Loading repository data...
Reading installed packages...
'kmod-zfs-4.4.21-69-default.x86_64 = 0.7.0-rc4' is already installed.
No update candidate for 'kmod-zfs-4.4.21-69-default-0.7.0-rc4.x86_64'. The highest available version is already installed.
'kmod-zfs-devel.x86_64 = 0.7.0-rc4' is already installed.
No update candidate for 'kmod-zfs-devel-0.7.0-rc4.x86_64'. The highest available version is already installed.
'tmpRPMcache:zfs=0:0.7.0-rc4' not found in package names. Trying capabilities.
No provider of 'tmpRPMcache:zfs=0:0.7.0-rc4' found.
Resolving package dependencies...

Nothing to do.

SBB-02:~/releases/zfs-spl # rpm -qa | grep zfs
kmod-zfs-4.4.21-69-default-0.7.0-rc4.x86_64
kmod-zfs-devel-0.7.0-rc4.x86_64
kmod-zfs-devel-4.4.21-69-default-0.7.0-rc4.x86_64

SBB-02:~/releases/zfs-spl # sudo zypper install zfs-0.7.0-rc4.src.rpm
Loading repository data...
Reading installed packages...
'tmpRPMcache:zfs=0:0.7.0-rc4' not found in package names. Trying capabilities.
No provider of 'tmpRPMcache:zfs=0:0.7.0-rc4' found.
Resolving package dependencies...

SBB-02:~/releases/zfs-spl # ls zfs*
zfs-0.7.0-rc4.src.rpm zfs-dkms-0.7.0-rc4.noarch.rpm zfs-dkms-0.7.0-rc4.src.rpm zfs-kmod-0.7.0-rc4.src.rpm
SBB-02:~/releases/zfs-spl # ls spl*rpm
spl-0.7.0-rc4.src.rpm spl-0.7.0-rc4.x86_64.rpm spl-dkms-0.7.0-rc4.noarch.rpm spl-dkms-0.7.0-rc4.src.rpm spl-kmod-0.7.0-rc4.src.rpm

thanks,
Abe

[Malcolm Cowe (Inactive)]

Abe,

Can you list the SPL and ZFS packages that were installed and the commands used to install them? It looks like the SPL development libraries might not have been installed. The configure script looks for the SPL and ZFS include files, which are in the libzfs2-devel RPM. For example:

vagrant@sl12sp2-b:~rpm -qf /usr/include/libspl
libzfs2-devel-0.7.0-rc4_56_g419c80e6d.x86_64
vagrant@sl12sp2-b:~> rpm -qf /usr/include/libzfs
libzfs2-devel-0.7.0-rc4_56_g419c80e6d.x86_64

The configure script will fail when it cannot find the include files.

[Abe (Inactive)]

that is fine, we are stuck with servers and client rpm build error: Required zfs osd cannot be built due to missing zfs development headers.

Any ideas:

SBB-02:~/lustre-release # ./configure --enable-server --disable-ldiskfs --with-linux=/usr/src/linux-4.4.21-69 --with-linux-obj=/usr/src/linux-4.4.21-69-obj/x86_64/default --with-zfs=/usr/src/zfs-0.7.0 --with-spl=/usr/src/spl-0.7.0

checking zfs source directory... /usr/src/zfs-0.7.0
checking zfs build directory... /usr/src/zfs-0.7.0/4.4.21-69-default
checking zfs source version... 0.7.0-rc4
checking zfs file name for module symbols... Module.symvers
checking user provided zfs devel headers...
checking zfs devel headers... Not Found
configure: error:

Required zfs osd cannot be built due to missing zfs development headers.

thanks,
Abe

[Peter Jones]

Abe

A 2.10.0 tag will be created when the release is finalized. In the meantime, you can just use the tip of master

Peter

[Abe (Inactive)]

Is there a label for 2.10 that i need to use to check it out:
for example:
git checkout 2.10.0

I don't see a 2.10.0 label

thanks,
Abe

[Peter Jones]

Abe

There is no need to wait for 2.10 - use the master branch

Peter

[Abe (Inactive)]

Is this a know problem with lustre 2.9 since it does not support zfs ?
should we wait till lustre 2.10 release is available 6/30/177
pls advice..
SBB-02:~/lustre-release # ./configure --enable-server --disable-ldiskfs --with-linux=/usr/src/linux-4.4.21-69 --with-linux-obj=/usr/src/linux-4.4.21-69-obj/x86_64/default --with-zfs=/usr/src/zfs-0.7.0 --with-spl=/usr/src/spl-0.7.0

checking zfs source directory... /usr/src/zfs-0.7.0
checking zfs build directory... /usr/src/zfs-0.7.0/4.4.21-69-default
checking zfs source version... 0.7.0-rc4
checking zfs file name for module symbols... Module.symvers
checking user provided zfs devel headers...
checking zfs devel headers... Not Found
configure: error:

Required zfs osd cannot be built due to missing zfs development headers.

thanks,
Abe

[Peter Jones]

Abe

Yes, the master branch will become 2.10

Peter

[Abe (Inactive)]

Also, is there a way to pull a lustre 2.10 revision pre-release code ?

thanks,
Abe