https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-9612 Lustre <p>Going through the instructions on <a href="http://wiki.lustre.org/Compiling_Lustre" class="external-link" target="_blank" rel="nofollow noopener">http://wiki.lustre.org/Compiling_Lustre</a> zfs build section:</p> <p>Prepare the build<br/> Run the configure script: <br/> cd $HOME/zfs</p> <ol> <li>For RHEL and CentOS only, set the --spec=redhat flag.<br/> ./configure <span class="error">&#91;--with-spec=redhat&#93;</span> \<br/> [--with-spl=&lt;path to spl-devel&gt; \<br/> <span class="error">&#91;--with-linux=&lt;path to kernel-devel&gt;&#93;</span> \<br/> <span class="error">&#91;--with-linux-obj=&lt;path to kernel obj&gt;&#93;</span></li> </ol> <p>I issued the following configure command script for suse linux os after build the spl package:</p> <p>./configure --with-spec=suse --with-spl=/usr/src/spl-0.7.0 --with-linux=/usr/src/linux-4.4.21-69/kernel</p> <p>It does not create zfs spec under suse folder as it only create these under redhat and generic folders:<br/> config.status: creating rpm/Makefile<br/> config.status: creating rpm/redhat/Makefile<br/> config.status: creating rpm/redhat/zfs.spec<br/> config.status: creating rpm/redhat/zfs-kmod.spec<br/> config.status: creating rpm/redhat/zfs-dkms.spec<br/> config.status: creating rpm/generic/Makefile<br/> config.status: creating rpm/generic/zfs.spec<br/> config.status: creating rpm/generic/zfs-kmod.spec<br/> config.status: creating rpm/generic/zfs-dkms.spec<br/> config.status: creating zfs-script-config.sh<br/> config.status: creating zfs.release<br/> config.status: creating zfs_config.h<br/> config.status: executing depfiles commands<br/> config.status: executing libtool commands</p> <p>This causes the make rpm-dkms to fail as there are no spec files configured under rpm/suse folder:</p> <p>make rpm-dkms errors snapshot:cp: cannot stat 'rpm/suse/zfs-dkms.spec': No such file or directory<br/> Makefile:1149: recipe for target 'rpm-local' failed<br/> make<span class="error">&#91;2&#93;</span>: *** <span class="error">&#91;rpm-local&#93;</span> Error 1<br/> make<span class="error">&#91;2&#93;</span>: Leaving directory '/root/zfs'<br/> Makefile:1167: recipe for target 'srpm-common' failed<br/> make<span class="error">&#91;1&#93;</span>: *** <span class="error">&#91;srpm-common&#93;</span> Error 1<br/> make<span class="error">&#91;1&#93;</span>: Leaving directory '/root/zfs'<br/> Makefile:1123: recipe for target 'srpm-dkms' failed<br/> make: *** <span class="error">&#91;srpm-dkms&#93;</span> Error 2</p> <p>This works for spl packages and not zfs</p> OS SLES12 SP2<br/> kernel-default-4.4.21-69.1.x86_64<br/> nfs-kernel-server-1.3.0-26.3.x86_64<br/> kernel-macros-4.4.21-69.1.noarch<br/> kernel-default-devel-4.4.21-69.1.x86_64<br/> kernel-devel-4.4.21-69.1.noarch<br/> kernel-firmware-20160516git-17.6.noarch<br/> kernel-source-4.4.21-69.1.noarch<br/> LU-9612

Unable to create rpm-dkms for zfs

Bug Major Resolved Done Malcolm Cowe Abe Tue, 6 Jun 2017 22:23:53 +0000 Sat, 16 Oct 2021 16:22:35 +0000 Sat, 16 Oct 2021 16:22:35 +0000 Lustre 2.10.0 0 3 <p>zfs rpms created without the rpm-dkms:<br/> zfs-0.7.0-rc4.src.rpm zfs-dkms-0.7.0-rc4.noarch.rpm zfs-dkms-0.7.0-rc4.src.rpm</p> <p>Malc</p> <p>Could you please advise here?</p> <p>Peter</p> <p>To create the SPL and ZFS packages for SUSE, the <tt>./configure</tt> command for each project should be run without any additional arguments (or at least, do not use the --with-spec=rpm option). The build script will then use the RPM spec files in the spl/rpm/generic/ and zfs/rpm/generic directories. There's some additional information on the ZFS custom build process here:</p> <p><a href="https://github.com/zfsonlinux/zfs/wiki/Custom-Packages" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/zfsonlinux/zfs/wiki/Custom-Packages</a></p> <p> </p> <p>Also, please note that I haven't evaluated DKMS on SLES 12 yet – the documentation covers kmod-based builds only.</p> <p>Hello Malcolm,<br/> Thanks for looking into this, this got resolved as the dkms-rpm are created now bu running<br/> ./configure without the additional arguments..<br/> kmod-zfs-4.4.21-69-default-0.7.0-rc4.x86_64.rpm<br/> kmod-zfs-devel-0.7.0-rc4.x86_64.rpm<br/> kmod-zfs-devel-4.4.21-69-default-0.7.0-rc4.x86_64.rpm<br/> zfs-0.7.0-rc4.src.rpm<br/> zfs-dkms-0.7.0-rc4.noarch.rpm<br/> zfs-dkms-0.7.0-rc4.src.rpm<br/> zfs-kmod-0.7.0-rc4.src.rpm</p> <p>However, when we try to build the rpm for lustre the compile is failing due to missing zfs development headers:<br/> full log:</p> <p>./configure --enable-server --disable-ldiskfs --with-linux=/usr/src/linux-4.4.21-69 --with-linux-obj=/usr/src/linux-4.4.21-69-obj/x86_64/default --with-zfs=/usr/src/zfs-0.7.0 --with-spl=/usr/src/spl-0.7.0</p> <p>SBB-02:~/lustre-release # ./configure --enable-server --disable-ldiskfs --with-linux=/usr/src/linux-4.4.21-69 --with-linux-obj=/usr/src/linux-4.4.21-69-obj/x86_64/default --with-zfs=/usr/src/zfs-0.7.0 --with-spl=/usr/src/spl-0.7.0<br/> checking build system type... x86_64-suse-linux-gnu<br/> checking host system type... x86_64-suse-linux-gnu<br/> checking target system type... x86_64-suse-linux-gnu<br/> checking for a BSD-compatible install... /usr/bin/install -c<br/> checking whether build environment is sane... yes<br/> checking for a thread-safe mkdir -p... /usr/bin/mkdir -p<br/> checking for gawk... gawk<br/> checking whether make sets $(MAKE)... yes<br/> checking whether make supports nested variables... yes<br/> checking whether UID '0' is supported by ustar format... yes<br/> checking whether GID '0' is supported by ustar format... yes<br/> checking how to create a ustar tar archive... gnutar<br/> checking whether to enable maintainer-specific portions of Makefiles... yes<br/> checking for gcc... gcc<br/> checking whether the C compiler works... yes<br/> checking for C compiler default output file name... a.out<br/> checking for suffix of executables...<br/> checking whether we are cross compiling... no<br/> checking for suffix of object files... o<br/> checking whether we are using the GNU C compiler... yes<br/> checking whether gcc accepts -g... yes<br/> checking for gcc option to accept ISO C89... none needed<br/> checking for style of include used by make... GNU<br/> checking dependency style of gcc... gcc3<br/> checking how to print strings... printf<br/> checking for a sed that does not truncate output... /usr/bin/sed<br/> checking for grep that handles long lines and -e... /usr/bin/grep<br/> checking for egrep... /usr/bin/grep -E<br/> checking for fgrep... /usr/bin/grep -F<br/> checking for ld used by gcc... /usr/x86_64-suse-linux/bin/ld<br/> checking if the linker (/usr/x86_64-suse-linux/bin/ld) is GNU ld... yes<br/> checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B<br/> checking the name lister (/usr/bin/nm -B) interface... BSD nm<br/> checking whether ln -s works... yes<br/> checking the maximum length of command line arguments... 1572864<br/> checking whether the shell understands some XSI constructs... yes<br/> checking whether the shell understands "+="... yes<br/> checking how to convert x86_64-suse-linux-gnu file names to x86_64-suse-linux-gnu format... func_convert_file_noop<br/> checking how to convert x86_64-suse-linux-gnu file names to toolchain format... func_convert_file_noop<br/> checking for /usr/x86_64-suse-linux/bin/ld option to reload object files... -r<br/> checking for objdump... objdump<br/> checking how to recognize dependent libraries... pass_all<br/> checking for dlltool... no<br/> checking how to associate runtime and link libraries... printf %s\n<br/> checking for ar... ar<br/> checking for archiver @FILE support... @<br/> checking for strip... strip<br/> checking for ranlib... ranlib<br/> checking command to parse /usr/bin/nm -B output from gcc object... ok<br/> checking for sysroot... no<br/> checking for mt... mt<br/> checking if mt is a manifest tool... no<br/> checking how to run the C preprocessor... gcc -E<br/> checking for ANSI C header files... yes<br/> checking for sys/types.h... yes<br/> checking for sys/stat.h... yes<br/> checking for stdlib.h... yes<br/> checking for string.h... yes<br/> checking for memory.h... yes<br/> checking for strings.h... yes<br/> checking for inttypes.h... yes<br/> checking for stdint.h... yes<br/> checking for unistd.h... yes<br/> checking for dlfcn.h... yes<br/> checking for objdir... .libs<br/> checking if gcc supports -fno-rtti -fno-exceptions... no<br/> checking for gcc option to produce PIC... -fPIC -DPIC<br/> checking if gcc PIC flag -fPIC -DPIC works... yes<br/> checking if gcc static flag -static works... no<br/> checking if gcc supports -c -o file.o... yes<br/> checking if gcc supports -c -o file.o... (cached) yes<br/> checking whether the gcc linker (/usr/x86_64-suse-linux/bin/ld -m elf_x86_64) supports shared libraries... yes<br/> checking whether -lc should be explicitly linked in... no<br/> checking dynamic linker characteristics... GNU/Linux ld.so<br/> checking how to hardcode library paths into programs... immediate<br/> checking whether stripping libraries is possible... yes<br/> checking if libtool supports shared libraries... yes<br/> checking whether to build shared libraries... yes<br/> checking whether to build static libraries... yes<br/> checking dependency style of gcc... gcc3<br/> checking for rpmbuild... /usr/bin/rpmbuild<br/> configure: Lustre base checks<br/> ==============================================================================<br/> checking whether to configure just enough for make dist... no<br/> checking if this distro uses dpkg... no<br/> checking for ranlib... (cached) ranlib<br/> checking for ld... /usr/x86_64-suse-linux/bin/ld -m elf_x86_64<br/> checking for objdump... (cached) objdump<br/> checking for strip... (cached) strip<br/> checking size of unsigned long long... 8<br/> checking whether to use OSD addon... no<br/> checking whether to build Lustre docs... no<br/> checking whether to build Lustre manpages... yes<br/> checking whether to build Lustre utilities... yes<br/> checking whether to build Lustre tests... yes<br/> checking whether to build Lustre client support... yes<br/> checking whether mpitests can be built... no<br/> checking whether to build Linux kernel modules... yes (linux-gnu)<br/> checking for Linux sources... /usr/src/linux-4.4.21-69<br/> checking for /usr/src/linux-4.4.21-69... yes<br/> checking for Linux objects... /usr/src/linux-4.4.21-69-obj/x86_64/default<br/> checking for /usr/src/linux-4.4.21-69-obj/x86_64/default/.config... yes<br/> checking for /boot/kernel.h... no<br/> checking for /var/adm/running-kernel.h... no<br/> checking for /usr/src/linux-4.4.21-69-obj/x86_64/default/include/generated/autoconf.h... yes<br/> checking for /usr/src/linux-4.4.21-69-obj/x86_64/default/include/linux/version.h... no<br/> checking for /usr/src/linux-4.4.21-69-obj/x86_64/default/include/generated/uapi/linux/version.h... yes<br/> checking for /usr/src/linux-4.4.21-69/include/linux/kconfig.h... yes<br/> checking for external module build target... M<br/> checking that modules can be built at all... yes<br/> checking for Linux kernel utsrelease... 4.4.21-69-default<br/> checking for RedHat kernel release number...<br/> checking if Linux kernel was built with CONFIG_SUSE_KERNEL... yes<br/> checking for Linux kernel module package directory... updates/kernel<br/> checking for the name of module symbol version file... Module.symvers<br/> checking if Linux kernel was built with CONFIG_MODULES... yes<br/> checking if Linux kernel was built with CONFIG_MODVERSIONS... yes<br/> checking if Linux kernel was built with CONFIG_KALLSYMS... yes<br/> checking if Linux kernel module loading is possible... yes<br/> configure: LibCFS kernel checks<br/> ==============================================================================<br/> checking whether to use tunable 'panic_dumplog' support... no<br/> checking if 'struct stacktrace_ops' has 'walk_stack' field... yes<br/> checking if 'shrinker' want self pointer in handler... no<br/> checking if 'ctl_table' has a 'ctl_name' field... no<br/> checking if Linux kernel has 'kstrtoul'... yes<br/> checking if 'dump_trace' want address... yes<br/> checking if 'shrink_control' is present... yes<br/> checking if 'stacktrace_ops.warning' is exist... yes<br/> checking for linux/uidgid.h... yes<br/> checking if 'i_uid_read' is present... yes<br/> checking if Linux kernel exports 'sock_alloc_file'... yes<br/> checking if 'sock_alloc_file' takes 3 arguments... yes<br/> checking if Linux kernel was built with CONFIG_CRC32 in or as module... yes<br/> checking if Linux kernel was built with CONFIG_CRYPTO_CRC32_PCLMUL in or as module... yes<br/> checking if Linux kernel was built with CONFIG_CRYPTO_CRC32C_INTEL in or as module... yes<br/> checking shrinker has 'count_objects'... yes<br/> checking does function 'hlist_add_after' exist... no<br/> checking does 'struct timespec64' exist... yes<br/> checking does function 'ktime_get_real_ts64' exist... yes<br/> checking does function 'topology_sibling_cpumask' exist... yes<br/> checking for asm/fpu/api.h... yes<br/> checking does crypto hash helper functions exist... no<br/> checking if 'struct stacktrace_ops' address function returns an int... no<br/> checking if 'get_user_pages()' takes 6 arguments... no<br/> configure: LNet kernel checks<br/> ==============================================================================<br/> checking whether to enable CPU affinity support... yes<br/> checking if Linux kernel has cpu affinity support... yes<br/> checking whether to enable tunable backoff TCP support... yes<br/> checking if Linux kernel has tunable backoff TCP support... no<br/> checking whether to use Compat RDMA... no<br/> checking whether to use any OFED backport headers... no<br/> checking whether to enable OpenIB gen2 support... yes<br/> checking if Linux kernel has kthread_worker... yes<br/> checking if 'rdma_create_id' wants four args... no<br/> checking if 'rdma_create_id' wants five args... yes<br/> checking if 'struct ib_cq_init_attr' is used... yes<br/> checking if 'ib_alloc_fast_reg_mr' exists... no<br/> checking if 'struct ib_rdma_wr' is defined... yes<br/> checking if 4arg 'ib_map_mr_sg' exists... yes<br/> checking if 5arg 'ib_map_mr_sg' exists... no<br/> checking if 'struct ib_device' has member 'attrs'... yes<br/> checking if function 'ib_inc_rkey' is defined... yes<br/> checking whether to enable GNI lnd... no<br/> checking if Linux kernel has 'sk_sleep'... yes<br/> checking if 'tcp_sendpage' first parameter is socket... no<br/> checking if 'sk_data_ready' takes only one argument... yes<br/> checking ext4 source directory... /usr/src/linux-4.4.21-69/fs/ext4<br/> checking for /usr/src/linux-4.4.21-69/fs/ext4/dir.c... yes<br/> checking for /usr/src/linux-4.4.21-69/fs/ext4/file.c... yes<br/> checking for /usr/src/linux-4.4.21-69/fs/ext4/inode.c... yes<br/> checking for /usr/src/linux-4.4.21-69/fs/ext4/super.c... yes<br/> configure: Lustre kernel checks<br/> ==============================================================================<br/> checking whether to enable Lustre pinger support... yes<br/> checking whether to enable data checksum support... yes<br/> checking whether to enable a write with the health check... no<br/> checking whether to enable lru self-adjusting... yes<br/> checking whether to enable 'llite_lloop' module... yes<br/> checking for name_to_handle_at... yes<br/> checking whether to enable gss support... auto<br/> checking whether to enable gss keyring backend... auto<br/> checking if Linux kernel was built with CONFIG_KEYS in or as module... yes<br/> checking for keyctl_search in -lkeyutils... no<br/> configure: WARNING: GSS keyring backend requires libkeyutils<br/> checking if 'struct cred' has member 'tgcred'... no<br/> checking if 'key_type-&gt;instantiate' has two args... yes<br/> checking if Linux kernel was built with CONFIG_SUNRPC in or as module... yes<br/> checking if Linux kernel was built with CONFIG_CRYPTO_MD5 in or as module... yes<br/> checking if Linux kernel was built with CONFIG_CRYPTO_SHA1 in or as module... yes<br/> checking if Linux kernel was built with CONFIG_CRYPTO_SHA256 in or as module... yes<br/> checking if Linux kernel was built with CONFIG_CRYPTO_SHA512 in or as module... yes<br/> checking for Kerberos v5... not found!<br/> checking whether OpenSSL has functions needed for SSK... no<br/> checking if 'blk_queue_max_segments' is defined... yes<br/> checking if 'quotactl_ops.set_dqblk' takes struct fs_disk_quota... no<br/> checking if 'quotactl_ops.set_dqblk' takes struct kqid &amp; fs_disk_quota... no<br/> checking if 'dquot_suspend' is defined... yes<br/> checking if '__add_wait_queue_exclusive' exists... yes<br/> checking if 'file_operations.fsync' takes 4 arguments... yes<br/> checking if Linux kernel exports 'simple_setattr'... yes<br/> checking if Linux kernel exports 'truncate_complete_page'... no<br/> checking if Linux kernel exports 'remove_from_page_cache'... no<br/> checking if Linux kernel exports 'delete_from_page_cache'... yes<br/> checking if 'fs_struct.lock' use rwlock... no<br/> checking if 'super_operations.evict_inode' exist... yes<br/> checking if 'kernel_locked' is defined... no<br/> checking if Linux kernel exports 'blkdev_get_by_dev'... yes<br/> checking if 'generic_permission' take 2 arguments... yes<br/> checking if 'dcache_lock' is exist... no<br/> checking if 'inode.i_rcu' exists... yes<br/> checking if 'dentry_operations.d_compare()' taken 7 arguments... no<br/> checking if 'dentry_operations.d_delete()' has const declare on first parameter... yes<br/> checking if 'request_queue' has 'unplug_fn' field... no<br/> checking if Linux kernel was built with CONFIG_FHANDLE in or as module... yes<br/> checking if 'file_system_type' has 'mount' field... yes<br/> checking if 'inode_operations' has '.truncate' member function... no<br/> checking if 'inode_owner_or_capable' exist... yes<br/> checking if security_inode_init_security takes a callback... yes<br/> checking if 'dirty_inode' super_operation takes flag... yes<br/> checking if 'lock-manager' ops renamed to 'lm_xxx'... yes<br/> checking if 'inode-&gt;i_alloc_sem' is killed and use inode_dio_wait... yes<br/> checking if 'inode_operations' has '.get_acl' member function... yes<br/> checking if Linux kernel exports 'generic_file_llseek_size'... yes<br/> checking if 'inode_operations-&gt;permission' has two args... yes<br/> checking radix_tree_exceptional_entry exist... yes<br/> checking for /usr/src/linux-4.4.21-69/include/linux/loop.h... no<br/> checking if 'request_queue.make_request_fn' returns void but not int... yes<br/> checking if 'inode-&gt;i_nlink' is protected from direct modification... yes<br/> checking for /usr/src/linux-4.4.21-69/include/linux/migrate.h... yes<br/> checking if 'address_space_operations.migratepage' has 4 args... yes<br/> checking if 'super_operations' use 'dentry' as parameter... yes<br/> checking if 'inode_operations' use 'umode_t' as parameter... yes<br/> checking if have 'cache_register'... no<br/> checking if have 'd_make_root'... yes<br/> checking if 'kmap_atomic' has only 1 argument... yes<br/> checking if have 'clear_inode'... yes<br/> checking if 'encode_fh' have parent inode as parameter... yes<br/> checking if Linux kernel has 'generic_file_llseek_size' with 5 args... yes<br/> checking if 'i_dentry/d_alias' uses 'list'... no<br/> checking if 'dentry_open' uses 'struct path' as first argument... yes<br/> checking if 'iop' has 'atomic_open'... yes<br/> checking if kernel supports wrapped FS freeze functions... yes<br/> checking if 'posix_acl_to_xattr' takes 'struct user_namespace'... yes<br/> checking if 'struct file' has member 'f_inode'... yes<br/> checking if file_inode() exists... yes<br/> checking if 'sunrpc_cache_pipe_upcall' takes 3 args... no<br/> checking if 'hlist_for_each_entry' has 3 args... yes<br/> checking if 'bio_end_sector' is defined... yes<br/> checking if 'is_sxid' is defined... yes<br/> checking if 'block_device_operations' release returns 'int'... no<br/> checking if 'remove_proc_subtree' is defined... yes<br/> checking if 'proc_remove' is defined... yes<br/> checking if 'security_dentry_init_security' is defined... yes<br/> checking if 'address_space_operations.invalidatepage' requires 3 arguments... yes<br/> checking if 'dir_context' exist... yes<br/> checking if 'd_compare' taken 5 arguments... yes<br/> checking if 'd_count' exist... yes<br/> checking if hlist 'dentry.d_u.d_alias' exist... yes<br/> checking if 'dentry.d_child' exist... yes<br/> checking if 'truncate_pagecache' with 'old_size' parameter... no<br/> checking if 'struct kiocb' with 'ki_left' member... no<br/> checking if Linux kernel has 'vfs_rename' with 5 args... no<br/> checking if Linux kernel has 'vfs_unlink' with 3 args... yes<br/> checking if Linux kernel has struct bvec_iter... yes<br/> checking if Linux kernel has truncate_inode_pages_final... yes<br/> checking if Linux kernel has 'vfs_rename' with 6 args... yes<br/> checking if direct IO uses iov_iter... no<br/> checking if 'iov_iter_init' takes a tag... yes<br/> checking if 'iov_iter_truncate' exists ... yes<br/> checking if 'file_operations.read|write_iter' exist... yes<br/> checking if struct key_match field exist... yes<br/> checking if percpu_counter_init uses GFP_* flag as argument... yes<br/> checking if filldir_t uses struct dir_context... yes<br/> checking if struct kiocb has ki_nbytes field... no<br/> checking if 'quotactl_ops.set_dqblk' takes struct qc_dqblk... yes<br/> checking if struct address_space has backing_dev_info... no<br/> checking if have 'BDI_CAP_MAP_COPY'... no<br/> checking if cancel_dirty_page still exist... no<br/> checking if iov_iter_rw exist... yes<br/> checking if Linux kernel exports 'new_sync_read'... no<br/> checking if cancel_dirty_page with one argument exist... yes<br/> checking if 'bio_endio' with one argument exist... yes<br/> checking if symlink inode operations have struct nameidata argument... no<br/> checking if 'struct cache_head' has 'cache_list' field... yes<br/> checking if 'locks_lock_file_wait' exists... yes<br/> checking if 'request_queue.make_request_fn' returns blk_qc_t... yes<br/> checking if 'struct key' has 'payload.data' as an array... yes<br/> checking if Linux kernel has 'file_dentry'... yes<br/> checking if 'inode_lock' is defined... yes<br/> checking if 'iop' has 'get_link'... no<br/> checking if 'in_compat_syscall' is defined... no<br/> checking if Linux kernel exports 'dev_set_rdonly'... no<br/> configure: WARNING: kernel missing dev_set_rdonly patch for testing<br/> checking if stack size is at least 8k... yes<br/> checking if kernel has 64-bit quota limits support... yes<br/> checking if Linux kernel was built with CONFIG_QUOTA in or as module... yes<br/> checking whether to build ldiskfs... no<br/> checking whether to enable zfs... yes<br/> checking spl source directory... /usr/src/spl-0.7.0<br/> checking spl build directory... /usr/src/spl-0.7.0/4.4.21-69-default<br/> checking spl source version... 0.7.0-rc4<br/> checking spl file name for module symbols... Module.symvers<br/> checking zfs source directory... /usr/src/zfs-0.7.0<br/> checking zfs build directory... /usr/src/zfs-0.7.0/4.4.21-69-default<br/> checking zfs source version... 0.7.0-rc4<br/> checking zfs file name for module symbols... Module.symvers<br/> checking user provided zfs devel headers...<br/> checking zfs devel headers... Not Found<br/> configure: error:</p> <p>Required zfs osd cannot be built due to missing zfs development headers.</p> <p>Support for zfs can be enabled by downloading the required packages for your<br/> distribution. See <a href="http://zfsonlinux.org/" class="external-link" target="_blank" rel="nofollow noopener">http://zfsonlinux.org/</a> to determine is zfs is supported by<br/> your distribution.</p> <p>SBB-02:~/lustre-release #</p> <p>Thanks,<br/> Abe</p> <p>Also, is there a way to pull a lustre 2.10 revision pre-release code ?</p> <p>thanks,<br/> Abe</p> <p>Abe</p> <p>Yes, the master branch will become 2.10</p> <p>Peter</p> <p>Is this a know problem with lustre 2.9 since it does not support zfs ?<br/> should we wait till lustre 2.10 release is available 6/30/177<br/> pls advice..<br/> SBB-02:~/lustre-release # ./configure --enable-server --disable-ldiskfs --with-linux=/usr/src/linux-4.4.21-69 --with-linux-obj=/usr/src/linux-4.4.21-69-obj/x86_64/default --with-zfs=/usr/src/zfs-0.7.0 --with-spl=/usr/src/spl-0.7.0</p> <p>checking zfs source directory... /usr/src/zfs-0.7.0<br/> checking zfs build directory... /usr/src/zfs-0.7.0/4.4.21-69-default<br/> checking zfs source version... 0.7.0-rc4<br/> checking zfs file name for module symbols... Module.symvers<br/> checking user provided zfs devel headers...<br/> checking zfs devel headers... Not Found<br/> configure: error:</p> <p>Required zfs osd cannot be built due to missing zfs development headers.</p> <p>thanks,<br/> Abe</p> <p>Abe</p> <p>There is no need to wait for 2.10 - use the master branch</p> <p>Peter</p> <p>Is there a label for 2.10 that i need to use to check it out:<br/> for example:<br/> git checkout 2.10.0</p> <p>I don't see a 2.10.0 label</p> <p>thanks,<br/> Abe</p> <p>Abe</p> <p>A 2.10.0 tag will be created when the release is finalized. In the meantime, you can just use the tip of master</p> <p>Peter</p> <p>that is fine, we are stuck with servers and client rpm build error: Required zfs osd cannot be built due to missing zfs development headers.</p> <p>Any ideas:</p> <p>SBB-02:~/lustre-release # ./configure --enable-server --disable-ldiskfs --with-linux=/usr/src/linux-4.4.21-69 --with-linux-obj=/usr/src/linux-4.4.21-69-obj/x86_64/default --with-zfs=/usr/src/zfs-0.7.0 --with-spl=/usr/src/spl-0.7.0</p> <p>checking zfs source directory... /usr/src/zfs-0.7.0<br/> checking zfs build directory... /usr/src/zfs-0.7.0/4.4.21-69-default<br/> checking zfs source version... 0.7.0-rc4<br/> checking zfs file name for module symbols... Module.symvers<br/> checking user provided zfs devel headers...<br/> checking zfs devel headers... Not Found<br/> configure: error:</p> <p>Required zfs osd cannot be built due to missing zfs development headers.</p> <p>thanks,<br/> Abe</p> <p>Abe,</p> <p>Can you list the SPL and ZFS packages that were installed and the commands used to install them? It looks like the SPL development libraries might not have been installed. The configure script looks for the SPL and ZFS include files, which are in the libzfs2-devel RPM. For example:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">vagrant@sl12sp2-b:~rpm -qf /usr/include/libspl libzfs2-devel-0.7.0-rc4_56_g419c80e6d.x86_64 vagrant@sl12sp2-b:~&gt; rpm -qf /usr/include/libzfs libzfs2-devel-0.7.0-rc4_56_g419c80e6d.x86_64 </pre> </div></div> <p>The configure script will fail when it cannot find the include files.</p> <p>Hi Malcom,</p> <p>your are right, the zfs rpm install is failing, but the spl packages are all installed:</p> <p>for spl commands used:</p> <p>sudo zypper install kmod-spl-4.4.21-69-default-0.7.0-rc4.x86_64.rpm kmod-spl-devel-0.7.0-rc4.x86_64.rpm spl-0.7.0-rc4.x86_64.rpm</p> <p>sudo zypper install kmod-spl-devel-4.4.21-69-default-0.7.0-rc4.x86_64.rpm</p> <p>SBB-02:~/releases/zfs-spl # rpm -qa | grep spl<br/> kmod-spl-4.4.21-69-default-0.7.0-rc4.x86_64<br/> kmod-spl-devel-0.7.0-rc4.x86_64<br/> libply-splash-core4-0.9.2-29.5.x86_64<br/> libply-splash-graphics4-0.9.2-29.5.x86_64<br/> spl-0.7.0-rc4.x86_64<br/> kmod-spl-devel-4.4.21-69-default-0.7.0-rc4.x86_64</p> <p>for zfs:</p> <p>SBB-02:~/releases/zfs-spl # sudo zypper install kmod-zfs-4.4.21-69-default-0.7.0-rc4.x86_64 kmod-zfs-devel-0.7.0-rc4.x86_64 zfs-0.7.0-rc4.src.rpm<br/> Loading repository data...<br/> Reading installed packages...<br/> 'kmod-zfs-4.4.21-69-default.x86_64 = 0.7.0-rc4' is already installed.<br/> No update candidate for 'kmod-zfs-4.4.21-69-default-0.7.0-rc4.x86_64'. The highest available version is already installed.<br/> 'kmod-zfs-devel.x86_64 = 0.7.0-rc4' is already installed.<br/> No update candidate for 'kmod-zfs-devel-0.7.0-rc4.x86_64'. The highest available version is already installed.<br/> '<em>tmpRPMcache</em>:zfs=0:0.7.0-rc4' not found in package names. Trying capabilities.<br/> No provider of '<em>tmpRPMcache</em>:zfs=0:0.7.0-rc4' found.<br/> Resolving package dependencies...</p> <p>Nothing to do.</p> <p>SBB-02:~/releases/zfs-spl # rpm -qa | grep zfs<br/> kmod-zfs-4.4.21-69-default-0.7.0-rc4.x86_64<br/> kmod-zfs-devel-0.7.0-rc4.x86_64<br/> kmod-zfs-devel-4.4.21-69-default-0.7.0-rc4.x86_64</p> <p>SBB-02:~/releases/zfs-spl # sudo zypper install zfs-0.7.0-rc4.src.rpm<br/> Loading repository data...<br/> Reading installed packages...<br/> '<em>tmpRPMcache</em>:zfs=0:0.7.0-rc4' not found in package names. Trying capabilities.<br/> No provider of '<em>tmpRPMcache</em>:zfs=0:0.7.0-rc4' found.<br/> Resolving package dependencies...</p> <p>SBB-02:~/releases/zfs-spl # ls zfs*<br/> zfs-0.7.0-rc4.src.rpm zfs-dkms-0.7.0-rc4.noarch.rpm zfs-dkms-0.7.0-rc4.src.rpm zfs-kmod-0.7.0-rc4.src.rpm<br/> SBB-02:~/releases/zfs-spl # ls spl*rpm<br/> spl-0.7.0-rc4.src.rpm spl-0.7.0-rc4.x86_64.rpm spl-dkms-0.7.0-rc4.noarch.rpm spl-dkms-0.7.0-rc4.src.rpm spl-kmod-0.7.0-rc4.src.rpm</p> <p>thanks,<br/> Abe</p> <p>run the following command:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">rpm -qi libzfs2-devel </pre> </div></div> <p>If the package is not installed then run, from the directory containing the ZFS RPMs you created:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">sudo rpm -ivh libzfs2-devel-*.rpm </pre> </div></div> <p>If that fails, then likely, you need to install all the library packages in the release directory. The simplest way to do that is:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">sudo rpm -ivh lib*.rpm </pre> </div></div> <p>From the output of your commands, the user-space tools might not be installed, either.  </p> <p>The lustre.org documentation uses the following command to install all the pre-requisite ZFS packages:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">cd $HOME/releases/zfs-spl sudo rpm -ivh kmod-spl-* spl-*.x86_64.rpm \ kmod-zfs-[0-9].*-<span class="code-keyword">default</span>-*.x86_64.rpm \ kmod-zfs-devel-[0-9].*.x86_64.rpm \ lib*.x86_64.rpm \ zfs-[0-9].*.x86_64.rpm \ zfs-dracut-[0-9].*.x86_64.rpm </pre> </div></div> <p> </p> <p>The lib,zfs,zfs-dracut rpm are missing, the configure script should have generated these right ?</p> <p>SBB-02:~/releases/zfs-spl # sudo rpm <del>ivh kmod-spl</del>* spl-<b>.x86_64.rpm kmod-zfs-<span class="error">&#91;0-9&#93;</span>.</b><del>default</del><b>.x86_64.rpm kmod-zfs-devel-<span class="error">&#91;0-9&#93;</span>.</b>.x86_64.rpm lib*.x86_64.rpm zfs-<span class="error">&#91;0-9&#93;</span>.<b>.x86_64.rpm zfs-dracut-<span class="error">&#91;0-9&#93;</span>.</b>.x86_64.rpm<br/> error: File not found by glob: lib*.x86_64.rpm<br/> error: File not found by glob: zfs-<span class="error">&#91;0-9&#93;</span>.*.x86_64.rpm<br/> error: File not found by glob: zfs-dracut-<span class="error">&#91;0-9&#93;</span>.*.x86_64.rpm</p> <p>Yes, I would have expected these to have been created as part of the build process, but it depends on the options supplied to the make command for the SPL and ZFS code. </p> <p>To create the user space packages, you run this command in both of the SPL and the ZFS directories:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">make pkg-utils </pre> </div></div> <p>This is my build process for SPL and ZFS on SLES 12 SP2:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"># SPL cd $HOME/spl sh autogen.sh # only needed the first time the code is checked out ./configure --with-linux=/usr/src/linux-4.4.59-92.17 make pkg-utils pkg-kmod mkdir -p $HOME/releases/zfs-spl mv $HOME/spl/*.rpm $HOME/releases/zfs-spl cd $HOME/releases/zfs-spl sudo rpm -ivh kmod-spl-* spl-0.7.0*.x86_64.rpm # ZFS cd $HOME/zfs ./configure --with-linux=/usr/src/linux-4.4.59-92.17 make pkg-utils pkg-kmod mv $HOME/zfs/*.rpm $HOME/releases/zfs-spl cd $HOME/releases/zfs-spl sudo rpm -ivh kmod-zfs-[0-9].*-<span class="code-keyword">default</span>-*.x86_64.rpm \ kmod-zfs-devel-[0-9].*.x86_64.rpm \ lib*.x86_64.rpm \ zfs-[0-9].*.x86_64.rpm \ zfs-dracut-[0-9].*.x86_64.rpm </pre> </div></div> <p> </p> <p>cd $HOME/zfs<br/> make pkg-utils pkg-mod ---&gt; returns libzfs compile errors, missing ludev lib<br/> snapshot below:</p> <p>make<span class="error">&#91;5&#93;</span>: Entering directory '/tmp/zfs-build-root-0K0ri1dq/BUILD/zfs-0.7.0/lib/libzfs'<br/> CC libzfs_changelist.lo<br/> CC libzfs_config.lo<br/> CC libzfs_dataset.lo<br/> CC libzfs_diff.lo<br/> CC libzfs_fru.lo<br/> CC libzfs_import.lo<br/> CC libzfs_iter.lo<br/> CC libzfs_mount.lo<br/> CC libzfs_pool.lo<br/> CC libzfs_sendrecv.lo<br/> CC libzfs_status.lo<br/> CC libzfs_util.lo<br/> CCLD libzfs.la<br/> /usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: cannot find -ludev<br/> collect2: error: ld returned 1 exit status<br/> Makefile:631: recipe for target 'libzfs.la' failed<br/> make<span class="error">&#91;5&#93;</span>: *** <span class="error">&#91;libzfs.la&#93;</span> Error 1<br/> make<span class="error">&#91;5&#93;</span>: Leaving directory '/tmp/zfs-build-root-0K0ri1dq/BUILD/zfs-0.7.0/lib/libzfs'<br/> Makefile:534: recipe for target 'all-recursive' failed<br/> make<span class="error">&#91;4&#93;</span>: *** <span class="error">&#91;all-recursive&#93;</span> Error 1<br/> make<span class="error">&#91;4&#93;</span>: Leaving directory '/tmp/zfs-build-root-0K0ri1dq/BUILD/zfs-0.7.0/lib'<br/> Makefile:707: recipe for target 'all-recursive' failed<br/> make<span class="error">&#91;3&#93;</span>: *** <span class="error">&#91;all-recursive&#93;</span> Error 1<br/> make<span class="error">&#91;3&#93;</span>: Leaving directory '/tmp/zfs-build-root-0K0ri1dq/BUILD/zfs-0.7.0'<br/> Makefile:575: recipe for target 'all' failed<br/> make<span class="error">&#91;2&#93;</span>: *** <span class="error">&#91;all&#93;</span> Error 2<br/> make<span class="error">&#91;2&#93;</span>: Leaving directory '/tmp/zfs-build-root-0K0ri1dq/BUILD/zfs-0.7.0'<br/> error: Bad exit status from /tmp/zfs-build-root-0K0ri1dq/TMP/rpm-tmp.NljItE (%build)</p> <p>RPM build errors:<br/> Bad exit status from /tmp/zfs-build-root-0K0ri1dq/TMP/rpm-tmp.NljItE (%build)<br/> Makefile:1183: recipe for target 'rpm-common' failed<br/> make<span class="error">&#91;1&#93;</span>: *** <span class="error">&#91;rpm-common&#93;</span> Error 1<br/> make<span class="error">&#91;1&#93;</span>: Leaving directory '/root/zfs'<br/> Makefile:1142: recipe for target 'rpm-utils' failed<br/> make: *** <span class="error">&#91;rpm-utils&#93;</span> Error 2</p> <p>The following link has the package pre-requisites for compiling ZFS and Lustre:</p> <p><a href="http://wiki.lustre.org/Compiling_Lustre#SLES_12:_Install_the_Software_Development_Tools" class="external-link" target="_blank" rel="nofollow noopener">http://wiki.lustre.org/Compiling_Lustre#SLES_12:_Install_the_Software_Development_Tools</a></p> <p>The following command will install the pre-reqs:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">sudo zypper install asciidoc automake bc binutils-devel bison bison \ device-mapper-devel elfutils libelf-devel flex gcc gcc-c++ git \ glib2-tools glib2-devel hmaccalc libattr-devel libblkid-devel \ libselinux-devel libtool libuuid-devel lsscsi make mksh ncurses-devel \ net-tools numactl parted patchutils pciutils-devel perl pesign \ python-devel rpm-build sysstat systemd-devel tcl tcl-devel tk tk-devel wget \ xmlto zlib-devel libyaml-devel krb5-devel keyutils-devel net-snmp-devel </pre> </div></div> <p>You will need to have the SLE-SDK12 add-on enabled. Additional dependencies will be resolved automatically.</p> <p>how do you enable the SLE-SDK12 add-on ?</p> <p>thanks</p> <p>SUSE provides the SDK add-on – I thought it was one of the standard add-ons for SLES. There might be an ISO download, but I am not sure.</p> <p>I forget which packages come from the SDK versus the core OS – if you run the above command, it will tell you which packages it couldn't find, if any.</p> <p>Hi Malcom,<br/> i figured out how to add the packages on the server, basically user needs to subscribe and register the node with suse server with NFR license..<br/> BB-02:~ # SUSEConnect -r 1FAC34FBD7DDAA<br/> Registered SLES 12.2 x86_64<br/> To server: <a href="https://scc.suse.com" class="external-link" target="_blank" rel="nofollow noopener">https://scc.suse.com</a><br/> SBB-02:~ # SUSEConnect -p<br/> Please provide a product identifier<br/> SBB-02:~ # SUSEConnect -p sle-sdk/12.2/x86_64<br/> Registered sle-sdk 12.2 x86_64<br/> To server: <a href="https://scc.suse.com" class="external-link" target="_blank" rel="nofollow noopener">https://scc.suse.com</a></p> <p>so spl and zfs components are installed ..</p> <p>SBB-02:~ # rpm -qf /usr/include/libspl<br/> libzfs2-devel-0.7.0-rc4.x86_64<br/> SBB-02:~ # rpm -qf /usr/include/libzfs<br/> libzfs2-devel-0.7.0-rc4.x86_64</p> <p>Now we are hitting a problem with lustre compilation, these are the steps have used:<br/> 1. make distclean<br/> 2. ./configure --enable-server --with-linux=/usr/src/linux-4.4.21-69 --with-linux-obj=/usr/src/linux-4.4.21-69-obj/x86_64/default<br/> 3. make rpms</p> <p>SBB-02:~/lustre-release # make rpms<br/> make dist-gzip am__post_remove_distdir='@:'<br/> make<span class="error">&#91;1&#93;</span>: Entering directory '/root/lustre-release'<br/> if test -d "lustre-2.9.58_22_gdb59ecb"; then find "lustre-2.9.58_22_gdb59ecb" -type d ! -perm -200 -exec chmod u+w {} ';' &amp;&amp; rm -rf "lustre-2.9.58_22_gdb59ecb" || </p> { sleep 5 &amp;&amp; rm -rf "lustre-2.9.58_22_gdb59ecb"; } <p>; else :; fi<br/> test -d "lustre-2.9.58_22_gdb59ecb" || mkdir "lustre-2.9.58_22_gdb59ecb"<br/> (cd ldiskfs &amp;&amp; make top_distdir=../lustre-2.9.58_22_gdb59ecb distdir=../lustre-2.9.58_22_gdb59ecb/ldiskfs \<br/> am_<em>remove_distdir=: am</em><em>skip_length_check=: am</em>_skip_mode_fix=: distdir)</p> <p>snapshot:<br/> rm -rf $rpmbuilddir<br/> make<span class="error">&#91;1&#93;</span>: Entering directory '/root/lustre-release'<br/> make<span class="error">&#91;1&#93;</span>: Leaving directory '/root/lustre-release'<br/> Wrote: /tmp/rpmbuild-lustre-root-DfOI5x2b/SRPMS/lustre-2.9.58_22_gdb59ecb-1.src.rpm<br/> rpmbuilddir=`mktemp <del>t -d rpmbuild-lustre</del>$USER-XXXXXXXX`; \<br/> make \<br/> rpmbuilddir="$rpmbuilddir" rpm-local || exit 1; \<br/> /usr/bin/rpmbuild \<br/> --define "_tmppath $rpmbuilddir/TMP" \<br/> --define "_topdir $rpmbuilddir" \<br/> --define "kdir /usr/src/linux-4.4.21-69" --define "kobjdir /usr/src/linux-4.4.21-69-obj/x86_64/default" --with zfs --with lnet_dlc \<br/> -<del>rebuild lustre-2.9.58_22_gdb59ecb</del>*.src.rpm || exit 1; \<br/> cp $rpmbuilddir/RPMS/<b>/</b>.rpm . || exit 1; \<br/> rm -rf $rpmbuilddir<br/> make<span class="error">&#91;1&#93;</span>: Entering directory '/root/lustre-release'<br/> make<span class="error">&#91;1&#93;</span>: Leaving directory '/root/lustre-release'<br/> Installing lustre-2.9.58_22_gdb59ecb-1.src.rpm<br/> sh: -c: line 15: unexpected EOF while looking for matching `"'<br/> sh: -c: line 17: syntax error: unexpected end of file<br/> error: Summary field must be present in package: lustre-osd-zfs-kmp-default<br/> autoMakefile:1091: recipe for target 'rpms' failed<br/> make: *** <span class="error">&#91;rpms&#93;</span> Error 1<br/> SBB-02:~/lustre-release #</p> <p>thanks,<br/> Abe</p> <p>There's a bug somewhere in the "make rpms" process that prevents creating LDISKFS and ZFS packages at the same time. The workaround is to disable the LDISKFS support explicitly:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">./configure --enable-server \ --disable-ldiskfs \ --with-linux=/usr/src/linux-4.4.21-69 \ --with-linux-obj=/usr/src/linux-4.4.21-69-obj/x86_64/<span class="code-keyword">default</span> </pre> </div></div> <p>Note the second line in the above command.</p> <p>This is awesome, i was able to build the rpms for the servers and the clients:<br/> ./configure --disable-server --enable-client --disable-ldiskfs --with-linux=/usr/src/linux-4.4.21-69 --with-linux-obj=/usr/src/linux-4.4.21-69-obj/x86_64/default<br/> At this point, have installed the rpms on the servers and applied zfs configurations without any issues and started benchmarking our platform..</p> <p>One more thing, if you have any documentation on how to use dkms for installs on sles12 sp2 that would be great..<br/> I assume that the clients needs to be running sles12 sp2 os as well correct ?</p> <p>thank you so much for your support here,</p> <p>Regards,<br/> Abe</p> <p>There is no documentation that I am aware of to build ZFS on SLES 12 SP2 with DKMS support, and my own initial attempts have not been successful. The ZFS on Linux project's documentation doesn't have much information about SUSE.</p> <p>Clients can run any supported OS, but should ideally be running the same version of Lustre. Normally, users will use a common platform across both servers and clients.</p> <p>Is there any further work required on this ticket? Since there has been no activity since June 2017, I propose to close.</p> Related LU-9675 Development Epic/Theme zfs Rank 1|hzzecf: Rank (Obsolete) 9223372036854775807 Severity