https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-9801 Lustre <p>Hi,</p> <p>we are unable to install this kmod rpm on centos 7 or redhat 7 os due to missing packages:</p> <p>os:<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># uname -r<br/> 3.10.0-514.2.2.el7.x86_64</p> <p> yum install kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64.rpm<br/> Loaded plugins: fastestmirror<br/> Examining kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64.rpm: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> Marking kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64.rpm to be installed<br/> Resolving Dependencies<br/> --&gt; Running transaction check<br/> ---&gt; Package kmod-lustre-osd-zfs.x86_64 0:2.10.0-1.el7 will be installed<br/> --&gt; Processing Dependency: lustre-osd-zfs-mount = 2.10.0 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> Loading mirror speeds from cached hostfile</p> <ul> <li>base: mirrors.unifiedlayer.com</li> <li>epel: mirror.sjc02.svwh.net</li> <li>extras: centos.sonn.com</li> <li>updates: mirror.san.fastserv.com<br/> --&gt; Processing Dependency: ksym(__cv_broadcast) = 0x97fb9a11 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(arc_add_prune_callback) = 0x6fa427c8 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(arc_buf_size) = 0x200a6087 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(arc_remove_prune_callback) = 0xd014a73b for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dbuf_create_bonus) = 0x3db839e8 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dbuf_read) = 0x26b83cc1 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_assign_arcbuf) = 0x127df8fa for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_bonus_hold) = 0x4e547c34 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_buf_hold_array_by_bonus) = 0x330ef227 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_buf_rele) = 0x53e356d2 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_buf_rele_array) = 0x46d80b8c for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_free_long_range) = 0x3321cb2f for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_free_range) = 0x7b02d653 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_object_alloc) = 0xc6fd1135 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_object_free) = 0xcea03098 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_object_next) = 0x4a72152f for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_object_set_blocksize) = 0xca1aabaf for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_objset_disown) = 0x97857130 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_objset_ds) = 0x413dc6c5 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_objset_own) = 0x861d7fa7 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_objset_pool) = 0xb524b986 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_objset_spa) = 0xf32ede4c for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_objset_space) = 0xdd6f9b59 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_objset_userused_enabled) = 0x785fbbe9 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_prefetch) = 0x9503b84d for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_read) = 0x1d4e7818 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_request_arcbuf) = 0xd877830c for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_return_arcbuf) = 0xf5f82bbb for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_abort) = 0x25c64f47 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_assign) = 0x4cad2510 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_callback_register) = 0x3ba8b9e8 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_commit) = 0xc5fa3853 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_create) = 0xa5fb980b for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_get_txg) = 0x1e964c8b for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_hold_bonus) = 0xebbb7705 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_hold_free) = 0x90f85057 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_hold_sa) = 0x99d26080 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_hold_sa_create) = 0x34a71a73 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_hold_spill) = 0x5f1e8c34 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_hold_write) = 0x818e2943 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_tx_hold_zap) = 0x0921e256 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dmu_write) = 0x7d836097 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dsl_pool_config_enter) = 0xdf6814d8 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dsl_pool_config_exit) = 0xfe90cd42 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dsl_prop_register) = 0x2869f407 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(dsl_prop_unregister) = 0x01a3a969 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(nvlist_add_byte_array) = 0x4ea06afa for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(nvlist_alloc) = 0x75a78768 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(nvlist_free) = 0x9d9f80c4 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(nvlist_lookup_byte_array) = 0xcb59902f for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(nvlist_next_nvpair) = 0x29c88b11 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(nvlist_pack) = 0x424ac2e1 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(nvlist_remove) = 0xcf24ceff for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(nvlist_size) = 0x730e1886 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(nvlist_unpack) = 0x1cd81596 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(nvpair_name) = 0xd42a96fa for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_bulk_lookup) = 0xcbb17a27 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_bulk_update) = 0x28755c91 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_handle_destroy) = 0xd3e92078 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_handle_get) = 0x5a89c11b for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_handle_get_from_db) = 0xcaa2face for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_lookup) = 0x6c565287 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_object_size) = 0x92005375 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_replace_all_by_template) = 0xf981e3d2 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_setup) = 0xf4af989e for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_size) = 0xe5210b6d for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_spill_rele) = 0xb2edfaed for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(sa_update) = 0x2fe1928c for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(spa_freeze) = 0x404a0201 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(spa_get_dsl) = 0xab70a030 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(spa_maxblocksize) = 0xa23848e6 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(spa_writeable) = 0xbc5c21ea for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(spl_panic) = 0xbc32eee7 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(txg_wait_callbacks) = 0x159c7f03 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(txg_wait_synced) = 0x3ca327e1 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_add) = 0xd7d0ece4 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_add_uint64) = 0x945aa714 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_create_flags) = 0x576b159a for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_cursor_advance) = 0xacfa9c80 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_cursor_fini) = 0x1db3578b for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_cursor_init) = 0x7a47ab51 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_cursor_init_serialized) = 0xe14f6134 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_cursor_retrieve) = 0x148b243f for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_cursor_serialize) = 0x9fc2d604 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_lookup) = 0x18f06e6f for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_lookup_uint64) = 0x6fb23a23 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_remove) = 0x0be74ac7 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_remove_uint64) = 0xcb5497ca for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zap_update) = 0x9c1bd0d7 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zfs_attr_table) = 0x7ae721f2 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zfs_prop_to_name) = 0xa483a8c3 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zio_buf_alloc) = 0x0c211976 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zio_buf_free) = 0x6e7a7166 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zrl_add) = 0x5ac99f0f for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: ksym(zrl_remove) = 0x17cdc7fe for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: zfs-kmod for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Finished Dependency Resolution<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(nvlist_unpack) = 0x1cd81596<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_setup) = 0xf4af989e<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_object_next) = 0x4a72152f<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_request_arcbuf) = 0xd877830c<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_buf_hold_array_by_bonus) = 0x330ef227<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_assign) = 0x4cad2510<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_bulk_lookup) = 0xcbb17a27<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_hold_spill) = 0x5f1e8c34<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dsl_pool_config_exit) = 0xfe90cd42<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_handle_destroy) = 0xd3e92078<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_object_alloc) = 0xc6fd1135<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_lookup) = 0x6c565287<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_free_long_range) = 0x3321cb2f<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_hold_zap) = 0x0921e256<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_remove_uint64) = 0xcb5497ca<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(__cv_broadcast) = 0x97fb9a11<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(nvlist_pack) = 0x424ac2e1<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(spa_writeable) = 0xbc5c21ea<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_replace_all_by_template) = 0xf981e3d2<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dsl_prop_register) = 0x2869f407<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(spa_freeze) = 0x404a0201<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_cursor_retrieve) = 0x148b243f<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(spl_panic) = 0xbc32eee7<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_update) = 0x2fe1928c<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(nvlist_lookup_byte_array) = 0xcb59902f<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_objset_own) = 0x861d7fa7<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: zfs-kmod<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zio_buf_free) = 0x6e7a7166<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_handle_get) = 0x5a89c11b<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_write) = 0x7d836097<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_get_txg) = 0x1e964c8b<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_cursor_fini) = 0x1db3578b<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_bulk_update) = 0x28755c91<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(txg_wait_synced) = 0x3ca327e1<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_buf_rele) = 0x53e356d2<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_hold_sa) = 0x99d26080<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_update) = 0x9c1bd0d7<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_hold_bonus) = 0xebbb7705<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zio_buf_alloc) = 0x0c211976<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zrl_add) = 0x5ac99f0f<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_commit) = 0xc5fa3853<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_objset_ds) = 0x413dc6c5<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_assign_arcbuf) = 0x127df8fa<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(nvlist_add_byte_array) = 0x4ea06afa<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(arc_add_prune_callback) = 0x6fa427c8<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_object_free) = 0xcea03098<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(nvlist_remove) = 0xcf24ceff<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(arc_remove_prune_callback) = 0xd014a73b<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_handle_get_from_db) = 0xcaa2face<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_create) = 0xa5fb980b<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_abort) = 0x25c64f47<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dbuf_read) = 0x26b83cc1<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_spill_rele) = 0xb2edfaed<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_remove) = 0x0be74ac7<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_objset_userused_enabled) = 0x785fbbe9<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(nvlist_next_nvpair) = 0x29c88b11<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_buf_rele_array) = 0x46d80b8c<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(nvpair_name) = 0xd42a96fa<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dsl_pool_config_enter) = 0xdf6814d8<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_add_uint64) = 0x945aa714<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(txg_wait_callbacks) = 0x159c7f03<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_object_size) = 0x92005375<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_return_arcbuf) = 0xf5f82bbb<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_prefetch) = 0x9503b84d<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(nvlist_alloc) = 0x75a78768<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(spa_get_dsl) = 0xab70a030<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dsl_prop_unregister) = 0x01a3a969<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_objset_space) = 0xdd6f9b59<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_callback_register) = 0x3ba8b9e8<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_cursor_init) = 0x7a47ab51<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_objset_disown) = 0x97857130<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_add) = 0xd7d0ece4<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_objset_pool) = 0xb524b986<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(nvlist_size) = 0x730e1886<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_hold_write) = 0x818e2943<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_object_set_blocksize) = 0xca1aabaf<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_create_flags) = 0x576b159a<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(sa_size) = 0xe5210b6d<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_lookup) = 0x18f06e6f<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dbuf_create_bonus) = 0x3db839e8<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_cursor_init_serialized) = 0xe14f6134<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(arc_buf_size) = 0x200a6087<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(nvlist_free) = 0x9d9f80c4<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_objset_spa) = 0xf32ede4c<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_cursor_advance) = 0xacfa9c80<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: lustre-osd-zfs-mount = 2.10.0<br/> Installed: lustre-osd-zfs-mount-2.7.19.6-3.10.0_514.el7_lustre.x86_64.x86_64 (installed)<br/> lustre-osd-zfs-mount = 2.7.19.6-3.10.0_514.el7_lustre.x86_64<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_hold_free) = 0x90f85057<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_lookup_uint64) = 0x6fb23a23<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(spa_maxblocksize) = 0xa23848e6<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_cursor_serialize) = 0x9fc2d604<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_read) = 0x1d4e7818<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zfs_attr_table) = 0x7ae721f2<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zrl_remove) = 0x17cdc7fe<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_tx_hold_sa_create) = 0x34a71a73<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_free_range) = 0x7b02d653<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zfs_prop_to_name) = 0xa483a8c3<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_bonus_hold) = 0x4e547c34<br/> You could try using --skip-broken to work around the problem <ul> <li>Found 5 pre-existing rpmdb problem(s), 'yum check' output follows:<br/> openmpi_gcc-1.10.4-9.x86_64 has missing requires of libosmcomp.so.3()(64bit)<br/> openmpi_gcc-1.10.4-9.x86_64 has missing requires of libpapi.so.5.2.0.0()(64bit)<br/> openmpi_gcc_hfi-1.10.4-9.x86_64 has missing requires of libosmcomp.so.3()(64bit)<br/> openmpi_gcc_hfi-1.10.4-9.x86_64 has missing requires of libpapi.so.5.2.0.0()(64bit)<br/> openshmem_gcc_hfi-1.0h-20.x86_64 has missing requires of elfutils-libelf-devel</li> </ul> </li> </ul> LU-9801

kmod-lustre-osd-zfs install failure due to missing packages

Bug Major Resolved Fixed Malcolm Cowe Abe Thu, 27 Jul 2017 01:05:37 +0000 Tue, 8 Aug 2017 00:30:23 +0000 Tue, 8 Aug 2017 00:30:23 +0000 Lustre 2.10.0 0 3 <p>os: centos</p> <p> uname -r<br/> 3.10.0-514.26.2.el7.x86_64</p> <p>kernel installed:<br/> rpm -qa | grep kernel<br/> kernel-tools-3.10.0-514.26.2.el7.x86_64<br/> kernel-devel-3.10.0-514.26.2.el7.x86_64<br/> kernel-tools-libs-devel-3.10.0-514.26.2.el7.x86_64<br/> kernel-tools-libs-3.10.0-514.26.2.el7.x86_64<br/> kernel-3.10.0-514.26.2.el7.x86_64<br/> kernel-headers-3.10.0-514.26.2.el7.x86_64</p> <p>Is the <tt>kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64.rpm</tt> package taken from the Lustre download site? And is the kernel that is installed taken from the regular OS distribution?</p> <p>If so, then I think there is a compatibility issue between the kmod-osd-zfs binary from the Lustre download site and the kernel that's been installed. This is most likely because the kmod-osd-zfs binary packages is compiled against a Lustre-patched kernel, not a stock kernel.</p> <p>Also, is ZFS installed? And if so, how did you install it? It might be that the kmod package cannot resolve the symbols for the ZFS binaries – again, probably because of differences in the kernels that were used to compile the modules.</p> <p>Could you try the following process as an alternative installation strategy? It's lifted from a different document I'm preparing, os might need a couple of tweaks, but should be more or less sound.</p> <p>The idea is to install the required kernel, install SPL and ZFS using DKMS, then install the Lustre modules with DKMS and the remaing Lustre packages.</p> <p>It may also be possible to use the ZFS binaries from the ZFS on Linux project, but I haven't tried that yet.</p> <h2><a name="Outlineinstructions%28mayneedtobeadjusted%29"></a>Outline instructions (may need to be adjusted)</h2> <p>Install the kernel packages that match the latest supported version for the Lustre release:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">yum install \ kernel \ kernel-devel \ kernel-headers \ kernel-tools \ kernel-tools-libs \ kernel-tools-libs-devel </pre> </div></div> <p>It may be necessary to specify the kernel package version number in order to ensure that a kernel that is compatible with Lustre is installed. For example, Lustre 2.10.0 has support for RHEL kernel 3.10.0-514.21.1.el7:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">yum install \ kernel-3.10.0-514.21.1.el7 \ kernel-devel-3.10.0-514.21.1.el7 \ kernel-headers-3.10.0-514.21.1.el7 \ kernel-tools-3.10.0-514.21.1.el7 \ kernel-tools-libs-3.10.0-514.21.1.el7 \ kernel-tools-libs-devel-3.10.0-514.21.1.el7 </pre> </div></div> <p>Refer to the Lustre Changelog for the list of supported kernels.</p> <p>Ensure that a persistent hostid has been generated on the machine. If necessary, generate a persistent hostid (needed to help protect zpools against simultaneous imports on multiple servers). For example:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">hid=`[ -f /etc/hostid ] &amp;&amp; od -An -tx /etc/hostid|sed <span class="code-quote">'s/ <span class="code-comment">//g'</span>` </span>[ <span class="code-quote">"$hid"</span> = `hostid` ] || genhostid </pre> </div></div> <p>Reboot the node.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">reboot </pre> </div></div> <p>Install EPEL (this might be optional but I have not checked):</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">yum -y install epel-release </pre> </div></div> <p>Follow the instructions from the ZFS on Linux project to install the ZFS YUM repository definition. Use the DKMS package repository (the default).</p> <p>For example:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">yum -y install \ http:<span class="code-comment">//download.zfsonlinux.org/epel/zfs-release.el7_3.noarch.rpm </span> </pre> </div></div> <p>Clean the YUM cache:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">yum clean all </pre> </div></div> <p>Install ZFS:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">yum install spl-dkms zfs-dkms </pre> </div></div> <p>Download and install the following packages from <a href="https://downloads.hpdd.intel.com/public/lustre/lustre-2.10.0/el7/server/RPMS/x86_64/:" class="external-link" target="_blank" rel="nofollow noopener">https://downloads.hpdd.intel.com/public/lustre/lustre-2.10.0/el7/server/RPMS/x86_64/:</a></p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">lustre-dkms-2.10.0-1.el7.noarch.rpm lustre-osd-zfs-mount-2.10.0-1.el7.x86_64.rpm lustre-2.10.0-1.el7.x86_64.rpm lustre-resource-agents-2.10.0-1.el7.x86_64.rpm </pre> </div></div> <p>we are still missing these packages during the download:<br/> Error: Package: kmod-lustre-osd-ldiskfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-ldiskfs-2.10.0-1.el7.x86_64)^M<br/> Requires: kernel(dquot_file_open) = 0x9376e8ae^M<br/> Installed: kernel-3.10.0-514.21.1.el7.x86_64 (@updates)^M<br/> kernel(dquot_file_open) = 0x5ab1bb15^M<br/> Available: kernel-3.10.0-514.el7.x86_64 (base)^M<br/> kernel(dquot_file_open) = 0x5ab1bb15^M</p> <p>Also, where can retrieve the spl-dkms and zfs-dkms</p> <p>installed kernel:<br/> rpm -qa | grep kernel<br/> kernel-3.10.0-514.21.1.el7.x86_64<br/> kernel-tools-libs-devel-3.10.0-514.21.1.el7.x86_64<br/> kernel-tools-3.10.0-514.21.1.el7.x86_64<br/> kernel-tools-libs-3.10.0-514.21.1.el7.x86_64<br/> kernel-headers-3.10.0-514.21.1.el7.x86_64<br/> kernel-devel-3.10.0-514.21.1.el7.x86_64</p> <p>thanks.</p> <p>Please provide the complete list of command that you are using to install the servers, and the complete list of Lustre packages that you are trying to install. My instructions assume that you are not using LDISKFS, and are using the OS kernels, <em>not</em> the Lustre patched kernels. If you require everything (including LDISKFS), then the instructions are slightly different.</p> <p>The spl-dkms and zfs-dkms packages are taken from the ZFS on Linux project:</p> <p><a href="http://zfsonlinux.org/" class="external-link" target="_blank" rel="nofollow noopener">http://zfsonlinux.org</a></p> <p>The instructions for installing ZFS on RHEL / CentOS are here:</p> <p><a href="https://github.com/zfsonlinux/zfs/wiki/RHEL-%26-CentOS" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/zfsonlinux/zfs/wiki/RHEL-%26-CentOS</a></p> <p> If you follow my instructions, it will set up the servers such that the ZFS and SPL packages are pulled in via YUM automatically. i.e., running the following will set up a YUM repo description on the server that points to the ZFS on Linux repo:</p> <p>yum -y install \<br/> <a href="http://download.zfsonlinux.org/epel/zfs-release.el7_3.noarch.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/zfs-release.el7_3.noarch.rpm</a><br/> then, you can just run the following to install ZFS:</p> <p><tt>yum clean all</tt></p> <p>yum install spl-dkms zfs-dkms<br/>  </p> <p> </p> <p>Hi Malcom,<br/> Tried this step from zfsonlinux setup guide, but still not able to download <br/> spl-dkms zfs-dkms</p> <p>sudo yum install <a href="http://download.zfsonlinux.org/epel/zfs-release.el7_3.noarch.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/zfs-release.el7_3.noarch.rpm</a><br/> gpg --quiet --with-fingerprint /etc/pki/rpm-gpg/RPM-GPG-KEY-zfsonlinux<br/> sudo yum install spl-dkms zfs-dkms</p> <p>Repository zfs is listed more than once in the configuration<br/> zfs-release.el7_3.noarch.rpm | 5.2 kB 00:00:00 <br/> Examining /var/tmp/yum-root-daaOQh/zfs-release.el7_3.noarch.rpm: zfs-release-1-4.el7_3.centos.noarch<br/> /var/tmp/yum-root-daaOQh/zfs-release.el7_3.noarch.rpm: does not update installed package.<br/> Error: Nothing to do<br/> pub 2048R/F14AB620 2013-03-21 ZFS on Linux &lt;zfs@zfsonlinux.org&gt;<br/> Key fingerprint = C93A FFFD 9F3F 7B03 C310 CEB6 A9D5 A1C0 F14A B620<br/> sub 2048R/99685629 2013-03-21<br/> Loaded plugins: fastestmirror<br/> Repository zfs is listed more than once in the configuration<br/> Loading mirror speeds from cached hostfile</p> <ul> <li>base: ftp.osuosl.org</li> <li>epel: mirror.sjc02.svwh.net</li> <li>extras: mirrors.sonic.net</li> <li>updates: linux.mirrors.es.net<br/> No package spl-dkms available.<br/> No package zfs-dkms available.<br/> Error: Nothing to do</li> </ul> <p>thanks,<br/> Abe</p> <p>Also, the exact command ran on the system:</p> <p>yum install kmod-lustre-2.10.0-1.el7.x86_64.rpm kmod-lustre-tests-2.10.0-1.el7.x86_64.rpm kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64.rpm<br/> installed kernel on server:<br/> rpm -qa | grep kernel<br/> kernel-3.10.0-514.21.1.el7.x86_64<br/> kernel-tools-libs-devel-3.10.0-514.21.1.el7.x86_64<br/> kernel-tools-3.10.0-514.21.1.el7.x86_64<br/> kernel-tools-libs-3.10.0-514.21.1.el7.x86_64<br/> kernel-headers-3.10.0-514.21.1.el7.x86_64<br/> kernel-devel-3.10.0-514.21.1.el7.x86_64<br/> Thanks,<br/> Abe</p> <p>There are two items of note in the output you supplied:</p> <ol> <li>The ZFS on Linux repo definition is already installed</li> <li>There is more than one definition of a <tt>zfs</tt> repository</li> </ol> <p>The fact that there are more than one repo definitions indicates that there is a conflict when trying to identify the packages to download. It might be something simple like stale metadata, in which case this can be cleaned using the following command:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">yum clean all </pre> </div></div> <p>If this does not resolve the issue, then the conflict exists within the configuration of YUM.</p> <p>Run the following command to get details of the repos:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">yum repoinfo zfs </pre> </div></div> <p>This will return a high level summary of the ZFS repo. If there is more than one definition, I'm not sure if it will return both. My lab system returns the following output as an example:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">[root@ctb-el73 ~]# yum repoinfo zfs Loaded plugins: fastestmirror, langpacks Loading mirror speeds from cached hostfile * base: centos.mirror.ausnetservers.net.au * epel: mirror.as24220.net * extras: mirror.ventraip.net.au * updates: mirror.intergrid.com.au Repo-id      : zfs/x86_64 Repo-name    : ZFS on Linux <span class="code-keyword">for</span> EL7 - dkms Repo-status  : enabled Repo-revision: 1501111462 Repo-updated : Wed Jul 26 19:24:24 2017 Repo-pkgs    : 67 Repo-size    : 39 M Repo-baseurl : http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/ </span>Repo-expire  : 604,800 second(s) (last: Fri Jul 28 23:27:03 2017)   Filter     : read-only:present Repo-filename: /etc/yum.repos.d/zfs.repo repolist: 67 </pre> </div></div> <p>You need to look in the /etc/yum.repos.d directory for files that contain <tt>zfs</tt> repo definitions, and disable / remove the one that conflicts with the ZFS on Linux zfs-release rpm. </p> <p>Also, check that the zfs-release package has not been compromised, using rpm verify ( <tt>rpm -Vv</tt>). For example:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">[root@ctb-el73 ~]# rpm -Vv zfs-release .........    /etc/pki/rpm-gpg/RPM-GPG-KEY-zfsonlinux .........  c /etc/yum.repos.d/zfs.repo </pre> </div></div> <p>The output should be similar to the above. The first field in the output should all dots. If not, then the file has been altered, overwritten or removed.</p> <p>You can also check the contents of the ZFS repository using the <tt>reposync</tt> command:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">reposync -r zfs -un </pre> </div></div> <p>On a correctly configured system, the output will be similar to the following (version numbers may differ slightly if there have been any updates):</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">[root@ctb-el73 ~]# reposync -r zfs -un http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/libnvpair1-0.7.0-1.el7_3.x86_64.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/libuutil1-0.7.0-1.el7_3.x86_64.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/libzfs2-0.7.0-1.el7_3.x86_64.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/libzfs2-devel-0.7.0-1.el7_3.x86_64.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/libzpool2-0.7.0-1.el7_3.x86_64.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/spl-0.7.0-1.el7_3.x86_64.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/debug/spl-debuginfo-0.7.0-1.el7_3.x86_64.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/spl-dkms-0.7.0-1.el7_3.noarch.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/zfs-0.7.0-1.el7_3.x86_64.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/debug/zfs-debuginfo-0.7.0-1.el7_3.x86_64.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/zfs-dkms-0.7.0-1.el7_3.noarch.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/zfs-dracut-0.7.0-1.el7_3.x86_64.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/zfs-release-1-4.el7_3.centos.noarch.rpm </span>http:<span class="code-comment">//download.zfsonlinux.org/epel/7.3/x86_64/zfs-test-0.7.0-1.el7_3.x86_64.rpm</span> </pre> </div></div> <p>Note that both <tt>spl-dkms</tt> and <tt>zfs-dkms</tt> are listed in this repository.</p> <p> </p> <p>Complete and comprehensive instructions for building Lustre are available on the lustre.org wiki:</p> <p><a href="http://wiki.lustre.org/Compiling_Lustre" class="external-link" target="_blank" rel="nofollow noopener">http://wiki.lustre.org/Compiling_Lustre</a></p> <p>This document provides a description for creating Lustre packages for servers and clients across several operating systems, and includes ZFS, LDISKFS, DKMS build options and descriptions for 3rd party network drivers such as Mellanox OFED (MOFED) and Intel Omni-path Architecture (OPA).</p> <p>Hi Malcom,</p> <p>It look like there was one repo for ZFS which previously add with Intel IML release, i have removed that<br/> and the duplicate zfs repo info is resolved.however the install is still showing similar errors..<br/> below are the steps:<br/> OSS1-A212 x86_64]# yum repoinfo zfs<br/> Loaded plugins: fastestmirror<br/> Repository zfs is listed more than once in the configuration<br/> Loading mirror speeds from cached hostfile</p> <ul> <li>base: mirror.san.fastserv.com</li> <li>epel: mirror.sjc02.svwh.net</li> <li>extras: mirrors.sonic.net</li> <li>updates: repos.lax.quadranet.com<br/> Repo-id : zfs/7<br/> Repo-name : ZFS<br/> Repo-status : disabled<br/> Repo-baseurl : <a href="https://iml3:443/repo//zfs/7/" class="external-link" target="_blank" rel="nofollow noopener">https://iml3:443/repo//zfs/7/</a><br/> Repo-expire : 21,600 second(s) (last: Wed Jul 26 20:45:54 2017)<br/> Filter : read-only:present<br/> Repo-filename: /etc/yum.repos.d/Intel-Lustre-Agent.repo</li> </ul> <p>repolist: 0</p> <p>after zfs / iml removal:</p> <p>oot@OSS1-A212 x86_64]# yum repoinfo zfs<br/> Loaded plugins: fastestmirror<br/> Loading mirror speeds from cached hostfile</p> <ul> <li>base: mirrors.unifiedlayer.com</li> <li>epel: mirror.sfo12.us.leaseweb.net</li> <li>extras: mirrors.sonic.net</li> <li>updates: repos-lax.psychz.net<br/> Repo-id : zfs/x86_64<br/> Repo-name : ZFS on Linux for EL7 - dkms<br/> Repo-status : enabled<br/> Repo-revision: 1501111462<br/> Repo-updated : Wed Jul 26 19:24:24 2017<br/> Repo-pkgs : 67<br/> Repo-size : 39 M<br/> Repo-baseurl : <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/</a><br/> Repo-expire : 604,800 second(s) (last: Mon Jul 31 12:49:07 2017)<br/> Filter : read-only:present<br/> Repo-filename: /etc/yum.repos.d/zfs.repo</li> </ul> <p><span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># reposync -r zfs -un<br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/libnvpair1-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/libnvpair1-0.7.0-1.el7_3.x86_64.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/libuutil1-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/libuutil1-0.7.0-1.el7_3.x86_64.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/libzfs2-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/libzfs2-0.7.0-1.el7_3.x86_64.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/libzfs2-devel-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/libzfs2-devel-0.7.0-1.el7_3.x86_64.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/libzpool2-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/libzpool2-0.7.0-1.el7_3.x86_64.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/spl-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/spl-0.7.0-1.el7_3.x86_64.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/debug/spl-debuginfo-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/debug/spl-debuginfo-0.7.0-1.el7_3.x86_64.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/spl-dkms-0.7.0-1.el7_3.noarch.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/spl-dkms-0.7.0-1.el7_3.noarch.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/zfs-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/zfs-0.7.0-1.el7_3.x86_64.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/debug/zfs-debuginfo-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/debug/zfs-debuginfo-0.7.0-1.el7_3.x86_64.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/zfs-dkms-0.7.0-1.el7_3.noarch.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/zfs-dkms-0.7.0-1.el7_3.noarch.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/zfs-dracut-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/zfs-dracut-0.7.0-1.el7_3.x86_64.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/zfs-release-1-4.el7_3.centos.noarch.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/zfs-release-1-4.el7_3.centos.noarch.rpm</a><br/> <a href="http://download.zfsonlinux.org/epel/7.3/x86_64/zfs-test-0.7.0-1.el7_3.x86_64.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7.3/x86_64/zfs-test-0.7.0-1.el7_3.x86_64.rpm</a></p> <p>snapshot of the kmod install:</p> <p>lustre-2.10/downloads.hpdd.intel.com/public/lustre/latest-feature-release/el7/server/RPMS/x86_64��[?1034h<span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># yum install kmod*rpm<br/> Loaded plugins: fastestmirror<br/> Examining kmod-lustre-2.10.0-1.el7.x86_64.rpm: kmod-lustre-2.10.0-1.el7.x86_64<br/> Marking kmod-lustre-2.10.0-1.el7.x86_64.rpm to be installed<br/> Examining kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64.rpm: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> Marking kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64.rpm to be installed<br/> Examining kmod-lustre-tests-2.10.0-1.el7.x86_64.rpm: kmod-lustre-tests-2.10.0-1.el7.x86_64<br/> Marking kmod-lustre-tests-2.10.0-1.el7.x86_64.rpm to be installed<br/> Resolving Dependencies<br/> --&gt; Running transaction check<br/> ---&gt; Package kmod-lustre.x86_64 0:2.10.0-1.el7 will be installed<br/> --&gt; Processing Dependency: kernel(PDE_DATA) = 0xc1b96fb1 for package: kmod-lustre-2.10.0-1.el7.x86_64<br/> Loading mirror speeds from cached hostfile</p> <ul> <li>base: mirror.san.fastserv.com</li> <li>epel: mirror.sjc02.svwh.net</li> <li>extras: mirrors.sonic.net</li> <li>updates: repos-lax.psychz.net<br/> --&gt; Processing Dependency: kernel(current_task) = 0xd5026ba3 for package: kmod-lustre-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(kmalloc_caches) = 0x67f04e83 for package: kmod-lustre-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(kmem_cache_alloc_trace) = 0x04f958be for package: kmod-lustre-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(module_layout) = 0x427ba377 for package: kmod-lustre-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(seq_lseek) = 0x42719b35 for package: kmod-lustre-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(seq_open) = 0x37c3d8af for package: kmod-lustre-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(seq_read) = 0xd3224c70 for package: kmod-lustre-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(single_open) = 0xf4d6601b for package: kmod-lustre-2.10.0-1.el7.x86_64<br/> ---&gt; Package kmod-lustre-osd-zfs.x86_64 0:2.10.0-1.el7 will be installed<br/> --&gt; Processing Dependency: lustre-osd-zfs-mount = 2.10.0 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(PDE_DATA) = 0xc1b96fb1 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(__free_pages) = 0xf5a3d828 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(alloc_pages_current) = 0x3da264a7 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(current_task) = 0xd5026ba3 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(kmalloc_caches) = 0x67f04e83 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(kmem_cache_alloc) = 0x7ec6f7b9 for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(kmem_cache_alloc_trace) = 0x04f958be for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: kernel(kmem_cache_free) = 0x7578859a for package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64<br/> ........................................................................................................<br/> --&gt; Finished Dependency Resolution<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(zap_cursor_retrieve) = 0x148b243f<br/> Installed: kmod-zfs-0.7.0-1.el7_3.x86_64 (@zfs-kmod)<br/> ksym(zap_cursor_retrieve) = 0x91006d40<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(__cv_broadcast) = 0x97fb9a11<br/> Installed: kmod-spl-0.7.0-1.el7_3.x86_64 (@zfs-kmod)<br/> ksym(__cv_broadcast) = 0x347a3ab7<br/> Error: Package: kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64 (/kmod-lustre-osd-zfs-2.10.0-1.el7.x86_64)<br/> Requires: ksym(dmu_objset_userused_enabled) = 0x785fbbe9</li> </ul> <p>thanks,<br/> Abe</p> <p>Also, the spl and zfs kmod rpm are installed:<br/> root@OSS1-A212 x86_64]# rpm -qa | grep kmod<br/> kmod-spl-0.7.0-1.el7_3.x86_64<br/> kmod-20-9.el7.x86_64<br/> kmod-zfs-0.7.0-1.el7_3.x86_64<br/> kmod-libs-20-9.el7.x86_64<br/> thanks,<br/> Abe</p> <p>The kmod-lustre-osd-zfs RPM distributed on the Lustre download site doesn't work with the ZoL packages. The kmod-lustre-osd-zfs RPM is compiled against ZFS 0.6.5.x, whereas the latest release version is 0.7.0. While the ZFS version could be downgraded to match Lustre 2.10.0 binaries, this is not sufficient to resolve the ksym dependency problem. The kmod-lustre-osd-zfs package is also compiled against the Lustre-patched kernel, and uses ZFS RPMs that are also created on the build environment. This means that the ksym dependencies don't match up with the ZoL distribution kmod RPMs.</p> <p>Due to the licensing incompatibility between CDDL (ZFS) and GPL (kernel and Lustre), the binary kmod ZFS packages used to help compile Lustre are not distributed. </p> <p>The Lustre-patched kernel breaks KABI compatibility with kernel modules compiled against the standard RHEL kernel for the same OS release. This means that the ZoL kmod binary RPMS won't load on a lustre-patched kernel, and that the Lustre kmod binary RPMs compiled against a Lustre-patched kernel won't load on a standard RHEL kernel.</p> <p>The unfortunate side-effect of all this is that the kmod-lustre-osd-zfs binary RPM in the Lustre distribution is not usable by most users, which means that you need to use the DKMS packages for Lustre, SPL and ZFS, per the earlier comment, or compile all of the packages from source.</p> <p>To use the DKMS packages, you will need to edit /etc/yum.repos.d/zfs.repo, disable the zfs-kmod repo and enable the zfs repo. You may also need to remove the existing ZFS packages.</p> <p> </p> <p>Hi Malcom,<br/> i have update the zfs repo to use DKMS packages, however not able to remove the zfs and spl components:<br/> rpm -qa | grep zfs<br/> zfs-0.7.0-1.el7_3.x86_64<br/> kmod-zfs-0.7.0-1.el7_3.x86_64<br/> libzfs2-0.7.0-1.el7_3.x86_64<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># rpm -e zfs-0.7.0-1.el7_3.x86_64<br/> error: Failed dependencies:<br/> zfs = 0.7.0 is needed by (installed) kmod-zfs-0.7.0-1.el7_3.x86_64<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># </p> <p>rpm -e kmod-zfs-0.7.0-1.el7_3.x86_64<br/> error: Failed dependencies:<br/> zfs-kmod = 0.7.0 is needed by (installed) zfs-0.7.0-1.el7_3.x86_64</p> <p>Tried also to remove these with dkms:<br/> root@OSS1-A212 x86_64]# dkms status<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># </p> <p>Any suggestions ?</p> <p>thanks,<br/> Abe</p> <p>now zfs 0.7 version has been removed:<br/> dkms status shows spl and zfs installed<br/> spl, 0.6.5.9, 3.10.0-514.21.1.el7.x86_64, x86_64: installed<br/> zfs, 0.6.5.9, 3.10.0-514.21.1.el7.x86_64, x86_64: installed</p> <p>now, tried to add lustre 2.10.0 via dkms and it is not <br/> being added:<br/> dkms install lustre/2.10.0 --all<br/> dkms status<br/> spl, 0.6.5.9, 3.10.0-514.21.1.el7.x86_64, x86_64: installed<br/> zfs, 0.6.5.9, 3.10.0-514.21.1.el7.x86_64, x86_64: installed<br/> thanks,<br/> Abe</p> <p>yum repo has been updated to use dkms as well<br/> <span class="error">&#91;zfs&#93;</span><br/> name=ZFS on Linux for EL 7 - dkms<br/> baseurl=<a href="http://download.zfsonlinux.org/epel/7/$basearch/" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7/$basearch/</a><br/> metadata_expire=7d<br/> gpgcheck=1<br/> gpgkey=<a href="file:///etc/pki/rpm-gpg/RPM-GPG-KEY-zfsonlinux" class="external-link" target="_blank" rel="nofollow noopener">file:///etc/pki/rpm-gpg/RPM-GPG-KEY-zfsonlinux</a></p> <p>I have installed lustre/zfs/spl using the following steps:<br/> 1.kernel-tools-3.10.0-514.21.1.el7_lustre.x86_64<br/> kernel-3.10.0-514.21.1.el7_lustre.x86_64<br/> kernel-debuginfo-common-x86_64-3.10.0-514.21.1.el7_lustre.x86_64<br/> kernel-tools-libs-devel-3.10.0-514.21.1.el7_lustre.x86_64<br/> kernel-debuginfo-3.10.0-514.21.1.el7_lustre.x86_64<br/> kernel-devel-3.10.0-514.21.1.el7_lustre.x86_64<br/> kernel-tools-libs-3.10.0-514.21.1.el7_lustre.x86_64<br/> kernel-tools-debuginfo-3.10.0-514.21.1.el7_lustre.x86_64<br/> installed kernel for lustre build:<br/> 2. update zfs repo for dkms:<br/> vi /etc/yum.repos.d/zfs.repo.rpmsave<br/> 3. <span class="error">&#91;zfs&#93;</span><br/> name=ZFS on Linux for EL 7 - dkms<br/> baseurl=<a href="http://download.zfsonlinux.org/epel/7/$basearch/" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/7/$basearch/</a><br/> metadata_expire=7d<br/> gpgcheck=1<br/> gpgkey=<a href="file:///etc/pki/rpm-gpg/RPM-GPG-KEY-zfsonlinux" class="external-link" target="_blank" rel="nofollow noopener">file:///etc/pki/rpm-gpg/RPM-GPG-KEY-zfsonlinux</a></p> <p>4. hid=`[ -f /etc/hostid ] &amp;&amp; od -An -tx /etc/hostid|sed 's/ //g'`<br/> [ "$hid" = `hostid` ] || genhostid<br/> 5. yum -y install <a href="http://download.zfsonlinux.org/epel/zfs-release.el7_3.noarch.rpm" class="external-link" target="_blank" rel="nofollow noopener">http://download.zfsonlinux.org/epel/zfs-release.el7_3.noarch.rpm</a><br/> 6. yum clean all<br/> 7. yum install spl-dkms zfs-dkms<br/> 8. yum install lustre*rpm --skip-broken<br/> dkms status<br/> lustre, 2.10.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed<br/> spl, 0.7.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed<br/> zfs, 0.7.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed</p> <p>However, not able to run the zfs commands like zpool:<br/> mds-201 x86_64]# zpool<br/> -bash: zpool: command not found<br/> we intend to use zfs version 0.7 for mdt performance improvement..</p> <p>thanks,<br/> Abe</p> <p>One of the side-effects of using DKMS is that it only builds the kernel modules – all of the user-space tools need to be installed as well. I thought that when the spl-dkms and zfs-dkms RPMs were installed, YUM would have also installed the user-space packages as dependencies but that does not seem to have happened. </p> <p>The following command should rectify the problem:</p> <p>yum -y install zfs</p> <p>In fact, I double-checked on my lab system, and it looks like all of the required packages are dependencies of zfs, so the above command should be all that is ever required, even on a clean system.</p> <p>On step 8, the <tt>--skip-broken</tt> flag should not be required. This implies that some of the required packages are not being installed. Can you share what happens when the --skip-broken flag is not used?</p> <p> </p> <p>when --skip-broken flag is not set, install fails due to kmod-lustre-tests rpm missing,<br/> if we trying to kmod-lustre-tests rpm it also fails due to incompability..</p> <p>OSS1-A212 x86_64]# yum install lustre*rpm<br/> Loaded plugins: fastestmirror<br/> Examining lustre-2.10.0-1.el7.x86_64.rpm: lustre-2.10.0-1.el7.x86_64<br/> Marking lustre-2.10.0-1.el7.x86_64.rpm to be installed<br/> Examining lustre-debuginfo-2.10.0-1.el7.x86_64.rpm: lustre-debuginfo-2.10.0-1.el7.x86_64<br/> Marking lustre-debuginfo-2.10.0-1.el7.x86_64.rpm to be installed<br/> Examining lustre-dkms-2.10.0-1.el7.noarch.rpm: lustre-dkms-2.10.0-1.el7.noarch<br/> Marking lustre-dkms-2.10.0-1.el7.noarch.rpm to be installed<br/> Examining lustre-iokit-2.10.0-1.el7.x86_64.rpm: lustre-iokit-2.10.0-1.el7.x86_64<br/> Marking lustre-iokit-2.10.0-1.el7.x86_64.rpm to be installed<br/> Examining lustre-osd-zfs-mount-2.10.0-1.el7.x86_64.rpm: lustre-osd-zfs-mount-2.10.0-1.el7.x86_64<br/> Marking lustre-osd-zfs-mount-2.10.0-1.el7.x86_64.rpm to be installed<br/> Examining lustre-resource-agents-2.10.0-1.el7.x86_64.rpm: lustre-resource-agents-2.10.0-1.el7.x86_64<br/> Marking lustre-resource-agents-2.10.0-1.el7.x86_64.rpm to be installed<br/> Examining lustre-tests-2.10.0-1.el7.x86_64.rpm: lustre-tests-2.10.0-1.el7.x86_64<br/> Marking lustre-tests-2.10.0-1.el7.x86_64.rpm to be installed<br/> Resolving Dependencies<br/> --&gt; Running transaction check<br/> ---&gt; Package lustre.x86_64 0:2.10.0-1.el7 will be installed<br/> ---&gt; Package lustre-debuginfo.x86_64 0:2.10.0-1.el7 will be installed<br/> ---&gt; Package lustre-dkms.noarch 0:2.10.0-1.el7 will be installed<br/> ---&gt; Package lustre-iokit.x86_64 0:2.10.0-1.el7 will be installed<br/> ---&gt; Package lustre-osd-zfs-mount.x86_64 0:2.10.0-1.el7 will be installed<br/> ---&gt; Package lustre-resource-agents.x86_64 0:2.10.0-1.el7 will be installed<br/> ---&gt; Package lustre-tests.x86_64 0:2.10.0-1.el7 will be installed<br/> --&gt; Processing Dependency: kmod-lustre-tests = 2.10.0 for package: lustre-tests-2.10.0-1.el7.x86_64<br/> Loading mirror speeds from cached hostfile</p> <ul> <li>base: centos.sonn.com</li> <li>epel: linux.mirrors.es.net</li> <li>extras: mirror.raystedman.net</li> <li>updates: mirrors.unifiedlayer.com<br/> --&gt; Processing Dependency: attr for package: lustre-tests-2.10.0-1.el7.x86_64<br/> --&gt; Processing Dependency: libmpi.so.1()(64bit) for package: lustre-tests-2.10.0-1.el7.x86_64<br/> --&gt; Running transaction check<br/> ---&gt; Package attr.x86_64 0:2.4.46-12.el7 will be installed<br/> ---&gt; Package compat-openmpi16.x86_64 0:1.6.4-10.3.el7 will be installed<br/> --&gt; Processing Dependency: environment-modules for package: compat-openmpi16-1.6.4-10.3.el7.x86_64<br/> --&gt; Processing Dependency: libosmcomp.so.3()(64bit) for package: compat-openmpi16-1.6.4-10.3.el7.x86_64<br/> --&gt; Processing Dependency: libhwloc.so.5()(64bit) for package: compat-openmpi16-1.6.4-10.3.el7.x86_64<br/> --&gt; Processing Dependency: libesmtp.so.6()(64bit) for package: compat-openmpi16-1.6.4-10.3.el7.x86_64<br/> ---&gt; Package lustre-tests.x86_64 0:2.10.0-1.el7 will be installed<br/> --&gt; Processing Dependency: kmod-lustre-tests = 2.10.0 for package: lustre-tests-2.10.0-1.el7.x86_64<br/> --&gt; Running transaction check<br/> ---&gt; Package environment-modules.x86_64 0:3.2.10-10.el7 will be installed<br/> ---&gt; Package hwloc-libs.x86_64 0:1.11.2-1.el7 will be installed<br/> ---&gt; Package libesmtp.x86_64 0:1.0.6-7.el7 will be installed<br/> ---&gt; Package lustre-tests.x86_64 0:2.10.0-1.el7 will be installed<br/> --&gt; Processing Dependency: kmod-lustre-tests = 2.10.0 for package: lustre-tests-2.10.0-1.el7.x86_64<br/> ---&gt; Package opensm-libs.x86_64 0:3.3.19-1.el7 will be installed<br/> --&gt; Finished Dependency Resolution<br/> Error: Package: lustre-tests-2.10.0-1.el7.x86_64 (/lustre-tests-2.10.0-1.el7.x86_64)<br/> Requires: kmod-lustre-tests = 2.10.0<br/> You could try using --skip-broken to work around the problem <ul> <li>Found 5 pre-existing rpmdb problem(s), 'yum check' output follows:<br/> openmpi_gcc-1.10.4-9.x86_64 has missing requires of libosmcomp.so.3()(64bit)<br/> openmpi_gcc-1.10.4-9.x86_64 has missing requires of libpapi.so.5.2.0.0()(64bit)<br/> openmpi_gcc_hfi-1.10.4-9.x86_64 has missing requires of libosmcomp.so.3()(64bit)<br/> openmpi_gcc_hfi-1.10.4-9.x86_64 has missing requires of libpapi.so.5.2.0.0()(64bit)<br/> openshmem_gcc_hfi-1.0h-20.x86_64 has missing requires of elfutils-libelf-devel</li> </ul> </li> </ul> <p><span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># yum install kmod-lustre-tests-2.10.0-1.el7.x86_64.rpm<br/> Loaded plugins: fastestmirror<br/> Examining kmod-lustre-tests-2.10.0-1.el7.x86_64.rpm: kmod-lustre-tests-2.10.0-1.el7.x86_64<br/> Marking kmod-lustre-tests-2.10.0-1.el7.x86_64.rpm to be installed<br/> Resolving Dependencies<br/> --&gt; Running transaction check<br/> ---&gt; Package kmod-lustre-tests.x86_64 0:2.10.0-1.el7 will be installed<br/> --&gt; Processing Dependency: kernel(current_task) = 0xd5026ba3 for package: kmod-lustre-tests-2.10.0-1.el7.x86_64<br/> Loading mirror speeds from cached hostfile</p> <ul> <li>base: centos.sonn.com</li> <li>epel: linux.mirrors.es.net</li> <li>extras: mirror.raystedman.net</li> </ul> <p>....<br/> Available: kernel-debug-3.10.0-514.10.2.el7.x86_64 (updates)<br/> kernel(module_layout) = 0xa3173bd4<br/> Available: kernel-debug-3.10.0-514.16.1.el7.x86_64 (updates)<br/> kernel(module_layout) = 0xa3173bd4<br/> Available: kernel-debug-3.10.0-514.21.1.el7.x86_64 (updates)<br/> kernel(module_layout) = 0xa3173bd4<br/> Available: kernel-debug-3.10.0-514.21.2.el7.x86_64 (updates)<br/> kernel(module_layout) = 0xa3173bd4<br/> Available: kernel-debug-3.10.0-514.26.1.el7.x86_64 (updates)<br/> kernel(module_layout) = 0xa3173bd4<br/> Available: kernel-debug-3.10.0-514.26.2.el7.x86_64 (updates)<br/> kernel(module_layout) = 0xa3173bd4<br/> You could try using --skip-broken to work around the problem</p> <ul> <li> <ul> <li>Found 5 pre-existing rpmdb problem(s), 'yum check' output follows:<br/> openmpi_gcc-1.10.4-9.x86_64 has missing requires of libosmcomp.so.3()(64bit)<br/> openmpi_gcc-1.10.4-9.x86_64 has missing requires of libpapi.so.5.2.0.0()(64bit)<br/> openmpi_gcc_hfi-1.10.4-9.x86_64 has missing requires of libosmcomp.so.3()(64bit)<br/> openmpi_gcc_hfi-1.10.4-9.x86_64 has missing requires of libpapi.so.5.2.0.0()(64bit)<br/> openshmem_gcc_hfi-1.0h-20.x86_64 has missing requires of elfutils-libelf-devel</li> </ul> </li> </ul> <p>Hi Malcolm,<br/> I think that this lustre release has been compiled with zfs version 0.6.5.9 and not zfs 0.7 hence<br/> the mismatch problems..<br/> should we install zfs 0.6.5.9 first and they try to install zfs 0.7 version with dkms ?</p> <p>thanks,<br/> Abe</p> <p>Don't try to install all of the RPMs in the Lustre repository – you end up installing more than you are likely to need. Also, if you don't resolve the dependencies, then some of the packages will fail to work – the Lustre tests have applications that use MPI, for example. I'd suggest not installing the lustre test packages unless specifically required for the server, and if they are required, then also install the dependencies.</p> <p>When using the DKMS packages, you have to use the DKMS kernel modules for Lustre as well. There's a known issue with the kmod-lustre-sd-zfs RPM in the download directory and it will not work properly with ZFS on Linux RPMs.</p> <p>Instead, I would recommend installing the following Lustre server packages (after installing ZFS DKMS):</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">lustre-dkms-2.10.0-1.el7.noarch.rpm lustre-osd-zfs-mount-2.10.0-1.el7.x86_64.rpm lustre-2.10.0-1.el7.x86_64.rpm lustre-resource-agents-2.10.0-1.el7.x86_64.rpm </pre> </div></div> <p>The lustre-dkms package will compile and install the kernel modules, and the other packages will install the Lustre user-space utilities. </p> <p>Hi Malcolm,</p> <p>the suggested lustre rpm install worked fine, however not able to run zfs commands ..<br/> Is there an issue with zfs 0.7 ?<br/> oot@OSS1-A212 x86_64]# modprobe lustre<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># modprobe lnet<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># lctl network up<br/> LNET configured<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># lctl list_nids<br/> 10.10.10.212@o2ib<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># zpool<br/> -bash: zpool: command not found<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># pwd<br/> /root/lustre-2.10/downloads.hpdd.intel.com/public/lustre/latest-feature-release/el7/server/RPMS/x86_64<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># dkms status<br/> lustre, 2.10.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed<br/> spl, 0.7.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed<br/> zfs, 0.7.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># zpool<br/> -bash: zpool: command not found<br/> <span class="error">&#91;root@OSS1-A212 x86_64&#93;</span># mkfs<br/> Usage:<br/> mkfs <span class="error">&#91;options&#93;</span> <span class="error">&#91;-t &lt;type&gt;&#93;</span> <span class="error">&#91;fs-options&#93;</span> &lt;device&gt; <span class="error">&#91;&lt;size&gt;&#93;</span></p> <p>Options:<br/> -t, --type=&lt;type&gt; filesystem type; when unspecified, ext2 is used<br/> fs-options parameters for the real filesystem builder</p> <p>thanks,<br/> Abe</p> <p>Hi Malcolm,<br/> just wondering if zfs 0.7 has been integrated with Lustre 2.10 ?</p> <p>thanks,<br/> Abe</p> <p>Hi Malcolm,<br/> I have downgraded spl/zfs to version 0.6.5.9 and re-built lustre 2.10 with dkms <br/> and sill not able to run zfs command lines, is this a know issue with lustre 2.10 ?<br/> are you seeing this problem on your setup ?</p> <p>dkms status<br/> lustre, 2.10.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed<br/> spl, 0.6.5.9, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed<br/> zfs, 0.6.5.9, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed<br/> <span class="error">&#91;root@OSS1-A212 ~&#93;</span># zpool<br/> -bash: zpool: command not found<br/> <span class="error">&#91;root@OSS1-A212 ~&#93;</span># mkfs<br/> Usage:<br/> mkfs <span class="error">&#91;options&#93;</span> <span class="error">&#91;-t &lt;type&gt;&#93;</span> <span class="error">&#91;fs-options&#93;</span> &lt;device&gt; <span class="error">&#91;&lt;size&gt;&#93;</span></p> <p>Options:<br/> -t, --type=&lt;type&gt; filesystem type; when unspecified, ext2 is used<br/> fs-options parameters for the real filesystem builder<br/> &lt;device&gt; path to the device to be used<br/> &lt;size&gt; number of blocks to be used on the device<br/> -V, --verbose explain what is being done;<br/> specifying -V more than once will cause a dry-run<br/> -V, --version display version information and exit;<br/> -V as --version must be the only option<br/> -h, --help display this help text and exit</p> <p>For more information see mkfs(8).</p> <p>thanks,<br/> Abe</p> <p>DKMS does not install user-space commands, it only compiles and installs the kernel modules. This is not a Lustre issue. You just need to install the additional packages that have the command-line utilities.</p> <p>Use the following command to install ZFS:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">yum install zfs </pre> </div></div> <p>This will resolve all of the dependencies, including the user-space packages that contain the <tt>zfs</tt> and <tt>zpool</tt> command lines.</p> <p>Then use something like the following command to install Lustre:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">yum localinstall \ lustre-dkms-2.10.0-1.el7.noarch.rpm \ lustre-osd-zfs-mount-2.10.0-1.el7.x86_64.rpm \ lustre-2.10.0-1.el7.x86_64.rpm \ lustre-resource-agents-2.10.0-1.el7.x86_64.rpm </pre> </div></div> <p>This will install the kernel modules using DKMS, plus the Lustre user-space utilities and ZFS OSD mount support. The above command assumes that the packages have been downloaded to a local directory. Otherwise amend the command to use <tt>install</tt> instead of <tt>localinstall</tt>. </p> <p>I strongly recommend using the latest ZFS version (0.7.0) in order to get the benefit of the metadata performance improvements.</p> <p> </p> <p>it works now, have the 0.7 zfs/spl on another node.<br/> after adding user space packages via yum install zfs<br/> We definitely need the 0.7 version for metadata performance impovements..</p> <p> dkms status<br/> lustre, 2.10.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed<br/> spl, 0.7.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed<br/> zfs, 0.7.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed</p> <p>I think we can close this ticket now..</p> <p>@mgs-200 ~]# zpool<br/> missing command<br/> usage: zpool command args ...<br/> where 'command' is one of the following:</p> <p> create <span class="error">&#91;-fnd&#93;</span> <span class="error">&#91;-o property=value&#93;</span> ...<br/> <span class="error">&#91;-O file-system-property=value&#93;</span> ...<br/> <span class="error">&#91;-m mountpoint&#93;</span> <span class="error">&#91;-R root&#93;</span> &lt;pool&gt; &lt;vdev&gt; ...<br/> destroy <span class="error">&#91;-f&#93;</span> &lt;pool&gt;</p> <p>thank you Malcolm,<br/> Abe</p> <p>Hi Abe,</p> <p>Thanks for the update. Glad to hear you've achieved a successful outcome.</p> <p>Customer success in installing Lustre + ZFS. Closing per customer recommendation.</p> Development Rank 1|hzzhcf: Rank (Obsolete) 9223372036854775807 Severity