Whamcloud Community JIRA https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 [LU-6152] zfs large block support https://jira.whamcloud.com/browse/LU-6152 Lustre <p>upstream zfs is about to land large block support (&gt; 128k). see <a href="https://github.com/zfsonlinux/zfs/pull/2865" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/zfsonlinux/zfs/pull/2865</a></p> <p>Lustre need to change to be able to compile with zfs.</p> LU-6152 zfs large block support Improvement Minor Resolved Fixed Nathaniel Clark Minh Diep Fri, 23 Jan 2015 20:49:54 +0000 Fri, 1 Jul 2016 18:46:27 +0000 Tue, 12 May 2015 15:34:28 +0000 Lustre 2.8.0 0 8 <p>Brian Behlendorf (behlendorf1@llnl.gov) uploaded a new patch: <a href="http://review.whamcloud.com/13544" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/13544</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6152" title="zfs large block support" class="issue-link" data-issue-key="LU-6152"><del>LU-6152</del></a> osd-zfs: ZFS large block compat<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: f5bab98f77036493bd96c2b05a19247d15fab328</p> <p>When installing RPMs built with patch and linked against the ZFS on Linux master built with the <span class="error">&#91;large block patch https://github.com/zfsonlinux/zfs/pull/2865&#93;</span>, I'm receiving the following warning. I have not tested the Lustre build, but I'm suspicious that I'm about to see errors.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> Installing : lustre-osd-zfs-2.6.92-3.10.65_g98c5043.x86_64 WARNING: /lib/modules/3.10.65/extra/kernel/fs/lustre/osd_zfs.ko needs unknown symbol spa_maxblocksize </pre> </div></div> <p>Confirmed. After successfully mounting a ZFS-backed MDT, attempting to mount a ZFS-backed OST gives the following error and related <tt>dmesg</tt> output</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">[root@seahorse-oss-19-2 ~]# mount -t lustre ost0/ost0 /mnt/ost0 mount.lustre: mount ost0/ost0 at /mnt/ost0 failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems </pre> </div></div> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">osd_zfs: Unknown symbol spa_maxblocksize (err 0) osd_zfs: Unknown symbol spa_maxblocksize (err 0) LustreError: 158-c: Can<span class="code-quote">'t load module '</span>osd-zfs' LustreError: Skipped 1 previous similar message LustreError: 15813:0:(genops.c:312:class_newdev()) OBD: unknown type: osd-zfs LustreError: 15813:0:(genops.c:312:class_newdev()) Skipped 1 previous similar message LustreError: 15813:0:(obd_config.c:369:class_attach()) Cannot create device ddragon-OST0000-osd of type osd-zfs : -19 LustreError: 15813:0:(obd_config.c:369:class_attach()) Skipped 1 previous similar message LustreError: 15813:0:(obd_mount.c:199:lustre_start_simple()) ddragon-OST0000-osd attach error -19 LustreError: 15813:0:(obd_mount.c:199:lustre_start_simple()) Skipped 1 previous similar message LustreError: 15813:0:(obd_mount_server.c:1750:server_fill_super()) Unable to start osd on ost0/ost0: -19 LustreError: 15813:0:(obd_mount_server.c:1750:server_fill_super()) Skipped 1 previous similar message LustreError: 15813:0:(obd_mount.c:1340:lustre_fill_super()) Unable to mount (-19) LustreError: 15813:0:(obd_mount.c:1340:lustre_fill_super()) Skipped 1 previous similar message </pre> </div></div> <p>A diff of the currents state of my source tree and the configure and build commands. I'm going to look at the <tt>LB_CHECK_COMPILE</tt> macro.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">$ ./configure --with-zfs=/usr/src/zfs-0.6.3 --with-spl=/usr/src/spl-0.6.3 --with-linux=/usr/src/linux-3.10 --without-ldiskfs --with-linux-config=/boot/config-3.10.65 $ make rpms </pre> </div></div> <p>The config step did not detect <tt>spa_maxblocksize</tt>, so the <tt>LB_CHECK_COMPILE</tt> macro is failing. Next step is for me is to see if config and my build of ZFS are correct.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">configure:26062: checking <span class="code-keyword">if</span> zfs defines spa_maxblocksize WARNING: <span class="code-quote">"spa_maxblocksize"</span> [/home/build/lustre-release/build/conftest.ko] undefined! lb_cv_compile_spa_maxblocksize=yes </pre> </div></div> <p>I believe I found the issue: <tt>spa_maxblocksize</tt> was not exported in <tt>spa_misc.c</tt> from ZFS. I've rebuilt ZFS and successfully mount a ZFS-backed MDT and OST. I'll drop an issue at the GitHub ZFS repo.</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/13544/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/13544/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6152" title="zfs large block support" class="issue-link" data-issue-key="LU-6152"><del>LU-6152</del></a> osd-zfs: ZFS large block compat<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: bc9eae65f0880e5ae781d373f843d2c76f263714</p> <p>Landed for 2.8</p> <p>Ned Bass (bass6@llnl.gov) uploaded a new patch: <a href="http://review.whamcloud.com/14870" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/14870</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-6152" title="zfs large block support" class="issue-link" data-issue-key="LU-6152"><del>LU-6152</del></a> osd-zfs: ZFS large block compat<br/> Project: fs/lustre-release<br/> Branch: b2_5<br/> Current Patch Set: 1<br/> Commit: 77e4232d20444261dbca12f288036beb6834f05a</p> Related LU-6038 LU-4865 Development Rank 1|hzx4rj: Rank (Obsolete) 17205