<!-- 
RSS generated by JIRA (9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c) at Sat Feb 10 03:13:58 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>Whamcloud Community JIRA</title>
    <link>https://jira.whamcloud.com</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.4.14</version>
        <build-number>940014</build-number>
        <build-date>05-12-2023</build-date>
    </build-info>


<item>
            <title>[LU-14927] osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)</title>
                <link>https://jira.whamcloud.com/browse/LU-14927</link>
                <project id="10000" key="LU">Lustre</project>
                    <description>&lt;p&gt;&lt;tt&gt;osd-zfs&lt;/tt&gt; module is not loading anymore since a kernel commit was merged in 5.9 and is now backported to 4.14 branch. This prevents using ZFS with Lustre, from &lt;tt&gt;2.12&lt;/tt&gt; up to &lt;tt&gt;master&lt;/tt&gt;.&lt;/p&gt;

&lt;p&gt;This is due to a stronger module license check and EXPORT_SYMBOL_GPL. ZFS is CDDL and as osd-zfs depends on it, it is inheriting is taint, preventing it from using GPL-only symbols.&lt;/p&gt;

&lt;p&gt;Here is the original commit: &lt;a href=&quot;https://github.com/torvalds/linux/commit/262e6ae7081df304fc625cf368d5c2cbba2bb991&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/torvalds/linux/commit/262e6ae7081df304fc625cf368d5c2cbba2bb991&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Backported to stable branch 4.14, and 5.4 (at least)&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Reproduced with Lustre &lt;tt&gt;master&lt;/tt&gt; branch and ZFS 2.0.5:&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;4.14.232: OK&lt;/li&gt;
&lt;/ul&gt;


&lt;ul&gt;
	&lt;li&gt;4.14.238: Error
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt;$ sudo LOAD=: FSTYPE=zfs ./lustre/tests/llmount.sh
Loading modules from /home/ec2-user/lustre/lustre/tests/..
detected 16 online CPUs by sysfs
libcfs will create CPU partition based on online CPUs
libkmod: kmod_module_get_holders: could not open &apos;/sys/module/pcc_cpufreq/holders&apos;: No such file or directory
libkmod: kmod_module_get_holders: could not open &apos;/sys/module/amd64_edac_mod/holders&apos;: No such file or directory
quota/lquota options: &apos;hash_lqs_cur_bits=3&apos;
$ dmesg | tail -n5
[ 1844.388948] ZFS: Loaded module v2.0.5-1, ZFS pool version 5000, ZFS filesystem version 5
[ 1844.400002] osd_zfs: module uses symbols from proprietary module zfs, inheriting taint.
[ 1844.403770] osd_zfs: Unknown symbol ktime_get_real_seconds (err 0)
[ 1844.406319] osd_zfs: Unknown symbol init_user_ns (err 0)
[ 1844.408548] osd_zfs: Unknown symbol ktime_get_seconds (err 0)
&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;&#160;&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;&#160;Not a problem with 2.10, likely because the patch which introduced this symbol was merged in 2.11: &lt;a href=&quot;https://review.whamcloud.com/#/c/29857/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/#/c/29857/&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</description>
                <environment></environment>
        <key id="65601">LU-14927</key>
            <summary>osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)</summary>
                <type id="1" iconUrl="https://jira.whamcloud.com/secure/viewavatar?size=xsmall&amp;avatarId=11303&amp;avatarType=issuetype">Bug</type>
                                            <priority id="4" iconUrl="https://jira.whamcloud.com/images/icons/priorities/minor.svg">Minor</priority>
                        <status id="5" iconUrl="https://jira.whamcloud.com/images/icons/statuses/resolved.png" description="A resolution has been taken, and it is awaiting verification by reporter. From here issues are either reopened, or are closed.">Resolved</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="1">Fixed</resolution>
                                        <assignee username="simmonsja">James A Simmons</assignee>
                                    <reporter username="degremoa">Aurelien Degremont</reporter>
                        <labels>
                    </labels>
                <created>Wed, 11 Aug 2021 09:26:18 +0000</created>
                <updated>Thu, 25 Jan 2024 14:58:05 +0000</updated>
                            <resolved>Sat, 20 Nov 2021 14:15:14 +0000</resolved>
                                    <version>Lustre 2.13.0</version>
                    <version>Lustre 2.14.0</version>
                    <version>Lustre 2.12.7</version>
                                    <fixVersion>Lustre 2.15.0</fixVersion>
                                        <due></due>
                            <votes>0</votes>
                                    <watches>8</watches>
                                                                            <comments>
                            <comment id="309895" author="simmonsja" created="Wed, 11 Aug 2021 12:33:48 +0000"  >&lt;p&gt;This is going to become a really huge problem in the future. The kernel has been moving ALL its core functionality it GPL only. I could see hello_world as the only non GPL supported module in the future. We are going to have to really trim down the OSD modules to the bare minimum.&lt;/p&gt;</comment>
                            <comment id="309900" author="degremoa" created="Wed, 11 Aug 2021 12:54:34 +0000"  >&lt;p&gt;You are working with upstream kernel way more than me, so I assume you&apos;re right, but I don&apos;t see how we could fix that with a minimum OSD modules.&lt;/p&gt;</comment>
                            <comment id="309906" author="simmonsja" created="Wed, 11 Aug 2021 14:15:34 +0000"  >&lt;p&gt;We do a lot of state management for the OSD drivers which is currently touching core kernel functionality. Thinks like scrub which needs to use the kernel time API and procfs / sysfs for our tunables. To avoid this tainted issue we need to approach this like NVIDIA does with its shim layer which has no core kernel functionality to interface with another module that does. This way osd-zfs ends up being just ZFS specific handling and higher layer modules do the rest of the state management.&#160;&lt;/p&gt;</comment>
                            <comment id="309907" author="simmonsja" created="Wed, 11 Aug 2021 14:16:15 +0000"  >&lt;p&gt;This is going to take awhile to work out.&lt;/p&gt;</comment>
                            <comment id="309911" author="degremoa" created="Wed, 11 Aug 2021 14:49:32 +0000"  >&lt;p&gt;Do you have a rough plan, even if lots of work, or everything has to be designed?&lt;/p&gt;

&lt;p&gt;Also, seeing the philosophy behind the kernel commits, it is possible that even a shim module will eventually be target of new patches... We need to be careful. Things like NVidia driver is definitely a target for this kind of patches.&lt;/p&gt;</comment>
                            <comment id="309916" author="simmonsja" created="Wed, 11 Aug 2021 15:06:13 +0000"  >&lt;p&gt;I have been looking at the osd-zfs code. From what I see I think we are looking at ~5 patches to get everything working again. Most don&apos;t look too difficult to work. The tricking one is the scrub kthread defined in the OSD drivers. We will need to move all the thread handing to the scrub.c in obdclass.&#160;&lt;/p&gt;</comment>
                            <comment id="310051" author="adilger" created="Thu, 12 Aug 2021 10:30:27 +0000"  >&lt;p&gt;It is trivial to replace &lt;tt&gt;ktime_get_real_seconds()&lt;/tt&gt; with &lt;tt&gt;ktime_get_real_ts64()&lt;/tt&gt; for the timestamps.  These are only coarse stats (seconds), so using &lt;tt&gt;tv_sec&lt;/tt&gt; is enough.&lt;/p&gt;

&lt;p&gt;However, I&apos;m not sure where &lt;tt&gt;init_user_ns&lt;/tt&gt; is being used.  Probably via some other inline kernel function/macro?&lt;/p&gt;</comment>
                            <comment id="310073" author="degremoa" created="Thu, 12 Aug 2021 15:10:07 +0000"  >&lt;p&gt;Nice, I didn&apos;t spot that some calls in &lt;tt&gt;time.h&lt;/tt&gt; are not GPL-exported. Some relies on CLOCK_MONOTONIC, we need to check if we can get that with some other calls. I&apos;m not very familiar with the GPL/non-GPL export story. I don&apos;t know why some calls are and others are not.&lt;/p&gt;</comment>
                            <comment id="310088" author="simmonsja" created="Thu, 12 Aug 2021 17:01:18 +0000"  >&lt;p&gt;Also the project quota stuff is being used. While ktime_get_real_ts64() is a stop gap I suspect it will be a temporary solution.&lt;/p&gt;</comment>
                            <comment id="310490" author="gerrit" created="Tue, 17 Aug 2021 22:29:44 +0000"  >&lt;p&gt;&quot;James Simmons &amp;lt;jsimmons@infradead.org&amp;gt;&quot; uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/44689&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/44689&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14927&quot; title=&quot;osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14927&quot;&gt;&lt;del&gt;LU-14927&lt;/del&gt;&lt;/a&gt; scrub: create shared scrub_needs_check() function.&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: d3b04a01506a5e08c80dcd81fdb630d0338f7048&lt;/p&gt;</comment>
                            <comment id="310493" author="gerrit" created="Tue, 17 Aug 2021 22:37:22 +0000"  >&lt;p&gt;&quot;James Simmons &amp;lt;jsimmons@infradead.org&amp;gt;&quot; uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/44690&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/44690&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14927&quot; title=&quot;osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14927&quot;&gt;&lt;del&gt;LU-14927&lt;/del&gt;&lt;/a&gt; osd: share brw_stats code between OSD back ends.&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 7f50c62bb81682d036f9a058487c5675b42c8576&lt;/p&gt;</comment>
                            <comment id="310599" author="gerrit" created="Wed, 18 Aug 2021 18:13:03 +0000"  >&lt;p&gt;&quot;James Simmons &amp;lt;jsimmons@infradead.org&amp;gt;&quot; uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/44705&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/44705&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14927&quot; title=&quot;osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14927&quot;&gt;&lt;del&gt;LU-14927&lt;/del&gt;&lt;/a&gt; scrub: share osd_scrub&lt;span class=&quot;error&quot;&gt;&amp;#91;prep|post&amp;#93;&lt;/span&gt; code&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 7006b1c5d076fa99b109117c37232a5b19c7f5ce&lt;/p&gt;</comment>
                            <comment id="310685" author="simmonsja" created="Thu, 19 Aug 2021 18:38:56 +0000"  >&lt;p&gt;Do you know which distro have been impacted and what kernel version for the distro things started to break?&lt;/p&gt;</comment>
                            <comment id="310736" author="degremoa" created="Fri, 20 Aug 2021 08:30:26 +0000"  >&lt;p&gt;Amazon Linux uses the latest upstream longterm kernels and these patches have been backported to 4.14.x and 5.4.x branches (see description for the kernel version). Ubuntu also uses these backports but after some discussion with Greg KH, they decided to revert them. So Ubuntu is not impacted yet.&lt;/p&gt;

&lt;p&gt;Don&apos;t know for RHEL but there are usually conservative, so I expect these patches to take more time to reach RHEL kernels.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="310918" author="gerrit" created="Mon, 23 Aug 2021 22:01:28 +0000"  >&lt;p&gt;&quot;James Simmons &amp;lt;jsimmons@infradead.org&amp;gt;&quot; uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/44735&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/44735&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14927&quot; title=&quot;osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14927&quot;&gt;&lt;del&gt;LU-14927&lt;/del&gt;&lt;/a&gt; quota: move qsd_transfer to lquota module&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: c514c6e881ae831a3650381bb741221449218784&lt;/p&gt;</comment>
                            <comment id="311651" author="gerrit" created="Tue, 31 Aug 2021 05:20:58 +0000"  >&lt;p&gt;&quot;Oleg Drokin &amp;lt;green@whamcloud.com&amp;gt;&quot; merged in patch &lt;a href=&quot;https://review.whamcloud.com/44705/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/44705/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14927&quot; title=&quot;osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14927&quot;&gt;&lt;del&gt;LU-14927&lt;/del&gt;&lt;/a&gt; scrub: share osd_scrub&lt;span class=&quot;error&quot;&gt;&amp;#91;prep|post&amp;#93;&lt;/span&gt; code&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: dd505aafd833f2dda274d83332e415d739da1d52&lt;/p&gt;</comment>
                            <comment id="311723" author="pjones" created="Tue, 31 Aug 2021 16:50:43 +0000"  >&lt;p&gt;Landed for 2.15&lt;/p&gt;</comment>
                            <comment id="311725" author="simmonsja" created="Tue, 31 Aug 2021 16:53:11 +0000"  >&lt;p&gt;Only one patch landed. We have two more to go.&lt;/p&gt;</comment>
                            <comment id="314304" author="gerrit" created="Wed, 29 Sep 2021 16:48:17 +0000"  >&lt;p&gt;&quot;James Simmons &amp;lt;jsimmons@infradead.org&amp;gt;&quot; uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/45093&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/45093&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14927&quot; title=&quot;osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14927&quot;&gt;&lt;del&gt;LU-14927&lt;/del&gt;&lt;/a&gt; zfs: debug code&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 736c53baa13277424de5be86ef174f5faf741c38&lt;/p&gt;</comment>
                            <comment id="315131" author="gerrit" created="Sun, 10 Oct 2021 03:31:39 +0000"  >&lt;p&gt;&quot;Oleg Drokin &amp;lt;green@whamcloud.com&amp;gt;&quot; merged in patch &lt;a href=&quot;https://review.whamcloud.com/44689/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/44689/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14927&quot; title=&quot;osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14927&quot;&gt;&lt;del&gt;LU-14927&lt;/del&gt;&lt;/a&gt; scrub: create shared scrub_needs_check() function.&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: 882a9f784de27bb6043345316ed3f5f4835a9bbf&lt;/p&gt;</comment>
                            <comment id="315148" author="simmonsja" created="Sun, 10 Oct 2021 13:42:29 +0000"  >&lt;p&gt;One more patch&lt;/p&gt;</comment>
                            <comment id="316632" author="gerrit" created="Wed, 27 Oct 2021 00:37:26 +0000"  >&lt;p&gt;&quot;Oleg Drokin &amp;lt;green@whamcloud.com&amp;gt;&quot; merged in patch &lt;a href=&quot;https://review.whamcloud.com/44735/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/44735/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14927&quot; title=&quot;osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14927&quot;&gt;&lt;del&gt;LU-14927&lt;/del&gt;&lt;/a&gt; quota: move qsd_transfer to lquota module&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: d2e8208e22f21bb7354a9207f381217c222d3df3&lt;/p&gt;</comment>
                            <comment id="316645" author="simmonsja" created="Wed, 27 Oct 2021 02:11:36 +0000"  >&lt;p&gt;Still one more patch.&lt;/p&gt;</comment>
                            <comment id="318734" author="gerrit" created="Sat, 20 Nov 2021 06:25:31 +0000"  >&lt;p&gt;&quot;Oleg Drokin &amp;lt;green@whamcloud.com&amp;gt;&quot; merged in patch &lt;a href=&quot;https://review.whamcloud.com/44690/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/44690/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-14927&quot; title=&quot;osd-zfs could not be loaded on 4.14+ and 5.9+ (gpl issue)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-14927&quot;&gt;&lt;del&gt;LU-14927&lt;/del&gt;&lt;/a&gt; osd: share brw_stats code between OSD back ends.&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: 8a84c7f9c7d65f6f880be6fe4d94fca26a405d81&lt;/p&gt;</comment>
                            <comment id="318770" author="simmonsja" created="Sat, 20 Nov 2021 14:15:14 +0000"  >&lt;p&gt;Proper support for ZFS has been restored.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Related</name>
                                                                <inwardlinks description="is related to">
                                                        </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                            <customfield id="customfield_10890" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10390" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i021hr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10090" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10060" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Severity</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10022"><![CDATA[3]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        </customfields>
    </item>
</channel>
</rss>