Whamcloud Community JIRA

Whamcloud Community JIRA https://jira.whamcloud.com This file is an XML representation of an issue en-us

9.4.14

940014

05-12-2023

[LU-8056] Support for linux 4.5 kernels https://jira.whamcloud.com/browse/LU-8056 Lustre <p>This ticket will track the needed changes to enable lustre support with linux kernels 4.5.X</p> Lustre built against linux kernel version 4.5.X LU-8056

Support for linux 4.5 kernels

Improvement Minor Resolved Fixed James A Simmons James A Simmons Fri, 22 Apr 2016 16:13:07 +0000 Mon, 6 Mar 2017 10:07:40 +0000 Mon, 22 Aug 2016 14:37:21 +0000 Lustre 2.9.0 Lustre 2.9.0 0 9 <p>Thanks for opening a ticket to track this activity James</p> <p>Dmitry Eremin (dmitry.eremin@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/20009" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20009</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> libcfs: Support for linux 4.2 kernels<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 5bee7cfe779a0ae8e6ba2771e8c7275545031347</p> <p>Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: <a href="http://review.whamcloud.com/20221" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20221</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> o2iblnd: ib_query_device removed in 4.5<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 2a70db9bd0b6d33b5a1d9e3756a2a376e0924a5f</p> <p>Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: <a href="http://review.whamcloud.com/20222" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20222</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> socklnd: NETIF_F_ALL_CSUM renamed to NETIF_F_CSUM_MASK<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: a7f5223e622ad3aee027a1b602a37a622af26cdd</p> <p>Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: <a href="http://review.whamcloud.com/20223" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20223</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> llite: use inode_lock to access i_mutex<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 37f52d82396adc41d451a29d0b814715e0da7b50</p> <p>Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: <a href="http://review.whamcloud.com/20224" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20224</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> llite: inode_operations interface changed in 4.5<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: a711d0c976238311678c6133d7421f4bfca926d3</p> <p>Li Dongyang (dongyang.li@anu.edu.au) uploaded a new patch: <a href="http://review.whamcloud.com/20225" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20225</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> llite: POSIX_ACL_XATTR_</p> {ACCESS,DEFAULT} <p> removed in 4.5<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 1dd4e8c307251c96f85784e44761a976ae0e6671</p> <p>James Simmons (uja.ornl@yahoo.com) uploaded a new patch: <a href="http://review.whamcloud.com/20619" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20619</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> lloop: fix bio_for_each_segment_all for newer kernels<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 2864b64e1ef2541e04da4816318e3876c6f826c2</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/20009/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20009/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> libcfs: Support for linux 4.2 kernels<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: beca050380b592477153fe16b79b7b6bb3aacbf2</p> <p>Hi!</p> <p>I tryed running lustre 2.8.0 and 2.8.54 with patches using kernel 4.4, and 4.5 from mainline and lts mainline with in-kernel IB stack drivers. <br/> Doing that i get problems with writes to lustre fs. Client can only write portions that are smaller then ~32M. If i try to write files larger then this limit client will hang.</p> <p>[ 24.133660] Lustre: Lustre: Build Version: 2.8.54_1_g9b478d6<br/> [ 24.196967] Lustre: 2854:0:(client.c:2067:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: <span class="error">[sent 1466197626/real 1466197626]</span> req@ffff88086ac78000 x1537419641880592/t0(0) o250->MGC10.252.246.12@o2ib@10.252.246.12@o2ib:26/25 lens 520/544 e 0 to 1 dl 1466197631 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1<br/> [ 49.258153] Lustre: Server MGS version (2.1.0.0) is much older than client. Consider upgrading server (2.8.54_1_g9b478d6)<br/> [ 49.294582] LustreError: 2909:0:(obd_config.c:1387:class_process_proc_param()) lov: home-clilov-ffff88106c9de800 unknown param qos_threshold_rr=100<br/> [ 49.312588] LustreError: 2909:0:(obd_config.c:1392:class_process_proc_param()) lov.: error writing proc entry 'stripeoffset': rc = -34<br/> [ 49.407596] Lustre: home-clilov-ffff88106c9de800: disabling xattr cache due to unknown maximum xattr size.<br/> [ 49.425897] Lustre: Mounted home-client<br/> [ 72.514684] NFSD: starting 90-second grace period (net ffffffff81b58e00)<br/> [ 112.190423] Lustre: 2858:0:(client.c:2067:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: <span class="error">[sent 1466197698/real 1466197698]</span> req@ffff880074610600 x1537419641883984/t0(0) o4->home-OST0010-osc-ffff88106c9de800@10.252.246.18@o2ib:6/4 lens 608/448 e 0 to 1 dl 1466197714 ref 2 fl Rpc:X/0/ffffffff rc 0/-1<br/> [ 112.222944] Lustre: home-OST0010-osc-ffff88106c9de800: Connection to home-OST0010 (at 10.252.246.18@o2ib) was lost; in progress operations using this service will wait for recovery to complete<br/> [ 112.295469] Lustre: home-OST0010-osc-ffff88106c9de800: Connection restored to 10.252.246.18@o2ib (at 10.252.246.18@o2ib)<br/> [ 128.294527] Lustre: 2859:0:(client.c:2067:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: <span class="error">[sent 1466197714/real 1466197714]</span> req@ffff880074610c00 x1537419641884176/t0(0) o4->home-OST0010-osc-ffff88106c9de800@10.252.246.18@o2ib:6/4 lens 608/448 e 0 to 1 dl 1466197730 ref 2 fl Rpc:X/2/ffffffff rc -11/-1<br/> [ 128.294531] Lustre: 2857:0:(client.c:2067:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: <span class="error">[sent 1466197714/real 1466197714]</span> req@ffff880074610300 x1537419641884160/t0(0) o4->home-OST0010-osc-ffff88106c9de800@10.252.246.18@o2ib:6/4 lens 608/448 e 0 to 1 dl 1466197730 ref 2 fl Rpc:X/2/ffffffff rc -11/-1<br/> [ 128.294537] Lustre: 2857:0:(client.c:2067:ptlrpc_expire_one_request()) Skipped 2 previous similar messages<br/> [ 128.294560] Lustre: home-OST0010-osc-ffff88106c9de800: Connection to home-OST0010 (at 10.252.246.18@o2ib) was lost; in progress operations using this service will wait for recovery to complete</p> <p>Your server side is at 2.1 which is to old. You need to run a minimum 2.5 server.</p> <p>It seems not related to server side cause if i use stock centos 7.2 kernel then it works<br/> (server is 2.1.0 and client is 2.8.0). So it seems to be bug in one of patches...<br/> <span class="error">[root@backup1 ~]</span># cat /proc/fs/lustre/version <br/> lustre: 2.8.0<br/> kernel: patchless_client<br/> build: jenkins-arch=x86_64,build_type=client,distro=el7,ib_stack=inkernel-12-1-PRISTINE-3.10.0-327.18.2.el7.x86_64</p> <p>Just to add... It seems like a kernel bug what comes after linux 4.1. Since mainline kernel 4.1.27 with lustre 2.8.0 and 2.8.54 works just fine =\<br/> I'll try to bisect it.</p> <p>Seems i was wrong.. 2.8.5x doesnt work with 4.1.27 (either dont build because of bio changes, or builds but doent work i.e. can write only 32M)</p> <p>Git bissect of lustre master shows that client fails after <a href="http://review.whamcloud.com/#/c/19368/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/19368/</a> was landed</p> <p>Tests was done with 4.1.27 mainline lts kernel</p> <p>alexxy@scc-106-02 ~/Src/lustre $ git bisect log <br/> git bisect start</p> <ol> <li>good: <span class="error">[50ac302a72c91853d64469d90111cb0baf223358]</span> New version 2.8.52<br/> git bisect good 50ac302a72c91853d64469d90111cb0baf223358</li> <li>bad: <span class="error">[d5865df5c1419457d0aa7a1636aa72de499d7b38]</span> New tag 2.8.53<br/> git bisect bad d5865df5c1419457d0aa7a1636aa72de499d7b38</li> <li>good: <span class="error">[71d2ea0fde17ecde0bf237f486d4bafb5d54fe3f]</span> <a href="https://jira.whamcloud.com/browse/LU-8023" title="build problem on master due to recent change" class="issue-link" data-issue-key="LU-8023"><del>LU-8023</del></a> lbuild: add find-requires parameter to rpmbuild<br/> git bisect good 71d2ea0fde17ecde0bf237f486d4bafb5d54fe3f</li> <li>good: <span class="error">[d2a310d698df167ccb41c1ae0ac24d4ef9846f45]</span> <a href="https://jira.whamcloud.com/browse/LU-8051" title="sanity tests 300[a-i] failed, tests defects: are to be skipped for old servers" class="issue-link" data-issue-key="LU-8051"><del>LU-8051</del></a> tests: Skipping sanity tests 300<span class="error">[a-d]</span> for old servers.<br/> git bisect good d2a310d698df167ccb41c1ae0ac24d4ef9846f45</li> <li>good: <span class="error">[3cbdb896b6b380ff7c843f9a7104456e7e80b347]</span> <a href="https://jira.whamcloud.com/browse/LU-7904" title="osd_fid_lookup() should honor LOC_F_NEW" class="issue-link" data-issue-key="LU-7904"><del>LU-7904</del></a> osd: honor LOC_F_NEW<br/> git bisect good 3cbdb896b6b380ff7c843f9a7104456e7e80b347</li> <li>bad: <span class="error">[c28933602a6971739cb5ec3a1e920409ff19b01e]</span> <a href="https://jira.whamcloud.com/browse/LU-8017" title="All Nodes report NOT HEALTHY, system is healthy" class="issue-link" data-issue-key="LU-8017"><del>LU-8017</del></a> obd: report correct health state of a node<br/> git bisect bad c28933602a6971739cb5ec3a1e920409ff19b01e</li> <li>bad: <span class="error">[037202f194cfed3bd195619d374f88adbd74ea38]</span> <a href="https://jira.whamcloud.com/browse/LU-4423" title="Tracking of patches from upstream kernel to Lustre client" class="issue-link" data-issue-key="LU-4423"><del>LU-4423</del></a> libcfs: use ahash for libcfs crypto layer<br/> git bisect bad 037202f194cfed3bd195619d374f88adbd74ea38</li> <li>bad: <span class="error">[d8467ab8a2ca15fbbd5be3429c9cf9ceb0fa78b8]</span> <a href="https://jira.whamcloud.com/browse/LU-7990" title=" Large bulk IO support" class="issue-link" data-issue-key="LU-7990"><del>LU-7990</del></a> clio: revise readahead to support 16MB IO<br/> git bisect bad d8467ab8a2ca15fbbd5be3429c9cf9ceb0fa78b8</li> <li>first bad commit: <span class="error">[d8467ab8a2ca15fbbd5be3429c9cf9ceb0fa78b8]</span> <a href="https://jira.whamcloud.com/browse/LU-7990" title=" Large bulk IO support" class="issue-link" data-issue-key="LU-7990"><del>LU-7990</del></a> clio: revise readahead to support 16MB IO</li> </ol> <p>Thanks for tracking this down. This is a serious bug that could impact more than just newer kernel users. This points to the ptlrpc layer as the problem and not LNet/ko2iblnd which is good since the upstream kernel client has the same LNet stack as the Intel/OpenSFS branch. Since it is easy to reproduce can you collect debug logs. Run the command 'lctl set_param debug=all" and then lctl dk > /tmp/dump.log. Then post the log here. We will gladly work on this problem.</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/20221/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20221/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> o2iblnd: ib_query_device removed in 4.5<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 31d6445718b896290198f5d127f86c174d499c6c</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/20619/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20619/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> lloop: fix bio_for_each_segment_all for newer kernels<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 87c5e1cd7f45b336d40028af986bf09d2e4922b3</p> <p>Dump log from lustre</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/20222/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20222/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> socklnd: NETIF_F_ALL_CSUM renamed to NETIF_F_CSUM_MASK<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 11e4f77fa6c2b120864f19d27a303cdfe6f57d44</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/20223/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20223/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> llite: use inode_lock to access i_mutex<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 2c7da05ca58b4146fa47cfcbc86de51099cf452a</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/20224/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20224/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> llite: inode_operations interface changed in 4.5<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: e8e440b36aaf8e45649e72f7a92d2ebc1ae8d874</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/20225/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/20225/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> llite: POSIX_ACL_XATTR_</p> {ACCESS,DEFAULT} <p> removed in 4.5<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 7af958a556ef2be0219ba279631b05a7b2a58cee</p> <p>One last patch to push for the ChangeLog.</p> <p>James Simmons (uja.ornl@yahoo.com) uploaded a new patch: <a href="http://review.whamcloud.com/21453" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21453</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> lprocfs: treat seq_printf as void function<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 6e6b2f9ec8f4dfdc5ae85c0522a2fce65ae520c6</p> <p>James Simmons (uja.ornl@yahoo.com) uploaded a new patch: <a href="http://review.whamcloud.com/21454" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21454</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> xattr: update server code for POSIX xattr rename<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 3890149aa255340bcfa2c2a1cec3580116f90fa1</p> <p>I gave the latest master a run using ZFS with a linux 4.5.7 kernel and found new regression. One of the changes for the 4.5 kernel is the removal of GFP_IOFS. In the past I submitted a patch to remove this flag in the server code but I was told it was needed. Now in newer kernels the lack of GFP_IOFS needs to be addressed.</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/21453/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21453/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> lprocfs: treat seq_printf as void function<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 008b5ffc75a22859ebe052d381594de7a51d95f5</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/21454/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21454/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> xattr: update server code for POSIX xattr rename<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 7509d5f6fbec7a38c51d696ffdabc0516b6baeff</p> <p>So is there more work to come tracked under this ticket?</p> <p>One more patch is needed.</p> <p>James Simmons (uja.ornl@yahoo.com) uploaded a new patch: <a href="http://review.whamcloud.com/21781" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21781</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> mem: handle GFP_IOFS removal in newer kernels<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 9b0cfaa1386423e6f538184c1910806a1a0ea93f</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/21781/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21781/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> mem: handle GFP_IOFS removal in newer kernels<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 654586b8f498550056d4a5949768a70736f07677</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="http://review.whamcloud.com/21970/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/21970/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8056" title="Support for linux 4.5 kernels" class="issue-link" data-issue-key="LU-8056"><del>LU-8056</del></a> build: announce linux kernel 4.5.7 support<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 198c2eda4dec4e19a71845d325c8af3acdd30f81</p> <p>Support fot linux 4.5 kernels is complete.</p> Related LU-6215 LU-8210 LU-8560 LU-9183 Development End date Fri, 3 Jun 2016 16:13:07 +0000 Rank 1|hzy8xb: Rank (Obsolete) 9223372036854775807 Start date Fri, 22 Apr 2016 16:13:07 +0000