https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-2850 Lustre <p>Update client code to support upstream 3.8 kernel.</p> LU-2850

Client support for upstream 3.8 kernel

Improvement Minor Resolved Fixed Yang Sheng Peng Tao emc patch Thu, 21 Feb 2013 23:10:59 +0000 Mon, 2 Jun 2014 15:40:11 +0000 Thu, 11 Jul 2013 17:52:57 +0000 Lustre 2.5.0 Lustre 2.5.0 Lustre 2.6.0 0 9 <p>following patches are submitted for review:<br/> <a href="http://review.whamcloud.com/5609" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5609</a><br/> <a href="http://review.whamcloud.com/5610" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5610</a><br/> <a href="http://review.whamcloud.com/5611" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5611</a><br/> <a href="http://review.whamcloud.com/5612" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5612</a><br/> <a href="http://review.whamcloud.com/5613" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5613</a></p> <p>More will be submitted later.</p> <p>Thanks Peng Tao! Yang Sheng, I think that it makes sense for you to oversee these patches.</p> <p>one more is submitted:<br/> <a href="http://review.whamcloud.com/5655" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5655</a></p> <p>With these patches, lustre client can build and work with 3.8 kernel.</p> <p>@Peng Tao</p> <p>Can you update list of patches for 3.8?</p> <p>Alexey,</p> <p>Here is the complete list for 3.8 patches. Three of them were replaced by patches from Jeff Mahoney.<br/> <a href="http://review.whamcloud.com/#change,5406" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5406</a><br/> <a href="http://review.whamcloud.com/#change,5768" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5768</a><br/> <a href="http://review.whamcloud.com/#change,5781" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5781</a><br/> <a href="http://review.whamcloud.com/#change,5609" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5609</a><br/> <a href="http://review.whamcloud.com/#change,5613" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5613</a><br/> <a href="http://review.whamcloud.com/#change,5655" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5655</a></p> <p>I have set of patches to support for 3.9 kernel. Should i open separate issue or i can use this one?</p> <p>For client and server 3.9 we need<br/> <a href="http://review.whamcloud.com/5898" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5898</a><br/> <a href="http://review.whamcloud.com/5899" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5899</a></p> <p>Hi, Alexey. Please open a new ticket for 3.9 kernel. Since every version kernel work will consumes a lone time to finished. So we keep it separately easy to track progress. TIA.</p> <p>Sure. I opened <a href="https://jira.whamcloud.com/browse/LU-3079" title="Support for 3.9 mainline kernel" class="issue-link" data-issue-key="LU-3079"><del>LU-3079</del></a></p> <p>Please be aware ticket <a href="https://jira.whamcloud.com/browse/LU-2686" title="Kernel update for 3.7.2-201.fc18" class="issue-link" data-issue-key="LU-2686"><del>LU-2686</del></a> over laps with this work.</p> <p><a href="http://review.whamcloud.com/6114" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/6114</a></p> <p>Oops, Please give me a chance be a inspector for kernel update relate patches. So avoid dup efforts. Thanks.</p> <p>Seems current list are for kernel v3.8<br/> <a href="http://review.whamcloud.com/4649" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/4649</a><br/> <a href="http://review.whamcloud.com/5973" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5973</a><br/> <a href="http://review.whamcloud.com/5974" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5974</a><br/> <a href="http://review.whamcloud.com/5768" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5768</a><br/> <a href="http://review.whamcloud.com/5781" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5781</a><br/> <a href="http://review.whamcloud.com/5763" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5763</a><br/> <a href="http://review.whamcloud.com/5613" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5613</a><br/> <a href="http://review.whamcloud.com/5655" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5655</a><br/> Last one need a rebase it conflicts with current master and this patches</p> <p> <a href="https://jira.whamcloud.com/browse/LU-2850" title="Client support for upstream 3.8 kernel" class="issue-link" data-issue-key="LU-2850"><del>LU-2850</del></a> kernel: 3.8 upstream kills daemonize()</p> <p> kernel_thread() is a low level kernel function.<br/> Instead of calling kernel_thread() and relying on daemonize()<br/> to create new kernel threads, we should really switch to<br/> kthread_run() and elimilate daemonize().</p> <p> Conflicts:<br/> libcfs/autoconf/lustre-libcfs.m4<br/> lustre/mdd/mdd_lfsck.c<br/> lustre/obdclass/llog_cat.c<br/> lustre/ptlrpc/recov_thread.c</p> <p>Also patches that good to have in 2.4 are<br/> <a href="http://review.whamcloud.com/6064" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/6064</a> &lt;- fix compilation with gcc-4.7.x gcc-4.8.x<br/> <a href="http://review.whamcloud.com/5960" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5960</a> &lt;- fix for zfs-0.6.1<br/> <a href="http://review.whamcloud.com/5751" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5751</a> &lt;- possible fix for sandbox enabled build systems</p> <p>I have a update rebased for 5655 if you want me to upload it.</p> <p>James, please upload it. It helps avoiding dup efforts. Thanks.<img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p>Yang, sorry for not including you in the first place. Will add you as inspector in all my future kernel support patches.</p> <p>I noticed that the 5655 patch is not dependent on any other patches. This is fine but I noticed the patches in <a href="https://jira.whamcloud.com/browse/LU-3079" title="Support for 3.9 mainline kernel" class="issue-link" data-issue-key="LU-3079"><del>LU-3079</del></a> don't apply cleanly due to the other patches here. Should we just want until a few patches land then rebase the patches in <a href="https://jira.whamcloud.com/browse/LU-3079" title="Support for 3.9 mainline kernel" class="issue-link" data-issue-key="LU-3079"><del>LU-3079</del></a> again or make 5655 dependent on the rest of the series in this ticket?</p> <p>I tend to waiting patches landed and then rebase lu-3079. </p> <p>BTW for 3.9 kernel support. Patches may be simplyfyed if stuff for ancient kernels (&lt;2.6.32) will be cleaned up. See <a href="https://jira.whamcloud.com/browse/LU-2800" title="build: clean out old autoconf options" class="issue-link" data-issue-key="LU-2800"><del>LU-2800</del></a></p> <p>Are there plans to land all this patches before 2.4.0 release? Or they will be postponed to 2.4.x or 2.5.x?</p> <p>Alexey</p> <p>2.4.0 is frozen now. This work will land in later releases</p> <p>Peter</p> <p>Peter can you label this as a 2.5 item</p> <p>The new recipe for this is against master is:</p> <p><a href="http://review.whamcloud.com/#change,5973" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5973</a> - <a href="https://jira.whamcloud.com/browse/LU-2686" title="Kernel update for 3.7.2-201.fc18" class="issue-link" data-issue-key="LU-2686"><del>LU-2686</del></a><br/> <a href="http://review.whamcloud.com/#change,5974" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5974</a><br/> <a href="http://review.whamcloud.com/#change,5763" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5763</a> - <a href="https://jira.whamcloud.com/browse/LU-2987" title="llite destory_inode should call rcu free" class="issue-link" data-issue-key="LU-2987"><del>LU-2987</del></a><br/> <a href="http://review.whamcloud.com/#change,5613" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5613</a> - <a href="https://jira.whamcloud.com/browse/LU-2850" title="Client support for upstream 3.8 kernel" class="issue-link" data-issue-key="LU-2850"><del>LU-2850</del></a><br/> <a href="http://review.whamcloud.com/#change,5655" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5655</a></p> <p>I have tested with the currently support RHEL6.4 kernel. I'm working on getting a 3.9.4 kernel going to test against soon. </p> <p>With the above listed patches and patches from <a href="https://jira.whamcloud.com/browse/LU-3079" title="Support for 3.9 mainline kernel" class="issue-link" data-issue-key="LU-3079"><del>LU-3079</del></a> I get this.</p> <p>LNet: HW CPU cores: 8, npartitions: 2<br/> alg: No test for crc32 (crc32-table)<br/> alg: No test for adler32 (adler32-zlib)<br/> LNet: Added LNI 10.37.248.7@o2ib1 <span class="error">&#91;8/2560/0/180&#93;</span><br/> Lustre: Lustre: Build Version: 2.4.50-g2f41b68-CHANGED-3.9.4<br/> Lustre: Layout lock feature supported.<br/> Lustre: Mounted lustre-client</p> <p>It appears to work. We have Lustre 3.9.4 clients. With this I can start my work on ldiskfs for 3.9.4.</p> <p>Yep. I run it on small production cluster with lustre/zfs 2.4rc2<br/> servers are 3.8.6 clients are both 3.8.6 and 3.9.4</p> <p>The only thing is I have modify <a href="http://review.whamcloud.com/#change,5655" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,5655</a> due to conflicts with the patch from <a href="https://jira.whamcloud.com/browse/LU-2059" title="mgc to backup configuration on osd-based llogs" class="issue-link" data-issue-key="LU-2059"><del>LU-2059</del></a> and <a href="https://jira.whamcloud.com/browse/LU-2800" title="build: clean out old autoconf options" class="issue-link" data-issue-key="LU-2800"><del>LU-2800</del></a> autoconf patch. Needs updating as well. At this point it is hard to say which will land first.</p> <p><a href="http://review.whamcloud.com/5655" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/5655</a> has landed. </p> <p>FYI, <a href="https://jira.whamcloud.com/browse/LU-3484" title="Incorrect identification of anonymous dentry as root under SLES11SP2" class="issue-link" data-issue-key="LU-3484"><del>LU-3484</del></a> and <a href="https://jira.whamcloud.com/browse/LU-3486" title="LBUG when exporting Lustre 2.4 via NFS on SLES11SP2: ll_dops_init: ASSERTION( de-&gt;d_op == &amp;ll_d_ops ) failed" class="issue-link" data-issue-key="LU-3486"><del>LU-3486</del></a> are needed for 3.8 kernels (for NFS export).</p> <p>Thanks Cory. For 3.8 to work properly you need the following patches:</p> <p><a href="http://review.whamcloud.com/#/c/5974" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/5974</a> - <a href="https://jira.whamcloud.com/browse/LU-2686" title="Kernel update for 3.7.2-201.fc18" class="issue-link" data-issue-key="LU-2686"><del>LU-2686</del></a><br/> <a href="http://review.whamcloud.com/#/c/5763" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/5763</a> - <a href="https://jira.whamcloud.com/browse/LU-2987" title="llite destory_inode should call rcu free" class="issue-link" data-issue-key="LU-2987"><del>LU-2987</del></a></p> <p><a href="http://review.whamcloud.com/#/c/6715" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/6715</a> - <a href="https://jira.whamcloud.com/browse/LU-3483" title="Null pointer dereference in ll_revalidate_nd (llite/dcache.c) in an NFS mounted Lustre file system" class="issue-link" data-issue-key="LU-3483"><del>LU-3483</del></a><br/> <a href="http://review.whamcloud.com/#/c/6726" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/6726</a> - <a href="https://jira.whamcloud.com/browse/LU-3484" title="Incorrect identification of anonymous dentry as root under SLES11SP2" class="issue-link" data-issue-key="LU-3484"><del>LU-3484</del></a></p> <p>Optional cleanup patch</p> <p><a href="http://review.whamcloud.com/#/c/5505" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/5505</a> - <a href="https://jira.whamcloud.com/browse/LU-2800" title="build: clean out old autoconf options" class="issue-link" data-issue-key="LU-2800"><del>LU-2800</del></a></p> <p>All 3.8 related patches were merged</p> <p>All that is left is some NFS patches but this is a general 3.X problem.I guess we can migrate all further information to <a href="https://jira.whamcloud.com/browse/LU-3079" title="Support for 3.9 mainline kernel" class="issue-link" data-issue-key="LU-3079"><del>LU-3079</del></a>. Peter can you close this ticket.</p> <p>ok</p> <p>One patch was missed due to GSS not being tested. It is at <a href="http://review.whamcloud.com/#/c/8396" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/8396</a>. Please inspect.</p> Related LU-2686 Development Rank 1|hzvjn3: Rank (Obsolete) 6901