[LU-2850] Client support for upstream 3.8 kernel

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.5.0
• Fix Version/s: Lustre 2.5.0, Lustre 2.6.0
• Type: Improvement
• Priority: Minor
• Reporter: Peng Tao
• Assignee: Yang Sheng
• Resolution: Fixed
• Labels: emc, patch

Description

Update client code to support upstream 3.8 kernel.

Issue Links

• is related to: LU-2686 Kernel update for 3.7.2-201.fc18

Comments

[Peng Tao]

following patches are submitted for review:
http://review.whamcloud.com/5609
http://review.whamcloud.com/5610
http://review.whamcloud.com/5611
http://review.whamcloud.com/5612
http://review.whamcloud.com/5613

More will be submitted later.

[Peter Jones]

Thanks Peng Tao! Yang Sheng, I think that it makes sense for you to oversee these patches.

[Peng Tao]

one more is submitted:
http://review.whamcloud.com/5655

With these patches, lustre client can build and work with 3.8 kernel.

[Alexey Shvetsov]

@Peng Tao

Can you update list of patches for 3.8?

[Peng Tao]

Alexey,

Here is the complete list for 3.8 patches. Three of them were replaced by patches from Jeff Mahoney.
http://review.whamcloud.com/#change,5406
http://review.whamcloud.com/#change,5768
http://review.whamcloud.com/#change,5781
http://review.whamcloud.com/#change,5609
http://review.whamcloud.com/#change,5613
http://review.whamcloud.com/#change,5655

[Alexey Shvetsov]

I have set of patches to support for 3.9 kernel. Should i open separate issue or i can use this one?

[Alexey Shvetsov]

For client and server 3.9 we need
http://review.whamcloud.com/5898
http://review.whamcloud.com/5899

[Yang Sheng]

Hi, Alexey. Please open a new ticket for 3.9 kernel. Since every version kernel work will consumes a lone time to finished. So we keep it separately easy to track progress. TIA.

[Alexey Shvetsov]

Sure. I opened LU-3079

[James A Simmons]

Please be aware ticket LU-2686 over laps with this work.

[Yang Sheng]

http://review.whamcloud.com/6114

[Yang Sheng]

Oops, Please give me a chance be a inspector for kernel update relate patches. So avoid dup efforts. Thanks.

[Alexey Shvetsov]

Seems current list are for kernel v3.8
http://review.whamcloud.com/4649
http://review.whamcloud.com/5973
http://review.whamcloud.com/5974
http://review.whamcloud.com/5768
http://review.whamcloud.com/5781
http://review.whamcloud.com/5763
http://review.whamcloud.com/5613
http://review.whamcloud.com/5655
Last one need a rebase it conflicts with current master and this patches

LU-2850 kernel: 3.8 upstream kills daemonize()

kernel_thread() is a low level kernel function.
Instead of calling kernel_thread() and relying on daemonize()
to create new kernel threads, we should really switch to
kthread_run() and elimilate daemonize().

Conflicts:
libcfs/autoconf/lustre-libcfs.m4
lustre/mdd/mdd_lfsck.c
lustre/obdclass/llog_cat.c
lustre/ptlrpc/recov_thread.c

Also patches that good to have in 2.4 are
http://review.whamcloud.com/6064 <- fix compilation with gcc-4.7.x gcc-4.8.x
http://review.whamcloud.com/5960 <- fix for zfs-0.6.1
http://review.whamcloud.com/5751 <- possible fix for sandbox enabled build systems

[James A Simmons]

I have a update rebased for 5655 if you want me to upload it.

[Peng Tao]

James, please upload it. It helps avoiding dup efforts. Thanks.

Yang, sorry for not including you in the first place. Will add you as inspector in all my future kernel support patches.

[James A Simmons]

I noticed that the 5655 patch is not dependent on any other patches. This is fine but I noticed the patches in LU-3079 don't apply cleanly due to the other patches here. Should we just want until a few patches land then rebase the patches in LU-3079 again or make 5655 dependent on the rest of the series in this ticket?

[Yang Sheng]

I tend to waiting patches landed and then rebase lu-3079.

[Alexey Shvetsov]

BTW for 3.9 kernel support. Patches may be simplyfyed if stuff for ancient kernels (<2.6.32) will be cleaned up. See LU-2800

[Alexey Shvetsov]

Are there plans to land all this patches before 2.4.0 release? Or they will be postponed to 2.4.x or 2.5.x?

[Peter Jones]

Alexey

2.4.0 is frozen now. This work will land in later releases

Peter

[James A Simmons]

Peter can you label this as a 2.5 item

[James A Simmons]

The new recipe for this is against master is:

http://review.whamcloud.com/#change,5973 - LU-2686
http://review.whamcloud.com/#change,5974
http://review.whamcloud.com/#change,5763 - LU-2987
http://review.whamcloud.com/#change,5613 - LU-2850
http://review.whamcloud.com/#change,5655

I have tested with the currently support RHEL6.4 kernel. I'm working on getting a 3.9.4 kernel going to test against soon.

[James A Simmons]

With the above listed patches and patches from LU-3079 I get this.

LNet: HW CPU cores: 8, npartitions: 2
alg: No test for crc32 (crc32-table)
alg: No test for adler32 (adler32-zlib)
LNet: Added LNI 10.37.248.7@o2ib1 [8/2560/0/180]
Lustre: Lustre: Build Version: 2.4.50-g2f41b68-CHANGED-3.9.4
Lustre: Layout lock feature supported.
Lustre: Mounted lustre-client

It appears to work. We have Lustre 3.9.4 clients. With this I can start my work on ldiskfs for 3.9.4.

[Alexey Shvetsov]

Yep. I run it on small production cluster with lustre/zfs 2.4rc2
servers are 3.8.6 clients are both 3.8.6 and 3.9.4

[James A Simmons]

The only thing is I have modify http://review.whamcloud.com/#change,5655 due to conflicts with the patch from LU-2059 and LU-2800 autoconf patch. Needs updating as well. At this point it is hard to say which will land first.

[Keith Mannthey (Inactive)]

http://review.whamcloud.com/5655 has landed.

[Cory Spitz]

FYI, LU-3484 and LU-3486 are needed for 3.8 kernels (for NFS export).

[James A Simmons]

Thanks Cory. For 3.8 to work properly you need the following patches:

http://review.whamcloud.com/#/c/5974 - LU-2686
http://review.whamcloud.com/#/c/5763 - LU-2987

http://review.whamcloud.com/#/c/6715 - LU-3483
http://review.whamcloud.com/#/c/6726 - LU-3484

Optional cleanup patch

http://review.whamcloud.com/#/c/5505 - LU-2800

[Alexey Shvetsov]

All 3.8 related patches were merged

[James A Simmons]

All that is left is some NFS patches but this is a general 3.X problem.I guess we can migrate all further information to LU-3079. Peter can you close this ticket.

[Peter Jones]

ok

[James A Simmons]

One patch was missed due to GSS not being tested. It is at http://review.whamcloud.com/#/c/8396. Please inspect.