[LU-12904] Support for linux kernel version 5.4

• Status: Resolved
• Project: Lustre
• Fix Version/s: Lustre 2.14.0
• Type: Task
• Priority: Minor
• Reporter: Shaun Tancheff
• Assignee: Shaun Tancheff
• Resolution: Fixed

Description

Now that linux 5.4 is upto rc4 there is enough stability to start reviewing / updating the changes for lustre.

The expectation is that 5.4 is an LTS kernel and will be picked up by some of the larger distributions.

Update build to support for 5.4 kernels.

Comments

[Gerrit Updater]

Shaun Tancheff ([e-mail]) uploaded a new patch: https://review.whamcloud.com/36575
Subject: LU-12904 build: account_page_dirtied is not exported
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: ae751b2ad825fb7d7cfa891ba1037dd9710aa5cc

[Gerrit Updater]

Shaun Tancheff ([e-mail]) uploaded a new patch: https://review.whamcloud.com/36576
Subject: LU-12904 build: External module decorator removed
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 40e9281cfd81ff5eec2fc37728985cb51e2fcaa3

[Gerrit Updater]

Shaun Tancheff ([e-mail]) uploaded a new patch: https://review.whamcloud.com/36577
Subject: LU-12904 build: Support for gcc -Wimplicit-fallthrough
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: aecdbb34d9f8e175d10d0751761ac1a4c0a88658

[Gerrit Updater]

Shaun Tancheff ([e-mail]) uploaded a new patch: https://review.whamcloud.com/36578
Subject: LU-12904 o2ib: ib_destroy_cq() returns void
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: f49f142a236f5598a0dcc0715d009e6bed33e5d9

[Gerrit Updater]

Shaun Tancheff ([e-mail]) uploaded a new patch: https://review.whamcloud.com/36580
Subject: LU-12904 gss: struct cache_detail readers changed to writers
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: f48d6dd45f8b1b5a7c0a2c0d8b50e096212e4210

[Gerrit Updater]

Shaun Tancheff ([e-mail]) uploaded a new patch: https://review.whamcloud.com/36582
Subject: LU-12904 utils: zfs spa_get_hostid requires spa_t
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: b2d5e47a681a807db9c637c48ce9b231c8dbaee0

[Gerrit Updater]

Shaun Tancheff ([e-mail]) uploaded a new patch: https://review.whamcloud.com/36583
Subject: LU-12904 ldiskfs: Add ldiskfs support for linux 5.4
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: b5b29626c48507222587008e341c5398c3193b37

[Shaun Tancheff]

NOTE: That gcc8 is also being used to enable additional kernel debugging features
$ gcc --version
gcc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3)

Linux 5.4-rc4 w/ZFS master (e35704647e) spa_mutltihost check fails due to spa_multihost not being an exported symbol and the more recent kernel build system fails the compile test.

From the config.log:

configure:33616: checking if ZFS has multihost protection
configure:33645: cp conftest.c build && make -d modules LDFLAGS= LD=/opt/rh/devtoolset-8/root/usr/libexec/gcc/x86_64-redhat-linux/8/ld -m elf_x86_64 CC=gcc -f /home/shaun/lustre-release/build/Ma
kefile LUSTRE_LINUX_CONFIG=/usr/src/kernels/5.4.0-0.ldiskfs.d.el7.x86_64/.config LINUXINCLUDE= -I/usr/src/kernels/5.4.0-0.ldiskfs.d.el7.x86_64/arch/x86/include -Iinclude -Iarch/x86/include/gener
ated -I/usr/src/kernels/5.4.0-0.ldiskfs.d.el7.x86_64/include -Iinclude2 -I/usr/src/kernels/5.4.0-0.ldiskfs.d.el7.x86_64/include/uapi -Iinclude/generated -I/usr/src/kernels/5.4.0-0.ldiskfs.d.el7.
x86_64/arch/x86/include/uapi -Iarch/x86/include/generated/uapi -I/usr/src/kernels/5.4.0-0.ldiskfs.d.el7.x86_64/include/uapi -Iinclude/generated/uapi -include /usr/src/zfs-0.8.0/5.4.0-0.ldiskfs.d
.el7.x86_64/zfs_config.h -I/usr/src/zfs-0.8.0 -I/usr/src/zfs-0.8.0/include -I/usr/src/zfs-0.8.0/include/spl -include /usr/src/kernels/5.4.0-0.ldiskfs.d.el7.x86_64/include/linux/kconfig.h KBUILD_
EXTRA_SYMBOLS=/usr/src/zfs-0.8.0/5.4.0-0.ldiskfs.d.el7.x86_64/Module.symvers -o tmp_include_depends -o scripts -o include/config/MARKER -C /usr/src/kernels/5.4.0-0.ldiskfs.d.el7.x86_64 EXTRA_CFL
AGS=-Werror-implicit-function-declaration -g -I/home/shaun/lustre-release/libcfs/include -I/home/shaun/lustre-release/lnet/include -I/home/shaun/lustre-release/lustre/include -Wno-format-truncat
ion -Wno-stringop-truncation -Wno-stringop-overflow M=/home/shaun/lustre-release/build
ERROR: "spa_multihost" [/home/shaun/lustre-release/build/conftest.ko] undefined!
make[2]: *** [__modpost] Error 1
make[1]: *** [modules] Error 2
make: *** [sub-make] Error 2
configure:33648: $? = 2
configure: failed program was:
| /* confdefs.h */

 

Changing the configure test from a kernel module test to a user space compile test to resolve this issue.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/36576/
Subject: LU-12904 build: External module decorator removed
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: c4daf833ffc5203ce22b67bebdd9fce4eae5baac

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/36577/
Subject: LU-12904 build: Support for gcc -Wimplicit-fallthrough
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 8167e3ad64276676f07d1ba7b9473c2ce74b64e3

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/36578/
Subject: LU-12904 o2ib: ib_destroy_cq() returns void
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 7d2ea1e5bbd80f23e6935174c969b34b58048443

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/36575/
Subject: LU-12904 build: account_page_dirtied is not exported
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: c38ab030d086e865a82c7d5236548062df47d7b1

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/36582/
Subject: LU-12904 utils: zfs properly detect spa_multihost
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 87cc32adc11b3db914dd63e3766614a02e2f988f

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/36580/
Subject: LU-12904 gss: struct cache_detail readers changed to writers
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 81fb8bc7d214394bbc504379a5a84441e871b60a

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/36583/
Subject: LU-12904 ldiskfs: Add ldiskfs support for linux 5.4
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 288cfdfa8d6cee3e5e061b129035965c4054d1df

[Peter Jones]

Everything seems to have landed to master for 2.14. Please reopen if there are more patches still to come...

[Gerrit Updater]

Jian Yu ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38193
Subject: LU-12904 gss: struct cache_detail readers changed to writers
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: 811f164e76be0a8c17d645f1b7f345d3123718fc

[Gerrit Updater]

Jian Yu ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38196
Subject: LU-12904 gss: struct cache_detail readers changed to writers
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: 36bf2fdb77122c02339abbcc88a3ff3a026c88f8

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/38193/
Subject: LU-12904 gss: struct cache_detail readers changed to writers
Project: fs/lustre-release
Branch: b2_12
Current Patch Set:
Commit: 14a18654a64ae05a94a4394d53b030ce91357e9a

[Gerrit Updater]

Jian Yu ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38489
Subject: LU-12904 o2ib: ib_destroy_cq() returns void
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: 73cc987261bdb93c44b72ffc69ec5367d3d8e869

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/38489/
Subject: LU-12904 o2ib: ib_destroy_cq() returns void
Project: fs/lustre-release
Branch: b2_12
Current Patch Set:
Commit: 2d14d718253d321f06f27cea681a7edee8492fe5

[Gerrit Updater]

Jian Yu ([e-mail]) uploaded a new patch: https://review.whamcloud.com/40315
Subject: LU-12904 build: Support for gcc -Wimplicit-fallthrough
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: 3e7e204b84c985de29716aec8df44425746113d0

[Gerrit Updater]

Jian Yu ([e-mail]) uploaded a new patch: https://review.whamcloud.com/40329
Subject: LU-12904 build: External module decorator removed
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: a3274d9e9189ab164fa21312f2941381a53d4368

[Gerrit Updater]

Jian Yu ([e-mail]) uploaded a new patch: https://review.whamcloud.com/40349
Subject: LU-12904 build: account_page_dirtied is not exported
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: c37222c9804dd6054811da1a637965b02465a400

[Gerrit Updater]

Jian Yu ([e-mail]) uploaded a new patch: https://review.whamcloud.com/40350
Subject: LU-12904 utils: zfs properly detect spa_multihost
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: 9842f9bc5c77f9847dfd0c97b94d1ddfa113770d