[LU-9183] Support for linux 4.9 kernels

• Status: Resolved
• Project: Lustre
• Fix Version/s: Lustre 2.10.1, Lustre 2.11.0
• Type: Improvement
• Priority: Minor
• Reporter: Dmitry Eremin (Inactive)
• Assignee: Dmitry Eremin (Inactive)
• Resolution: Fixed

Description

This ticket will track the needed changes to enable lustre support with linux kernels 4.9.X

Issue Links

• is related to: LU-9003 Linux kernel 4.8 adds user_namespace ...
• is related to: LU-8560 Support for linux 4.6 kernels
• is related to: LU-8056 Support for linux 4.5 kernels
• is related to: LU-8661 support for Linux 4.7 kernels
• is related to: LU-11062 Backtrace stack printing is broken in...
• is related to: LU-9558 Support linux kernel version 4.12

Comments

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25816
Subject: LU-9183 libcfs: handle dump_trace() and related callbacks removal
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: e804fed6dcebd0c6e87fdb6988fcb1b8c96353a8

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25817
Subject: LU-9183 libcfs: handle get_user_pages() with gup_flags
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: dc8ff9ce96f60c9885401f4d3edef13d63c002fb

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25818
Subject: LU-9183 libcfs: handle get rid of 'parent' argument of ->d_compare()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 374ccdd5aac21f6f83a88f0912c26ad6381ebb9b

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25819
Subject: LU-9183 llite: handle make the string hashes salt the hash
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: e50b350d7bb821de7eae9331718e29822139d6e5

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25821
Subject: LU-9183 mdc: handle additional argument for posix_acl_valid()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 032c2d033e00a341a34ae8b513c33e397fc89563

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25822
Subject: LU-9183 llite: handle removing the offset argument of direct_IO
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: f99512d14dab9d7bc02113e8dfc163f74031130b

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25826
Subject: LU-9183 llite: handle removal the pos argument of generic_write_sync
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: bd10d7f45ee996148d9c307f9f58b42f15fb57f0

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25827
Subject: LU-9183 llite: handle flags as argument for inode_operations->rename
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 417dcd2f628c302f115aeed5570167f707abcb2c

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25838
Subject: LU-9183 ptlrpc: handle changes in struct group_info
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 1d46c6100497a76f95efe7afdabd24c84a6b4a85

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25840
Subject: LU-9183 llite: handle removal

{get,set,remove}

xattr inode operations
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 9e14a328714203d3ea5585d958d725a1f7602a73

[Bob Glossman (Inactive)]

if I'm not mistaken one of your patches is a dup of LU-9003. this one:

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25821
Subject: LU-9183 mdc: handle additional argument for posix_acl_valid()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 032c2d033e00a341a34ae8b513c33e397fc89563

[Dmitry Eremin (Inactive)]

yes, thanks Bob. I will see those from LU-9003.

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25892
Subject: LU-9183 ptlrpc: handle posix_acl: xattr representation cleanups
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 036b4a3a8491d3fe36fc6c8e7f1ab185fefbfb1b

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25893
Subject: LU-9183 llite: remove struct file on stack in ll_setxattr()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: ace7cdbd60867f02aad22796f30830383c7b663b

[Gerrit Updater]

Dmitry Eremin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/25965
Subject: LU-9183 llite: add support set_acl method in inode operations
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 139582e277da7ca24efefef964c14eda33b55f1f

[Dmitry Eremin (Inactive)]

With last patch all sanity tests passed with 4.9.13-200.fc25.x86_64 kernel in CLIENTONLY mode.

[Dmitry Eremin (Inactive)]

Doug, you can checkout https://review.whamcloud.com/25965 patch (this branch contain your patch also) and build it with 4.9 kernel. It will works.

[Doug Oucharek (Inactive)]

Thanks Dmitry.  Hopefully I'll get a chance to build and run the fix this week.

[Doug Oucharek (Inactive)]

Just tried to build the above patch against the 4.10 kernel.  Get this error right away:

  CC [M]  /root/lustre-release/libcfs/libcfs/linux/linux-debug.o

/root/lustre-release/libcfs/libcfs/linux/linux-debug.c: In function ‘lbug_with_loc’:

/root/lustre-release/libcfs/libcfs/linux/linux-debug.c:120:9: error: *implicit declaration of function ‘*set_task_state’ [-Werror=implicit-function-declaration]

         set_task_state(current, TASK_UNINTERRUPTIBLE);

         ^

cc1: all warnings being treated as errors

 

[Bob Glossman (Inactive)]

Doug,
In every kernel version I can find set_task_state() is #define'd in the kernel #Include sched.h If that is no longer true in 4.10 it's a whole new issue.

[Dmitry Eremin (Inactive)]

I have ported to linux 4.9 kernel only.

[Dmitry Eremin (Inactive)]

With latest patch all sanity tests are passed in client only mode on Fedora Core with 4.9.13 kernel.

 

[Doug Oucharek (Inactive)]

I have a VM where I have linux-staging checked out and have built 4.10.0-rc7 and installed it.  I then cloned lustre-release and did a pull of your change (as given above).  I then tried to build Lustre with:

> sh ./autogen.sh

> ./configure --disable-server --with-linux=/root/linux-staging

> make -j4

The make is failing due to issues in linux-debug.c and llite/dcache.c.  Am I doing something wrong here?

[Dmitry Eremin (Inactive)]

yes, please build and install 4.9.13 kernel and all will compile without problems.

[Doug Oucharek (Inactive)]

There is that big a difference between 4.9 and 4.10?  Ok.

[Bob Glossman (Inactive)]

Dmitry,
I can't complete a client build using your patch stack on current fedora 25. build fails in user space code calling readdir_r(). Apparently this call has been declared 'deprecated' and any use of it generates errors.

All the kernel code seems to build ok, but the client build including utils doesn't succeed.

[James A Simmons]

Bob LU-9137 covers readdir_r() deprecation.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25816/
Subject: LU-9183 libcfs: handle dump_trace() and related callbacks removal
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 70d70c4f541c84adc88c372d670cd3a7fa8bc91f

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25817/
Subject: LU-9183 libcfs: handle get_user_pages() with gup_flags
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: beb733c0f27c28d699700a5aabec41bf573712f8

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25818/
Subject: LU-9183 llite: handle removal of parent argument of ->d_compare()
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 4a50afa42e67244398158a2b68ae68fc0eb68cd7

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25822/
Subject: LU-9183 llite: handle removal the offset argument of direct_IO
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 337aafa282d0f1127eef8b7ee4f865171f48bc12

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25827/
Subject: LU-9183 llite: handle flags as argument for inode_operations->rename
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 2b0d3ff9a3b516e240e7fb44f79e2cb4e4a064a7

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25819/
Subject: LU-9183 llite: handle make the string hashes salt the hash
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 4d1bb7a76ebef4e69f9aaeb28175e62f73afa002

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25826/
Subject: LU-9183 llite: handle removal the pos argument of generic_write_sync
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: e9a1d3d02df1c444e8f5190ad730817ce2506eea

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25838/
Subject: LU-9183 ptlrpc: handle changes in struct group_info
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: fa3598d0beca2bc8c5eb4c570210f5298a8613d0

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25893/
Subject: LU-9183 llite: remove struct file on stack in ll_setxattr()
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 5d32447500107f5abd386400ec9cd8ab8a3d9706

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/27240
Subject: LU-9183 llite: handle xattr with the xattr_handler infrastructure
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: f84266cbc3842760e068278fb0c4b5d42f0680df

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25892/
Subject: LU-9183 ptlrpc: handle posix_acl: xattr representation cleanups
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: f7df2365bc51a7b2804f9b497cbc6bc340dd9da1

[James A Simmons]

Dmitry you will need https://review.whamcloud.com/#/c/27422 as well for your testing

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/27240/
Subject: LU-9183 llite: handle xattr with the xattr_handler infrastructure
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 7c332c2757fb125ffb1c902d5302f7f7dc3c0433

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/25965/
Subject: LU-9183 llite: add support set_acl method in inode operations
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: c8d56a664306c3ceb4e598999c41eb72ea46a68f

[Peter Jones]

Landed for 2.11

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/28110
Subject: LU-9183 llite: handle xattr with the xattr_handler infrastructure
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: 2e77631988cec9fc694d9c9bed6cd6172dee90eb

[Gerrit Updater]

John L. Hammond ([e-mail]) merged in patch https://review.whamcloud.com/28110/
Subject: LU-9183 llite: handle xattr with the xattr_handler infrastructure
Project: fs/lustre-release
Branch: b2_10
Current Patch Set:
Commit: 264ce3d71841c6d84f3d4c0df05b238c42c31476

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/28342
Subject: LU-9183 llite: add support set_acl method in inode operations
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: d00f79fd5dcecffc9c7bc6bbc7dae947e34f28e3

[Gerrit Updater]

John L. Hammond ([e-mail]) merged in patch https://review.whamcloud.com/28342/
Subject: LU-9183 llite: add support set_acl method in inode operations
Project: fs/lustre-release
Branch: b2_10
Current Patch Set:
Commit: 65fef90864aed68665b6887c91857d9bd891fd97