[LU-9679] Prepare lustre for adoption into the linux kernel

• Type: Improvement
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Upstream
• Assignee: James A Simmons
• Reporter: James A Simmons

Description

This is for book keeping all the work that is being done to bring the Intel branch during the lustre 2.11.0 cycle into syncing with what is upstream in the linux kernel. Also at the same ensure important changes upstream get merged back into the Intel branch.

Issue Links

• is related to: LU-9179 Upstream ko2iblnd has poor performance
• is related to: LU-9180 Upstream ko2iblnd does not work with map_on_demand <256
• is related to: LU-10926 ll_set_acl can panic the node.
• is related to: LU-14424 write performance regression in Lustre-2.14.0-RC1
• is related to: LU-9863 Potential one off bug in lmv_fid2path
• is related to: LU-9886 Crash in upstream kiblnd_handle_early_rxs()
• is related to: LU-10086 LNET_MINOR conflicts with USERIO_MINOR
• is related to: LU-7746 skip test of new functionality on upstream client
• is related to: LU-9869 fix incorrect arguments order calling lstcon_session_new
• is related to: LU-10541 parallel-scale-nfsv3 test racer_on_nfs hangs with BUG: unable to handle kernel NULL pointer dereference
• is related to: LU-10785 ll_acl_{access,default}_xattr_handler confuse name and prefix
• is related to: LU-10787 setxattr(..., XATTR_REPLACE) removes rather than replaces the attribute
• is related to: LU-10788 __vfs_setxattr() should pass flags through
• is related to: LU-10792 remove unused parameters from md_{get,set}xattr()
• is related to: LU-10257 vvp_lock, lov_page, and lovsub_{lock,page} are (more or less) unused
• is related to: LU-8980 Add tracepoint support to Lustre
• is related to: LU-6245 Untangle userland and kernel space support for libcfs
• is related to: LU-11089 Performance improvements for lu_object locking
• is related to: LU-6401 Untangle lustre userland and kernel headers
• is related to: LU-10942 Support for Lustre Servers (ldiskfs backend) on kernel 4.12.8
• is related to: LU-9500 MOFED 4/mlx5: Aligning non-aligned page addresses trigger dump_cqe
• is related to: LU-12511 Prepare lustre for adoption into the linux kernel
• is related to: LU-9558 Support linux kernel version 4.12
• is related to: LU-11838 Support linux kernel version 4.18

Comments

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/41691/
Subject: LU-9679 osc: simplify osc_extent_find()
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 3e6b7a785cab514a9703f6ae8d792113f5c53d19

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/39133/
Subject: LU-9679 ptlrpc: list_for_each improvements.
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: dcc8b9c00d5de4bf4580e74bea47e3f99b2ad5da

[Shuichi Ihara]

it looks that patch https://review.whamcloud.com/41691 solved solved problem.

Client Version	NP	Write(MB/s)	Read(MB/s)
Lustre-2.14.0-RC2	1	537	3117
Lustre-2.14.0-RC3	1	773	3175
Lustre-2.14.0-RC3/w patch 41691	1	768	3086

all stats are attached also.

[Gerrit Updater]

Neil Brown ([e-mail]) uploaded a new patch: https://review.whamcloud.com/41691
Subject: LU-9679 osc: simplify osc_extent_find()
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 09a3700c77b4b277329abff5bcb1ff093e8bf1aa

[Andreas Dilger]

All but one of the patches under this ticket in Gerrit have landed.

I'm going to close this, and LU-12511 can be used for newer patches in the 2.14 release.

[Andreas Dilger]

This ticket should really be closed, and LU-12511 used for newer patches.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/39292/
Subject: LU-9679 mdc: create mdc_acl.c
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 896ff00276afd83efb7523f61807feb63e6a70d5

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/39291/
Subject: LU-9679 lustre: make ptlrpc_connection_put() static inline
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 0a03e51b7e49a319a288c7c2be367c90e63d045d

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/39248/
Subject: LU-9679 lov: annotate nested locking of obd_dev_mutex
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 10dae4c3b68ebc2509d7089037eccc9f4460c08f

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/39234/
Subject: LU-9679 llite: annotate non-owner locking
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: f34392412fe2204d6202cb11b44a646e368a1ce7