[LU-12511] Prepare lustre for adoption into the linux kernel

• Status: Open
• Project: Lustre
• Fix Version/s: Upstream
• Type: Improvement
• Priority: Major
• Reporter: James A Simmons
• Assignee: James A Simmons
• Resolution: Unresolved

Description

This is for book keeping all the work that is being done to bring the Intel branch during the lustre 2.14.0 cycle into syncing with what is upstream in the linux kernel. Also at the same ensure important changes upstream get merged back into the whamcloud community branch.

Issue Links

• is related to: LU-9868 dcache/namei fixes for lustre
• is related to: LU-9036 node-provisioning-1 node-provisioning...
• is related to: LU-9633 Add kernel-doc style comments to All ...
• is related to: LU-12661 sanity test_817: FAIL: failed to exec...
• is related to: LU-8874 Adapt ko2iblnd to latest RDMA changes
• is related to: LU-10824 ll_umount being improper use of cache...
• is related to: LU-12335 mb_prealloc_table table read/write c...
• is related to: LU-11594 sanity test_103a: FAIL: permissions f...
• is related to: LU-11893 doesn't handle logical network interf...
• is related to: LU-12460 lli_trunc_sem can lead to a readlock
• is related to: LU-9862 The patch that landed for LU-7890 le...
• is related to: LU-11805 sanityn test 16a clients hang with ‘E...
• is related to: LU-12362 kernel warning 'do not call blocking ...
• is related to: LU-9164 Incorporate RDMA map/unmap APIs into ...
• is related to: LU-4423 Tracking of patches from upstream ker...
• is related to: LU-9855 Clean up obdclass preprocessor code
• is related to: LU-6142 Enforce Linux kernel coding style in ...
• is related to: LU-6220 push ext4/ldiskfs patches upstream if...
• is related to: LU-8066 Move lustre procfs handling to sysfs ...
• is related to: LU-8130 Migrate from libcfs hash to rhashtable
• is related to: LU-9859 libcfs simplification
• is related to: LU-9680 Improve the user land to kernel space...
• is related to: LU-9325 Improve lustre kernel string handling
• is related to: LU-9019 Migrate lustre to standard 64 bit tim...
• is related to: LU-10467 use standard linux wait_event macros
• is related to: LU-10994 remove unused page layers
• is related to: LU-12330 Support per-session JOBID without usi...
• is related to: LU-12331 hardened usercopy whitelisting
• is related to: LU-12542 LDLM improvements form linux lustre c...
• is related to: LU-12780 Avoid using ptlrpc_thread where is in...
• is related to: LU-9091 Replace lprocfs_str_with_units_to_s64...
• is related to: LU-13833 hook llite to inode cache shrinker
• is related to: LU-8874 Adapt ko2iblnd to latest RDMA changes
• is related to: LU-11463 DOM: osc_extent_make_ready()) ASSERTI...
• is related to: LU-12657 sanity/103 and sanityn/25 fail with 4...
• is related to: LU-10391 LNET: Support IPv6
• is related to: LU-13006 need test for /sys/fs/lustre/jobid_th...
• is related to: LU-13783 Support for linux kernel version 5.8
• is related to: LU-13903 Make "configure --disable-modules" mo...
• is related to: LU-12480 add STATX_PROJID to upstream kernel
• is related to: LU-12514 separate out the lustre mount code fo...
• is related to: LU-12678 LNet simplification work from linux c...
• is related to: LU-13118 change client instance to respect ASLR
• is related to: LU-14195 Support for linux kernel version 5.10
• is related to: LU-14633 change ksocklnd over to use iov_iter_...
• is related to: LU-14680 remove strict dependency between user...
• is related to: LU-15420 Linux kernel 5.15 support
• is related to: LU-14291 Improve use of HAVE_SERVER_SUPPORT an...
• is related to: LU-9679 Prepare lustre for adoption into the ...
• is related to: LU-14651 Linux kernel 5.12 support
• is related to: LU-12930 use schedule_timeout_{un,}interruptib...
• is related to: LU-13274 Building againt lustreapi using -std=c99
• is related to: LU-13344 Support for linux 5.6 clients
• is related to: LU-14073 Support for linux kernel version 5.9
• is related to: LU-14352 Only use wake_up_all when necessary
• is related to: LU-14353 Move obdclass/debug.c to obdecho/
• is related to: LU-15220 Linux kernel 5.14 support
• is related to: LU-15363 Don't use lustre modules to test LNet...

Comments

[Peter Jones]

The Intel branch?

[Gerrit Updater]

Neil Brown ([e-mail]) uploaded a new patch: https://review.whamcloud.com/37737
Subject: LU-12511 fld: remove unused functions from fld_cache.c
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 53b5f21276713fe31f61be676f9f8a7ad084cd4b

[Gerrit Updater]

Neil Brown ([e-mail]) uploaded a new patch: https://review.whamcloud.com/37738
Subject: LU-12511 lustre: introduce LUSTRE_MDT_MAXNAMELEN
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 09a96645fba9db04c9ad154e19189d4b0d3a6c91

[Gerrit Updater]

Neil Brown ([e-mail]) uploaded a new patch: https://review.whamcloud.com/37739
Subject: LU-12511 fld: use list_last_entry in fld_cache_shrink
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: cc0f0f7424d8dd8a90a20d7f33e7ea67db13c751

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/37737/
Subject: LU-12511 fld: remove unused functions from fld_cache.c
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 2d9104895ba86eea855cbe1a989b4ec56d0c4173

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/37738/
Subject: LU-12511 lustre: introduce LUSTRE_MDT_MAXNAMELEN
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: bb0e7e7d04a7319f56092d2412a5c8b88467541d

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/37739/
Subject: LU-12511 fld: use list_last_entry in fld_cache_shrink
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 8c207f38fb1e4104c22912d0e1344cd8be8ce6aa

[Peter Jones]

Hmm. All the patches have landed but this sounds like a very open-ended description so I expect more is to come...

[James A Simmons]

Yes their is more. This ticket is for book keeping as well of the issues impacting upstream / lastest kernels.

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38369
Subject: LU-12511 build: avoid building rpm with --disable-modules
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: e7e0eb3935a9efb3bdc083df747beb6899f551f7

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38370
Subject: LU-12511 build: don't use OpenSFS UAPI headers with --disable-modules
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 4bd986942e6ccbccf829d557a4bc96ac8af2745e

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/38369/
Subject: LU-12511 build: avoid building rpm with --disable-modules
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 62ad24cd92ef2f2333aa372902a7842580867467

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/38370/
Subject: LU-12511 build: don't use OpenSFS UAPI headers with --disable-modules
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 24f825e2934a40811c651e8943f843a80b70f97d

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38649
Subject: LU-12511 build: ignore kmod handling in spec file for utilities only build
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: aa61058a20d70fa7ffc8f69d13e11b4149c0caf3

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38790
Subject: LU-12511 utils: Move utilies specific values out of Lustre UAPI headers
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 531350d4e32a11e6dba6feed1ec4770576581308

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/38791
Subject: LU-12511 lov: use lov_pattern_support() to verify lmm
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: f2a3f326e2d612707a97504a92547a2b76328ce4

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/38649/
Subject: LU-12511 build: ignore kmod handling in spec file for
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: b855fa0168d3253e8b2bba9673251a1ba458e81e

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/38790/
Subject: LU-12511 utils: Move utilies specific values out of Lustre UAPI headers
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 980f8741339f2bece106f6955b0b076d35211850

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/38791/
Subject: LU-12511 lov: use lov_pattern_support() to verify lmm
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 0f607f22696ffcf0e8567ed3a3149a0ba5e5b1e9

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/39115
Subject: LU-12511 utils: move cfs_expand_nidlist() to user land header
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: ae99a8bbdbb8e1fba28d1d126855b5025838bb42

[Gerrit Updater]

James Simmons ([e-mail]) uploaded a new patch: https://review.whamcloud.com/39207
Subject: LU-12511 utils: have liblustreapi support Linux client
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 1968c76e89caaee956dca033b9ebf31120707a19

[Gerrit Updater]

"James Simmons <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/45580
Subject: LU-12511 llite: fix misuse of current->parent.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: bfa083192f6bf1ba101ae313cf0f6e7d1f939d0f

[Gerrit Updater]

"James Simmons <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/45585
Subject: LU-12511 ldlm: free resource when ldlm_lock_create() fails.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 95f98b81fa4d6e323f3b9bad1a502af7bd052192

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/45580/
Subject: LU-12511 llite: fix misuse of current->parent.
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 4e4618ced462abe18d9fef9409f6e6e49ed1fda1

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/45585/
Subject: LU-12511 ldlm: free resource when ldlm_lock_create() fails.
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 62d8ef889373587fe936bab628e9d151e8f1466a

[Gerrit Updater]

"James Simmons <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/47565
Subject: LU-12511 test: use proper UAPI header for fsx test app
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 7aaa78ec8286500dda21afbdeacb52033987c472

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/47565/
Subject: LU-12511 test: use proper UAPI header for fsx test app
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 162208003ae4e07975642c65afa4178a3198f402

[Gerrit Updater]

"James Simmons <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/47803
Subject: LU-12511 utils: fix regression for UAPI headers for native client
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 6e0dd00223f3b99394bb6901adde01f6d5ceda3c

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/47803/
Subject: LU-12511 utils: fix regression for UAPI headers for native client
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 14db26a85c52561d186b5c400981a0025d45864a

[Gerrit Updater]

"James Simmons <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/48518
Subject: LU-12511 utils: make kfilnd support a soft requirement
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: c2c37f535d1dcb810c2b3a53d18d4082a756c715

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/48518/
Subject: LU-12511 utils: make kfilnd support a soft requirement
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: bbff57c3e89134b70068b0b2a5b48ba4dacca41a

[Gerrit Updater]

"James Simmons <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51372
Subject: LU-12511 llite: use mapping_set_error instead of opencoded set_bit
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: b17ba6baa7bbfa2024ee18cced73db0fdf16e71d

[Gerrit Updater]

"James Simmons <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51379
Subject: LU-12511 build: include firewalld files for native Linux client
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 5cf441a1b7229fffce2caacda0b6467760d5de37

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51372/
Subject: LU-12511 llite: use mapping_set_error instead of opencoded set_bit
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: aac625055e50e83d7716bdfc6ecfab3282eb0ad2

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51379/
Subject: LU-12511 build: include firewalld files for native Linux client
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 530a302e10fc9ed6c9eeb8e8e3d37185af97e70c