Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-12511

Prepare lustre for adoption into the linux kernel

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • Upstream
    • None
    • None
    • 9223372036854775807

    Description

      This is for book keeping all the work that is being done to submit the Lustre client for acceptance into the Linux kernel. Alongside the tickets below, there are a few major areas that need to be addressed before the client can be submitted.

      Lustre Upstream Client Requirements

      • Finish IPv6
      • Finish checkpatch.pl cleanups
        • Space -> Tabs
        • SPDX headers and other warnings
        • Update checkpatch.pl script in Lustre tree (it hasn't been updated since 2017)
        • Remove errant kernel-doc comments
      • Remove procfs from client
      • Remove libcfs (except for kernel compatibility)
        • Convert cfs_hash -> rhashtable
        • Remove custom interval tree
        • Move from custom debugging -> slightly less custom debugging
      • Ensure various Lustre sanity tests pass for upstream client branch
      • Clearer separation of client/server using HAVE_SERVER_SUPPORT
      • Unify Lustre modules to just lnet, k*lnd, lustre
      • Decide on o2ib submission
        • Port o2ib driver to nicer APIs favored by Infiniband maintainers?
        • Delay submission of o2ib until later?
        • Determine how to support GDS out-of-tree
      • Decide on how to submit code upstream
        • Port each individual change (large patch series)?
        • Fresh port of client to latest Linux (couple small patches)?
      • Decide on processes for maintaining upstream client alongside out-of-tree code
        • Develop automation (along the lines of Neil Brown’s script) to generate a port of the client to the kernel
        • Develop automation to find patch that are missing out-of-tree vs. in-tree
        • Will the client be built for kernels that already have a Lustre client?
        • How will servers be built for kernel with the Lustre client?

      Attachments

        Issue Links

          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. LU-8874 Adapt ko2iblnd to latest RDMA changes

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-13833 hook llite to inode cache shrinker

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-14145 protect cli->cl_import with with_imp_locked()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-11463 DOM: osc_extent_make_ready()) ASSERTION( last_oap_count > 0 ) failed

          • Major - Major loss of function.
          • Reopened

          Bug - A problem which impairs or prevents the functions of the product. LU-8622 recovery-small test_24b: no discarded dirty page found!

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-12657 sanity/103 and sanityn/25 fail with 4.18 kernel

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-16327 Linux 5.19 client support

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-16350 Updated server support for new linux releases

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. LU-10391 LNET: Support IPv6

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. LU-13006 need test for /sys/fs/lustre/jobid_this_session

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. LU-13783 Support for linux kernel version 5.8

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. LU-13903 Make "configure --disable-modules" more useful

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-18417 Finish IPv6 support

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-12480 add STATX_PROJID to upstream kernel

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-12514 separate out the lustre mount code for server and clients

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-12678 LNet simplification work from linux client

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-13118 change client instance to respect ASLR

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-14633 change ksocklnd over to use iov_iter_for_each_range()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-14680 remove strict dependency between user tools and kernel RPMs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-15420 Linux kernel 5.15 support

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-17862 Unify (most of) the Lustre kernel modules

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-14291 Improve use of HAVE_SERVER_SUPPORT and others for Linux-kernel client

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Reopened

          Improvement - An improvement or enhancement to an existing feature or task. LU-9679 Prepare lustre for adoption into the linux kernel

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-14651 Linux kernel 5.12 support

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-11085 Replace Lustre interval tree with kernel one

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-12930 use schedule_timeout_{un,}interruptible where possible.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-13274 Building againt lustreapi using -std=c99

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-13344 Support for linux 5.6 clients

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-14073 Support for linux kernel version 5.9

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-14195 Support for linux kernel version 5.10

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-14352 Only use wake_up_all when necessary

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-14353 Move obdclass/debug.c to obdecho/

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-15220 Linux kernel 5.14 support

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-15363 Don't use lustre modules to test LNet with sanity-lnet

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. LU-8874 Adapt ko2iblnd to latest RDMA changes

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-9868 dcache/namei fixes for lustre

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-9036 node-provisioning-1 node-provisioning_1: Failure with linux-staging version of Lustre

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. LU-9633 Add kernel-doc style comments to All lustre Code describing function & parameters.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-12661 sanity test_817: FAIL: failed to execute 'true' command

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. LU-10824 ll_umount being improper use of cached mountpoint from mount time

          • Major - Major loss of function.
          • Reopened

          Bug - A problem which impairs or prevents the functions of the product. LU-12335 mb_prealloc_table table read/write code is racy

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-11594 sanity test_103a: FAIL: permissions failed

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-11893 doesn't handle logical network interface properly.

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-12460 lli_trunc_sem can lead to a readlock

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-9862 The patch that landed for LU-7890 leads to static checker errors

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-11805 sanityn test 16a clients hang with ‘Error trying to bind to port 1023: -99’

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-12362 kernel warning 'do not call blocking ops when !TASK_RUNNING ' in ptlrpcd

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Technical task - A technical task. LU-9164 Incorporate RDMA map/unmap APIs into ko2iblnd

          • Major - Major loss of function.
          • Open

          Technical task - A technical task. LU-4423 Tracking of patches from upstream kernel to Lustre client

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. LU-9855 Clean up obdclass preprocessor code

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-6142 Enforce Linux kernel coding style in all code

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-6220 push ext4/ldiskfs patches upstream if possible

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-8066 Move lustre procfs handling to sysfs and debugfs.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-8130 Migrate from libcfs hash to rhashtable

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-9859 libcfs simplification

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. LU-9680 Improve the user land to kernel space interface for lustre

          • Major - Major loss of function.
          • In Progress

          Improvement - An improvement or enhancement to an existing feature or task. LU-9019 Migrate lustre to standard 64 bit time kernel API

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-10467 use standard linux wait_event macros

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-9325 Improve lustre kernel string handling

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-10994 remove unused page layers

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-12330 Support per-session JOBID without using the environment

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-12331 hardened usercopy whitelisting

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-12542 LDLM improvements form linux lustre client work

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-12780 Avoid using ptlrpc_thread where is in't needed

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-9091 Replace lprocfs_str_with_units_to_s64 with string_get_size()

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              simmonsja James A Simmons
              simmonsja James A Simmons
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated: