Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-9680

Improve the user land to kernel space interface for lustre

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • Upstream
    • Lustre 2.11.0
    • None
    • 9223372036854775807

    Description

      Lustre currently has a complex assortment of ioctls for both the file system component and the LNet layer. Many of the those ioctls are no longer used or can be replaced with accessing files in the sysfs or debugfs file systems. With the initial review of lustre in the upstream kernel two topics on how ioctls are managed to brought to our attention. One is the dislike of the ioctl redirection that is done in lustre. The seconds is the request that we use the netlink userland API, in particular with the LNet layer. The netlink API could also be used for lustre.

      Attachments

        Issue Links

          Activity

            [LU-9680] Improve the user land to kernel space interface for lustre

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/53733/
            Subject: LU-9680 lnet: Fault injection list ioctls to netlink
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 60cea1a08c4bcecb59ebf00313948ad862b588e1

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/53733/ Subject: LU-9680 lnet: Fault injection list ioctls to netlink Project: fs/lustre-release Branch: master Current Patch Set: Commit: 60cea1a08c4bcecb59ebf00313948ad862b588e1

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/53734/
            Subject: LU-9680 lnet: Convert lnetctl debug recovery to netlink
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 9c8f9b80f9d2f479221a38841dab6a2423edcbf3

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/53734/ Subject: LU-9680 lnet: Convert lnetctl debug recovery to netlink Project: fs/lustre-release Branch: master Current Patch Set: Commit: 9c8f9b80f9d2f479221a38841dab6a2423edcbf3

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/53004/
            Subject: LU-9680 lnet: add NLM_F_DUMP_FILTERED support
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: d3ef8f699343db2578996a3f45625cc2daf603fa

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/53004/ Subject: LU-9680 lnet: add NLM_F_DUMP_FILTERED support Project: fs/lustre-release Branch: master Current Patch Set: Commit: d3ef8f699343db2578996a3f45625cc2daf603fa

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/53889/
            Subject: LU-9680 utils: fix nested attribute handling in liblnetconfig
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 8f64231185a974c561c0603003d1e3f1749a390b

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/53889/ Subject: LU-9680 utils: fix nested attribute handling in liblnetconfig Project: fs/lustre-release Branch: master Current Patch Set: Commit: 8f64231185a974c561c0603003d1e3f1749a390b

            lctl get_param devices for 18000 obd devices

            root (debugfs)

            real    0m0.052s
            user    0m0.000s
            sys     0m0.052s

            normal user (netlink)

            real    0m0.251s
            user    0m0.133s
            sys     0m0.117s

            So a super massive debugfs file performs much better in this case.

            simmonsja James A Simmons added a comment - lctl get_param devices for 18000 obd devices root (debugfs) real    0m0.052s user    0m0.000s sys     0m0.052s normal user (netlink) real    0m0.251s user    0m0.133s sys     0m0.117s So a super massive debugfs file performs much better in this case.

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/53731/
            Subject: LU-9680 lnet: Convert net_fault.c to work with large NIDs
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 654794472ec17b8c672add8af71306eb7f52b60d

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/53731/ Subject: LU-9680 lnet: Convert net_fault.c to work with large NIDs Project: fs/lustre-release Branch: master Current Patch Set: Commit: 654794472ec17b8c672add8af71306eb7f52b60d

            "James Simmons <jsimmons@infradead.org>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/54064
            Subject: LU-9680 utils: revert parts to track down maloo failures
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 5b3169211fb595c8ccbdc5f2ab106bda99d8afe7

            gerrit Gerrit Updater added a comment - "James Simmons <jsimmons@infradead.org>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/54064 Subject: LU-9680 utils: revert parts to track down maloo failures Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 5b3169211fb595c8ccbdc5f2ab106bda99d8afe7

            "James Simmons <jsimmons@infradead.org>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/53889
            Subject: LU-9680 utils: fix nested attribute handling in liblnetconfig
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: b86ab2cb34936524987fd510a6185d3ceab5a942

            gerrit Gerrit Updater added a comment - "James Simmons <jsimmons@infradead.org>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/53889 Subject: LU-9680 utils: fix nested attribute handling in liblnetconfig Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: b86ab2cb34936524987fd510a6185d3ceab5a942

            "Chris Horn <chris.horn@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/53734
            Subject: LU-9680 lnet: Convert lnetctl debug recovery to netlink
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: f6e4fecc98f25dcc57aa6b6e905ab11ff5d1d9b4

            gerrit Gerrit Updater added a comment - "Chris Horn <chris.horn@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/53734 Subject: LU-9680 lnet: Convert lnetctl debug recovery to netlink Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: f6e4fecc98f25dcc57aa6b6e905ab11ff5d1d9b4

            "Chris Horn <chris.horn@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/53733
            Subject: LU-9680 lnet: Fault injection list ioctls to netlink
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 94b2c1948673f9c4702799301219bd86322db257

            gerrit Gerrit Updater added a comment - "Chris Horn <chris.horn@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/53733 Subject: LU-9680 lnet: Fault injection list ioctls to netlink Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 94b2c1948673f9c4702799301219bd86322db257

            People

              simmonsja James A Simmons
              simmonsja James A Simmons
              Votes:
              0 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated: