Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-13485

Enable parallel compile tests during configure

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • Lustre 2.16.0
    • None
    • None
    • 9223372036854775807

    Description

      Inspired by OpenZFS adding parallel compile testing
      Adapt a similar scheme for lustre builds

      Initial work adding parallel support for libcfs (libcfs/autoconf/lustre-libcfs.m4)
      helps reduce the configure run from:

      	serial		parallel	p: 38361
real	2m24.365s	1m53.446s	0m53.153s
user	1m34.807s	1m20.060s	0m54.937s
sys	1m9.891s	0m57.069s	0m31.493s

      The conversion process is straight forward if a bit tedious

      Attachments

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. LU-17288 LU-13485 breaks Ubuntu build

          • Major - Major loss of function.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. LU-16053 osd-zfs build system update

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            [LU-13485] Enable parallel compile tests during configure
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38368/
            Subject: LU-13485 lnet: Parallel configure tests for lnet
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: fc84caa81b7fb9d27e82229d39f046e83b5ebb7e

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38368/ Subject: LU-13485 lnet: Parallel configure tests for lnet Project: fs/lustre-release Branch: master Current Patch Set: Commit: fc84caa81b7fb9d27e82229d39f046e83b5ebb7e
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49092/
            Subject: LU-13485 libcfs: Parallel configure tests for libcfs
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set:
            Commit: a9a07e4faa061b948a0b0a92cd35f1165b3a2bcb

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49092/ Subject: LU-13485 libcfs: Parallel configure tests for libcfs Project: fs/lustre-release Branch: b2_15 Current Patch Set: Commit: a9a07e4faa061b948a0b0a92cd35f1165b3a2bcb
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49805/
            Subject: LU-13485 build: Parallel build configure cache fixes
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set:
            Commit: 3bf0b2c3afe89a4db763fe33ac92164b477e4e74

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49805/ Subject: LU-13485 build: Parallel build configure cache fixes Project: fs/lustre-release Branch: b2_15 Current Patch Set: Commit: 3bf0b2c3afe89a4db763fe33ac92164b477e4e74
            gerrit Gerrit Updater added a comment -

            "Shaun Tancheff <shaun.tancheff@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50110
            Subject: LU-13485 build: fscrypt checks can be run in parallel
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 0d187c90229c61869d97d86d9127ff8ae975dec0

            gerrit Gerrit Updater added a comment - "Shaun Tancheff <shaun.tancheff@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50110 Subject: LU-13485 build: fscrypt checks can be run in parallel Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 0d187c90229c61869d97d86d9127ff8ae975dec0
            gerrit Gerrit Updater added a comment -

            "Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49805
            Subject: LU-13485 build: Parallel build configure cache fixes
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set: 1
            Commit: b01eb62089a5e5acf94f99c0b487eac7afe3bfb3

            gerrit Gerrit Updater added a comment - "Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49805 Subject: LU-13485 build: Parallel build configure cache fixes Project: fs/lustre-release Branch: b2_15 Current Patch Set: 1 Commit: b01eb62089a5e5acf94f99c0b487eac7afe3bfb3
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38351/
            Subject: LU-13485 ldiskfs: Parallel configure tests for ldiskfs
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 3774b6afbe3b67e869bb61c9cb212cc37e8705fa

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38351/ Subject: LU-13485 ldiskfs: Parallel configure tests for ldiskfs Project: fs/lustre-release Branch: master Current Patch Set: Commit: 3774b6afbe3b67e869bb61c9cb212cc37e8705fa
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38361/
            Subject: LU-13485 kernel: Parallel core configure tests
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: a346cf6cf22c285e05177a5a5e70a7d8e5bd9fa8

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38361/ Subject: LU-13485 kernel: Parallel core configure tests Project: fs/lustre-release Branch: master Current Patch Set: Commit: a346cf6cf22c285e05177a5a5e70a7d8e5bd9fa8
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38349/
            Subject: LU-13485 libcfs: Parallel configure tests for libcfs
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 182fa9be075f5866aba2f37fbc3434cd0292ac0e

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38349/ Subject: LU-13485 libcfs: Parallel configure tests for libcfs Project: fs/lustre-release Branch: master Current Patch Set: Commit: 182fa9be075f5866aba2f37fbc3434cd0292ac0e
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49149/
            Subject: LU-13485 build: Parallel build configure cache fixes
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 24c9f1f4c56d266656572e7bd97197d690d49369

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49149/ Subject: LU-13485 build: Parallel build configure cache fixes Project: fs/lustre-release Branch: master Current Patch Set: Commit: 24c9f1f4c56d266656572e7bd97197d690d49369
            gerrit Gerrit Updater added a comment -

            "Shaun Tancheff <shaun.tancheff@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49149
            Subject: LU-13485 build: Parallel build configure cache fixes
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: c7ef9a8d0f59f72e4de4339a1b6f634677f560a3

            gerrit Gerrit Updater added a comment - "Shaun Tancheff <shaun.tancheff@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49149 Subject: LU-13485 build: Parallel build configure cache fixes Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: c7ef9a8d0f59f72e4de4339a1b6f634677f560a3
            gerrit Gerrit Updater added a comment -

            "Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49101
            Subject: LU-13485 libcfs: Remove unused iter_type check
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set: 1
            Commit: 4919b4d531b81fef0155b3476b489e227b39927d

            gerrit Gerrit Updater added a comment - "Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49101 Subject: LU-13485 libcfs: Remove unused iter_type check Project: fs/lustre-release Branch: b2_15 Current Patch Set: 1 Commit: 4919b4d531b81fef0155b3476b489e227b39927d

            People

              stancheff Shaun Tancheff
              stancheff Shaun Tancheff
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: