Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-13485

Enable parallel compile tests during configure

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • Lustre 2.16.0
    • None
    • None
    • 9223372036854775807

    Description

      Inspired by OpenZFS adding parallel compile testing
      Adapt a similar scheme for lustre builds

      Initial work adding parallel support for libcfs (libcfs/autoconf/lustre-libcfs.m4)
      helps reduce the configure run from:

      	serial		parallel	p: 38361
      real	2m24.365s	1m53.446s	0m53.153s
      user	1m34.807s	1m20.060s	0m54.937s
      sys	1m9.891s	0m57.069s	0m31.493s
      

      The conversion process is straight forward if a bit tedious

      Attachments

        Issue Links

          Activity

            [LU-13485] Enable parallel compile tests during configure

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49098/
            Subject: LU-13485 kernel: Parallel core configure tests
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set:
            Commit: 355da3ba8df599a771281df3f5db024b033946c9

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49098/ Subject: LU-13485 kernel: Parallel core configure tests Project: fs/lustre-release Branch: b2_15 Current Patch Set: Commit: 355da3ba8df599a771281df3f5db024b033946c9

            Parallel build is infrastructure is landed. Remaining ZFS parallel work will be completed under another ticket.

            stancheff Shaun Tancheff added a comment - Parallel build is infrastructure is landed. Remaining ZFS parallel work will be completed under another ticket.

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/50110/
            Subject: LU-13485 build: fscrypt checks can be run in parallel
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: e7900e9fcb67a39dc8323cdf6ac6290664dd066c

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/50110/ Subject: LU-13485 build: fscrypt checks can be run in parallel Project: fs/lustre-release Branch: master Current Patch Set: Commit: e7900e9fcb67a39dc8323cdf6ac6290664dd066c

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/48091/
            Subject: LU-13485 libcfs: Remove unused iter_type check
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: c755373c567090c49589e5aa0d3134847d4b952e

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/48091/ Subject: LU-13485 libcfs: Remove unused iter_type check Project: fs/lustre-release Branch: master Current Patch Set: Commit: c755373c567090c49589e5aa0d3134847d4b952e

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38368/
            Subject: LU-13485 lnet: Parallel configure tests for lnet
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: fc84caa81b7fb9d27e82229d39f046e83b5ebb7e

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38368/ Subject: LU-13485 lnet: Parallel configure tests for lnet Project: fs/lustre-release Branch: master Current Patch Set: Commit: fc84caa81b7fb9d27e82229d39f046e83b5ebb7e

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49092/
            Subject: LU-13485 libcfs: Parallel configure tests for libcfs
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set:
            Commit: a9a07e4faa061b948a0b0a92cd35f1165b3a2bcb

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49092/ Subject: LU-13485 libcfs: Parallel configure tests for libcfs Project: fs/lustre-release Branch: b2_15 Current Patch Set: Commit: a9a07e4faa061b948a0b0a92cd35f1165b3a2bcb

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49805/
            Subject: LU-13485 build: Parallel build configure cache fixes
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set:
            Commit: 3bf0b2c3afe89a4db763fe33ac92164b477e4e74

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49805/ Subject: LU-13485 build: Parallel build configure cache fixes Project: fs/lustre-release Branch: b2_15 Current Patch Set: Commit: 3bf0b2c3afe89a4db763fe33ac92164b477e4e74

            "Shaun Tancheff <shaun.tancheff@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50110
            Subject: LU-13485 build: fscrypt checks can be run in parallel
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 0d187c90229c61869d97d86d9127ff8ae975dec0

            gerrit Gerrit Updater added a comment - "Shaun Tancheff <shaun.tancheff@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/50110 Subject: LU-13485 build: fscrypt checks can be run in parallel Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 0d187c90229c61869d97d86d9127ff8ae975dec0

            "Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49805
            Subject: LU-13485 build: Parallel build configure cache fixes
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set: 1
            Commit: b01eb62089a5e5acf94f99c0b487eac7afe3bfb3

            gerrit Gerrit Updater added a comment - "Jian Yu <yujian@whamcloud.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49805 Subject: LU-13485 build: Parallel build configure cache fixes Project: fs/lustre-release Branch: b2_15 Current Patch Set: 1 Commit: b01eb62089a5e5acf94f99c0b487eac7afe3bfb3

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38351/
            Subject: LU-13485 ldiskfs: Parallel configure tests for ldiskfs
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 3774b6afbe3b67e869bb61c9cb212cc37e8705fa

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/38351/ Subject: LU-13485 ldiskfs: Parallel configure tests for ldiskfs Project: fs/lustre-release Branch: master Current Patch Set: Commit: 3774b6afbe3b67e869bb61c9cb212cc37e8705fa

            People

              stancheff Shaun Tancheff
              stancheff Shaun Tancheff
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: