Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-6387

Add Power8 support to Lustre

Details

    • New Feature
    • Resolution: Fixed
    • Major
    • Lustre 2.12.0
    • Lustre 2.8.0
    • IBM Power8 hardware. Currently Ubuntu and later RHEL7.1 support will be added to this platform.
    • 9223372036854775807

    Description

      Currently working with Power8 client nodes running Ubuntu with a 3.13 kernel. Later the nodes will be moved to RHEL7.1 as support improves.
      Here the work will be pushed to be able to build and run lustre in such an
      environment.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-8485 workqueue overflows with mlx5 on power8 platforms.

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-8693 ko2iblnd recieving IB_WC_MW_BIND_ERR errors.

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-10752 Lustre rpm build issues due to improper lsvcgss packaging

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-11453 sanity test 184a: Basic layout swap panics on Power8

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-6284 FLD read is not swabbed correctly

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-8117 lustre-ppc fails to build on ppc64 el7

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-8776 fix weird inline definitions

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-11246 New lustre e2fsprogs 1.44 issues

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. LU-11278 LNet failures on Power8

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. LU-7321 LustreError: 61814:0:(ldlm_lockd.c:692:ldlm_handle_ast_error()) ### client (nid 172.20.17.9@o2ib500) returned -5 from glimpse AST

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. LU-8567 mdc_reint.c:57:mdc_reint()) error in handling -17 encountered on power8 node

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. LU-12419 ppc64le: "LNetError: RDMA has too many fragments for peer_ni" when reading two files

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. LU-11200 Centos 8 arm64 server support

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-11440 Make e2fsprogs-1.44.3-wc1 release

          • Major - Major loss of function.
          • Resolved

          Question/Request - A product question or request LU-10300 Can the Lustre 2.10.x clients support 64K kernel page?

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. LU-10157 LNET_MAX_IOV hard coded to 256

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. LU-8700 dkms fails to build lustre on Power8 due to llite_loop missing

          • Major - Major loss of function.
          • Resolved

          Activity

            [LU-6387] Add Power8 support to Lustre
            simmonsja James A Simmons added a comment -

            All the last pieces have landed to the lustre community release to support both Power8 and ARM out of the box.

            simmonsja James A Simmons added a comment - All the last pieces have landed to the lustre community release to support both Power8 and ARM out of the box.
            simmonsja James A Simmons added a comment -

            This also applies to ARM platforms. So the patches you need to make this work for 2.11 out of the box are:

            https://review.whamcloud.com/#/c/31485 - So you can build rpms

            https://review.whamcloud.com/#/c/31559 - To handle the page size difference

            With these I can now run Power/ARM with no problems.

            simmonsja James A Simmons added a comment - This also applies to ARM platforms. So the patches you need to make this work for 2.11 out of the box are: https://review.whamcloud.com/#/c/31485 - So you can build rpms https://review.whamcloud.com/#/c/31559 - To handle the page size difference With these I can now run Power/ARM with no problems.
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/22941/
            Subject: LU-6387 tests: fix lp_utils build issues on Power8
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 0d68cfcf18f8f2118d5115fe3766d72c0630bb4d

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/22941/ Subject: LU-6387 tests: fix lp_utils build issues on Power8 Project: fs/lustre-release Branch: master Current Patch Set: Commit: 0d68cfcf18f8f2118d5115fe3766d72c0630bb4d
            simmonsja James A Simmons added a comment -

            Besides the patch I pushed two other issues showed up in this latest port to Power8. The next bug deals with libcfs byteorder which breaks the build. I think we can backport the libcfs byteorder removal to handle that.

            The remaining problem I have never seen before. For the test application cascading_rw.c I was seeing missing build ID errors. So the way I worked around this problem was adding the following to lustre.spec.in.

            %undefine _missing_build_ids_terminate_build

            This enables rpms again but I don't know if that is the correct solution.

            simmonsja James A Simmons added a comment - Besides the patch I pushed two other issues showed up in this latest port to Power8. The next bug deals with libcfs byteorder which breaks the build. I think we can backport the libcfs byteorder removal to handle that. The remaining problem I have never seen before. For the test application cascading_rw.c I was seeing missing build ID errors. So the way I worked around this problem was adding the following to lustre.spec.in. %undefine _missing_build_ids_terminate_build This enables rpms again but I don't know if that is the correct solution.
            gerrit Gerrit Updater added a comment -

            James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/22941
            Subject: LU-6387 tests: fix lp_utils build issues on Power8
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: feda7c747a674eb0a89b1dd0cd3561b9e802532a

            gerrit Gerrit Updater added a comment - James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/22941 Subject: LU-6387 tests: fix lp_utils build issues on Power8 Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: feda7c747a674eb0a89b1dd0cd3561b9e802532a
            simmonsja James A Simmons added a comment -

            Since this such a new platform it looks like we will be migrating to Ubuntu 15 which uses a patches 3.19 kernel. Except patches soon to support newer kernels.

            simmonsja James A Simmons added a comment - Since this such a new platform it looks like we will be migrating to Ubuntu 15 which uses a patches 3.19 kernel. Except patches soon to support newer kernels.
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14544/
            Subject: LU-6387 build: lustre-dev debain package missing shared libraries
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 8ca3a752fc428d35f6ce4cf035dafdfc3d25d4e7

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14544/ Subject: LU-6387 build: lustre-dev debain package missing shared libraries Project: fs/lustre-release Branch: master Current Patch Set: Commit: 8ca3a752fc428d35f6ce4cf035dafdfc3d25d4e7
            gerrit Gerrit Updater added a comment -

            James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/14544
            Subject: LU-6387 build: lustre-dev debain package missing shared libraries
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: ed6cde3e9e26c616175c5c9ca8f92ef05847b76d

            gerrit Gerrit Updater added a comment - James Simmons (uja.ornl@yahoo.com) uploaded a new patch: http://review.whamcloud.com/14544 Subject: LU-6387 build: lustre-dev debain package missing shared libraries Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: ed6cde3e9e26c616175c5c9ca8f92ef05847b76d
            simmonsja James A Simmons added a comment -

            Please don't close this ticket yet. Soon we will be moving over to RHEL7.1 so more patches might be needed.

            simmonsja James A Simmons added a comment - Please don't close this ticket yet. Soon we will be moving over to RHEL7.1 so more patches might be needed.
            yujian Jian Yu added a comment -

            Patch landed to master branch for Lustre 2.8.0.

            yujian Jian Yu added a comment - Patch landed to master branch for Lustre 2.8.0.
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14115/
            Subject: LU-6387 build: add support for power8
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: cb1063a43f3cfee988f801fb791ca4b3a9a1bb76

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/14115/ Subject: LU-6387 build: add support for power8 Project: fs/lustre-release Branch: master Current Patch Set: Commit: cb1063a43f3cfee988f801fb791ca4b3a9a1bb76

            People

              simmonsja James A Simmons
              simmonsja James A Simmons
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: