Details

    • Question/Request
    • Resolution: Fixed
    • Blocker
    • Lustre 2.13.0, Lustre 2.12.2
    • Lustre 2.12.1
    • Centos 2.6 with kernel 3.10.0-957.10.1.el7
      Mellannox 100GB Ethernet w/ RoCE
    • 9223372036854775807

    Description

      We are trying to stand up a new Lustre instance based on version 2.12.1. The DKMS packages downloaded from the Whamcloud website install without error. But, there doesn't seem to be a way to start the Lustre service. /usr/lib/systemd/system/lustre.service appears to only unmount a filesystem and there is no longer an /etc/rc.d/init.d/lustre

       

      We found that removing both lnet.service and lustre.service from /usr/lib/systemd/system/ and recopying /etc/rc.d/init.d/lnet and /etc/rc.d/init.d/lustre from a working Lustre 2.10.3 system allowed us to start the system and mount the OSTs that we created with mkfs.lustre.

       

      Creating an MGS/MDS with mkfs.lustre executes and running zpool list reports the expected values. The server is using the in kernel OFED for Mellanox ConnectX 100GBE cards. The packages we installed were: 

       

      libuutil1-0.7.13-1.el7.x86_643.rpm
      libzfs2-0.7.13-1.el7.x86_643.rpm
      libzfs2-devel-0.7.13-1.el7.x86_643.rpm
      libzpool2-0.7.13-1.el7.x86_643.rpm
      lustre-2.12.1-1.el7.x86_643.rpm
      lustre-osd-zfs-mount-2.12.1-1.el7.x86_643.rpm
      lustre-resource-agents-2.12.1-1.el7.x86_643.rpm
      lustre-zfs-dkms-2.12-1.el7.x86_643.rpm
      spl-0.7.13-1.el7.x86_643.rpm
      spl-debuginfo-0.7.13-1.el7.x86_643.rpm
      spl-dkms-0.7.13-1.el7.x86_643.rpm
      zfs-0.7.13-1.el7.x86_643.rpm
      zfs-debuginfo-0.7.13-1.el7.x86_643.rpm
      zfs-dkms-0.7.13-1.el7.x86_643.rpm
      zfs-test-0.7.13-1.el7.x86_643.rpm

       

      What am I missing here? Thanks!

       

      Attachments

        Issue Links

          Activity

            [LU-12298] Cannot Start Lustre 2.12.1 Server
            pjones Peter Jones added a comment -

            Landed for 2.13 and 2.12.2

            pjones Peter Jones added a comment - Landed for 2.13 and 2.12.2

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/34873/
            Subject: LU-12298 init: Add init info to lustre sysvinit script
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: cd8a5f533d9df8aef4976d1a4c741d0f3673dd05

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/34873/ Subject: LU-12298 init: Add init info to lustre sysvinit script Project: fs/lustre-release Branch: master Current Patch Set: Commit: cd8a5f533d9df8aef4976d1a4c741d0f3673dd05

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/34869/
            Subject: LU-12298 init: Add init info to lustre sysvinit script
            Project: fs/lustre-release
            Branch: b2_12
            Current Patch Set:
            Commit: 6e91b341f3d3d3afeef46e1256e35564f8c9d0d1

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/34869/ Subject: LU-12298 init: Add init info to lustre sysvinit script Project: fs/lustre-release Branch: b2_12 Current Patch Set: Commit: 6e91b341f3d3d3afeef46e1256e35564f8c9d0d1

            Tested this patch on our TDS at ORNL and it looks like it resolves this issue.

            curtispb Philip B Curtis added a comment - Tested this patch on our TDS at ORNL and it looks like it resolves this issue.

            Nathaniel Clark (nclark@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34873
            Subject: LU-12298 init: Add init info to lustre sysvinit script
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 7dcc7f13bd978c1f38302715cced9061d71f8899

            gerrit Gerrit Updater added a comment - Nathaniel Clark (nclark@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34873 Subject: LU-12298 init: Add init info to lustre sysvinit script Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 7dcc7f13bd978c1f38302715cced9061d71f8899

            Nathaniel Clark (nclark@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34869
            Subject: LU-12298 init: Add init info to lustre sysvinit script
            Project: fs/lustre-release
            Branch: b2_12
            Current Patch Set: 1
            Commit: 0f8bcefbfcd6858e571ad75a99690240e6c9cf27

            gerrit Gerrit Updater added a comment - Nathaniel Clark (nclark@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/34869 Subject: LU-12298 init: Add init info to lustre sysvinit script Project: fs/lustre-release Branch: b2_12 Current Patch Set: 1 Commit: 0f8bcefbfcd6858e571ad75a99690240e6c9cf27
            utopiabound Nathaniel Clark added a comment - Revert of LU-8384 for b2_12 https://review.whamcloud.com/#/c/34868/

            Reverting LU-8384 should be okay.  It would be good to get the systemd compatibility block into lustre sysvinit.

            utopiabound Nathaniel Clark added a comment - Reverting LU-8384 should be okay.  It would be good to get the systemd compatibility block into lustre sysvinit.
            pjones Peter Jones added a comment -

            Nathaniel

            Can you please investigate?

            Thanks

            Peter

            pjones Peter Jones added a comment - Nathaniel Can you please investigate? Thanks Peter

            Oh good, it's not just me! We tried building from source using the --disable-client flag but ran into trouble building the RPMs afterward then stopped debugging there.We managed to get a working version by copying the init.d script from version 12.0 into the 12.1 init.d area and deleting the systemd service file.

            Do you think this should be marked as a regression?

            petrillo Neale Petrillo (Inactive) added a comment - Oh good, it's not just me! We tried building from source using the --disable-client flag but ran into trouble building the RPMs afterward then stopped debugging there.We managed to get a working version by copying the init.d script from version 12.0 into the 12.1 init.d area and deleting the systemd service file. Do you think this should be marked as a regression?

            People

              utopiabound Nathaniel Clark
              petrillo Neale Petrillo (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: