Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-7192

conf-sanity test_32c: ZFS test failure with DNE config

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • Lustre 2.8.0
    • None
    • None
    • 3
    • 9223372036854775807

    Description

      This issue was created by maloo for Lai Siyao <lai.siyao@intel.com>

      Please provide additional information about the failure here.

      This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/a4236274-54ad-11e5-9766-5254006e85c2.

      Attachments

        Issue Links

          Activity

            [LU-7192] conf-sanity test_32c: ZFS test failure with DNE config

            Landed for 2.8

            jgmitter Joseph Gmitter (Inactive) added a comment - Landed for 2.8

            Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16663/
            Subject: LU-7192 tests: conf-sanity test 32c supports DNE on ZFS
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: e414f14d88a059b7bc99b730907060d72e951b03

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16663/ Subject: LU-7192 tests: conf-sanity test 32c supports DNE on ZFS Project: fs/lustre-release Branch: master Current Patch Set: Commit: e414f14d88a059b7bc99b730907060d72e951b03
            yujian Jian Yu added a comment -

            Patch http://review.whamcloud.com/16663 was updated (patch set 4) and passed local testing.

            yujian Jian Yu added a comment - Patch http://review.whamcloud.com/16663 was updated (patch set 4) and passed local testing.
            yujian Jian Yu added a comment -

            After updating test_32newtarball(), LU-7522 was resolved. I'm still doing local testing and will update the patch soon.

            yujian Jian Yu added a comment - After updating test_32newtarball(), LU-7522 was resolved. I'm still doing local testing and will update the patch soon.
            yujian Jian Yu added a comment -

            Upgrading from disk2_7-*.tar.bz2 failed with LU-7522.

            yujian Jian Yu added a comment - Upgrading from disk2_7-*.tar.bz2 failed with LU-7522 .

            Lai Siyao (lai.siyao@intel.com) uploaded a new patch: http://review.whamcloud.com/16663
            Subject: LU-7192 test: conf_sanity 32c support DNE on ZFS
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 5af4663633e7260e3c0b61cb3c2c7acf982c870e

            gerrit Gerrit Updater added a comment - Lai Siyao (lai.siyao@intel.com) uploaded a new patch: http://review.whamcloud.com/16663 Subject: LU-7192 test: conf_sanity 32c support DNE on ZFS Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 5af4663633e7260e3c0b61cb3c2c7acf982c870e
            laisiyao Lai Siyao added a comment -

            conf_sanity test_32c failed:

            == conf-sanity test 32c: dne upgrade test == 08:25:53 (1441527953)
            CMD: shadow-48vm3 which tunefs.lustre
            /usr/sbin/tunefs.lustre
            CMD: shadow-48vm3 find /usr/lib64/lustre/tests -maxdepth 1 -name 'disk*-zfs.tar.bz2'
            Loading modules from /usr/lib64/lustre
            detected 2 online CPUs by sysfs
            Force libcfs to create 2 CPU partitions
            debug=-1
            subsystem_debug=all -lnet -lnd -pinger
            CMD: shadow-48vm3 /usr/sbin/lctl list_nids
            Loading modules from /usr/lib64/lustre
            detected 2 online CPUs by sysfs
            Force libcfs to create 2 CPU partitions
            debug=-1
            subsystem_debug=all -lnet -lnd -pinger
            CMD: shadow-48vm3 mkdir -p /tmp/t32/mnt/mdt /tmp/t32/mnt/ost
            CMD: shadow-48vm3 tar xjvf /usr/lib64/lustre/tests/disk2_4-zfs.tar.bz2 -S -C /tmp/t32
            arch
            bspace
            commit
            ispace
            kernel
            list
            mdt
            ost
            sha1sums
            CMD: shadow-48vm3 cat /tmp/t32/commit
            CMD: shadow-48vm3 cat /tmp/t32/kernel
            CMD: shadow-48vm3 cat /tmp/t32/arch
            CMD: shadow-48vm3 cat /tmp/t32/bspace
            CMD: shadow-48vm3 cat /tmp/t32/ispace
            Upgrading from disk2_4-zfs.tar.bz2, created with:
              Commit: 2.4.93
              Kernel: 2.6.32-358.18.1.el6_lustre.g0753086.x86_64
                Arch: x86_64
            OST version: 2.7.58
            CMD: shadow-48vm3 zpool import -f -d /tmp/t32 t32fs-mdt1
            CMD: shadow-48vm3 zpool import -f -d /tmp/t32 t32fs-ost1
            CMD: shadow-48vm3 zpool list |
            			awk '/^t32fs-mdt1/ { print \$1 }'
            CMD: shadow-48vm3 zpool list |
            			awk '/^t32fs-mdt1/ { print \$1 }'
            CMD: shadow-48vm3 /usr/sbin/lctl set_param debug=-1
            debug=-1
            CMD: shadow-48vm3 tunefs.lustre --dryrun t32fs-mdt1/mdt1
            checking for existing Lustre data: found
            
               Read previous values:
            Target:     t32fs-MDT0000
            Index:      0
            Lustre FS:  t32fs
            Mount type: zfs
            Flags:      0x5
                          (MDT MGS )
            Persistent mount opts: 
            Parameters: lov.stripecount=0 lov.stripesize=1048576 mdt.identity_upcall=/usr/sbin/l_getidentity sys.timeout=20
            
            
               Permanent disk data:
            Target:     t32fs-MDT0000
            Index:      0
            Lustre FS:  t32fs
            Mount type: zfs
            Flags:      0x5
                          (MDT MGS )
            Persistent mount opts: 
            Parameters: lov.stripecount=0 lov.stripesize=1048576 mdt.identity_upcall=/usr/sbin/l_getidentity sys.timeout=20
            
            exiting before disk write.
            wait for devices to go
            CMD: shadow-48vm3 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/qt-3.3/bin:/usr/lib64/openmpi/bin:/usr/bin:/bin:/usr/sbin:/sbin::/sbin:/bin:/usr/sbin: NAME=autotest_config sh rpc.sh /usr/sbin/lctl device_list 
            CMD: shadow-48vm3 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/qt-3.3/bin:/usr/lib64/openmpi/bin:/usr/bin:/bin:/usr/sbin:/sbin::/sbin:/bin:/usr/sbin: NAME=autotest_config sh rpc.sh losetup -a 
            CMD: shadow-48vm3 mount -t lustre -o writeconf t32fs-mdt1/mdt1 /tmp/t32/mnt/mdt
            mkfs new MDT on lustre-mdt1_2/mdt1_2....
            CMD: shadow-48vm3 grep -c /mnt/fs2mds' ' /proc/mounts
            CMD: shadow-48vm3 lsmod | grep lnet > /dev/null && lctl dl | grep ' ST '
            CMD: shadow-48vm3 ! zpool list -H lustre-mdt1_2 >/dev/null 2>&1 ||
            			grep -q ^lustre-mdt1_2/ /proc/mounts ||
            			zpool export  lustre-mdt1_2
            CMD: shadow-48vm3 mkfs.lustre --mgsnode=shadow-48vm3@tcp --fsname=t32fs --mdt --index=1 --param=sys.timeout=20 --param=lov.stripesize=1048576 --param=lov.stripecount=0 --param=mdt.identity_upcall=/usr/sbin/l_getidentity --backfstype=zfs --device-size=200000 --reformat lustre-mdt1_2/mdt1_2 /dev/lvm-Role_MDS/S1
            CMD: shadow-48vm3 zpool set cachefile=none lustre-mdt1_2
            CMD: shadow-48vm3 ! zpool list -H lustre-mdt1_2 >/dev/null 2>&1 ||
            			grep -q ^lustre-mdt1_2/ /proc/mounts ||
            			zpool export  lustre-mdt1_2
            CMD: shadow-48vm3 tunefs.lustre --dryrun lustre-mdt1_2/mdt1_2
            shadow-48vm3: 
            shadow-48vm3: tunefs.lustre FATAL: Device lustre-mdt1_2/mdt1_2 has not been formatted with mkfs.lustre
            shadow-48vm3: tunefs.lustre: exiting with 19 (No such device)
            checking for existing Lustre data: not found
             conf-sanity test_32c: @@@@@@ FAIL: tunefs.lustre before mounting the MDT 
            
            laisiyao Lai Siyao added a comment - conf_sanity test_32c failed: == conf-sanity test 32c: dne upgrade test == 08:25:53 (1441527953) CMD: shadow-48vm3 which tunefs.lustre /usr/sbin/tunefs.lustre CMD: shadow-48vm3 find /usr/lib64/lustre/tests -maxdepth 1 -name 'disk*-zfs.tar.bz2' Loading modules from /usr/lib64/lustre detected 2 online CPUs by sysfs Force libcfs to create 2 CPU partitions debug=-1 subsystem_debug=all -lnet -lnd -pinger CMD: shadow-48vm3 /usr/sbin/lctl list_nids Loading modules from /usr/lib64/lustre detected 2 online CPUs by sysfs Force libcfs to create 2 CPU partitions debug=-1 subsystem_debug=all -lnet -lnd -pinger CMD: shadow-48vm3 mkdir -p /tmp/t32/mnt/mdt /tmp/t32/mnt/ost CMD: shadow-48vm3 tar xjvf /usr/lib64/lustre/tests/disk2_4-zfs.tar.bz2 -S -C /tmp/t32 arch bspace commit ispace kernel list mdt ost sha1sums CMD: shadow-48vm3 cat /tmp/t32/commit CMD: shadow-48vm3 cat /tmp/t32/kernel CMD: shadow-48vm3 cat /tmp/t32/arch CMD: shadow-48vm3 cat /tmp/t32/bspace CMD: shadow-48vm3 cat /tmp/t32/ispace Upgrading from disk2_4-zfs.tar.bz2, created with: Commit: 2.4.93 Kernel: 2.6.32-358.18.1.el6_lustre.g0753086.x86_64 Arch: x86_64 OST version: 2.7.58 CMD: shadow-48vm3 zpool import -f -d /tmp/t32 t32fs-mdt1 CMD: shadow-48vm3 zpool import -f -d /tmp/t32 t32fs-ost1 CMD: shadow-48vm3 zpool list | awk '/^t32fs-mdt1/ { print \$1 }' CMD: shadow-48vm3 zpool list | awk '/^t32fs-mdt1/ { print \$1 }' CMD: shadow-48vm3 /usr/sbin/lctl set_param debug=-1 debug=-1 CMD: shadow-48vm3 tunefs.lustre --dryrun t32fs-mdt1/mdt1 checking for existing Lustre data: found Read previous values: Target: t32fs-MDT0000 Index: 0 Lustre FS: t32fs Mount type: zfs Flags: 0x5 (MDT MGS ) Persistent mount opts: Parameters: lov.stripecount=0 lov.stripesize=1048576 mdt.identity_upcall=/usr/sbin/l_getidentity sys.timeout=20 Permanent disk data: Target: t32fs-MDT0000 Index: 0 Lustre FS: t32fs Mount type: zfs Flags: 0x5 (MDT MGS ) Persistent mount opts: Parameters: lov.stripecount=0 lov.stripesize=1048576 mdt.identity_upcall=/usr/sbin/l_getidentity sys.timeout=20 exiting before disk write. wait for devices to go CMD: shadow-48vm3 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/qt-3.3/bin:/usr/lib64/openmpi/bin:/usr/bin:/bin:/usr/sbin:/sbin::/sbin:/bin:/usr/sbin: NAME=autotest_config sh rpc.sh /usr/sbin/lctl device_list CMD: shadow-48vm3 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/qt-3.3/bin:/usr/lib64/openmpi/bin:/usr/bin:/bin:/usr/sbin:/sbin::/sbin:/bin:/usr/sbin: NAME=autotest_config sh rpc.sh losetup -a CMD: shadow-48vm3 mount -t lustre -o writeconf t32fs-mdt1/mdt1 /tmp/t32/mnt/mdt mkfs new MDT on lustre-mdt1_2/mdt1_2.... CMD: shadow-48vm3 grep -c /mnt/fs2mds' ' /proc/mounts CMD: shadow-48vm3 lsmod | grep lnet > /dev/null && lctl dl | grep ' ST ' CMD: shadow-48vm3 ! zpool list -H lustre-mdt1_2 >/dev/null 2>&1 || grep -q ^lustre-mdt1_2/ /proc/mounts || zpool export lustre-mdt1_2 CMD: shadow-48vm3 mkfs.lustre --mgsnode=shadow-48vm3@tcp --fsname=t32fs --mdt --index=1 --param=sys.timeout=20 --param=lov.stripesize=1048576 --param=lov.stripecount=0 --param=mdt.identity_upcall=/usr/sbin/l_getidentity --backfstype=zfs --device-size=200000 --reformat lustre-mdt1_2/mdt1_2 /dev/lvm-Role_MDS/S1 CMD: shadow-48vm3 zpool set cachefile=none lustre-mdt1_2 CMD: shadow-48vm3 ! zpool list -H lustre-mdt1_2 >/dev/null 2>&1 || grep -q ^lustre-mdt1_2/ /proc/mounts || zpool export lustre-mdt1_2 CMD: shadow-48vm3 tunefs.lustre --dryrun lustre-mdt1_2/mdt1_2 shadow-48vm3: shadow-48vm3: tunefs.lustre FATAL: Device lustre-mdt1_2/mdt1_2 has not been formatted with mkfs.lustre shadow-48vm3: tunefs.lustre: exiting with 19 (No such device) checking for existing Lustre data: not found conf-sanity test_32c: @@@@@@ FAIL: tunefs.lustre before mounting the MDT

            Please provide a more useful summary and description for this bug.

            adilger Andreas Dilger added a comment - Please provide a more useful summary and description for this bug.

            People

              yujian Jian Yu
              maloo Maloo
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: