[LU-9852] zfs pool creation fails in version 0.7.0

• Type: Bug
• Resolution: Not a Bug
• Priority: Major
• Affects Version/s: Lustre 2.10.0
• Labels: zfs
• Severity: 3
• Assignee: Nathaniel Clark
• Reporter: Abe (Inactive)

Description

Under zfs 0.7 zpool create fails with this response, anything has changed in version 0.7 ?

zpool create -f -o ashift=12 ost raidz2 35000c5008355e2c3 35000c5008355cedb 35000c500837ece67 35000c5008355ddcf 35000c500837f23cf 35000c500837f2b93 35000c5008355bb67 35000c5008355bbdf 35000c5008355da8b 35000c500837f249f 35000c5008355c33b

cannot create 'ost': invalid argument for this pool operation
rpm -qa "zpool"
libzpool2-0.7.0-1.el7_3.x86_64

dkms status
lustre, 2.10.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed
spl, 0.7.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed
zfs, 0.7.0, 3.10.0-514.21.1.el7_lustre.x86_64, x86_64: installed

thanks,
Abe

Comments

[Abe (Inactive)]

make sense, pls go ahead close this ticket..

thank you Nathaniel for the support,
Abe

[Nathaniel Clark]

Looking at the log, it looks like you had ZFS 0.6.5.9 installed then upgraded to 0.7.0, but the old modules weren't unloaded prior to upgrade, so I think that is where the issue lay, and why a reboot fixed it.

[Abe (Inactive)]

Hi Nathaniel,

The problem went away after i rebooted the server, however still like to know
the root cause..
I have uploaded the sosreport, pls take a look and let me know your findings.

[root@OSS1-A212 tmp]# ncftp ftp.hpdd.intel.com
NcFTP 3.2.5 (Feb 02, 2011) by Mike Gleason (http://www.NcFTP.com/contact/).

Copyright (c) 1992-2011 by Mike Gleason.
All rights reserved.

Connecting to ftp.hpdd.intel.com...
Welcome to the FTP service on ftp-1.onyx.hpdd.intel.com. Please be nice.
Logging in...
Login successful.
Logged in to ftp.hpdd.intel.com.
ncftp / > cd uploads
Directory successfully changed.
ncftp /uploads > mkdir LU-9852
ncftp /uploads > cd LU-9852
Directory successfully changed.
ncftp /uploads/LU-9852 > ls
ncftp /uploads/LU-9852 > put sosreport-AbeAsraoui-20170811194052.tar.xz
sosreport-AbeAsraoui-20170811194052.tar.xz: 102.83 MB 2.43 MB/s
Could not preserve times for sosreport-AbeAsraoui-20170811194052.tar.xz: UTIME failed.
ncftp /uploads/LU-9852 > ls -l sos*
rw-rr- 1 99 50 107827736 Aug 22 2017 sosreport-AbeAsraoui-20170811194052.tar.xz

thanks,
Abe

[Nathaniel Clark]

Here are the following instructions for ftp upload:

Sometimes the diagnostic data collected as part of Lustre troubleshooting is too large to be attached to a JIRA ticket. For these cases, HPDD provides an anonymous write-only FTP upload service. In order to use this service, you'll need an FTP client (e.g. ncftp, ftp, etc.) and a JIRA issue. Use the 'uploads' directory and create a new subdirectory using your Jira issue as a name.
In the following example, there are three debug logs in a single directory and the JIRA issue LU-4242 has been created. After completing the upload, please update the relevant issue with a note mentioning the upload, so that our engineers know where to find your logs.

$ ls -lh
total 333M
-rw-r--r-- 1 mjmac mjmac  98M Feb 23 17:36 mds-debug
-rw-r--r-- 1 mjmac mjmac 118M Feb 23 17:37 oss-00-debug
-rw-r--r-- 1 mjmac mjmac 118M Feb 23 17:37 oss-01-debug
$ ncftp ftp.hpdd.intel.com
NcFTP 3.2.2 (Sep 04, 2008) by Mike Gleason (http://www.NcFTP.com/contact/).
Connecting to 99.96.190.235...
(vsFTPd 2.2.2)
Logging in...
Login successful.
Logged in to ftp.hpdd.intel.com.
ncftp / > cd uploads
Directory successfully changed.
ncftp /uploads > mkdir LU-4242
ncftp /uploads > cd LU-4242
Directory successfully changed.
ncftp /uploads/LU-4242 > put *
mds-debug:                                              97.66 MB   11.22 MB/s
oss-00-debug:                                          117.19 MB   11.16 MB/s
oss-01-debug:                                          117.48 MB   11.18 MB/s
ncftp /uploads/LU-4242 >

Please note that this is a WRITE-ONLY FTP service, so you will not be able to see (with ls) the files or directories you've created, nor will you (or anyone other than HPDD staff) be able to see or read them.

[Abe (Inactive)]

Hi Nathaniel,

is there a tftp server i can ftp the the compressed tar file to ?

thanks,
Abe

[Abe (Inactive)]

not able to upload the sos report, is there a tftp server or an email where i can upload this ?

File "sosreport-AbeAsraoui-20170811194052.tar.xz" was not uploaded
File exceeds maximum size limit set by the administrator (100.00 MB).

thanks,
Abe

[Abe (Inactive)]

sorry not familiar with this sosreport, how do i run it and how to download this tool..

thanks,
Abe

[Nathaniel Clark]

Can you attach an sosreport from the affected OSS?

[Abe (Inactive)]

it looks like it is mapped:
e.g.
zpool create -f -o ashift=12 ost1 raidz2 35000c5008355e01f 35000c5008355ce6b 35000c500837f714b 35000c5008355dc6f 35000c50083551f3b 35000c500837eccbb 35000c5008355229f 35000c5008357281b 35000c50083571977 35000c50083571ceb 35000c500835550c7

lrwxrwxrwx 1 root root 7 Aug 11 13:42 /dev/mapper/35000c5008355e01f -> ../dm-4
lrwxrwxrwx 1 root root 7 Aug 11 13:42 /dev/mapper/35000c5008355ce6b -> ../dm-5
lrwxrwxrwx 1 root root 7 Aug 11 13:42 /dev/mapper/35000c500837f714b -> ../dm-6
lrwxrwxrwx 1 root root 7 Aug 11 13:42 /dev/mapper/35000c5008355dc6f -> ../dm-7
lrwxrwxrwx 1 root root 7 Aug 11 13:42 /dev/mapper/35000c50083551f3b -> ../dm-8
lrwxrwxrwx 1 root root 7 Aug 11 13:42 /dev/mapper/35000c500837eccbb -> ../dm-9
lrwxrwxrwx 1 root root 8 Aug 11 13:42 /dev/mapper/35000c5008355229f -> ../dm-10
lrwxrwxrwx 1 root root 8 Aug 11 13:42 /dev/mapper/35000c5008357281b -> ../dm-11
lrwxrwxrwx 1 root root 8 Aug 11 13:42 /dev/mapper/35000c50083571977 -> ../dm-12
lrwxrwxrwx 1 root root 8 Aug 11 13:42 /dev/mapper/35000c50083571ceb -> ../dm-13
lrwxrwxrwx 1 root root 8 Aug 11 13:42 /dev/mapper/35000c500835550c7 -> ../dm-14

[Nathaniel Clark]

The mpath's listed in the create, aren't listed in /dev/mapper/. Maybe the LUs aren't mapped to this server?