[LU-11569] mkfs.lustre return error to upgrade e2fsprogs

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.11.0
• Type: Bug
• Priority: Major
• Reporter: Abe
• Assignee: WC Triage
• Resolution: Done
• Severity: 3

Description

we are seeing these error when issuing mkfs.lustre command:

mkfs.lustre FATAL: "-O quota" must be supported by e2fsprogs, please upgrade your e2fsprogs.

 

cli command issued:

[root@oss100 ~]# mkfs.lustre --reformat --ost --backfstype=ldiskfs --fsname=tempAA --index=8 --mgsnode=10.10.10.251@o2ib /dev/sdd

Permanent disk data:
Target: tempAA:OST0008
Index: 8
Lustre FS: tempAA
Mount type: ldiskfs
Flags: 0x62
(OST first_time update )
Persistent mount opts: ,errors=remount-ro
Parameters: mgsnode=10.10.10.251@o2ib

 

 

device size = 5723166MB

mkfs.lustre FATAL: "-O quota" must be supported by e2fsprogs, please upgrade your e2fsprogs.

mkfs.lustre FATAL: mkfs failed 22
mkfs.lustre: exiting with 22 (Invalid argument).  thanks,

Abe

 

 

 

 

Comments

[Andreas Dilger]

What version of e2fsprogs do you have? Do you have the Lustre e2fsprogs-1.42.13.wc5 at least?

[Abe]

this is the version we have installed:

root@oss100 lustre-2.11-rpms]# rpm -qa | grep e2fsprogs
e2fsprogs-libs-1.42.9-12.el7_5.x86_64
e2fsprogs-devel-1.42.9-12.el7_5.x86_64
e2fsprogs-1.42.9-12.el7_5.x86_64
e2fsprogs-static-1.42.9-12.el7_5.x86_64
[root@oss100 lustre-2.11-rpms]#

 

thanks,

Abe

[Peter Jones]

Abe

Try with the latest Lustre-specific version - https://downloads.whamcloud.com/public/e2fsprogs/ 

Peter

[Abe]

I went ahead and upgrade e2fs to rev wc5, however an issue come up with ldiskfs module not loaded!!

 

[root@oss100 ~]# mkfs.lustre --reformat --ost --backfstype=ldiskfs --fsname=tempAA --index=8 --mgsnode=10.10.10.251@o2ib /dev/sdd

Permanent disk data:
Target: tempAA:OST0008
Index: 8
Lustre FS: tempAA
Mount type: ldiskfs
Flags: 0x62
(OST first_time update )
Persistent mount opts: ,errors=remount-ro
Parameters: mgsnode=10.10.10.251@o2ib

device size = 5723166MB
formatting backing filesystem ldiskfs on /dev/sdd
target name tempAA:OST0008
4k blocks 1465130646
options -J size=400 -I 512 -i 524288 -q -O extents,uninit_bg,dir_nlink,quota,huge_file,flex_bg -G 256 -E resize="4290772992",lazy_journal_init -F
mkfs_cmd = mke2fs -j -b 4096 -L tempAA:OST0008 -J size=400 -I 512 -i 524288 -q -O extents,uninit_bg,dir_nlink,quota,huge_file,flex_bg -G 256 -E resize="4290772992",lazy_journal_init -F /dev/sdd 1465130646
mkfs.lustre: Unable to mount /dev/sdd: No such device
Is the ldiskfs module available?

mkfs.lustre FATAL: failed to write local files
mkfs.lustre: exiting with 19 (No such device)
[root@oss100 ~]# dkms status
lustre-all, 2.11.0, 3.10.0-693.21.1.el7_lustre.x86_64, x86_64: installed
spl, 0.7.6, 3.10.0-693.21.1.el7_lustre.x86_64, x86_64: installed
zfs, 0.7.6, 3.10.0-693.21.1.el7_lustre.x86_64, x86_64: installed
[root@oss100 ~]#

 

 

root@oss100 ~]# modprobe ldiskfs
modprobe: FATAL: Module ldiskfs not found.
[root@oss100 ~]#

 

thanks,

Abe

[Abe]

Hi Peter/Andreas,

 

any ideas what is causing this ?

 

thanks,

Abe

 

[Andreas Dilger]

I would imagine your ldiskfs module is not installed or does not match the current kernel version, so it can't be loaded?

[Abe]

ldiskfs appears to be installed, is there anything that we are missing ?

root@oss100 lustre-2.11-rpms]# rpm -qa | grep osd
kmod-lustre-osd-ldiskfs-2.11.0-1.el7.x86_64
lustre-osd-ldiskfs-mount-2.11.0-1.el7.x86_64
lustre-osd-zfs-mount-2.11.0-1.el7.x86_64
[root@oss100 lustre-2.11-rpms]#

 

[root@oss100 lustre-2.11-rpms]# dkms status
lustre-all, 2.11.0: added
spl, 0.7.6, 3.10.0-693.21.1.el7_lustre.x86_64, x86_64: installed
spl, 0.7.6, 3.10.0-862.14.4.el7.x86_64, x86_64: installed
zfs, 0.7.6, 3.10.0-693.21.1.el7_lustre.x86_64, x86_64: installed
zfs, 0.7.6, 3.10.0-862.14.4.el7.x86_64, x86_64: installed
[root@oss100 lustre-2.11-rpms]#

 

thanks,

Abe

[Andreas Dilger]

Does "modprobe ldiskfs" result in the ldiskfs module being loaded? What does "modinfo ldiskfs" report and "uname -a"?

[Abe]

[root@oss100 IntelOPA-Basic.RHEL74-x86_64.10.7.0.0.145]# modprobe ldiskfs
[root@oss100 IntelOPA-Basic.RHEL74-x86_64.10.7.0.0.145]# modinfo ldiskfs
filename: /lib/modules/3.10.0-693.21.1.el7_lustre.x86_64/extra/lustre-osd-ldiskfs/fs/ldiskfs.ko
license: GPL
description: Fourth Extended Filesystem
author: Remy Card, Stephen Tweedie, Andrew Morton, Andreas Dilger, Theodore Ts'o and others
alias: fs-ldiskfs
retpoline: Y
rhelversion: 7.4
srcversion: 754AF59D82FDB7BC80F3A5E
depends: mbcache,jbd2
vermagic: 3.10.0-693.21.1.el7_lustre.x86_64 SMP mod_unload modversions
[root@oss100 IntelOPA-Basic.RHEL74-x86_64.10.7.0.0.145]#

[root@oss100 IntelOPA-Basic.RHEL74-x86_64.10.7.0.0.145]# uname -a
Linux oss100 3.10.0-693.21.1.el7_lustre.x86_64 #1 SMP Tue Apr 3 17:48:49 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
[root@oss100 IntelOPA-Basic.RHEL74-x86_64.10.7.0.0.145]#

 

Hmm that seems to have worked after issuing mod probe ldiskfs

mkfs.lustre --reformat --ost --backfstype=ldiskfs --fsname=tempAA --index=8 --mgsnode=10.10.10.251@o2ib /dev/sdb

Permanent disk data:
Target: tempAA:OST0008
Index: 8
Lustre FS: tempAA
Mount type: ldiskfs
Flags: 0x62
(OST first_time update )
Persistent mount opts: ,errors=remount-ro
Parameters: mgsnode=10.10.10.251@o2ib

device size = 160233472MB
formatting backing filesystem ldiskfs on /dev/sdb
target name tempAA:OST0008
4k blocks 41019768832
options -J size=400 -I 512 -i 1048576 -q -O extents,uninit_bg,dir_nlink,quota,huge_file,64bit,flex_bg -G 256 -E lazy_journal_init -F
mkfs_cmd = mke2fs -j -b 4096 -L tempAA:OST0008 -J size=400 -I 512 -i 1048576 -q -O extents,uninit_bg,dir_nlink,quota,huge_file,64bit,flex_bg -G 256 -E lazy_journal_init -F /dev/sdb 41019768832
Writing CONFIGS/mountdata
[root@oss100 IntelOPA-Basic.RHEL74-x86_64.10.7.0.0.145]#

Is there any documentation on how to benchmark ldiskfs, is obdsurvery supported on this release ?

 

thanks,

Abe

 

[Andreas Dilger]

Lustre e2fsprogs was not installed, problem was resolved once installed.