[LU-7395] lfs and ls failed as: Argument list too long

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.8.0
• Type: Bug
• Priority: Minor
• Reporter: Sarah Liu
• Assignee: WC Triage
• Resolution: Not a Bug

Environment

client and server: lustre-master #3226 RHEL7

• Severity: 3

Description

Not sure if there is any limitation here but running lfs and ls failed

[root@onyx-27 lustre]# lfs getstripe -M /mnt/lustre/other_dir/* |grep 1
1
1
1
1
[root@onyx-27 lustre]# lfs getstripe -M /mnt/lustre/other_dir/* |grep 0
0
0
0
[root@onyx-27 lustre]# lfs getstripe -M /mnt/lustre/migrate_dir/* |grep 0
-bash: /bin/lfs: Argument list too long
[root@onyx-27 lustre]# 
[root@onyx-27 lustre]# ls /mnt/lustre/migrate_dir/* |grep 1
-bash: /bin/ls: Argument list too long
[root@onyx-27 lustre]# lfs df -i
UUID                      Inodes       IUsed       IFree IUse% Mounted on
lustre-MDT0000_UUID      1000184         332      999852   0% /mnt/lustre[MDT:0]
lustre-MDT0001_UUID      1000184      522379      477805  52% /mnt/lustre[MDT:1]
lustre-MDT0002_UUID      1000184         236      999948   0% /mnt/lustre[MDT:2]
lustre-MDT0003_UUID      1000184         236      999948   0% /mnt/lustre[MDT:3]
lustre-OST0000_UUID       131072      131072           0 100% /mnt/lustre[OST:0]
lustre-OST0001_UUID       131072      131072           0 100% /mnt/lustre[OST:1]
lustre-OST0002_UUID       131072      131072           0 100% /mnt/lustre[OST:2]
lustre-OST0003_UUID       131072      131072           0 100% /mnt/lustre[OST:3]

filesystem summary:       523183      523183           0 100% /mnt/lustre

Comments

[Robert Read (Inactive)]

That error is actually coming from bash, and yes there is a limitation on command line length so using wildcards on the command line is error prone.

In the case of lfs, you can use something like "find /mnt/lustre/other_dir -maxdepth 1 |xargs lfs -M | grep 0" or "lfs --recursive -M /mnt/lustre/dir | grep 0", depending on how much flexibility you need in limiting the scan. For ls you can just drop the the wildcard so ls will just list that directory or use -R option to enable recursion.

[Joseph Gmitter (Inactive)]

Hi Sarah,
Is this part of a test script? At the triage call, it was discussed that the issue is using /* in the commands and should be left off to resolve the problem. however, it if is part of a test script, the script will need to be updated.
Thanks.
Joe

[Andreas Dilger]

The "argument list too long" message is from the expansion of "*" on the command line.

That said, there also appears to be a problem that the 4 MDTs have 1M inodes each, but the OSTs only have 128k inodes each and they have all been used, so the filesystem can only create at most 512k files with objects. I don't know if this is also affecting your testing, but I thought I would point it out

[Sarah Liu]

Hi Joe,
This is not from test script, I hit it when manually tested migration; I will try Robert's way