[LU-2113] ENOSPC sometimes incorrectly reported as file too bigin lfs setstripe

• Type: Bug
• Resolution: Duplicate
• Priority: Minor
• Affects Version/s: Lustre 2.4.0
• Severity: 3
• Assignee: WC Triage
• Reporter: Oleg Drokin

Description

Lately I seem to see a lot of reports of Not enough space being actally reported as file too big.
Here's a sample:

== sanity test 27o: create file with all full OSTs (should error) ====== 17:17:23 (1349731043)
fail_loc=0
OSTIDX=0 MDSIDX=1
osc.lustre-OST0000-osc-MDT0000.prealloc_last_id=387
osc.lustre-OST0000-osc-MDT0000.prealloc_next_id=387
osc.lustre-OST0000-osc-MDT0000.prealloc_reserved=0
osc.lustre-OST0000-osc-MDT0000.prealloc_status=-28
osc.lustre-OST0001-osc-MDT0000.prealloc_last_id=131
osc.lustre-OST0001-osc-MDT0000.prealloc_next_id=103
osc.lustre-OST0001-osc-MDT0000.prealloc_reserved=0
osc.lustre-OST0001-osc-MDT0000.prealloc_status=0
fail_val=-1
fail_loc=0x215
Creating to objid 387 on ost lustre-OST0000...
total: 2 creates in 0.00 seconds: 1212.75 creates/second
osc.lustre-OST0000-osc-MDT0000.prealloc_last_id=387
osc.lustre-OST0000-osc-MDT0000.prealloc_next_id=387
osc.lustre-OST0000-osc-MDT0000.prealloc_reserved=0
osc.lustre-OST0000-osc-MDT0000.prealloc_status=-28
osc.lustre-OST0001-osc-MDT0000.prealloc_last_id=131
osc.lustre-OST0001-osc-MDT0000.prealloc_next_id=103
osc.lustre-OST0001-osc-MDT0000.prealloc_reserved=0
osc.lustre-OST0001-osc-MDT0000.prealloc_status=0
fail_loc=0x215
OSTIDX=1 MDSIDX=1
osc.lustre-OST0000-osc-MDT0000.prealloc_last_id=387
osc.lustre-OST0000-osc-MDT0000.prealloc_next_id=387
osc.lustre-OST0000-osc-MDT0000.prealloc_reserved=0
osc.lustre-OST0000-osc-MDT0000.prealloc_status=-28
osc.lustre-OST0001-osc-MDT0000.prealloc_last_id=131
osc.lustre-OST0001-osc-MDT0000.prealloc_next_id=103
osc.lustre-OST0001-osc-MDT0000.prealloc_reserved=0
osc.lustre-OST0001-osc-MDT0000.prealloc_status=-28
fail_val=-1
fail_loc=0x215
Creating to objid 131 on ost lustre-OST0001...
open(/mnt/lustre/d0.sanity/d27/lustre-OST0001/f131) error: File too large
total: 28 creates in 0.02 seconds: 1181.39 creates/second
osc.lustre-OST0000-osc-MDT0000.prealloc_last_id=387
osc.lustre-OST0000-osc-MDT0000.prealloc_next_id=387
osc.lustre-OST0000-osc-MDT0000.prealloc_reserved=0
osc.lustre-OST0000-osc-MDT0000.prealloc_status=-28
osc.lustre-OST0001-osc-MDT0000.prealloc_last_id=131
osc.lustre-OST0001-osc-MDT0000.prealloc_next_id=131
osc.lustre-OST0001-osc-MDT0000.prealloc_reserved=0
osc.lustre-OST0001-osc-MDT0000.prealloc_status=-28
fail_loc=0x215
touch: cannot touch `/mnt/lustre/d0.sanity/d27/f.sanity.27o': No space left on device
fail_loc=0
Resetting fail_loc on all nodes...done.
PASS 27o (46s)

Another example

== sanity test 65k: validate manual striping works properly with deactivated OSCs == 17:27:39 (1349731659)
Check OST status: 
lustre-OST0000-osc-MDT0000 is activate
lustre-OST0001-osc-MDT0000 is activate
Deactivate:  lustre-OST0000-osc-MDT0000
/home/green/git/lustre-release/lustre/utils/lfs setstripe -i 0 -c 1 /mnt/lustre/d0.sanity/d65/0
/home/green/git/lustre-release/lustre/utils/lfs setstripe -i 1 -c 1 /mnt/lustre/d0.sanity/d65/1
lustre-OST0000-osc-MDT0000 is Activate.
Deactivate:  lustre-OST0001-osc-MDT0000
/home/green/git/lustre-release/lustre/utils/lfs setstripe -i 0 -c 1 /mnt/lustre/d0.sanity/d65/0
error on ioctl 0x4008669a for '/mnt/lustre/d0.sanity/d65/0' (3): File too large
error: setstripe: create stripe file '/mnt/lustre/d0.sanity/d65/0' failed
 sanity test_65k: @@@@@@ FAIL: setstripe should have succeeded 

Issue Links

• is related to: LU-10350 ost-pools test 1n fails with 'failed to write to /mnt/lustre/d1n.ost-pools/file: 1'