[LU-3964] inode overquota error although user is well below quota

Tue, 29 Jul 2014 18:09:33 +0000

"SOME" users run into over quota when creating a lot (ie 400 tasks creating 400 files) using fopen. There perror return is "Disk quota exceeded" even though they are will below the inode quota.

Test Case:
The debug logs is 64MB please let me know how to upload the file. User ID is 30180. One thing I notices is for this users iunit=2 and itune=1. For other users it can be very large. Even after setting quota_least_iunit=512

Here is the proc values:
quota_boundary_factor=4
quota_btune_sz=67108850
quota_bunit_sz=134217728
quota_itune_sz=2560
quota_iunit_sz=5120
quota_least_bunit=1048576
quota_least_iunit=512
quota_qs_factor=2
quota_switch_qs=changing qunit size is enabled
quota_switch_seconds=300
quota_sync_blk=0
quota_type=u3

A modified version of mdsrate.c using fopen.
bash-3.2$ rm f*;mpiexec -n 400 /nobackupp1/mahmoudhanafiTesting_echiang/mdsrate.intel_mpt --verbose --create --nfiles 400
0: r133i1n5 starting at Mon Sep 16 15:11:19 2013
f396: Disk quota exceeded
rank 396: open(f396) error: Success
MPT: Global rank 396 is aborting with error code 1.
Process ID: 12249, Host: r134i2n2, Program: /nobackupp1/mah

bash-3.2$ lfs quota -v /nobackupp1
Disk quotas for Filesystem kbytes /nobackupp1 388163032 nbp1-MDT0000_UUID
71540 nbp1-OST0000_UUID
3946924 nbp1-OST0001_UUID
3056352 nbp1-OST0002_UUID
3893468 nbp1-OST0003_UUID
3343592 nbp1-OST0004_UUID
3439124 nbp1-OST0005_UUID
3443716 nbp1-OST0006_UUID
2951164 nbp1-OST0007_UUID
2815988 nbp1-OST0008_UUID
3334720 nbp1-OST0009_UUID
3314664 nbp1-OST000a_UUID
3229116 nbp1-OST000b_UUID
3295576 nbp1-OST000c_UUID
3359160 nbp1-OST000d_UUID
3131648 nbp1-OST000e_UUID
2967292 nbp1-OST000f_UUID
3231296 nbp1-OST0010_UUID
4360532 nbp1-OST0011_UUID
2412480 nbp1-OST0012_UUID
3411052 nbp1-OST0013_UUID
3426328 nbp1-OST0014_UUID
3368980 nbp1-OST0015_UUID
2926928 nbp1-OST0016_UUID
3251712 nbp1-OST0017_UUID
2758180 nbp1-OST0018_UUID
2945264 nbp1-OST0019_UUID
2355904 nbp1-OST001a_UUID
2925488 nbp1-OST001b_UUID
3389104 nbp1-OST001c_UUID
3231104 nbp1-OST001d_UUID
3852040 nbp1-OST001e_UUID
3378656 nbp1-OST001f_UUID
2746128 nbp1-OST0020_UUID
3040204 nbp1-OST0021_UUID
2564516 nbp1-OST0022_UUID
3022252 nbp1-OST0023_UUID
3025024 nbp1-OST0024_UUID
3388188 nbp1-OST0025_UUID
3240412 nbp1-OST0026_UUID
3744020 nbp1-OST0027_UUID
3455960 nbp1-OST0028_UUID
3678528 nbp1-OST0029_UUID
3705640 nbp1-OST002a_UUID
3257948 nbp1-OST002b_UUID
3208432 nbp1-OST002c_UUID
3064224 nbp1-OST002d_UUID
2865980 nbp1-OST002e_UUID
3791268 nbp1-OST002f_UUID
3174436 nbp1-OST0030_UUID
2329128 nbp1-OST0031_UUID
3961672 nbp1-OST0032_UUID
3541660 nbp1-OST0033_UUID
3463088 nbp1-OST0034_UUID
2845520 nbp1-OST0035_UUID
2648728 nbp1-OST0036_UUID
3005508 nbp1-OST0037_UUID
3657768 nbp1-OST0038_UUID
3093848 nbp1-OST0039_UUID
2478220 nbp1-OST003a_UUID
3280152 nbp1-OST003b_UUID
2499008 nbp1-OST003c_UUID
3406280 nbp1-OST003d_UUID
3450564 nbp1-OST003e_UUID
3326960 nbp1-OST003f_UUID
2665224 nbp1-OST0040_UUID
2831504 nbp1-OST0041_UUID
3450520 nbp1-OST0042_UUID
3156436 nbp1-OST0043_UUID
2798676 nbp1-OST0044_UUID
3628844 nbp1-OST0045_UUID
3255928 nbp1-OST0046_UUID
3038004 nbp1-OST0047_UUID
3138496 nbp1-OST0048_UUID
3718224 nbp1-OST0049_UUID
2859828 nbp1-OST004a_UUID
3540212 nbp1-OST004b_UUID
3150716 nbp1-OST004c_UUID
3591992 nbp1-OST004d_UUID
3471888 nbp1-OST004e_UUID
3748968 nbp1-OST004f_UUID
3354948 nbp1-OST0050_UUID
3316300 nbp1-OST0051_UUID
3152108 nbp1-OST0052_UUID
3838468 nbp1-OST0053_UUID
3376732 nbp1-OST0054_UUID
3918108 nbp1-OST0055_UUID
3449808 nbp1-OST0056_UUID
3551388 nbp1-OST0057_UUID
3667468 nbp1-OST0058_UUID
3354304 nbp1-OST0059_UUID
2965084 nbp1-OST005a_UUID
2929228 nbp1-OST005b_UUID
2948140 nbp1-OST005c_UUID
3411472 nbp1-OST005d_UUID
3339932 nbp1-OST005e_UUID
2810480 nbp1-OST005f_UUID
3375644 nbp1-OST0060_UUID
4247276 nbp1-OST0061_UUID
3574344 nbp1-OST0062_UUID
3407656 nbp1-OST0063_UUID
3894524 nbp1-OST0064_UUID
3226492 nbp1-OST0065_UUID
3812356 nbp1-OST0066_UUID
3089144 nbp1-OST0067_UUID
2847240 nbp1-OST0068_UUID
3166388 nbp1-OST0069_UUID
2993524 nbp1-OST006a_UUID
3249768 nbp1-OST006b_UUID
3110808 nbp1-OST006c_UUID
2656340 nbp1-OST006d_UUID
3244824 nbp1-OST006e_UUID
2712384 nbp1-OST006f_UUID
2970080 nbp1-OST0070_UUID
2657952 nbp1-OST0071_UUID
3438304 nbp1-OST0072_UUID
3103096 nbp1-OST0073_UUID
3004436 nbp1-OST0074_UUID
3615556 nbp1-OST0075_UUID
2835936 nbp1-OST0076_UUID
3352284 nbp1-OST0077_UUID
2366892 group quotas are not enabled. user echiang (uid 30180):
quota limit grace files quota limit grace
530000000 1100000000 - 390994 600000 750000 -
- 262144 - 390994 - 390996 -
- 4063232 - - - - -
- 3145728 - - - - -
- 4063232 - - - - -
- 3538944 - - - - -
- 3538944 - - - - -
- 3538944 - - - - -
- 3145728 - - - - -
- 2883584 - - - - -
- 3407872 - - - - -
- 3407872 - - - - -
- 3407872 - - - - -
- 3407872 - - - - -
- 3538944 - - - - -
- 3276800 - - - - -
- 3145728 - - - - -
- 3407872 - - - - -
- 4456448 - - - - -
- 2490368 - - - - -
- 3538944 - - - - -
- 3538944 - - - - -
- 3538944 - - - - -
- 3014656 - - - - -
- 3407872 - - - - -
- 2883584 - - - - -
- 3014656 - - - - -
- 2490368 - - - - -
- 3014656 - - - - -
- 3538944 - - - - -
- 3407872 - - - - -
- 3932160 - - - - -
- 3538944 - - - - -
- 2883584 - - - - -
- 3145728 - - - - -
- 2752512 - - - - -
- 3145728 - - - - -
- 3145728 - - - - -
- 3538944 - - - - -
- 3407872 - - - - -
- 3932160 - - - - -
- 3538944 - - - - -
- 3801088 - - - - -
- 3801088 - - - - -
- 3407872 - - - - -
- 3276800 - - - - -
- 3145728 - - - - -
- 3014656 - - - - -
- 3932160 - - - - -
- 3276800 - - - - -
- 2490368 - - - - -
- 4063232 - - - - -
- 3670016 - - - - -
- 3538944 - - - - -
- 3014656 - - - - -
- 2752512 - - - - -
- 3145728 - - - - -
- 3801088 - - - - -
- 3276800 - - - - -
- 2621440 - - - - -
- 3407872 - - - - -
- 2621440 - - - - -
- 3538944 - - - - -
- 3538944 - - - - -
- 3407872 - - - - -
- 2752512 - - - - -
- 3014656 - - - - -
- 3538944 - - - - -
- 3276800 - - - - -
- 2883584 - - - - -
- 3801088 - - - - -
- 3407872 - - - - -
- 3145728 - - - - -
- 3276800 - - - - -
- 3801088 - - - - -
- 3014656 - - - - -
- 3670016 - - - - -
- 3276800 - - - - -
- 3670016 - - - - -
- 3538944 - - - - -
- 3932160 - - - - -
- 3538944 - - - - -
- 3407872 - - - - -
- 3276800 - - - - -
- 3932160 - - - - -
- 3538944 - - - - -
- 4063232 - - - - -
- 3538944 - - - - -
- 3670016 - - - - -
- 3801088 - - - - -
- 3538944 - - - - -
- 3145728 - - - - -
- 3014656 - - - - -
- 3014656 - - - - -
- 3538944 - - - - -
- 3407872 - - - - -
- 2883584 - - - - -
- 3538944 - - - - -
- 4325376 - - - - -
- 3670016 - - - - -
- 3538944 - - - - -
- 4063232 - - - - -
- 3407872 - - - - -
- 3932160 - - - - -
- 3276800 - - - - -
- 3014656 - - - - -
- 3276800 - - - - -
- 3145728 - - - - -
- 3407872 - - - - -
- 3276800 - - - - -
- 2752512 - - - - -
- 3407872 - - - - -
- 2883584 - - - - -
- 3145728 - - - - -
- 2752512 - - - - -
- 3538944 - - - - -
- 3276800 - - - - -
- 3145728 - - - - -
- 3801088 - - - - -
- 3014656 - - - - -
- 3538944 - - - - -
- 2490368 - - - - -

Whamcloud Community JIRA

[LU-3964] inode overquota error although user is well below quota