[LU-12829] sanity-quota test 61 fails with 'write succeed, expect EDQUOT'

Related — Mon, 18 Dec 2023 22:21:17 +0000

sanity-quota test_61 fails with 'write succeed, expect EDQUOT'. This test seems to fail once or twice a month on master and/or on b2_12 and started in March or earlier of this year.

sanity-quota test 61 fails the following call to the test_default_quota() routine

3274         test_default_quota "-g" "data"

and fails the following code in the test_default_quota() routine

3192         log "Test out of quota"
3193         # flush cache, ensure noquota flag is set on client
3194         cancel_lru_locks osc
3195         cancel_lru_locks mdc
3196         sync; sync_all_data || true
3197         if [ $qpool == "data" ]; then
3198                 $RUNAS $DD of=$TESTFILE count=$((LIMIT*2 >> 10)) oflag=sync &&
3199                         quota_error $qtype $qid "write succeed, expect EDQUOT"

Looking at the client test_log for the failure at https://testing.whamcloud.com/test_sets/1e9bb45a-d2ce-11e9-a25b-52540065bddc, we see

set to use default quota
set default quota
get default quota
Disk default grp quota:
     Filesystem   bquota  blimit  bgrace   iquota  ilimit  igrace
    /mnt/lustre  20480   20480       0      0       0  604800
Test not out of quota
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d61.sanity-quota/f61.sanity-quota-0] [count=10] [oflag=sync]
10+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 3.08127 s, 3.4 MB/s
Test out of quota
CMD: trevis-12vm4,trevis-12vm5 lctl set_param -n os[cd]*.*MDT*.force_sync=1
CMD: trevis-12vm3 lctl set_param -n osd*.*OS*.force_sync=1
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d61.sanity-quota/f61.sanity-quota-0] [count=40] [oflag=sync]
40+0 records in
40+0 records out
41943040 bytes (42 MB) copied, 10.5095 s, 4.0 MB/s
 sanity-quota test_61: @@@@@@ FAIL: write succeed, expect EDQUOT 
  Trace dump:
  = /usr/lib64/lustre/tests/test-framework.sh:6115:error()
  = /usr/lib64/lustre/tests/sanity-quota.sh:152:quota_error()
  = /usr/lib64/lustre/tests/sanity-quota.sh:3199:test_default_quota()
  = /usr/lib64/lustre/tests/sanity-quota.sh:3274:test_61()

Looking at the console logs, there is nothing obviously wrong and no error messages.

Logs for past failures are at
https://testing.whamcloud.com/test_sets/c4e0eb7a-e019-11e9-9874-52540065bddc
https://testing.whamcloud.com/test_sets/f302b6ae-d548-11e9-90ad-52540065bddc
https://testing.whamcloud.com/test_sets/32fd1f46-e2d3-11e9-a197-52540065bddc

Whamcloud Community JIRA

[LU-12829] sanity-quota test 61 fails with 'write succeed, expect EDQUOT'