[LU-14202] sanity-sec test 16 fails with 'unable to write quota test file'

• Type: Bug
• Resolution: Duplicate
• Priority: Minor
• Affects Version/s: Lustre 2.14.0
• Labels: rhel8.3
• Environment: RHEL 8.3 clients/servers
• Severity: 3
• Assignee: Sebastien Buisson
• Reporter: James Nunez (Inactive)

Description

sanity-sec test_16 fails for RHEL 8.3 client/server testing. We’ve only seen this test fail once with this error; https://testing.whamcloud.com/test_sets/1c1e2670-df76-498e-a3a9-d74b490d63a9 .

Looking at the suite_log for this failure, we see several “pdsh@trevis-8vm7: trevis-8vm8: ssh exited with exit code 2”

…
pdsh@trevis-8vm7: trevis-8vm8: ssh exited with exit code 2
CMD: trevis-8vm8 runas -u60005 -g60005 -G60005 rm /mnt/lustre/d16.sanity-sec/f16.sanity-sec
trevis-8vm8: running as uid/gid/euid/egid 60005/60005/60005/60005, groups: 60005
trevis-8vm8:  [rm] [/mnt/lustre/d16.sanity-sec/f16.sanity-sec]
CMD: trevis-24vm6 /usr/sbin/lctl set_param -n os[cd]*.*MD*.force_sync 1
CMD: trevis-24vm6 /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
CMD: trevis-24vm6 /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
CMD: trevis-24vm6 /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
CMD: trevis-24vm6 /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
CMD: trevis-24vm6 /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
CMD: trevis-24vm6 /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
CMD: trevis-8vm8 runas -u60005 -g60005 -G60005 lfs quota -q /mnt/lustre
trevis-8vm8: running as uid/gid/euid/egid 60005/60005/60005/60005, groups: 60005
trevis-8vm8:  [lfs] [quota] [-q] [/mnt/lustre]
pdsh@trevis-8vm7: trevis-8vm8: ssh exited with exit code 2
CMD: trevis-8vm7.trevis.whamcloud.com chmod 000 /mnt/lustre/d16.sanity-sec
CMD: trevis-8vm7.trevis.whamcloud.com chmod 003 /mnt/lustre/d16.sanity-sec
CMD: trevis-8vm7.trevis.whamcloud.com chmod 300 /mnt/lustre/d16.sanity-sec
CMD: trevis-8vm7.trevis.whamcloud.com chmod 303 /mnt/lustre/d16.sanity-sec
CMD: trevis-8vm7.trevis.whamcloud.com chmod 777 /mnt/lustre/d16.sanity-sec
CMD: trevis-8vm8 runas -u60006 -g60006 -G60006 lfs quota -q /mnt/lustre
trevis-8vm8: running as uid/gid/euid/egid 60006/60006/60006/60006, groups: 60006
trevis-8vm8:  [lfs] [quota] [-q] [/mnt/lustre]
pdsh@trevis-8vm7: trevis-8vm8: ssh exited with exit code 2
 sanity-sec test_16: @@@@@@ FAIL: unable to write quota test file 
  Trace dump:
  = /usr/lib64/lustre/tests/test-framework.sh:6257:error()
  = /usr/lib64/lustre/tests/sanity-sec.sh:1290:do_fops_quota_test()
  = /usr/lib64/lustre/tests/sanity-sec.sh:1483:test_fops()
  = /usr/lib64/lustre/tests/sanity-sec.sh:1567:test_16()

In the client2 (8vm8) console log, we see the following error

[23001.757304] Lustre: DEBUG MARKER: runas -u60006 -g60006 -G60006 dd if=/dev/zero of=/mnt/lustre/d16.sanity-sec/f16.sanity-sec oflag=sync bs=1M count=1
[23002.132686] LustreError: 8532:0:(osc_request.c:1947:osc_brw_fini_request()) lustre-OST0002-osc-ffff8a310b0e7800: unexpected positive size 1
[23002.680119] Lustre: DEBUG MARKER: /usr/sbin/lctl mark  sanity-sec test_16: @@@@@@ FAIL: unable to write quota test file 

Issue Links

• duplicates: LU-14205 RHEL8.3: sanity test 398c fails with 'fio write error'
• is related to: LU-14200 ost-pools test 23b fails with 'dd did not fail with ENOSPC'