[LU-3371] sanity-quota test_6: @@@@@@ FAIL: LNet: Service thread pid 9320 was inactive for 40.00s.

• Type: Bug
• Resolution: Duplicate
• Priority: Minor
• Environment: https://maloo.whamcloud.com/test_sets/235aa66c-c197-11e2-9e40-52540035b04c
• Severity: 3
• Assignee: WC Triage
• Reporter: Minh Diep

Description

== sanity-quota test 6: Test dropping acquire request on master == 13:38:14 (1369082294)
Waiting for local destroys to complete
Creating test directory
CMD: mds03 lctl set_param fail_val=0
fail_val=0
CMD: mds03 lctl set_param fail_loc=0
fail_loc=0
CMD: oss02 lctl set_param fail_val=0
fail_val=0
CMD: oss02 lctl set_param fail_loc=0
fail_loc=0
CMD: mds03 /usr/sbin/lctl conf_param smplust.quota.ost=ug
CMD: oss02 /usr/sbin/lctl dl
CMD: oss02 /usr/sbin/lctl get_param -n osd-ldiskfs.smplust-OST0000.quota_slave.enabled
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
[dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d0.sanity-quota/d6/f.sanity-quota.6-quota_usr] [count=1]
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.236313 s, 4.4 MB/s
running as uid/gid/euid/egid 60001/60001/60001/60001, groups:
[dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d0.sanity-quota/d6/f.sanity-quota.6-quota_2usr] [count=1]
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00301028 s, 348 MB/s
CMD: mds03 lctl set_param -n osd*.MDT.force_sync 1
CMD: oss02 lctl set_param -n osd*.OS.force_sync 1
CMD: mds03 lctl set_param fail_val=601
fail_val=601
CMD: mds03 lctl set_param fail_loc=0x513
fail_loc=0x513
running as uid/gid/euid/egid 60001/60001/60001/60001, groups:
[dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d0.sanity-quota/d6/f.sanity-quota.6-quota_2usr] [count=3] [seek=1] [oflag=sync] [conv=notrunc]
3+0 records in
3+0 records out
3145728 bytes (3.1 MB) copied, 0.0459552 s, 68.5 MB/s
Sleep for 41 seconds ...
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
[dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d0.sanity-quota/d6/f.sanity-quota.6-quota_usr] [count=3] [seek=1] [oflag=sync] [conv=notrunc]
CMD: mds03 lctl set_param fail_val=0
fail_val=0
CMD: mds03 lctl set_param fail_loc=0
fail_loc=0
CMD: oss02 dmesg
sanity-quota test_6: @@@@@@ FAIL: Lustre: DEBUG MARKER: sanity-quota test_6: @@@@@@ FAIL: LNet: Service thread pid 9320 was inactive for 40.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Lustre: DEBUG MARKER: sanity-quota test_18: @@@@@@ FAIL: LNet: Service thread pid 9320 was inactive for 40.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
LNet: Service thread pid 12919 was inactive for 40.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Trace dump:
= /usr/lib64/lustre/tests/test-framework.sh:4186:error_noexit()
= /usr/lib64/lustre/tests/test-framework.sh:4213:error()
= /usr/lib64/lustre/tests/sanity-quota.sh:927:test_6()
= /usr/lib64/lustre/tests/test-framework.sh:4452:run_one()
= /usr/lib64/lustre/tests/test-framework.sh:4485:run_one_logged()
= /usr/lib64/lustre/tests/test-framework.sh:4355:run_test()
= /usr/lib64/lustre/tests/sanity-quota.sh:957:main()
Dumping lctl log to /scratch/tmp/minh/logs//2013-05-20/130604/sanity-quota.test_6.*.1369082343.log
CMD: c07,c08,c09,c10,c11,c12,c13,c14,c15,c18,c19,c20,c21,c22,c23,c24,mds03,oss02 /usr/sbin/lctl dk > /scratch/tmp/minh/logs//2013-05-20/130604/sanity-quota.test_6.debug_log.\$(hostname -s).1369082343.log;
dmesg > /scratch/tmp/minh/logs//2013-05-20/130604/sanity-quota.test_6.dmesg.\$(hostname -s).1369082343.log
Delete files...
Wait for unlink objects finished...
CMD: mds03 lctl set_param -n osd*.MD.force_sync 1
dd: writing `/mnt/lustre/d0.sanity-quota/d6/f.sanity-quota.6-quota_usr': Disk quota exceeded
2+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 53.2045 s, 19.7 kB/s
CMD: mds03 lctl get_param -n osc.MDT.sync_*
CMD: mds03 lctl get_param -n osc.MDT.sync_*
CMD: mds03 lctl get_param -n osc.MDT.sync_*
CMD: mds03 lctl get_param -n osc.MDT.sync_*
CMD: mds03 lctl get_param -n osc.MDT.sync_*
CMD: mds03 lctl get_param -n osc.MDT.sync_*
CMD: mds03 lctl get_param -n osc.MDT.sync_*
CMD: mds03 lctl get_param -n osc.MDT.sync_*
Waiting for local destroys to complete
CMD: mds03 lctl set_param -n osd*.MDT.force_sync 1
CMD: oss02 lctl set_param -n osd*.OS.force_sync 1