[LU-15623] sanity: test_123ac: statx -c %n %i %A %h %u %g %W %X %Z -D 100000 files is slower with statahead!

Duplicate — Tue, 9 Jan 2024 17:45:09 +0000

This issue was created by maloo for paf <pfarrell@whamcloud.com>

This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/f9358269-28b9-4981-9e78-f7ead1a837ca

CMD: onyx-118vm1.onyx.whamcloud.com,onyx-118vm2,onyx-118vm3,onyx-118vm4 /usr/sbin/lctl set_param -n debug=0

open/close 10000 (time 1646423963.25 total 7.07 last 1415.24)
open/close 20000 (time 1646423970.08 total 13.89 last 1465.90)
open/close 30000 (time 1646423976.98 total 20.80 last 1447.64)
open/close 40000 (time 1646423984.00 total 27.81 last 1424.67)
open/close 50000 (time 1646423990.96 total 34.77 last 1437.11)
open/close 60000 (time 1646423998.69 total 42.50 last 1294.02)
open/close 70000 (time 1646424005.65 total 49.46 last 1436.51)
open/close 80000 (time 1646424012.67 total 56.48 last 1425.32)
total: 90000 open/close in 64.02 seconds: 1405.88 ops/second
CMD: onyx-118vm1.onyx.whamcloud.com,onyx-118vm2,onyx-118vm3,onyx-118vm4 /usr/sbin/lctl set_param -n debug=\"super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck\"
llite.lustre-ffff991a73fc6800.statahead_max=0
200008

real 0m49.717s
user 0m1.623s
sys 0m14.454s
statx -c "%n %i %A %h %u %g %W %X %Z" -D 100000 files without statahead: 49 sec
llite.lustre-ffff991a73fc6800.statahead_max=32
32
200008

real 0m51.319s
user 0m0.665s
sys 0m16.333s
statx -c "%n %i %A %h %u %g %W %X %Z" -D 100000 files with statahead: 52 sec
statahead total: 33
statahead wrong: 3
agl total: 29
statahead was stopped, maybe too many locks held!
llite.lustre-ffff991a73fc6800.statahead_max=0
200008

real 0m49.840s
user 0m1.175s
sys 0m15.244s
statx -c "%n %i %A %h %u %g %W %X %Z" -D 100000 files again without statahead: 50 sec
llite.lustre-ffff991a73fc6800.statahead_max=32
sanity test_123ac: @@@@@@ FAIL: statx -c "%n %i %A %h %u %g %W %X %Z" -D 100000 files is slower with statahead!
Trace dump:
= /usr/lib64/lustre/tests/test-framework.sh:6386:error()
= /usr/lib64/lustre/tests/sanity.sh:12964:test_123a_base()
= /usr/lib64/lustre/tests/sanity.sh:13018:test_123ac()
= /usr/lib64/lustre/tests/test-framework.sh:6690:run_one()
= /usr/lib64/lustre/tests/test-framework.sh:6737:run_one_logged()
= /usr/lib64/lustre/tests/test-framework.sh:6578:run_test()
= /usr/lib64/lustre/tests/sanity.sh:13028:main()
Dumping lctl log to /autotest/autotest-1/2022-03-04/lustre-reviews_review-ldiskfs_86487_1_1_b99267ab-3acd-436a-a4c1-3b12085c4e73//sanity.test_123ac.*.1646424183.log
CMD: onyx-118vm1.onyx.whamcloud.com,onyx-118vm2,onyx-118vm3,onyx-118vm4 /usr/sbin/lctl dk > /autotest/autotest-1/2022-03-04/lustre-reviews_review-ldiskfs_86487_1_1_b99267ab-3acd-436a-a4c1-3b12085c4e73//sanity.test_123ac.debug_log.\$(hostname -s).1646424183.log;
dmesg > /autotest/autotest-1/2022-03-04/lustre-reviews_review-ldiskfs_86487_1_1_b99267ab-3acd-436a-a4c1-3b12085c4e73//sanity.test_123ac.dmesg.\$(hostname -s).1646424183.log

Whamcloud Community JIRA

[LU-15623] sanity: test_123ac: statx -c %n %i %A %h %u %g %W %X %Z -D 100000 files is slower with statahead!