Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-15623

sanity: test_123ac: statx -c %n %i %A %h %u %g %W %X %Z -D 100000 files is slower with statahead!

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Minor
    • None
    • None
    • None
    • 3
    • 9223372036854775807

    Description

      This issue was created by maloo for paf <pfarrell@whamcloud.com>

      This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/f9358269-28b9-4981-9e78-f7ead1a837ca

      CMD: onyx-118vm1.onyx.whamcloud.com,onyx-118vm2,onyx-118vm3,onyx-118vm4 /usr/sbin/lctl set_param -n debug=0

      • open/close 10000 (time 1646423963.25 total 7.07 last 1415.24)
      • open/close 20000 (time 1646423970.08 total 13.89 last 1465.90)
      • open/close 30000 (time 1646423976.98 total 20.80 last 1447.64)
      • open/close 40000 (time 1646423984.00 total 27.81 last 1424.67)
      • open/close 50000 (time 1646423990.96 total 34.77 last 1437.11)
      • open/close 60000 (time 1646423998.69 total 42.50 last 1294.02)
      • open/close 70000 (time 1646424005.65 total 49.46 last 1436.51)
      • open/close 80000 (time 1646424012.67 total 56.48 last 1425.32)
        total: 90000 open/close in 64.02 seconds: 1405.88 ops/second
        CMD: onyx-118vm1.onyx.whamcloud.com,onyx-118vm2,onyx-118vm3,onyx-118vm4 /usr/sbin/lctl set_param -n debug=\"super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck\"
        llite.lustre-ffff991a73fc6800.statahead_max=0
        200008

      real 0m49.717s
      user 0m1.623s
      sys 0m14.454s
      statx -c "%n %i %A %h %u %g %W %X %Z" -D 100000 files without statahead: 49 sec
      llite.lustre-ffff991a73fc6800.statahead_max=32
      32
      200008

      real 0m51.319s
      user 0m0.665s
      sys 0m16.333s
      statx -c "%n %i %A %h %u %g %W %X %Z" -D 100000 files with statahead: 52 sec
      statahead total: 33
      statahead wrong: 3
      agl total: 29
      statahead was stopped, maybe too many locks held!
      llite.lustre-ffff991a73fc6800.statahead_max=0
      200008

      real 0m49.840s
      user 0m1.175s
      sys 0m15.244s
      statx -c "%n %i %A %h %u %g %W %X %Z" -D 100000 files again without statahead: 50 sec
      llite.lustre-ffff991a73fc6800.statahead_max=32
      sanity test_123ac: @@@@@@ FAIL: statx -c "%n %i %A %h %u %g %W %X %Z" -D 100000 files is slower with statahead!
      Trace dump:
      = /usr/lib64/lustre/tests/test-framework.sh:6386:error()
      = /usr/lib64/lustre/tests/sanity.sh:12964:test_123a_base()
      = /usr/lib64/lustre/tests/sanity.sh:13018:test_123ac()
      = /usr/lib64/lustre/tests/test-framework.sh:6690:run_one()
      = /usr/lib64/lustre/tests/test-framework.sh:6737:run_one_logged()
      = /usr/lib64/lustre/tests/test-framework.sh:6578:run_test()
      = /usr/lib64/lustre/tests/sanity.sh:13028:main()
      Dumping lctl log to /autotest/autotest-1/2022-03-04/lustre-reviews_review-ldiskfs_86487_1_1_b99267ab-3acd-436a-a4c1-3b12085c4e73//sanity.test_123ac.*.1646424183.log
      CMD: onyx-118vm1.onyx.whamcloud.com,onyx-118vm2,onyx-118vm3,onyx-118vm4 /usr/sbin/lctl dk > /autotest/autotest-1/2022-03-04/lustre-reviews_review-ldiskfs_86487_1_1_b99267ab-3acd-436a-a4c1-3b12085c4e73//sanity.test_123ac.debug_log.\$(hostname -s).1646424183.log;
      dmesg > /autotest/autotest-1/2022-03-04/lustre-reviews_review-ldiskfs_86487_1_1_b99267ab-3acd-436a-a4c1-3b12085c4e73//sanity.test_123ac.dmesg.\$(hostname -s).1646424183.log

      Attachments

        Issue Links

          Activity

            People

              wc-triage WC Triage
              maloo Maloo
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: