[LU-9972] Performance regressions on unique directory removal

• Type: Bug
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.11.0, Lustre 2.10.4
• Environment: 2.10 (and 2.11)
• Severity: 3
• Assignee: Alex Zhuravlev
• Reporter: Shuichi Ihara (Inactive)

Description

There is a performance regression on dir removal.

Server and client : RHEL7.3
Lustre version : 2.10.52
Backend filesystem: ldiskfs

mpirun --allow-run-as-root /work/tools/bin/mdtest -n 5000 -v -d /scratch0/mdtest.out -D -i 3 -p 10 -w 0 -u

SUMMARY: (of 3 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   Directory creation:      89757.381      65618.928      74607.900      10774.356
   Directory stat    :     320946.433     319888.242     320294.264        465.749
   Directory removal :      19028.569      17837.487      18351.200        499.838
   Tree creation     :        434.446        158.826        318.943        116.860
   Tree removal      :         27.018         25.210         26.281          0.775

Issue Links

• is related to: LU-7053 Do not use osd_object_find in osd_index_ea_insert

Comments

[Gerrit Updater]

John L. Hammond ([e-mail]) merged in patch https://review.whamcloud.com/31211/
Subject: LU-9972 osd: cache OI mapping in dt_declare_ref_add
Project: fs/lustre-release
Branch: b2_10
Current Patch Set:
Commit: 025d0412599ed9381be4a0ab84d190b59fc2c451

[Gerrit Updater]

Minh Diep ([e-mail]) uploaded a new patch: https://review.whamcloud.com/31211
Subject: LU-9972 osd: cache OI mapping in dt_declare_ref_add
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: d334fd8aa117d9a957365bdfb6792bcaaf6533cc

[Peter Jones]

Landed for 2.11

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/29709/
Subject: LU-9972 osd: cache OI mapping in dt_declare_ref_add
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: b6e718def348c53759a12afee9450207fc7ab56f

[Joseph Gmitter (Inactive)]

Hi Ihara,

Have you been able to confirm that Alex's patch resolves the issue?

Thanks.
Joe

[Alex Zhuravlev]

please, try with the updated patch.