[LU-9796] Speedup file creation under heavy concurrency

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.11.0, Lustre 2.10.5
• Labels: patch
• Assignee: Hongchao Zhang
• Reporter: Shuichi Ihara (Inactive)

Description

In general, there are some metadata performance regression with/without quota.
Now, Project quota introduced, it's time to measure metadata and improve metadata performance when quota is enabled.
Also, it seems upstream kernel has some performance optimizations for ext4 when quota enabled. It might be possible to get those optimization for Lustre.

Comments

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/31683/
Subject: Revert "LU-9796 kernel: improve metadata performaces for RHEL7"
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 2083ffd1bc6c772972834b50e5aef2118c88658d

[Gerrit Updater]

Andreas Dilger ([e-mail]) uploaded a new patch: https://review.whamcloud.com/31683
Subject: Revert "LU-9796 kernel: improve metadata performaces for RHEL7"
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 4232b2842ff720791f2afb55b80ba6640142f624

[Peter Jones]

Landed for 2.11

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/28276/
Subject: LU-9796 kernel: improve metadata performaces for RHEL7
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 17fe3c192e101ace75b2f4d7f7e9ff7d8d85480e

[Bob Glossman (Inactive)]

I see recent mods in master have landed for this issue, but only for RHEL 7.x
Is this not needed for RHEL 6.x, SLES 11/12, Ubuntu ?

[Peter Jones]

Does the remaining patch need to land too or can that be abandoned and this ticket marked resolved?

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/29032/
Subject: LU-9796 ldiskfs: improve inode allocation performance
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 3f0a7241c434d9556308299eea069628715816c2

[Shuichi Ihara (Inactive)]

attached is test mds-survey resutls (File creation) with/withotu patch. https://jira.hpdd.intel.com/secure/attachment/28338/LU-9796.png
1 x MDS(1 x Platinum 8160 CPU, 128GB DDR4 memory)
1 x MDT(SFA7700X, RAID10 with 4 x Toshiba RI SSD)
Lustre-2.10.1CR (user/group quota enabled) on CentOS7.3

patch helps file creation speedup especially at high number of thread. we are now reaching ~250K ops/sec for file creation with single MDT on RHEL7 kernel.

[Gerrit Updater]

Wang Shilong ([e-mail]) uploaded a new patch: https://review.whamcloud.com/29032
Subject: LU-9796 ldiskfs: improve inode allocation performace
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 0f94e45786dc92f9ec048908234153a547d64462

[Patrick Farrell (Inactive)]

Ah, I like that much better! And it looks like it's much faster too, at least for creates. Nice. (In fact, faster than the original code before the regression, isn't it?)

[Wang Shilong (Inactive)]

Hello Patrick,

I have refreshed the patch to use new approach which looks better for me.
https://patchwork.ozlabs.org/patch/799014/

I don't like a timed sleep too.^_