[LU-9796] Speedup file creation under heavy concurrency

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.11.0, Lustre 2.10.5
• Labels: patch
• Assignee: Hongchao Zhang
• Reporter: Shuichi Ihara (Inactive)

Description

In general, there are some metadata performance regression with/without quota.
Now, Project quota introduced, it's time to measure metadata and improve metadata performance when quota is enabled.
Also, it seems upstream kernel has some performance optimizations for ext4 when quota enabled. It might be possible to get those optimization for Lustre.

Comments

[Lukasz Flis]

I am sorry for commenting in the "resolved" issue.

This patch is not included in rhel7.5 builds  - is it desired ?

# checking with sources from 3.10.0-862.9.1.el7 patched kernel SRPM
[root@kernel-builder linux-3.10.0-862.9.1.el7]# patch -p1 < ext4-reduce-lock-contention-in-__ext4_new_inode.patch 
patching file fs/ext4/ialloc.c
Hunk #1 succeeded at 698 (offset -5 lines).
Hunk #2 FAILED at 840.
Hunk #3 succeeded at 873 (offset -1 lines).
1 out of 3 hunks FAILED -- saving rejects to file fs/ext4/ialloc.c.rej

[root@kernel-builder linux-3.10.0-862.9.1.el7]# patch -p1 < ext4-cleanup-goto-next-group.patch
patching file fs/ext4/ialloc.c
Hunk #1 succeeded at 815 (offset 40 lines).
Hunk #2 succeeded at 838 (offset 40 lines).

I can't see these fixes in 7.5 kernel changelog 

 

[Gerrit Updater]

John L. Hammond ([e-mail]) merged in patch https://review.whamcloud.com/32295/
Subject: LU-9796 ldiskfs: improve inode allocation performance
Project: fs/lustre-release
Branch: b2_10
Current Patch Set:
Commit: f27584430fc8b1379a4f6f064b9b201da8deec92

[Peter Jones]

ok 0 thanks

[Wang Shilong (Inactive)]

Nope, you could close the ticket now.

[Minh Diep]

wangshilong, are you planning to submit any more patch since the #31683 reverted?

[Gerrit Updater]

Bob Glossman ([e-mail]) uploaded a new patch: https://review.whamcloud.com/32295
Subject: LU-9796 ldiskfs: improve inode allocation performance
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: e5e6c26a0f3137f4dbd2bb300a437116c957727d

[Patrick Farrell (Inactive)]

OK, thanks!  I'll keep an eye on this bug, then.

[Peter Jones]

No. AFAIK these are unconfirmed suspicions from support situations. We're just erring on the side of caution for the time being.

[Patrick Farrell (Inactive)]

Are there any details on the failures seen, like an LU tracking them or anything?

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/31683/
Subject: Revert "LU-9796 kernel: improve metadata performaces for RHEL7"
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 2083ffd1bc6c772972834b50e5aef2118c88658d