[LU-13290] Write performance regression in ldiskfs patches

• Type: Bug
• Resolution: Duplicate
• Priority: Major
• Environment: CentOS7.7, master
• Severity: 3
• Assignee: WC Triage
• Reporter: Shuichi Ihara

Description

ldiskfs patch in master branch(commit 2c0b2b7) causes write performance regressions on large OST.
There are two major performance regressions caused by "LU-12988 ldiskfs: mballoc to prefetch groups"" and "LU-12988 ldiskfs: skip non-loaded groups at cr=0/1".

As I commented on LU-12988, patch https://review.whamcloud.com/#/c/37619 has odd behaviors on large OST.
Howerver, even patch https://review.whamcloud.com/#/c/37619 reverts, there is still performance regression. After revert several ldiskfs patches, it seems that patch "LU-12988 ldiskfs: skip non-loaded groups at cr=0/1" causes another perforamnce regression.
Here is test case and test resutls.

8 clients (PPN=16), IOR (1MB, FPP) 
$ salloc --nodes=8 --ntasks-per-node=16 mpirun --allow-run-as-root /work/tools/bin/ior -w -t 1m -b 1g -e -F -C -o /scratch/file

cb86073 Revert "LU-12103 ldiskfs: don't search large block range if disk full"
Max Write: 6890.87 MiB/sec (7225.60 MB/sec)

19c4b48 Revert "LU-12988 ldiskfs: skip non-loaded groups at cr=0/1"
Max Write: 6757.56 MiB/sec (7085.81 MB/sec)

5222bf6 Revert "LU-13183 ldiskfs: Drop remove truncate warning patch"
Max Write: 985.87 MiB/sec (1033.76 MB/sec)

7b7c89c Revert "LU-12988 ldiskfs: mballoc to prefetch groups"
Max Write: 991.18 MiB/sec (1039.33 MB/sec)

2c0b2b7 LU-13166 osd-ldiskfs: fix to allow to get system inode
Max Write: 2184.79 MiB/sec (2290.92 MB/sec)

Issue Links

• is related to: LU-13291 mballoc should not skip uninitialized-on-disk groups
• is related to: LU-12988 improve mount time on huge ldiskfs filesystem