https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-14894 Lustre <p><a href="https://jira.whamcloud.com/browse/LU-8465" title="parallel e2fsck performance at scale" class="issue-link" data-issue-key="LU-8465"><del>LU-8465</del></a> implemented parallel inode table scanning for e2fsck pass1, and parallel bitmap loading for e2fsck pass5.</p> <p>After these improvements, e2fsck of a 50% full 1PB filesystem running with 256 threads improved pass1 from 7777s to 191s (40x faster), and pass5 from 10523s to 286s (36x faster). </p> <p>However, pass2 only improved marginally, from 1363s to 1265s (7%) and this now dominates the total e2fsck runtime (70% in this test) on large OSTs, and limits the aggregate speedup of e2fsck to "only" 10x faster despite the other improvements.</p> <p>Processing directories in parallel should also be possible, in order to further speed up e2fsck times on large OSTs, and expecially on large MDT filesystems.</p> LU-14894

Parallel pass2 support for e2fsck

Improvement Major Open Unresolved WC Triage Wang Shilong e2fsck ldiskfs Fri, 30 Jul 2021 05:03:04 +0000 Wed, 10 May 2023 22:56:12 +0000 0 5 <p>Wang Shilong (wshilong@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/44428" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/44428</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-14894" title="Parallel pass2 support for e2fsck" class="issue-link" data-issue-key="LU-14894">LU-14894</a> e2fsck: parallel pass2 support<br/> Project: tools/e2fsprogs<br/> Branch: master-lustre<br/> Current Patch Set: 1<br/> Commit: 40420a2f4dc1ae76176e7ce4fa39e600e38717ef</p> <p>The description of this ticket mentions only about parallel loading of directory blocks, but not parallel checking. Is that true of the actual patch? It looked to me like it was also checking the directory blocks in parallel. </p> <p>This patch only implement parallel loading, parallel checking a bit complex, it touch many global variable.</p> Duplicate LU-14679 Related LU-14168 LU-14213 LU-8465 LU-16170 LU-16169 Development Rank 1|i020jz: Rank (Obsolete) 9223372036854775807