https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-17153 Lustre <p>There have been the number of mballoc optimizations, but allocator in general allocates blocks from lower block groups to later in sequential order if the filesystem is free.<br/> It would be nice to have another allocator policy that allows e.g. pseudo-random allocation across block groups in the ldiskfs.</p> <p>There are some use cases</p> <ol> <li>Consistent block allocation performance<br/> Even peak performance is slow in that policy, it can keep consist performance regardless filesystem is empty and full.</li> <li>Benchmark, test and debug purpose<br/> In order to optimize mballoc or run benchmark, it would have fragmented filesystem conditions to see how improvements work.<br/> Today, we are using fallocate (allocate/punch-hole) to make such filesystem conditions. If a random block allocator policy is available, it could help for that debug/benchmark.</li> </ol> LU-17153

Random block allocation policy in ldiskfs

New Feature Minor Open Unresolved WC Triage Shuichi Ihara Thu, 28 Sep 2023 02:01:28 +0000 Thu, 28 Sep 2023 02:53:15 +0000 Lustre 2.16.0 0 5 <p>The ticket <a href="https://jira.whamcloud.com/browse/LU-10946" title="add an interface to load ldiskfs block bitmaps" class="issue-link" data-issue-key="LU-10946"><del>LU-10946</del></a> is intended to allow a fragmentation map to be loaded from an existing filesystem into a test filesystem in order to better simulate slow performance from a customer filesystem.</p> <p>For pseudo-random block allocation, this should be relatively straight forward to add an ldiskfs mballoc allocation policy to just try random group numbers to allocate space. The groups could still be checked for "good" status so that we don't try to allocate too-small chunks and increase fragmentation, but this would distribute the write allocation across the whole device uniformly and should average out the bandwidth over the lifetime of the filesystem (i.e. some fraction of "slow" group allocation would happen when the filesystem is empty, and some fraction of "fast" group allocation would happen when the filesystem is nearly full).</p> Related LU-14438 LU-10946 Development Rank 1|i03wzr: Rank (Obsolete) 9223372036854775807 Severity