https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-5949 Lustre <p>A number of cases of corrupt inodes have lead to large numbers of duplicate blocks during e2fsck runs. Corrupt inodes should be detected as such during e2fsck scanning and be cleared instead of invoking duplicate block resolution in pass1b. </p> <p>This may be complicated by running "e2fsck -fn" that does not clear these corrupt inodes during pass1. Need to verify that inode badness is working properly, and possibly figure a way that "e2fsck -fn"</p> LU-5949

Verify e2fsck inode badness is working for duplicate blocks

Bug Major Resolved Fixed Andreas Dilger Andreas Dilger e2fsck Sun, 23 Nov 2014 17:59:58 +0000 Tue, 9 Feb 2021 18:04:53 +0000 Mon, 8 Feb 2021 11:26:57 +0000 0 6 <p>It is clear from several reports that the e2fsck inode badness is not working correctly for duplicate blocks. It is intended functionality is that if some inode is reporting duplicate blocks, but also had other errors such as bad flags, size, blocks, mode, etc. then it is likely that this inode is actually corrupt/garbage and should be cleared instead of spending a long time to clone the file blocks just to have a garbage inode with some other file's data.</p> <p>Avoiding the e2fsck pass1b/1c/1d process can save a very significant amount of time when running on a large/corrupt filesystem, and would be preferable to trying to repair such inodes.</p> <p>It has also been suggested that <b>instead</b> of the "inode badness" feature (which is not yet landed upstream because it touches a lot of different code) that instead e2fsck check all of the inodes in an itable block together, and if there is corruption across multiple inodes in that block block that this be used as the "badness" for the inode, and consider those inodes as targets for deletion if they are also found to be sharing blocks. I think it is potentially dangerous to <b>always</b> clear a block of inodes that are all showing corruption, in case this corruption is systematic (e.g. clearing some feature flag, updating the checksum after filesystem UUID was changed, etc).</p> <p>I believe inode_badness patch just checks the inode fields without looking at the dup blocks at the moment, and offers to delete the inode in pass2 and pass4 if the badness is over the threshold.</p> <p>dup blocks are handled independently by e2fsck: allow deleting or zeroing shared blocks.</p> <p>I think we could check if the badness is over before pass1b, and skip/delete the inode before scanning for dup blocks.</p> <p>One difficulty with checking the badness before doing the duplicate scanning is that the outcome depends on the order the inodes were processed in. The e2fsck block bitmap only stores if a block is used for pass1, assuming that no duplicate blocks exist in the filesystem. If e2fsck finds any duplicate blocks it has to re-scan the whole filesystem to find the inodes that are sharing blocks.</p> <p>It is possible that we could avoid pass1 in some cases by clearing the bad inode rather than adding the blocks into the bitmap, assuming that the good inode is processed first and adds its blocks to the bitmap, and then the bad inode is found later and verified and does <b>not</b> add which would avoid pass1b sometimes.</p> <p>The other proposal that Ted Ts'o had was to check all inodes in a block at the same time. That makes it easier to detect if a whole block is corrupted.</p> <p>Andreas Dilger (adilger@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/41328/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/41328/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-5949" title="Verify e2fsck inode badness is working for duplicate blocks" class="issue-link" data-issue-key="LU-5949"><del>LU-5949</del></a> e2fsck: simplify inode badness handling<br/> Project: tools/e2fsprogs<br/> Branch: master-lustre<br/> Current Patch Set: <br/> Commit: 8725134d27574605c3da74b46df909e419d02b63</p> <p>Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/41450" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/41450</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-5949" title="Verify e2fsck inode badness is working for duplicate blocks" class="issue-link" data-issue-key="LU-5949"><del>LU-5949</del></a> e2fsck: call delete_inode() properly<br/> Project: tools/e2fsprogs<br/> Branch: master-lustre<br/> Current Patch Set: 1<br/> Commit: 7257c1a81bcf13ad7a88da7bb54625a61aba8163</p> <p>Andreas Dilger (adilger@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/41450/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/41450/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-5949" title="Verify e2fsck inode badness is working for duplicate blocks" class="issue-link" data-issue-key="LU-5949"><del>LU-5949</del></a> e2fsck: call delete_inode() properly<br/> Project: tools/e2fsprogs<br/> Branch: master-lustre<br/> Current Patch Set: <br/> Commit: 4aea203f2d490f53596eb21233bf0c186a5b3679</p> Related LU-12913 LU-8465 LU-13650 Development Rank 1|hzx1dr: Rank (Obsolete) 16606 Severity