https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-470 Lustre <p>dx_get_block() will mask logic block number to 24-bits, which means we can only have 16-M blocks and a few giga FIDs, this is not enough because we have one single IAM dir to save all (fids, ino) for MDT.<br/> I think the 24-bits bitmask is not necessary at all because we just inherit it from ext3/4 and which is reserved for coalesce-on-delete and unlikely to happen at all. So the simplest workaround for this is just removing the bitmask so we have plenty block numbers and FIDs at least for all recent requirements.</p> LU-470

remove 24-bits bitmask for logic block number of IAM dir

Bug Minor Resolved Fixed Liang Zhen Liang Zhen Tue, 28 Jun 2011 00:00:00 +0000 Mon, 23 Jan 2012 13:44:39 +0000 Mon, 23 Jan 2012 13:44:39 +0000 Lustre 2.1.0 Lustre 2.1.0 0 0 <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=ofa/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,ofa #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=inkernel/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,inkernel #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=sles11,ib_stack=inkernel/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,sles11,inkernel #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=inkernel/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,inkernel #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/red.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el6,ib_stack=inkernel/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el6,inkernel #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=ofa/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,ofa #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=ubuntu1004,ib_stack=inkernel/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,ubuntu1004,inkernel #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=ofa/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,ofa #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=inkernel/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,inkernel #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el6,ib_stack=inkernel/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el6,inkernel #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=ofa/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,ofa #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=inkernel/208/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,inkernel #208</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/209/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el6,inkernel #209</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/209/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el6,inkernel #209</a><br/> <a href="https://jira.whamcloud.com/browse/LU-470" title="remove 24-bits bitmask for logic block number of IAM dir" class="issue-link" data-issue-key="LU-470"><del>LU-470</del></a> remove 24-bits mask for logic block number of IAM dir</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=b79078ebbdcf210225893b4ffb45f2b8e9e51b75" class="external-link" target="_blank" rel="nofollow noopener">b79078ebbdcf210225893b4ffb45f2b8e9e51b75</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_iam.h</li> </ul> <p>This still needs a patch in e2fsprogs to remove the mask there. Otherwise, a very large directory would be corrupted when running e2fsck.</p> <p>This is only an IAM limit, and has nothing to do with ldiskfs.</p> Development Rank 1|hzv8rr: Rank (Obsolete) 4955 Severity