Whamcloud Community JIRA

Whamcloud Community JIRA https://jira.whamcloud.com This file is an XML representation of an issue en-us

9.4.14

940014

05-12-2023

[LU-248] port bug24194 to master (Still seeing inconsistencies in OST allocation) https://jira.whamcloud.com/browse/LU-248 Lustre port the patch in 1.8.6 to master(2.1.0) LU-248

port bug24194 to master (Still seeing inconsistencies in OST allocation)

Bug Minor Resolved Fixed Hongchao Zhang Hongchao Zhang Thu, 28 Apr 2011 23:49:48 +0000 Wed, 1 Jun 2011 01:53:48 +0000 Wed, 1 Jun 2011 01:53:48 +0000 Lustre 1.8.6 Lustre 2.1.0 0 0 Hongchao it would be a good idea to copy the main details of the issue from the bz ticket in case bz is unavailable when you want to work on this after the qos_threshold_rr was set to 100%, the allocation of OSTs is not consistent in a consistent round-robin allocation. Each IOR test creates 48 to 240 files (multiples of 12) in a directory called multdir with: lfs setstripe multdir -s 1m -c 1 After creating the files, we look at the output of 'lfs getstripe multdir' and add up the number of files assigned to each OST. Most of the time the number of objects per OST is uniform, but about 1 in 10 times it is not. For example: ++++ Results are listed by OST ++ OST OSS Objects assigned 0 0 16 1 3 16 2 0 16 3 3 15 <--- 4 0 16 5 3 16 6 0 16 7 3 16 8 0 16 9 3 17 <--- 10 0 16 11 3 16 ++ Total number of OST's assigned is 12 ++ Total number of objects assigned is 192 the cause of the above problem is that there are other creating operations during the IOR test, and the OST objects are allocated in MDS-LOV, which will be affected by all clients' creation. if there is other creation before this test, the re-seed mechanism will cause inconsistent OST allocation, e.g. if OST count is 12, lqr_start_count will be (1000/12 + 4)*12 = 1044, set lqr_start_idx=2, and one file is created before the test, then lqr_start_idx increase to 3 let's do the test, creating 1044 files (87 objects in each OST), then when creating the 1044th file, the re-seed will be triggered and lqr_start_idx will be reset to another random value(say, 5) the final OST objects allocation will be, OST0 87 OST1 87 OST2 86 <-- the re-seed point OST3 87 OST4 87 OST5 88 <-- the new lqr_start_idx OST6 87 OST7 87 OST8 87 OST9 87 OST10 87 OST11 87 btw, the OST allocation is still consistent in the system view. the patch will increase the LOV reseed window to mitigate the issue Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=inkernel/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,inkernel #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el6,inkernel #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=sles11,ib_stack=inkernel/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,sles11,inkernel #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=inkernel/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,inkernel #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=ofa/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,ofa #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=ubuntu1004,ib_stack=inkernel/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,ubuntu1004,inkernel #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el6,ib_stack=inkernel/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el6,inkernel #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=inkernel/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,inkernel #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el6,inkernel #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=ubuntu1004,ib_stack=ofa/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,ubuntu1004,ofa #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=inkernel/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,inkernel #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=ofa/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,ofa #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el6,ib_stack=inkernel/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el6,inkernel #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=ofa/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,ofa #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> Integrated in <img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=ofa/143/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,ofa #143</a> <a href="https://jira.whamcloud.com/browse/LU-248" title="port bug24194 to master (Still seeing inconsistencies in OST allocation)" class="issue-link" data-issue-key="LU-248"><del>LU-248</del></a> increase LOV reseed to mitigate OST allocation inconsitence Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&a=commit&h=4f50bbfa20b8cfdf13c2647cfae057285df9e9e8" class="external-link" target="_blank" rel="nofollow noopener">4f50bbfa20b8cfdf13c2647cfae057285df9e9e8</a> Files : <ul> <li>lustre/lov/lov_qos.c</li> </ul> patch has been pushed into master, close the issue, please reopen it if needed Bugzilla ID 24194.0 Development Rank 1|hzv953: Rank (Obsolete) 5015 Severity