https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-371 Lustre <p>Failure looks like this, -1 debug log attached.</p> <ol> <li>ehyperion-mds1 /root &gt; modprobe -v lustre<br/> insmod /lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/net/lustre/libcfs.ko libcfs_panic_on_lbug=1<br/> insmod /lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/fs/lustre/lvfs.ko <br/> insmod /lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/net/lustre/lnet.ko networks="o2ib0(ib0)" live_router_check_in<br/> insmod /lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/fs/lustre/obdclass.ko <br/> insmod /lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/fs/lustre/ptlrpc.ko <br/> WARNING: Error inserting ptlrpc (/lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/fs/lustre/ptlrpc.ko): Cannot allocate memor<br/> WARNING: Error inserting fld (/lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/fs/lustre/fld.ko): Cannot allocate memory<br/> WARNING: Error inserting fid (/lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/fs/lustre/fid.ko): Cannot allocate memory<br/> WARNING: Error inserting mdc (/lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/fs/lustre/mdc.ko): Cannot allocate memory<br/> WARNING: Error inserting osc (/lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/fs/lustre/osc.ko): Cannot allocate memory<br/> WARNING: Error inserting lov (/lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/fs/lustre/lov.ko): Cannot allocate memory<br/> FATAL: Error inserting lustre (/lib/modules/2.6.18-238.9.1.el5_lustre/updates/kernel/fs/lustre/lustre.ko): Cannot allocate memory</li> </ol> <p>I checked the log, it failed at this point but we need more information to pin the bug</p> <p>00000100:00000040:8.0:1306524860.227747:0:14126:0:(pinger.c:315:ptlrpc_pinger_main()) next wakeup in 25000 (4304047406)<br/> 00000100:00000001:0.0:1306524860.227920:0:14070:0:(ptlrpc_module.c:109:ptlrpc_init()) Process leaving via cleanup (rc=18446744073709551604 : -12 : 0xfffffffffffffff4)</p> LU-371

Hyperion MDS failed on loading sptlrpc for ENOMEM

Bug Minor Resolved Fixed Liang Zhen Liang Zhen Sat, 28 May 2011 20:59:03 +0000 Tue, 28 Jun 2011 23:22:12 +0000 Tue, 28 Jun 2011 23:22:12 +0000 Lustre 2.1.0 Lustre 2.1.0 0 0 <p>debug patch is here:</p> <p><a href="http://review.whamcloud.com/#change,869" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,869</a></p> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=sles11,ib_stack=inkernel/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,sles11,inkernel #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el6,inkernel #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el6,ib_stack=inkernel/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el6,inkernel #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el6,ib_stack=inkernel/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el6,inkernel #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el6,inkernel #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=ubuntu1004,ib_stack=inkernel/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,ubuntu1004,inkernel #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=ofa/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,ofa #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=inkernel/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,inkernel #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=ofa/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,ofa #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=inkernel/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,inkernel #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=ofa/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,ofa #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=inkernel/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,inkernel #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=inkernel/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,inkernel #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://newbuild.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://newbuild.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=ofa/186/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,ofa #186</a><br/> <a href="https://jira.whamcloud.com/browse/LU-371" title="Hyperion MDS failed on loading sptlrpc for ENOMEM" class="issue-link" data-issue-key="LU-371"><del>LU-371</del></a> call OBD_ALLOC_LARGE to allocate epp_pools</p> <p>Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=a36a47b5078e27168260a2f92e0e25ecbcad191a" class="external-link" target="_blank" rel="nofollow noopener">a36a47b5078e27168260a2f92e0e25ecbcad191a</a><br/> Files : </p> <ul> <li>lustre/ptlrpc/sec_bulk.c</li> </ul> <p>patch landed on master</p> Development Rank 1|hzv8w7: Rank (Obsolete) 4975 Severity