https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-106 Lustre <p>This kernel oops happened while unmounting an OST. cerebrod is a monitoring daemon that gathers Lustre data from /proc.</p> <p>2011-03-01 13:06:10 Lustre: client ffff8802e6927000 umount complete<br/> 2011-03-01 13:06:13 Lustre: Failing over lustre-MDT0000<br/> 2011-03-01 13:06:13 Lustre: Failing over mdd_obd-lustre-MDT0000-0<br/> 2011-03-01 13:06:13 Lustre: mdd_obd-lustre-MDT0000-0: shutting down for failover; client state will be preserved.<br/> 2011-03-01 13:06:13 Lustre: MGS has stopped.<br/> 2011-03-01 13:06:13 Lustre: server umount lustre-MDT0000 complete<br/> 2011-03-01 13:06:15 Lustre: lustre-OST0000: shutting down for failover; client state will be preserved.<br/> 2011-03-01 13:06:15 BUG: unable to handle kernel paging request at 00000000deadcb17<br/> 2011-03-01 13:06:15 IP: <span class="error">&#91;&lt;ffffffffa0400f52&gt;&#93;</span> lprocfs_stats_collect+0x102/0x160 <span class="error">&#91;obdclass&#93;</span><br/> 2011-03-01 13:06:15 PGD 630662067 PUD 0 <br/> 2011-03-01 13:06:15 Oops: 0000 <a href="#1" target="_blank" rel="noopener">1</a> SMP <br/> 2011-03-01 13:06:15 last sysfs file: /sys/module/lov/initstate<br/> 2011-03-01 13:06:15 CPU 0 <br/> 2011-03-01 13:06:15 Modules linked in: lustre lmv obdfilter ost cmm osd_ldiskfs mdt mdd mds fsfilt_ldiskfs exportfs mgs mgc ldiskfs mbcache jbd2 lov osc mdc fid fld ko2iblnd ptlrpc obdclass lnet lvfs libcfs ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ib_sa mlx4_ib ib_mad ib_core sg sd_mod crc_t10dif dm_mirror dm_region_hash dm_log dm_mod video output sbs sbshc power_meter hwmon acpi_pad parport serio_raw i2c_i801 i2c_core ata_generic pata_acpi ata_piix iTCO_wdt iTCO_vendor_support ioatdma i7core_edac edac_core mpt2sas scsi_transport_sas raid_class ipv6 nfs lockd fscache nfs_acl auth_rpcgss sunrpc mlx4_core igb dca <span class="error">&#91;last unloaded: lustre&#93;</span><br/> 2011-03-01 13:06:15 <br/> 2011-03-01 13:06:15 Modules linked in: lustre lmv obdfilter ost cmm osd_ldiskfs mdt mdd mds fsfilt_ldiskfs exportfs mgs mgc ldiskfs mbcache jbd2 lov osc mdc fid fld ko2iblnd ptlrpc obdclass lnet lvfs libcfs ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ib_sa mlx4_ib ib_mad ib_core sg sd_mod crc_t10dif dm_mirror dm_region_hash dm_log dm_mod video output sbs sbshc power_meter hwmon acpi_pad parport serio_raw i2c_i801 i2c_core ata_generic pata_acpi ata_piix iTCO_wdt iTCO_vendor_support ioatdma i7core_edac edac_core mpt2sas scsi_transport_sas raid_class ipv6 nfs lockd fscache nfs_acl auth_rpcgss sunrpc mlx4_core igb dca <span class="error">&#91;last unloaded: lustre&#93;</span><br/> 2011-03-01 13:06:16 Pid: 8198, comm: cerebrod Tainted: G W ---------------- 2.6.32-14chaos #1 X8DTH-i/6/iF/6F<br/> 2011-03-01 13:06:16 RIP: 0010:<span class="error">&#91;&lt;ffffffffa0400f52&gt;&#93;</span> <span class="error">&#91;&lt;ffffffffa0400f52&gt;&#93;</span> lprocfs_stats_collect+0x102/0x160 <span class="error">&#91;obdclass&#93;</span><br/> 2011-03-01 13:06:16 RSP: 0018:ffff88061dffbd48 EFLAGS: 00010206<br/> 2011-03-01 13:06:16 RAX: 00000000deadcacf RBX: ffff880609677180 RCX: 0000000000000be0<br/> 2011-03-01 13:06:16 RDX: 0000000000000026 RSI: 0000000000000000 RDI: 0000000000000000<br/> 2011-03-01 13:06:16 RBP: ffff88061dffbd88 R08: 0000000000000018 R09: 0000000000000000<br/> 2011-03-01 13:06:16 R10: 7fffffffffffffff R11: 0000000000000bf0 R12: ffff88061dffbd98<br/> 2011-03-01 13:06:16 R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000<br/> 2011-03-01 13:06:16 FS: 00007ffff7ff0700(0000) GS:ffff880028200000(0000) knlGS:0000000000000000<br/> 2011-03-01 13:06:16 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033<br/> 2011-03-01 13:06:16 CR2: 00000000deadcb17 CR3: 000000061d597000 CR4: 00000000000006f0<br/> 2011-03-01 13:06:16 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000<br/> 2011-03-01 13:06:16 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400<br/> 2011-03-01 13:06:16 Process cerebrod (pid: 8198, threadinfo ffff88061dffa000, task ffff88063007f560)<br/> 2011-03-01 13:06:16 Stack:<br/> 2011-03-01 13:06:16 ffff880609677180 0000000000000026 0000000000000001 ffff88060970ebe0<br/> 2011-03-01 13:06:16 &lt;0&gt; ffff880609677180 ffff8802e67eaac0 0000000000000000 ffff88061dffbe58<br/> 2011-03-01 13:06:16 &lt;0&gt; ffff88061dffbe18 ffffffffa040100f 0000000000000000 0000000000000000<br/> 2011-03-01 13:06:16 Call Trace:<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffffa040100f&gt;&#93;</span> lprocfs_stats_seq_show+0x5f/0x170 <span class="error">&#91;obdclass&#93;</span><br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff8118e497&gt;&#93;</span> seq_read+0x267/0x3f0<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff811ced7e&gt;&#93;</span> proc_reg_read+0x7e/0xc0<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff8116caf5&gt;&#93;</span> vfs_read+0xb5/0x1a0<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff8116cc31&gt;&#93;</span> sys_read+0x51/0x90<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff81013172&gt;&#93;</span> system_call_fastpath+0x16/0x1b<br/> 2011-03-01 13:06:16 Code: 28 4d 39 4c 24 30 7d 05 4d 89 4c 24 30 41 83 c0 01 4d 01 6c 24 38 44 39 c0 77 96 48 8b 55 c8 48 8d 04 92 48 c1 e0 04 48 03 43 10 &lt;48&gt; 8b 40 48 49 89 44 24 48 f6 43 04 01 74 0a 48 83 c3 08 66 ff <br/> 2011-03-01 13:06:16 RIP <span class="error">&#91;&lt;ffffffffa0400f52&gt;&#93;</span> lprocfs_stats_collect+0x102/0x160 <span class="error">&#91;obdclass&#93;</span><br/> 2011-03-01 13:06:16 RSP &lt;ffff88061dffbd48&gt;<br/> 2011-03-01 13:06:16 CR2: 00000000deadcb17<br/> 2011-03-01 13:06:16 --<del>[ end trace 210f520790780e8d ]</del>--<br/> 2011-03-01 13:06:16 Kernel panic - not syncing: Fatal exception<br/> 2011-03-01 13:06:16 Pid: 8198, comm: cerebrod Tainted: G D W ---------------- 2.6.32-14chaos #1<br/> 2011-03-01 13:06:16 Call Trace:<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff814c62e3&gt;&#93;</span> panic+0x78/0x137<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff814ca3b4&gt;&#93;</span> oops_end+0xe4/0x100<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff8104651b&gt;&#93;</span> no_context+0xfb/0x260<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff810467a5&gt;&#93;</span> __bad_area_nosemaphore+0x125/0x1e0<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff810468ce&gt;&#93;</span> bad_area+0x4e/0x60<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff814cbf00&gt;&#93;</span> do_page_fault+0x390/0x3a0<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff814c9705&gt;&#93;</span> page_fault+0x25/0x30<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffffa0400f52&gt;&#93;</span> ? lprocfs_stats_collect+0x102/0x160 <span class="error">&#91;obdclass&#93;</span><br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffffa0400eaa&gt;&#93;</span> ? lprocfs_stats_collect+0x5a/0x160 <span class="error">&#91;obdclass&#93;</span><br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffffa040100f&gt;&#93;</span> lprocfs_stats_seq_show+0x5f/0x170 <span class="error">&#91;obdclass&#93;</span><br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff8118e497&gt;&#93;</span> seq_read+0x267/0x3f0<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff811ced7e&gt;&#93;</span> proc_reg_read+0x7e/0xc0<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff8116caf5&gt;&#93;</span> vfs_read+0xb5/0x1a0<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff8116cc31&gt;&#93;</span> sys_read+0x51/0x90<br/> 2011-03-01 13:06:16 <span class="error">&#91;&lt;ffffffff81013172&gt;&#93;</span> system_call_fastpath+0x16/0x1b</p> RHEL6 x86_64 LU-106

unable to handle kernel paging request in lprocfs_stats_collect()

Bug Major Resolved Fixed Lai Siyao Ned Bass Wed, 2 Mar 2011 11:33:52 +0000 Thu, 7 Jun 2012 11:56:34 +0000 Mon, 12 Dec 2011 17:31:40 +0000 Lustre 2.1.0 Lustre 2.2.0 Lustre 2.1.2 0 5 <p>Lai</p> <p>Could you please look at this one</p> <p>Thanks</p> <p>Peter</p> <p>There are several places where in memory struct may be released or un-initialized before proc entry creation/removal for mgs/mds/obdfilter.</p> <p>I tested with the below scripts, and it could pass:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>while true; do umount -d /mnt/ost1 mount -t lustre &lt;OST_DEVICE&gt; /mnt/ost1 done </pre> </div></div> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>while true; do cat /proc/fs/lustre/obdfilter/lustre-OST0000/* cat /proc/fs/lustre/obdfilter/lustre-OST0000/export/*/* done </pre> </div></div> <p>These two scripts are running concurrently for mds/obdfilter.</p> <p>Patch is at <a href="http://review.whamcloud.com/#change,325" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,325</a>.</p> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/reviews-centos5/442/" class="external-link" target="_blank" rel="nofollow noopener">reviews-centos5 #442</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> unable to handle kernel pagig request in lprocfs_stats_collect()</p> <p>Lai Siyao : <a href="http://git.whamcloud.com/gitweb/?p=fs/lustre-release.git&amp;a=commit&amp;h=28030d340504ce9a9e938d7a5a7b65205a82cc7b" class="external-link" target="_blank" rel="nofollow noopener">28030d340504ce9a9e938d7a5a7b65205a82cc7b</a><br/> Files : </p> <ul> <li>lustre/mds/handler.c</li> <li>lustre/mds/lproc_mds.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/mgs/lproc_mgs.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/reviews-centos5/444/" class="external-link" target="_blank" rel="nofollow noopener">reviews-centos5 #444</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> unable to handle kernel paging request in lprocfs_stats_collect()</p> <p>Lai Siyao : <a href="http://git.whamcloud.com/gitweb/?p=fs/lustre-release.git&amp;a=commit&amp;h=6b85a6cc4348274e29cc6d26bd958cc977c16207" class="external-link" target="_blank" rel="nofollow noopener">6b85a6cc4348274e29cc6d26bd958cc977c16207</a><br/> Files : </p> <ul> <li>lustre/mgs/lproc_mgs.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/obdfilter/filter.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/red.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/reviews-centos5/458/" class="external-link" target="_blank" rel="nofollow noopener">reviews-centos5 #458</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> unable to handle kernel pagig request in lprocfs_stats_collect()</p> <p>Lai Siyao : <a href="http://git.whamcloud.com/gitweb/?p=fs/lustre-release.git&amp;a=commit&amp;h=e7146c54ba1ae58e796f66c9f1619d42bc90c025" class="external-link" target="_blank" rel="nofollow noopener">e7146c54ba1ae58e796f66c9f1619d42bc90c025</a><br/> Files : </p> <ul> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/mgs/lproc_mgs.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/mds/handler.c</li> <li>lustre/include/obd_class.h</li> <li>lustre/mds/lproc_mds.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/red.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/reviews-centos5/459/" class="external-link" target="_blank" rel="nofollow noopener">reviews-centos5 #459</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> unable to handle kernel paging request in lprocfs_stats_collect()</p> <p>Lai Siyao : <a href="http://git.whamcloud.com/gitweb/?p=fs/lustre-release.git&amp;a=commit&amp;h=95a83d156c0b6e63d4b6ef197393839c6f9869c7" class="external-link" target="_blank" rel="nofollow noopener">95a83d156c0b6e63d4b6ef197393839c6f9869c7</a><br/> Files : </p> <ul> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/mgs/lproc_mgs.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/include/obd_class.h</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/obdclass/lprocfs_status.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/reviews-centos5/460/" class="external-link" target="_blank" rel="nofollow noopener">reviews-centos5 #460</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> unable to handle kernel paging request in lprocfs_stats_collect()</p> <p>Lai Siyao : <a href="http://git.whamcloud.com/gitweb/?p=fs/lustre-release.git&amp;a=commit&amp;h=95a83d156c0b6e63d4b6ef197393839c6f9869c7" class="external-link" target="_blank" rel="nofollow noopener">95a83d156c0b6e63d4b6ef197393839c6f9869c7</a><br/> Files : </p> <ul> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/include/obd_class.h</li> <li>lustre/mgs/lproc_mgs.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/reviews-centos5/463/" class="external-link" target="_blank" rel="nofollow noopener">reviews-centos5 #463</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> unable to handle kernel pagig request in lprocfs_stats_collect()</p> <p>Lai Siyao : <a href="http://git.whamcloud.com/gitweb/?p=fs/lustre-release.git&amp;a=commit&amp;h=e7146c54ba1ae58e796f66c9f1619d42bc90c025" class="external-link" target="_blank" rel="nofollow noopener">e7146c54ba1ae58e796f66c9f1619d42bc90c025</a><br/> Files : </p> <ul> <li>lustre/obdfilter/filter.c</li> <li>lustre/mgs/lproc_mgs.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/mds/lproc_mds.c</li> <li>lustre/include/obd_class.h</li> <li>lustre/mds/handler.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/reviews-centos5/468/" class="external-link" target="_blank" rel="nofollow noopener">reviews-centos5 #468</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> unable to handle kernel paging request in lprocfs_stats_collect()</p> <p>Lai Siyao : <a href="http://git.whamcloud.com/gitweb/?p=fs/lustre-release.git&amp;a=commit&amp;h=496d18c30da3998711bb3ab3379a486a4739b324" class="external-link" target="_blank" rel="nofollow noopener">496d18c30da3998711bb3ab3379a486a4739b324</a><br/> Files : </p> <ul> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/mgs/lproc_mgs.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/include/obd_class.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/reviews-centos5/533/" class="external-link" target="_blank" rel="nofollow noopener">reviews-centos5 #533</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> unable to handle kernel paging request in lprocfs_stats_collect()</p> <p>Lai Siyao : <a href="http://git.whamcloud.com/gitweb/?p=fs/lustre-release.git&amp;a=commit&amp;h=8a21280779de8135e0255e13582053e6195cc3e1" class="external-link" target="_blank" rel="nofollow noopener">8a21280779de8135e0255e13582053e6195cc3e1</a><br/> Files : </p> <ul> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/mgs/lproc_mgs.c</li> <li>lustre/include/obd_class.h</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/mdt/mdt_handler.c</li> </ul> <p>Review is on <a href="http://review.whamcloud.com/#change,326" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,326</a>.</p> <p>Maloo result is on <a href="https://maloo.whamcloud.com/test_sessions/a3e23b96-6588-11e0-b32b-52540025f9af" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/a3e23b96-6588-11e0-b32b-52540025f9af</a>.</p> <p>maloo result is on <a href="https://maloo.whamcloud.com/test_sessions/c057691e-70db-11e0-80b5-52540025f9af" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/c057691e-70db-11e0-80b5-52540025f9af</a>, and looks okay.<br/> Oleg, do you think it's okay to land this?</p> <p>Single node test w/ patch: <a href="https://maloo.whamcloud.com/test_sessions/9a08f0b6-750e-11e0-a1b3-52540025f9af" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/9a08f0b6-750e-11e0-a1b3-52540025f9af</a></p> <p>Prakash\Ned</p> <p>When do you think LLNL might be able to test this at scale? I have discussed this patch with Oleg and he would prefer to get some scale testing of this patch (preferably using your monitoring tool) before this is landed. It would be great if we were able to land this patch in time for 2.1 but we probably would not hold the release just for this so I am dropping the priority to reflect that</p> <p>Regards</p> <p>Peter</p> <p>Hi Peter,</p> <p>We are currently waiting on getting our test server cluster updated to RHEL6 and Lustre 2.x. I need to check with our system administrators on the timeframe, but my guess is that this should happen within the next two weeks or so. They've been heavily focused on other system integration projects which have priority over our test infrastructure. Once that work is done we can start at scale testing.</p> <p>Thanks,<br/> Ned</p> <p>What testing have you guys done at small scale?</p> <p>I honestly don't see much to gain from scale testing except that we'll have more simultaneous small scale tests...</p> <p>The test for this should look like this:</p> <ul class="alternate" type="square"> <li>Have a script walk and cat files in lustre /proc tree will repeatedly starting and stopping the OSTs. Run for days.</li> </ul> <p>We can help with that, but I don't really think scale is an issue here.</p> <p>Chris</p> <p>I think that our concern is more around unexpected side-effects from this patch not just whether the patch corrects the reported issue.</p> <p>Lai</p> <p>Have you tried running tests as Chris suggests in order to validate this patch? If not, could you please look into doing so?</p> <p>Thanks</p> <p>Peter</p> <p>Peter, in the second comment I described how I tested locally: cat files under /proc/fs/lustre/<span class="error">&#91;mdt|obdfilter&#93;</span>, and it's tested for tens of minutes. To follow Chris' suggest, I need walk and cat more files under /proc/fs/lustre and /proc/sys/<span class="error">&#91;lnet|lustre&#93;</span> and test up to 1 day. I will test it later and post result.</p> <p>Unable to handle kernel NULL pointer dereference at 0000000000000028 RIP:<br/> <span class="error">&#91;&lt;ffffffff80023bb2&gt;&#93;</span> filp_close+0x7/0x64<br/> PGD 2d0057067 PUD 2d004d067 PMD 0<br/> Oops: 0000 <span class="error">&#91;1&#93;</span> SMP<br/> last sysfs file: /devices/pci0000:00/0000:00:01.0/0000:01:00.1/irq<br/> CPU 3<br/> Modules linked in: llite_lloop(U) lustre(U) obdfilter(U) ost(U) osd_ldiskfs(U) cmm(U) fsfilt_ldiskfs(U) exportfs(U) mdt(U) mdd(U) mds(U) mgs(U) ldiskfs(U) jbd2(U) crc16(U) mgc(U) lov(U) osc(U) mdc(U) lmv(U) fid(U) fld(U) lquota(U) ptlrpc(U) obdclass(U) lvfs(U) ksocklnd(U) lnet(U) libcfs(U) nfs(U) fscache(U) nfs_acl(U) autofs4(U) hidp(U) rfcomm(U) l2cap(U) bluetooth(U) lockd(U) sunrpc(U) cpufreq_ondemand(U) acpi_cpufreq(U) freq_table(U) be2iscsi(U) iscsi_tcp(U) bnx2i(U) cnic(U) uio(U) cxgb3i(U) iw_cxgb3(U) cxgb3(U) libiscsi_tcp(U) ib_iser(U) libiscsi2(U) scsi_transport_iscsi2(U) scsi_transport_iscsi(U) ib_srp(U) rds(U) ib_sdp(U) ib_ipoib(U) ipoib_helper(U) ipv6(U) xfrm_nalgo(U) crypto_api(U) rdma_ucm(U) rdma_cm(U) ib_ucm(U) ib_uverbs(U) ib_umad(U) ib_cm(U) iw_cm(U) ib_addr(U) ib_sa(U) loop(U) dm_mirror(U) dm_multipath(U) scsi_dh(U) video(U) backlight(U) sbs(U) power_meter(U) hwmon(U) i2c_ec(U) dell_wmi(U) wmi(U) button(U) battery(U) asus_acpi(U) acpi_memhotplug(U) ac(U) parport_pc(U) lp(U) parport(U) mlx4_ib(U) ib_mad(U) ib_core(U) mlx4_en(U) joydev(U) sg(U) igb(U) 8021q(U) serio_raw(U) i2c_i801(U) i2c_core(U) mlx4_core(U) shpchp(U) dca(U) pcspkr(U) dm_raid45(U) dm_message(U) dm_region_hash(U) dm_log(U) dm_mod(U) dm_mem_cache(U) ahci(U) libata(U) sd_mod(U) scsi_mod(U) ext3(U) jbd(U) uhci_hcd(U) ohci_hcd(U) ehci_hcd(U)<br/> Pid: 32369, comm: cat Tainted: G 2.6.18-194.17.1.el5_lustre.g4a053f7 #1<br/> RIP: 0010:<span class="error">&#91;&lt;ffffffff80023bb2&gt;&#93;</span> <span class="error">&#91;&lt;ffffffff80023bb2&gt;&#93;</span> filp_close+0x7/0x64<br/> RSP: 0018:ffff8102d17afc98 EFLAGS: 00010246<br/> RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffff8102d17afb40<br/> RDX: 0000000000000003 RSI: 0000000000000000 RDI: 0000000000000000<br/> RBP: 0000000000000000 R08: ffff8102d17ae000 R09: 000000000000003d<br/> R10: ffff81010b7e4068 R11: 0000000000000080 R12: ffff8102db2d8928<br/> R13: ffff8102db2d8670 R14: ffff8102d17afce8 R15: 0000000019844000<br/> FS: 00002abeea526260(0000) GS:ffff81010b7636c0(0000) knlGS:0000000000000000<br/> CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b<br/> CR2: 0000000000000028 CR3: 00000002d165b000 CR4: 00000000000006e0<br/> Process cat (pid: 32369, threadinfo ffff8102d17ae000, task ffff8102da4fd860)<br/> Stack: 0000000000000001 ffff8102db2d83f8 ffff8102db2d8928 ffffffff88e43dbd<br/> 0000003000000030 ffff8102d17afdf0 ffff8102d17afcd8 0000000000000004<br/> 0000000000000000 0000000000000000 ffff81033f5cd580 ffff81030d8019c0<br/> Call Trace:<br/> <span class="error">&#91;&lt;ffffffff88e43dbd&gt;&#93;</span> :obdfilter:filter_post+0x11d/0x240<br/> <span class="error">&#91;&lt;ffffffff88e5629f&gt;&#93;</span> :obdfilter:filter_cleanup+0x15f/0x290<br/> <span class="error">&#91;&lt;ffffffff888bb31f&gt;&#93;</span> :obdclass:class_decref+0x43f/0x5b0<br/> <span class="error">&#91;&lt;ffffffff888a2215&gt;&#93;</span> :obdclass:obd_devlist_next+0x65/0x80<br/> <span class="error">&#91;&lt;ffffffff8888a124&gt;&#93;</span> :obdclass:obd_device_list_seq_start+0x34/0x50<br/> <span class="error">&#91;&lt;ffffffff80063b05&gt;&#93;</span> mutex_lock+0xd/0x1d<br/> <span class="error">&#91;&lt;ffffffff8003f649&gt;&#93;</span> seq_read+0xe5/0x28c<br/> <span class="error">&#91;&lt;ffffffff8000b729&gt;&#93;</span> vfs_read+0xcb/0x171<br/> <span class="error">&#91;&lt;ffffffff80011c15&gt;&#93;</span> sys_read+0x45/0x6e<br/> <span class="error">&#91;&lt;ffffffff8005d28d&gt;&#93;</span> tracesys+0xd5/0xe0</p> <p>Peter, during stress test I met one crash, this looks to be another issue related with procfs, should I fix it along in this ticket?</p> <p>crash&gt; bt 22333<br/> PID: 22333 TASK: ffff8102e3a46860 CPU: 3 COMMAND: "umount"<br/> #0 <span class="error">&#91;ffff8102e48e9c58&#93;</span> schedule at ffffffff80062f96<br/> #1 <span class="error">&#91;ffff8102e48e9d30&#93;</span> schedule_timeout at ffffffff800638ab<br/> #2 <span class="error">&#91;ffff8102e48e9d80&#93;</span> server_put_super at ffffffff88861a01<br/> #3 <span class="error">&#91;ffff8102e48e9e60&#93;</span> generic_shutdown_super at ffffffff800e3f3f<br/> #4 <span class="error">&#91;ffff8102e48e9e80&#93;</span> kill_anon_super at ffffffff800e400f<br/> #5 <span class="error">&#91;ffff8102e48e9e90&#93;</span> deactivate_super at ffffffff800e40c0<br/> #6 <span class="error">&#91;ffff8102e48e9eb0&#93;</span> sys_umount at ffffffff800edf11</p> <p>server_put_super() is at server_wait_finished(), it means this obd has been cleaned up. While the crash backtrace shows the obd is been cleaned up again. After checking obd_device_list_seq related code, I found `cat /proc/fs/lustre/devices` will class_getref() on obd, and then class_putref() later, but doing this on a cleaned up obd may cause obd_cleanup() called twice, and finally cause this crash.</p> <p>I will add obd-&gt;obd_stopping check in obd_devlist_first/next() to fix this.</p> <p>&gt; Peter, during stress test I met one crash, this looks to be another issue related with procfs, should I fix it along in this ticket?</p> <p>Yes but perhaps you should track it under a new ticket if it is a distinct issue</p> <p>Ah it seems that you have already corrected this existing patch to address the new issue. That is fine</p> <p>Yes, because it blocked the stress test.</p> <p>I've run the stress test without failure on two setup, one for 8 hours, and another 24 hours. The test script is as below:</p> <ul> <li>one shell running walk.sh: <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>while true; do cat /proc/fs/lustre/* cat /proc/fs/lustre/*/* cat /proc/fs/lustre/*/*/* cat /proc/fs/lustre/*/*/*/* cat /proc/sys/lnet/* cat /proc/sys/lustre/* usleep 20 done </pre> </div></div></li> </ul> <ul> <li>the other one running failover_ost.sh: <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>while true; do umount -d /mnt/ost1 sleep 1 mount -t lustre -o loop /tmp/lustre-ost1 /mnt/ost1 sleep 9 done </pre> </div></div></li> </ul> <p>We have found one more race condition in lprocfs. In osd_device_alloc(), if a /proc read happens in between dt_device_init() and osd_device initialization, a kernel crash is triggered by functions like osd_statfs().</p> <hr /> <p>A reproducer: </p> <p>1. patch lustre with the following</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">diff --git a/lustre/osd-ldiskfs/osd_handler.c b/lustre/osd-ldiskfs/osd_handler.c index 29764c9..728c371 100644 --- a/lustre/osd-ldiskfs/osd_handler.c +++ b/lustre/osd-ldiskfs/osd_handler.c @@ -3874,6 +3874,9 @@ <span class="code-keyword">static</span> <span class="code-object">int</span> osd_device_init(<span class="code-keyword">const</span> struct lu_env *env, struct lu_device *d, rc = lu_context_init(ctx, LCT_MD_THREAD|LCT_REMEMBER|LCT_NOREF); <span class="code-keyword">if</span> (rc == 0) { rc = osd_procfs_init(osd_dev(d), name); + + cfs_schedule_timeout_and_set_state(CFS_TASK_UNINT, cfs_time_seconds(10)); + ctx-&gt;lc_cookie = 0x3; } <span class="code-keyword">return</span> rc; </pre> </div></div> <p>2. run llmount.sh <br/> 3. wait a few seconds and run "find /proc/fs/lustre -name '<b>filesfree</b>' -exec cat {} \;" </p> <hr /> <p>We are cooking a fix in the context of MRP-275.</p> <p>The following patch (applied to other pieces of osd-lprocfs as well) fixes the issue for us:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">@@ -200,7 +250,17 @@ <span class="code-object">int</span> lprocfs_osd_rd_filesfree(<span class="code-object">char</span> *page, <span class="code-object">char</span> **start, off_t off, <span class="code-object">int</span> count, <span class="code-object">int</span> *eof, void *data) { struct osd_device *osd = data; - <span class="code-object">int</span> rc = osd_statfs(NULL, &amp;osd-&gt;od_dt_dev, &amp;osd-&gt;od_kstatfs); + <span class="code-object">int</span> rc; + + /* + * We possibly haven't mounted yet. When od_mount is assigned, it + * should be consistent and should not deinit until lprocfs is + * fully unregistered. + */ + <span class="code-keyword">if</span> (unlikely(osd-&gt;od_mount == NULL)) + <span class="code-keyword">return</span> -EINPROGRESS; + + rc = osd_statfs(NULL, &amp;osd-&gt;od_dt_dev, &amp;osd-&gt;od_kstatfs); <span class="code-keyword">if</span> (!rc) { *eof = 1; rc = snprintf(page, count, LPU64<span class="code-quote">"\n"</span>, osd-&gt;od_kstatfs.f_ffree); </pre> </div></div> <p>The race described above will work just like that:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">[root@panda ~]# find /proc/fs/lustre -name <span class="code-quote">'filesfree'</span> -exec cat {} \; cat: /proc/fs/lustre/osd-ldiskfs/lustre-MDT0000/filesfree: Operation now in progress cat: /proc/fs/lustre/lov/lustre-MDT0000-mdtlov/filesfree: Input/output error </pre> </div></div> <p>Nice catch, I'll go through the code and see whether other places needs this check too, and then I'll include this fix. Thanks!</p> <p>Fix included in latest patch: <a href="http://review.whamcloud.com/#change,326" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,326</a>.</p> <p>Landed for 2.2</p> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=sles11,ib_stack=inkernel/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,sles11,inkernel #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_config.c</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/mdc/mdc_request.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el6,ib_stack=inkernel/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el6,inkernel #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/obdclass/lprocfs_status.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el6,inkernel #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/include/lprocfs_status.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=ofa/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,ofa #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/include/lprocfs_status.h</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/include/lustre_fld.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el6,ib_stack=inkernel/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el6,inkernel #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/lov/lov_obd.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=el5,ib_stack=inkernel/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,el5,inkernel #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_config.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/fld/fld_request.c</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/obdfilter/filter.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=client,distro=ubuntu1004,ib_stack=inkernel/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,client,ubuntu1004,inkernel #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/osc/osc_request.c</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/include/lustre_fld.h</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=inkernel/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,inkernel #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/fld/fld_request.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=ofa/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,ofa #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/mdc/mdc_request.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/lov/lov_obd.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=client,distro=el5,ib_stack=inkernel/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,client,el5,inkernel #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/fld/fld_request.c</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/lov/lov_obd.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/red.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=x86_64,build_type=server,distro=el5,ib_stack=ofa/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » x86_64,server,el5,ofa #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = FAILURE<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/osc/osc_request.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=inkernel/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,inkernel #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/cmm/cmm_device.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/mdt/mdt_lproc.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el6,ib_stack=inkernel/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el6,inkernel #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/obdclass/obd_config.c</li> <li>lustre/mdt/mdt_handler.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/osc/osc_request.c</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/cmm/cmm_device.c</li> </ul> <p>Integrated in <span class="image-wrap" style=""><img src="http://build.whamcloud.com/images/16x16/blue.png" style="border: 0px solid black" /></span> <a href="http://build.whamcloud.com/job/lustre-master/./arch=i686,build_type=server,distro=el5,ib_stack=ofa/378/" class="external-link" target="_blank" rel="nofollow noopener">lustre-master » i686,server,el5,ofa #378</a><br/> <a href="https://jira.whamcloud.com/browse/LU-106" title="unable to handle kernel paging request in lprocfs_stats_collect()" class="issue-link" data-issue-key="LU-106"><del>LU-106</del></a> procfs: many proc entries are not accessed safely (Revision ad538dba7f5259df31fc45e90835edc12756db40)</p> <p> Result = SUCCESS<br/> Oleg Drokin : <a href="http://git.whamcloud.com/gitweb?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master&amp;a=commit&amp;h=ad538dba7f5259df31fc45e90835edc12756db40" class="external-link" target="_blank" rel="nofollow noopener">ad538dba7f5259df31fc45e90835edc12756db40</a><br/> Files : </p> <ul> <li>lustre/cmm/cmm_device.c</li> <li>lustre/mgs/mgs_handler.c</li> <li>lustre/obdclass/obd_config.c</li> <li>lustre/include/lustre_fld.h</li> <li>lustre/lov/lov_obd.c</li> <li>lustre/mdt/mdt_lproc.c</li> <li>lustre/obdclass/lprocfs_status.c</li> <li>lustre/lmv/lmv_obd.c</li> <li>lustre/obdfilter/filter.c</li> <li>lustre/include/lprocfs_status.h</li> <li>lustre/osc/osc_request.c</li> <li>lustre/fld/fld_request.c</li> <li>lustre/osd-ldiskfs/osd_lproc.c</li> <li>lustre/mdc/mdc_request.c</li> <li>lustre/mdt/mdt_handler.c</li> </ul> Development Rank 1|hzv7vr: Rank (Obsolete) 4811 Severity