<!-- 
RSS generated by JIRA (9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c) at Sat Feb 10 01:36:44 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>Whamcloud Community JIRA</title>
    <link>https://jira.whamcloud.com</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.4.14</version>
        <build-number>940014</build-number>
        <build-date>05-12-2023</build-date>
    </build-info>


<item>
            <title>[LU-3766] ASSERTION( stripe &lt; lio-&gt;lis_stripe_count )</title>
                <link>https://jira.whamcloud.com/browse/LU-3766</link>
                <project id="10000" key="LU">Lustre</project>
                    <description>&lt;p&gt;We have a kernel crash on Lustre Client 2.1.5 with the following assertion:&lt;/p&gt;

&lt;p&gt;LustreError: 31091:0:(lov_io.c:214:lov_sub_get()) ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
LustreError: 31091:0:(lov_io.c:214:lov_sub_get()) LBUG&lt;/p&gt;

&lt;p&gt;It very similar to:&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.whamcloud.com/browse/LU-2652&quot; title=&quot;lov_io.c:222:lov_sub_get()) ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-2652&quot;&gt;&lt;del&gt;LU-2652&lt;/del&gt;&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;https://jira.whamcloud.com/browse/LU-3524&quot; title=&quot;Lustre 2.1.3: lov_io.c:212:lov_sub_get()) ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-3524&quot;&gt;&lt;del&gt;LU-3524&lt;/del&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;This bug has been fixed in 2.4? If so, any plans to fix it in 2.1? And how can you get around the error (perhaps by configuring) without updating?&lt;/p&gt;


&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;root@r03 lustre_2.1.5&amp;#93;&lt;/span&gt;# crash /usr/lib/debug/lib/modules/2.6.32-279.19.1.el6_lustre.x86_64/vmlinux /var/crash/127.0.0.1-2013-08-13-10\:15\:56/vmcore&lt;/p&gt;

&lt;p&gt;crash 6.0.4-2.el6&lt;br/&gt;
Copyright (C) 2002-2012  Red Hat, Inc.&lt;br/&gt;
Copyright (C) 2004, 2005, 2006  IBM Corporation&lt;br/&gt;
Copyright (C) 1999-2006  Hewlett-Packard Co&lt;br/&gt;
Copyright (C) 2005, 2006  Fujitsu Limited&lt;br/&gt;
Copyright (C) 2006, 2007  VA Linux Systems Japan K.K.&lt;br/&gt;
Copyright (C) 2005  NEC Corporation&lt;br/&gt;
Copyright (C) 1999, 2002, 2007  Silicon Graphics, Inc.&lt;br/&gt;
Copyright (C) 1999, 2000, 2001, 2002  Mission Critical Linux, Inc.&lt;br/&gt;
This program is free software, covered by the GNU General Public License,&lt;br/&gt;
and you are welcome to change it and/or distribute copies of it under&lt;br/&gt;
certain conditions.  Enter &quot;help copying&quot; to see the conditions.&lt;br/&gt;
This program has absolutely no warranty.  Enter &quot;help warranty&quot; for details.&lt;/p&gt;

&lt;p&gt;GNU gdb (GDB) 7.3.1&lt;br/&gt;
Copyright (C) 2011 Free Software Foundation, Inc.&lt;br/&gt;
License GPLv3+: GNU GPL version 3 or later &amp;lt;&lt;a href=&quot;http://gnu.org/licenses/gpl.html&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://gnu.org/licenses/gpl.html&lt;/a&gt;&amp;gt;&lt;br/&gt;
This is free software: you are free to change and redistribute it.&lt;br/&gt;
There is NO WARRANTY, to the extent permitted by law.  Type &quot;show copying&quot;&lt;br/&gt;
and &quot;show warranty&quot; for details.&lt;br/&gt;
This GDB was configured as &quot;x86_64-unknown-linux-gnu&quot;...&lt;/p&gt;

&lt;p&gt;      KERNEL: /usr/lib/debug/lib/modules/2.6.32-279.19.1.el6_lustre.x86_64/vmlinux&lt;br/&gt;
    DUMPFILE: /var/crash/127.0.0.1-2013-08-13-10:15:56/vmcore  &lt;span class=&quot;error&quot;&gt;&amp;#91;PARTIAL DUMP&amp;#93;&lt;/span&gt;&lt;br/&gt;
        CPUS: 16&lt;br/&gt;
        DATE: Tue Aug 13 10:14:51 2013&lt;br/&gt;
      UPTIME: 4 days, 12:04:11&lt;br/&gt;
LOAD AVERAGE: 0.00, 0.11, 0.12&lt;br/&gt;
       TASKS: 513&lt;br/&gt;
    NODENAME: r03&lt;br/&gt;
     RELEASE: 2.6.32-279.19.1.el6_lustre.x86_64&lt;br/&gt;
     VERSION: #1 SMP Wed Mar 20 16:37:18 PDT 2013&lt;br/&gt;
     MACHINE: x86_64  (2400 Mhz)&lt;br/&gt;
      MEMORY: 12 GB&lt;br/&gt;
       PANIC: &quot;Kernel panic - not syncing: LBUG&quot;&lt;br/&gt;
         PID: 31091&lt;br/&gt;
     COMMAND: &quot;lrvfarmd&quot;&lt;br/&gt;
        TASK: ffff88013cd3b500  &lt;span class=&quot;error&quot;&gt;&amp;#91;THREAD_INFO: ffff880149fd4000&amp;#93;&lt;/span&gt;&lt;br/&gt;
         CPU: 1&lt;br/&gt;
       STATE: TASK_RUNNING (PANIC)&lt;/p&gt;


&lt;p&gt;crash&amp;gt; log&lt;/p&gt;

&lt;p&gt;LustreError: 31091:0:(lov_io.c:214:lov_sub_get()) ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
LustreError: 31091:0:(lov_io.c:214:lov_sub_get()) LBUG&lt;br/&gt;
Pid: 31091, comm: lrvfarmd&lt;/p&gt;

&lt;p&gt;Call Trace:&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa034a785&amp;gt;&amp;#93;&lt;/span&gt; libcfs_debug_dumpstack+0x55/0x80 &lt;span class=&quot;error&quot;&gt;&amp;#91;libcfs&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa034ad97&amp;gt;&amp;#93;&lt;/span&gt; lbug_with_loc+0x47/0xb0 &lt;span class=&quot;error&quot;&gt;&amp;#91;libcfs&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa099e93f&amp;gt;&amp;#93;&lt;/span&gt; lov_sub_get+0x47f/0x6f0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0998cfc&amp;gt;&amp;#93;&lt;/span&gt; lov_page_init_raid0+0x14c/0x770 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff812754b4&amp;gt;&amp;#93;&lt;/span&gt; ? call_rwsem_down_read_failed+0x14/0x30&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0995a54&amp;gt;&amp;#93;&lt;/span&gt; lov_page_init+0x54/0xe0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04a415c&amp;gt;&amp;#93;&lt;/span&gt; cl_page_find0+0x1cc/0x850 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04a4811&amp;gt;&amp;#93;&lt;/span&gt; cl_page_find+0x11/0x20 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a591d2&amp;gt;&amp;#93;&lt;/span&gt; ll_cl_init+0x152/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8116b858&amp;gt;&amp;#93;&lt;/span&gt; ? mem_cgroup_cache_charge+0x118/0x130&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a5962a&amp;gt;&amp;#93;&lt;/span&gt; ll_readpage+0x4a/0x200 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff811117ec&amp;gt;&amp;#93;&lt;/span&gt; generic_file_aio_read+0x1fc/0x700&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8109672f&amp;gt;&amp;#93;&lt;/span&gt; ? up+0x2f/0x50&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a80cdb&amp;gt;&amp;#93;&lt;/span&gt; vvp_io_read_start+0x13b/0x3e0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04ac23a&amp;gt;&amp;#93;&lt;/span&gt; cl_io_start+0x6a/0x140 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04b0a7c&amp;gt;&amp;#93;&lt;/span&gt; cl_io_loop+0xcc/0x190 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a31047&amp;gt;&amp;#93;&lt;/span&gt; ll_file_io_generic+0x3a7/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a31339&amp;gt;&amp;#93;&lt;/span&gt; ll_file_aio_read+0x139/0x2c0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a317f9&amp;gt;&amp;#93;&lt;/span&gt; ll_file_read+0x169/0x2a0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176cb5&amp;gt;&amp;#93;&lt;/span&gt; vfs_read+0xb5/0x1a0&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176df1&amp;gt;&amp;#93;&lt;/span&gt; sys_read+0x51/0x90&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff814ed03e&amp;gt;&amp;#93;&lt;/span&gt; ? do_device_not_available+0xe/0x10&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8100b072&amp;gt;&amp;#93;&lt;/span&gt; system_call_fastpath+0x16/0x1b&lt;/p&gt;

&lt;p&gt;Kernel panic - not syncing: LBUG&lt;br/&gt;
Pid: 31091, comm: lrvfarmd Not tainted 2.6.32-279.19.1.el6_lustre.x86_64 #1&lt;br/&gt;
Call Trace:&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff814e9811&amp;gt;&amp;#93;&lt;/span&gt; ? panic+0xa0/0x168&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa034adeb&amp;gt;&amp;#93;&lt;/span&gt; ? lbug_with_loc+0x9b/0xb0 &lt;span class=&quot;error&quot;&gt;&amp;#91;libcfs&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa099e93f&amp;gt;&amp;#93;&lt;/span&gt; ? lov_sub_get+0x47f/0x6f0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0998cfc&amp;gt;&amp;#93;&lt;/span&gt; ? lov_page_init_raid0+0x14c/0x770 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff812754b4&amp;gt;&amp;#93;&lt;/span&gt; ? call_rwsem_down_read_failed+0x14/0x30&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0995a54&amp;gt;&amp;#93;&lt;/span&gt; ? lov_page_init+0x54/0xe0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04a415c&amp;gt;&amp;#93;&lt;/span&gt; ? cl_page_find0+0x1cc/0x850 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04a4811&amp;gt;&amp;#93;&lt;/span&gt; ? cl_page_find+0x11/0x20 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a591d2&amp;gt;&amp;#93;&lt;/span&gt; ? ll_cl_init+0x152/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8116b858&amp;gt;&amp;#93;&lt;/span&gt; ? mem_cgroup_cache_charge+0x118/0x130&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a5962a&amp;gt;&amp;#93;&lt;/span&gt; ? ll_readpage+0x4a/0x200 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff811117ec&amp;gt;&amp;#93;&lt;/span&gt; ? generic_file_aio_read+0x1fc/0x700&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8109672f&amp;gt;&amp;#93;&lt;/span&gt; ? up+0x2f/0x50&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a80cdb&amp;gt;&amp;#93;&lt;/span&gt; ? vvp_io_read_start+0x13b/0x3e0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04ac23a&amp;gt;&amp;#93;&lt;/span&gt; ? cl_io_start+0x6a/0x140 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04b0a7c&amp;gt;&amp;#93;&lt;/span&gt; ? cl_io_loop+0xcc/0x190 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a31047&amp;gt;&amp;#93;&lt;/span&gt; ? ll_file_io_generic+0x3a7/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a31339&amp;gt;&amp;#93;&lt;/span&gt; ? ll_file_aio_read+0x139/0x2c0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a317f9&amp;gt;&amp;#93;&lt;/span&gt; ? ll_file_read+0x169/0x2a0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176cb5&amp;gt;&amp;#93;&lt;/span&gt; ? vfs_read+0xb5/0x1a0&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176df1&amp;gt;&amp;#93;&lt;/span&gt; ? sys_read+0x51/0x90&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff814ed03e&amp;gt;&amp;#93;&lt;/span&gt; ? do_device_not_available+0xe/0x10&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8100b072&amp;gt;&amp;#93;&lt;/span&gt; ? system_call_fastpath+0x16/0x1b&lt;/p&gt;</description>
                <environment>Linux 2.6.32-279.19.1.el6_lustre.x86_64 #1 SMP</environment>
        <key id="20359">LU-3766</key>
            <summary>ASSERTION( stripe &lt; lio-&gt;lis_stripe_count )</summary>
                <type id="1" iconUrl="https://jira.whamcloud.com/secure/viewavatar?size=xsmall&amp;avatarId=11303&amp;avatarType=issuetype">Bug</type>
                                            <priority id="2" iconUrl="https://jira.whamcloud.com/images/icons/priorities/critical.svg">Critical</priority>
                        <status id="5" iconUrl="https://jira.whamcloud.com/images/icons/statuses/resolved.png" description="A resolution has been taken, and it is awaiting verification by reporter. From here issues are either reopened, or are closed.">Resolved</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="5">Cannot Reproduce</resolution>
                                        <assignee username="wc-triage">WC Triage</assignee>
                                    <reporter username="rustequal">Rustem Bikboulatov</reporter>
                        <labels>
                    </labels>
                <created>Thu, 15 Aug 2013 15:35:32 +0000</created>
                <updated>Sat, 9 Oct 2021 05:51:43 +0000</updated>
                            <resolved>Sat, 9 Oct 2021 05:51:43 +0000</resolved>
                                    <version>Lustre 2.1.5</version>
                                                        <due></due>
                            <votes>0</votes>
                                    <watches>1</watches>
                                                                            <comments>
                            <comment id="64457" author="rustequal" created="Mon, 19 Aug 2013 09:53:57 +0000"  >&lt;p&gt;Today we had another &quot;Lustre Client&quot; crash:&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;root@r03 ~&amp;#93;&lt;/span&gt;# crash /usr/lib/debug/lib/modules/2.6.32-279.19.1.el6_lustre.x86_64/vmlinux /var/crash/127.0.0.1-2013-08-19-01\:19\:55/vmcore&lt;/p&gt;

&lt;p&gt;crash 6.0.4-2.el6&lt;br/&gt;
Copyright (C) 2002-2012  Red Hat, Inc.&lt;br/&gt;
Copyright (C) 2004, 2005, 2006  IBM Corporation&lt;br/&gt;
Copyright (C) 1999-2006  Hewlett-Packard Co&lt;br/&gt;
Copyright (C) 2005, 2006  Fujitsu Limited&lt;br/&gt;
Copyright (C) 2006, 2007  VA Linux Systems Japan K.K.&lt;br/&gt;
Copyright (C) 2005  NEC Corporation&lt;br/&gt;
Copyright (C) 1999, 2002, 2007  Silicon Graphics, Inc.&lt;br/&gt;
Copyright (C) 1999, 2000, 2001, 2002  Mission Critical Linux, Inc.&lt;br/&gt;
This program is free software, covered by the GNU General Public License,&lt;br/&gt;
and you are welcome to change it and/or distribute copies of it under&lt;br/&gt;
certain conditions.  Enter &quot;help copying&quot; to see the conditions.&lt;br/&gt;
This program has absolutely no warranty.  Enter &quot;help warranty&quot; for details.&lt;/p&gt;

&lt;p&gt;GNU gdb (GDB) 7.3.1&lt;br/&gt;
Copyright (C) 2011 Free Software Foundation, Inc.&lt;br/&gt;
License GPLv3+: GNU GPL version 3 or later &amp;lt;&lt;a href=&quot;http://gnu.org/licenses/gpl.html&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://gnu.org/licenses/gpl.html&lt;/a&gt;&amp;gt;&lt;br/&gt;
This is free software: you are free to change and redistribute it.&lt;br/&gt;
There is NO WARRANTY, to the extent permitted by law.  Type &quot;show copying&quot;&lt;br/&gt;
and &quot;show warranty&quot; for details.&lt;br/&gt;
This GDB was configured as &quot;x86_64-unknown-linux-gnu&quot;...&lt;/p&gt;

&lt;p&gt;      KERNEL: /usr/lib/debug/lib/modules/2.6.32-279.19.1.el6_lustre.x86_64/vmlinux&lt;br/&gt;
    DUMPFILE: /var/crash/127.0.0.1-2013-08-19-01:19:55/vmcore  &lt;span class=&quot;error&quot;&gt;&amp;#91;PARTIAL DUMP&amp;#93;&lt;/span&gt;&lt;br/&gt;
        CPUS: 16&lt;br/&gt;
        DATE: Mon Aug 19 01:18:50 2013&lt;br/&gt;
      UPTIME: 3 days, 06:55:45&lt;br/&gt;
LOAD AVERAGE: 1.48, 2.67, 3.51&lt;br/&gt;
       TASKS: 572&lt;br/&gt;
    NODENAME: r03&lt;br/&gt;
     RELEASE: 2.6.32-279.19.1.el6_lustre.x86_64&lt;br/&gt;
     VERSION: #1 SMP Wed Mar 20 16:37:18 PDT 2013&lt;br/&gt;
     MACHINE: x86_64  (2400 Mhz)&lt;br/&gt;
      MEMORY: 12 GB&lt;br/&gt;
       PANIC: &quot;Kernel panic - not syncing: LBUG&quot;&lt;br/&gt;
         PID: 9099&lt;br/&gt;
     COMMAND: &quot;lrvfarmd&quot;&lt;br/&gt;
        TASK: ffff8802b063f500  &lt;span class=&quot;error&quot;&gt;&amp;#91;THREAD_INFO: ffff8802b0640000&amp;#93;&lt;/span&gt;&lt;br/&gt;
         CPU: 6&lt;br/&gt;
       STATE: TASK_RUNNING (PANIC)&lt;/p&gt;

&lt;p&gt;crash&amp;gt; log&lt;/p&gt;

&lt;p&gt;LustreError: 9099:0:(lov_io.c:214:lov_sub_get()) ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
LustreError: 9099:0:(lov_io.c:214:lov_sub_get()) LBUG&lt;br/&gt;
Pid: 9099, comm: lrvfarmd&lt;/p&gt;

&lt;p&gt;Call Trace:&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0372785&amp;gt;&amp;#93;&lt;/span&gt; libcfs_debug_dumpstack+0x55/0x80 &lt;span class=&quot;error&quot;&gt;&amp;#91;libcfs&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0372d97&amp;gt;&amp;#93;&lt;/span&gt; lbug_with_loc+0x47/0xb0 &lt;span class=&quot;error&quot;&gt;&amp;#91;libcfs&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa099a93f&amp;gt;&amp;#93;&lt;/span&gt; lov_sub_get+0x47f/0x6f0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0994cfc&amp;gt;&amp;#93;&lt;/span&gt; lov_page_init_raid0+0x14c/0x770 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff812754b4&amp;gt;&amp;#93;&lt;/span&gt; ? call_rwsem_down_read_failed+0x14/0x30&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0991a54&amp;gt;&amp;#93;&lt;/span&gt; lov_page_init+0x54/0xe0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04ba15c&amp;gt;&amp;#93;&lt;/span&gt; cl_page_find0+0x1cc/0x850 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04ba811&amp;gt;&amp;#93;&lt;/span&gt; cl_page_find+0x11/0x20 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a551d2&amp;gt;&amp;#93;&lt;/span&gt; ll_cl_init+0x152/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8116b858&amp;gt;&amp;#93;&lt;/span&gt; ? mem_cgroup_cache_charge+0x118/0x130&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a5562a&amp;gt;&amp;#93;&lt;/span&gt; ll_readpage+0x4a/0x200 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff811117ec&amp;gt;&amp;#93;&lt;/span&gt; generic_file_aio_read+0x1fc/0x700&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8109672f&amp;gt;&amp;#93;&lt;/span&gt; ? up+0x2f/0x50&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a7ccdb&amp;gt;&amp;#93;&lt;/span&gt; vvp_io_read_start+0x13b/0x3e0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04c223a&amp;gt;&amp;#93;&lt;/span&gt; cl_io_start+0x6a/0x140 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04c6a7c&amp;gt;&amp;#93;&lt;/span&gt; cl_io_loop+0xcc/0x190 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a2d047&amp;gt;&amp;#93;&lt;/span&gt; ll_file_io_generic+0x3a7/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a2d339&amp;gt;&amp;#93;&lt;/span&gt; ll_file_aio_read+0x139/0x2c0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a2d7f9&amp;gt;&amp;#93;&lt;/span&gt; ll_file_read+0x169/0x2a0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176cb5&amp;gt;&amp;#93;&lt;/span&gt; vfs_read+0xb5/0x1a0&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176df1&amp;gt;&amp;#93;&lt;/span&gt; sys_read+0x51/0x90&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff814ed03e&amp;gt;&amp;#93;&lt;/span&gt; ? do_device_not_available+0xe/0x10&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8100b072&amp;gt;&amp;#93;&lt;/span&gt; system_call_fastpath+0x16/0x1b&lt;/p&gt;

&lt;p&gt;Kernel panic - not syncing: LBUG&lt;br/&gt;
Pid: 9099, comm: lrvfarmd Not tainted 2.6.32-279.19.1.el6_lustre.x86_64 #1&lt;br/&gt;
Call Trace:&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff814e9811&amp;gt;&amp;#93;&lt;/span&gt; ? panic+0xa0/0x168&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0372deb&amp;gt;&amp;#93;&lt;/span&gt; ? lbug_with_loc+0x9b/0xb0 &lt;span class=&quot;error&quot;&gt;&amp;#91;libcfs&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa099a93f&amp;gt;&amp;#93;&lt;/span&gt; ? lov_sub_get+0x47f/0x6f0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0994cfc&amp;gt;&amp;#93;&lt;/span&gt; ? lov_page_init_raid0+0x14c/0x770 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff812754b4&amp;gt;&amp;#93;&lt;/span&gt; ? call_rwsem_down_read_failed+0x14/0x30&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0991a54&amp;gt;&amp;#93;&lt;/span&gt; ? lov_page_init+0x54/0xe0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04ba15c&amp;gt;&amp;#93;&lt;/span&gt; ? cl_page_find0+0x1cc/0x850 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04ba811&amp;gt;&amp;#93;&lt;/span&gt; ? cl_page_find+0x11/0x20 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a551d2&amp;gt;&amp;#93;&lt;/span&gt; ? ll_cl_init+0x152/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8116b858&amp;gt;&amp;#93;&lt;/span&gt; ? mem_cgroup_cache_charge+0x118/0x130&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a5562a&amp;gt;&amp;#93;&lt;/span&gt; ? ll_readpage+0x4a/0x200 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff811117ec&amp;gt;&amp;#93;&lt;/span&gt; ? generic_file_aio_read+0x1fc/0x700&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8109672f&amp;gt;&amp;#93;&lt;/span&gt; ? up+0x2f/0x50&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a7ccdb&amp;gt;&amp;#93;&lt;/span&gt; ? vvp_io_read_start+0x13b/0x3e0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04c223a&amp;gt;&amp;#93;&lt;/span&gt; ? cl_io_start+0x6a/0x140 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04c6a7c&amp;gt;&amp;#93;&lt;/span&gt; ? cl_io_loop+0xcc/0x190 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a2d047&amp;gt;&amp;#93;&lt;/span&gt; ? ll_file_io_generic+0x3a7/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a2d339&amp;gt;&amp;#93;&lt;/span&gt; ? ll_file_aio_read+0x139/0x2c0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a2d7f9&amp;gt;&amp;#93;&lt;/span&gt; ? ll_file_read+0x169/0x2a0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176cb5&amp;gt;&amp;#93;&lt;/span&gt; ? vfs_read+0xb5/0x1a0&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176df1&amp;gt;&amp;#93;&lt;/span&gt; ? sys_read+0x51/0x90&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff814ed03e&amp;gt;&amp;#93;&lt;/span&gt; ? do_device_not_available+0xe/0x10&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8100b072&amp;gt;&amp;#93;&lt;/span&gt; ? system_call_fastpath+0x16/0x1b&lt;/p&gt;

&lt;p&gt;crash&amp;gt; kmem -i&lt;br/&gt;
              PAGES        TOTAL      PERCENTAGE&lt;br/&gt;
 TOTAL MEM  3014311      11.5 GB         ----&lt;br/&gt;
      FREE  2394588       9.1 GB   79% of TOTAL MEM&lt;br/&gt;
      USED   619723       2.4 GB   20% of TOTAL MEM&lt;br/&gt;
    SHARED    90534     353.6 MB    3% of TOTAL MEM&lt;br/&gt;
   BUFFERS      114       456 KB    0% of TOTAL MEM&lt;br/&gt;
    CACHED    87771     342.9 MB    2% of TOTAL MEM&lt;br/&gt;
      SLAB   381764       1.5 GB   12% of TOTAL MEM&lt;/p&gt;

&lt;p&gt;TOTAL SWAP   524286         2 GB         ----&lt;br/&gt;
 SWAP USED      426       1.7 MB    0% of TOTAL SWAP&lt;br/&gt;
 SWAP FREE   523860         2 GB   99% of TOTAL SWAP&lt;/p&gt;</comment>
                            <comment id="65358" author="rustequal" created="Thu, 29 Aug 2013 12:43:35 +0000"  >&lt;p&gt;And another crash:&lt;/p&gt;

&lt;p&gt;LustreError: 3447:0:(lov_io.c:214:lov_sub_get()) ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
LustreError: 3447:0:(lov_io.c:214:lov_sub_get()) LBUG&lt;br/&gt;
Pid: 3447, comm: lrvfarmd&lt;/p&gt;

&lt;p&gt;Call Trace:&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0374785&amp;gt;&amp;#93;&lt;/span&gt; libcfs_debug_dumpstack+0x55/0x80 &lt;span class=&quot;error&quot;&gt;&amp;#91;libcfs&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0374d97&amp;gt;&amp;#93;&lt;/span&gt; lbug_with_loc+0x47/0xb0 &lt;span class=&quot;error&quot;&gt;&amp;#91;libcfs&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa099493f&amp;gt;&amp;#93;&lt;/span&gt; lov_sub_get+0x47f/0x6f0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa098ecfc&amp;gt;&amp;#93;&lt;/span&gt; lov_page_init_raid0+0x14c/0x770 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff812754b4&amp;gt;&amp;#93;&lt;/span&gt; ? call_rwsem_down_read_failed+0x14/0x30&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa098ba54&amp;gt;&amp;#93;&lt;/span&gt; lov_page_init+0x54/0xe0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04bc15c&amp;gt;&amp;#93;&lt;/span&gt; cl_page_find0+0x1cc/0x850 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04bc811&amp;gt;&amp;#93;&lt;/span&gt; cl_page_find+0x11/0x20 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a4f1d2&amp;gt;&amp;#93;&lt;/span&gt; ll_cl_init+0x152/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8116b858&amp;gt;&amp;#93;&lt;/span&gt; ? mem_cgroup_cache_charge+0x118/0x130&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a4f62a&amp;gt;&amp;#93;&lt;/span&gt; ll_readpage+0x4a/0x200 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff811117ec&amp;gt;&amp;#93;&lt;/span&gt; generic_file_aio_read+0x1fc/0x700&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8109672f&amp;gt;&amp;#93;&lt;/span&gt; ? up+0x2f/0x50&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a76cdb&amp;gt;&amp;#93;&lt;/span&gt; vvp_io_read_start+0x13b/0x3e0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04c423a&amp;gt;&amp;#93;&lt;/span&gt; cl_io_start+0x6a/0x140 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04c8a7c&amp;gt;&amp;#93;&lt;/span&gt; cl_io_loop+0xcc/0x190 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a27047&amp;gt;&amp;#93;&lt;/span&gt; ll_file_io_generic+0x3a7/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a27339&amp;gt;&amp;#93;&lt;/span&gt; ll_file_aio_read+0x139/0x2c0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a277f9&amp;gt;&amp;#93;&lt;/span&gt; ll_file_read+0x169/0x2a0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176cb5&amp;gt;&amp;#93;&lt;/span&gt; vfs_read+0xb5/0x1a0&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176df1&amp;gt;&amp;#93;&lt;/span&gt; sys_read+0x51/0x90&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff814ed03e&amp;gt;&amp;#93;&lt;/span&gt; ? do_device_not_available+0xe/0x10&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8100b072&amp;gt;&amp;#93;&lt;/span&gt; system_call_fastpath+0x16/0x1b&lt;/p&gt;

&lt;p&gt;Kernel panic - not syncing: LBUG&lt;br/&gt;
Pid: 3447, comm: lrvfarmd Not tainted 2.6.32-279.19.1.el6_lustre.x86_64 #1&lt;br/&gt;
Call Trace:&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff814e9811&amp;gt;&amp;#93;&lt;/span&gt; ? panic+0xa0/0x168&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0374deb&amp;gt;&amp;#93;&lt;/span&gt; ? lbug_with_loc+0x9b/0xb0 &lt;span class=&quot;error&quot;&gt;&amp;#91;libcfs&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa099493f&amp;gt;&amp;#93;&lt;/span&gt; ? lov_sub_get+0x47f/0x6f0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa098ecfc&amp;gt;&amp;#93;&lt;/span&gt; ? lov_page_init_raid0+0x14c/0x770 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff812754b4&amp;gt;&amp;#93;&lt;/span&gt; ? call_rwsem_down_read_failed+0x14/0x30&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa098ba54&amp;gt;&amp;#93;&lt;/span&gt; ? lov_page_init+0x54/0xe0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lov&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04bc15c&amp;gt;&amp;#93;&lt;/span&gt; ? cl_page_find0+0x1cc/0x850 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04bc811&amp;gt;&amp;#93;&lt;/span&gt; ? cl_page_find+0x11/0x20 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a4f1d2&amp;gt;&amp;#93;&lt;/span&gt; ? ll_cl_init+0x152/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8116b858&amp;gt;&amp;#93;&lt;/span&gt; ? mem_cgroup_cache_charge+0x118/0x130&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a4f62a&amp;gt;&amp;#93;&lt;/span&gt; ? ll_readpage+0x4a/0x200 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff811117ec&amp;gt;&amp;#93;&lt;/span&gt; ? generic_file_aio_read+0x1fc/0x700&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8109672f&amp;gt;&amp;#93;&lt;/span&gt; ? up+0x2f/0x50&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a76cdb&amp;gt;&amp;#93;&lt;/span&gt; ? vvp_io_read_start+0x13b/0x3e0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04c423a&amp;gt;&amp;#93;&lt;/span&gt; ? cl_io_start+0x6a/0x140 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa04c8a7c&amp;gt;&amp;#93;&lt;/span&gt; ? cl_io_loop+0xcc/0x190 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a27047&amp;gt;&amp;#93;&lt;/span&gt; ? ll_file_io_generic+0x3a7/0x560 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a27339&amp;gt;&amp;#93;&lt;/span&gt; ? ll_file_aio_read+0x139/0x2c0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffffa0a277f9&amp;gt;&amp;#93;&lt;/span&gt; ? ll_file_read+0x169/0x2a0 &lt;span class=&quot;error&quot;&gt;&amp;#91;lustre&amp;#93;&lt;/span&gt;&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176cb5&amp;gt;&amp;#93;&lt;/span&gt; ? vfs_read+0xb5/0x1a0&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff81176df1&amp;gt;&amp;#93;&lt;/span&gt; ? sys_read+0x51/0x90&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff814ed03e&amp;gt;&amp;#93;&lt;/span&gt; ? do_device_not_available+0xe/0x10&lt;br/&gt;
 &lt;span class=&quot;error&quot;&gt;&amp;#91;&amp;lt;ffffffff8100b072&amp;gt;&amp;#93;&lt;/span&gt; ? system_call_fastpath+0x16/0x1b&lt;/p&gt;</comment>
                            <comment id="74916" author="rustequal" created="Tue, 14 Jan 2014 11:16:44 +0000"  >&lt;p&gt;Lustre Cluster Diagram&lt;/p&gt;</comment>
                            <comment id="74917" author="rustequal" created="Tue, 14 Jan 2014 11:18:33 +0000"  >&lt;p&gt;Here the cluster configuration:&lt;/p&gt;

&lt;p&gt;Lustre Server MGS/MDS - mmp-2&lt;br/&gt;
Lustre Servers OSS - n11, n12, n13, n14, n15, n21, n22, n23, n24, n25&lt;br/&gt;
Lustre Clients - r01, r02, r03, r04, mmp-1, vn-1, cln01, cln02, cln03, cln04&lt;/p&gt;

&lt;p&gt;(refer to the diagram &quot;20140113 - Hardware Diagram v0.1_R3.gif&quot; in attachment)&lt;/p&gt;

&lt;p&gt;Environment:&lt;br/&gt;
Linux 2.6.32-279.19.1.el6_lustre.x86_64 #1 SMP&lt;/p&gt;

&lt;p&gt;Mount points:&lt;/p&gt;

&lt;p&gt;OSS:&lt;br/&gt;
/dev/md11 on /lustre/ost type lustre (rw,noauto,_netdev,abort_recov)&lt;/p&gt;

&lt;p&gt;MGS/MDS:&lt;br/&gt;
/dev/lustre_mgs on /lustre/mgs type lustre (rw,noauto,_netdev,abort_recov)&lt;br/&gt;
/dev/lustre_mdt1 on /lustre/mdt1 type lustre (rw,noauto,_netdev,abort_recov)&lt;/p&gt;

&lt;p&gt;Clients:&lt;br/&gt;
mmp-2@tcp:mmp-1@tcp:/lustre1 on /array1 type lustre (rw,noauto,_netdev,flock,abort_recov,lazystatfs)&lt;/p&gt;

&lt;p&gt;Stripe config:&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;root@mmp-1 ~&amp;#93;&lt;/span&gt;# lfs getstripe /array1/.&lt;br/&gt;
/array1/.&lt;br/&gt;
stripe_count: 1 stripe_size: 1048576 stripe_offset: -1&lt;/p&gt;

&lt;p&gt;kdump config:&lt;/p&gt;

&lt;p&gt;core_collector makedumpfile -c --message-level 1 -d 31&lt;/p&gt;

&lt;p&gt;Application Software Description (LRVfarm):&lt;/p&gt;

&lt;p&gt;LRVfarm - it&apos;s the software that processes media files (video+audio) and creates a proxy video ( low resolution video). Each running task contains a small task file, which is located on Lustre file system. Software LRVfarm runs several threads (processes) - 8 processes on each client (r01, r02, r03, r04). For a total of 32 LRVfarm processes running in cluster. Each process uses the file locking feature when performing tasks. LRVfarm process locks a task file and perform the task. Other LRVfarm processes (on local client and remote clients) also attempt to lock that task files, but it is not possible in the case when the task already running (for the reason that the file is already locked by another LRVfarm process). Periodically, all clients are crashes (kernel panic) with different errors. Here the crash statistics for the last time:&lt;/p&gt;

&lt;p&gt;Client r01&lt;br/&gt;
==================&lt;br/&gt;
2013-12-30-13:27:09	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-12-18-17:53:58	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-11-27-11:33:23	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-11-22-19:13:07	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-10-29-18:38:51	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-10-06-13:47:27	 osc_lock_detach+0x51/0x1b0 &lt;span class=&quot;error&quot;&gt;&amp;#91;osc&amp;#93;&lt;/span&gt;&lt;br/&gt;
2013-09-29-07:10:08	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-08-29-16:34:36	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-08-08-20:42:27	 osc_lock_detach+0x51/0x1b0 &lt;span class=&quot;error&quot;&gt;&amp;#91;osc&amp;#93;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;Client r02&lt;br/&gt;
==================&lt;br/&gt;
2014-01-13-16:50:05	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2014-01-07-23:05:13	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-12-25-10:01:04	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-12-16-00:34:43	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-11-25-12:54:33	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-11-14-21:59:24	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-09-11-15:57:46	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;/p&gt;

&lt;p&gt;Client r03&lt;br/&gt;
==================&lt;br/&gt;
2013-11-06-20:25:26	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-10-16-19:04:01	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-10-14-18:38:01	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-09-30-19:26:50	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-09-12-19:55:17	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-09-10-11:22:25	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-08-19-01:19:55	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-08-13-10:15:56	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;/p&gt;

&lt;p&gt;Client r04&lt;br/&gt;
==================&lt;br/&gt;
2013-12-08-06:19:11	 cl_lock_mutex_get+0x2e/0xe0 &lt;span class=&quot;error&quot;&gt;&amp;#91;obdclass&amp;#93;&lt;/span&gt;&lt;br/&gt;
2013-12-03-13:32:04	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-11-16-08:49:25	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-10-21-22:14:46	 ASSERTION( stripe &amp;lt; lio-&amp;gt;lis_stripe_count ) failed:&lt;br/&gt;
2013-10-13-18:48:27	 osc_lock_detach+0x51/0x1b0 &lt;span class=&quot;error&quot;&gt;&amp;#91;osc&amp;#93;&lt;/span&gt;&lt;br/&gt;
2013-09-01-14:26:14	 osc_lock_detach+0x51/0x1b0 &lt;span class=&quot;error&quot;&gt;&amp;#91;osc&amp;#93;&lt;/span&gt;&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="13976" name="20140113 - Hardware Diagram v0.1_R3.gif" size="713285" author="rustequal" created="Tue, 14 Jan 2014 11:16:44 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                            <customfield id="customfield_10890" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10390" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hzvy1r:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10090" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9700</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10060" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Severity</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10022"><![CDATA[3]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        </customfields>
    </item>
</channel>
</rss>