https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-1384 Lustre <p>After the mkfs of all the FS I was able to mount it, and do a simple 'dd' to create few files. Once that I mount it on 12 client with lustre 1.8.4 and trying to make IOR benchmark, using 2 nodes for a total of 12 cores the file system immediately hang and the MDS01 had a kernel panic, as follow:<br/> Message from syslogd@mds01 at May 8 12:00:59 ...<br/> kernel:LustreError: 3523:0:(mdd_object.c:635:mdd_big_lmm_get()) ASSERTION( ma-&gt;ma_lmm_size &gt; 0 ) failed: </p> <p>Message from syslogd@mds01 at May 8 12:00:59 ...<br/> kernel:LustreError: 3523:0:(mdd_object.c:635:mdd_big_lmm_get()) LBUG<br/> Write failed: Broken pipe</p> <p>The heartbeat tried to takeover but immediately had kernel panic too:</p> <p>Message from syslogd@mds02 at May 8 12:04:05 ...<br/> kernel:LustreError: 3657:0:(mdd_object.c:635:mdd_big_lmm_get()) ASSERTION( ma-&gt;ma_lmm_size &gt; 0 ) failed: </p> <p>Message from syslogd@mds02 at May 8 12:04:05 ...<br/> kernel:LustreError: 3657:0:(mdd_object.c:635:mdd_big_lmm_get()) LBUG<br/> Write failed: Broken pipe</p> <p>To make the file system I did as the attached file weisshorn_mkfs.sh</p> <p>The SSD Lun is built on a LSI SSD controller with RAID10.</p> <p>Any suggestions or input that I can try to fix the problem?<br/> Attached also the /var/log/messages with the kernel messages.</p> Linux 2.6.32-220.7.1.el6_lustre.g9c8f747.x86_64 #1 SMP Tue Apr 24 14:27:35 PDT 2012 x86_64 x86_64 x86_64 GNU/Linux<br/> 14 Servers Total<br/> 1 MDS + 1 Fail Over ( 300 GB ) AMD Opteron(tm) Processor 6128<br/> 12 OSS ( with fail over per each couple ) Sandy Bridge <br/> 6 OST per OSS ( 7 TB ) LU-1384

MDS Kernel Panic when trying to mount the lustre file system

Bug Critical Resolved Fixed Zhenyu Xu Fabio Verzelloni Tue, 8 May 2012 08:05:06 +0000 Fri, 1 Jun 2012 14:45:24 +0000 Fri, 1 Jun 2012 14:45:24 +0000 Lustre 2.2.0 Lustre 2.3.0 Lustre 2.3.0 0 1 <p>That's the moment of the kernel panic as soon as I mounted the lustre FS on the client with 1.8.4</p> <p>The version of lustre on the client side which are killing the MDS are:</p> <p>lustre-modules-1.8.4-2.6.32.36_0.5_default_201202291115<br/> lustre-client-source-1.8.4-2.6.27_39_0.3_lustre.1.8.4_default<br/> lustre-1.8.4-2.6.32.36_0.5_default_201202291115</p> <p>cray-liblustreconfig0-1.0-1.0400.30000.6.18.gem<br/> cray-lustre-utils-2.3-1.0400.29861.8.1.gem<br/> cray-lustre-cray_gem_s-1.8.4_2.6.32.45_0.3.2_1.0400.6221.1.1-1.0400.30252.1.29<br/> cray-lustre-cray_gem_s-1.8.4_2.6.32.45_0.3.2_1.0400.6221.1.1-1.0400.31443.0.0</p> <p>Lai</p> <p>Could you please look into this one?</p> <p>Thanks</p> <p>Peter</p> <p>As a starting point, the client should never be able to crash the MDS. The MDS code needs to be updated to validate the incoming data and return an error if it is wrong.</p> <p>A separate case is that the 1.8.4 client will not work correctly with a 2.x server without several patches being applied.</p> <p>Bobijam</p> <p>Could you please look into this one?</p> <p>Thanks</p> <p>Peter</p> <p>patch tracking at <a href="http://review.whamcloud.com/2905" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/2905</a></p> <p><a href="https://jira.whamcloud.com/browse/LU-1384" title="MDS Kernel Panic when trying to mount the lustre file system" class="issue-link" data-issue-key="LU-1384"><del>LU-1384</del></a> mdd: validate incoming param to avoid crashing</p> <p>MDS get crashed when it is connected by unsupported 1.8.x client,<br/> the crash point is</p> <p>kernel:LustreError: 3657:0:(mdd_object.c:635:mdd_big_lmm_get())<br/> ASSERTION( ma-&gt;ma_lmm_size &gt; 0 ) failed</p> <p>We need validate the incoming @ma lest old client crash the MDS.</p> <p>Landed for 2.3</p> Development Rank 1|hzv6lz: Rank (Obsolete) 4605 Severity