https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-938 Lustre <p>When I run sanity test 27c it fails to create a multistriped file. This is consistent with my own findings on the same cluster &#8211; which is what prompted me to run sanity in fact. To illustrate:</p> <ol> <li>lfs setstripe -c 2 bigfile5<br/> <span class="error">&#91;root@client1 lustre&#93;</span># lfs getstripe bigfile5<br/> bigfile5<br/> lmm_stripe_count: 1<br/> lmm_stripe_size: 1048576<br/> lmm_stripe_offset: 1<br/> obdidx objid objid group<br/> 1 18853 0x49a5 0</li> </ol> <ol> <li>dd if=/dev/zero of=bigfile2 bs=10M count=100<br/> 100+0 records in<br/> 100+0 records out<br/> 1048576000 bytes (1.0 GB) copied, 62.157 s, 16.9 MB/s</li> <li>lfs getstripe bigfile5<br/> bigfile5<br/> lmm_stripe_count: 1<br/> lmm_stripe_size: 1048576<br/> lmm_stripe_offset: 1<br/> obdidx objid objid group<br/> 1 18853 0x49a5 0</li> </ol> <p>So as you can see, my attempts to create a 2 striped file fail.</p> <p>Two OSTs are available and have capacity:</p> <ol> <li>lfs df<br/> UUID 1K-blocks Used Available Use% Mounted on<br/> lustre-MDT0000_UUID 78629560 473256 72913424 1% /mnt/lustre<span class="error">&#91;MDT:0&#93;</span><br/> lustre-OST0000_UUID 208927160 472988 197968348 0% /mnt/lustre<span class="error">&#91;OST:0&#93;</span><br/> lustre-OST0001_UUID 208927160 1494412 196946924 1% /mnt/lustre<span class="error">&#91;OST:1&#93;</span></li> </ol> <p>filesystem summary: 417854320 1967400 394915272 0% /mnt/lustre</p> <ol> <li>lfs df -i<br/> UUID Inodes IUsed IFree IUse% Mounted on<br/> lustre-MDT0000_UUID 52428800 40 52428760 0% /mnt/lustre<span class="error">&#91;MDT:0&#93;</span><br/> lustre-OST0000_UUID 3097600 58 3097542 0% /mnt/lustre<span class="error">&#91;OST:0&#93;</span><br/> lustre-OST0001_UUID 3097600 86 3097514 0% /mnt/lustre<span class="error">&#91;OST:1&#93;</span></li> </ol> <p>filesystem summary: 52428800 40 52428760 0% /mnt/lustre</p> <p>Servers are running:</p> <p>kernel-2.6.32-131.6.1.el6_lustre.g65156ed.x86_64<br/> kernel-firmware-2.6.32-131.6.1.el6_lustre.g65156ed.x86_64<br/> lustre-2.1.0-2.6.32_131.6.1.el6_lustre.g65156ed.x86_64_g9d71fe8.x86_64<br/> lustre-ldiskfs-3.3.0-2.6.32_131.6.1.el6_lustre.g65156ed.x86_64_g9d71fe8.x86_64<br/> lustre-modules-2.1.0-2.6.32_131.6.1.el6_lustre.g65156ed.x86_64_g9d71fe8.x86_64<br/> lustre-repo-2.1-1.noarch<br/> lustre-tests-2.1.0-2.6.32_131.6.1.el6_lustre.g65156ed.x86_64_g9d71fe8.x86_64</p> <p>which should be 2.1.0 GA and the client is running b2_1, which is (only) two commits forward of 2.1.0.</p> <p>I will attach the 27c portion of the lustre debug log from the MDT for analysis.</p> ONLY=27c CLIENTONLY=true PDSH=&quot;pdsh -R ssh -S -w&quot; mds_HOST=mds1 mgs_HOST=mds2 ost1_HOST=oss1 ost2_HOST=oss2 OSTDEV1=&quot;/dev/vdb&quot; OSTDEV2=&quot;/dev/vdb&quot; bash /usr/lib64/lustre/tests/sanity.sh LU-938

sanity test_27c: @@@@@@ FAIL: two-stripe file doesn't have two stripes

Bug Minor Resolved Cannot Reproduce Niu Yawei Brian Murrell Sat, 17 Dec 2011 09:55:48 +0000 Mon, 5 Nov 2012 01:09:53 +0000 Mon, 5 Nov 2012 01:09:53 +0000 Lustre 2.1.0 0 2 <p>Niu</p> <p>Could you please look into this one?</p> <p>Thanks</p> <p>Peter</p> <p>I didn't see anything abnormal in the 27c.dk log, and I can't reproduce it with b2_1 code neither.</p> <p>Hi, Brian, could you reproduce the test_27c with the D_TRACE enabled log? I think that might be helpful.</p> <p>Hi Niu,</p> <p>I will attach <em>after_setstripe.log</em> which is a <tt>lctl dk</tt> immediately after issuing an <tt>lfs setstripe -c 2</tt> per the example below:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"># lfs setstripe -c 2 bigfile8 [root@client1 lustre]# lfs getstripe bigfile8 bigfile8 lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_stripe_offset: 1 obdidx objid objid group 1 18884 0x49c4 0 </pre> </div></div> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">00020000:00000001:0.0:1325259847.301275:0:28375:0:(lov_pack.c:319:lov_alloc_memmd()) <span class="code-object">Process</span> leaving (rc=72 : 72 : 48) </pre> </div></div> <p>MDS allocated memmd only for only 1 stripe, is it possible that one of the MDT OSC was inactive? Could you try 'lctl get_param osc.*.active' (on mds node) to see if all OSCs are active?</p> <blockquote> <p>Could you try 'lctl get_param osc.*.active' (on mds node) to see if all OSCs are active?</p></blockquote> <p>Sure:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"># lctl get_param osc.*.active osc.lustre-OST0000-osc-MDT0000.active=1 osc.lustre-OST0001-osc-MDT0000.active=1 </pre> </div></div> <p>Thank you, Brian. Looks it's not caused by inactive osc. Could you recapture the log with both D_IOCTL &amp; D_INFO enabled? We could probably figure out why mds changed the stripe count to 1 from this log.</p> <p>Brian, is it reporducable? or it's no longer relevant, can we close it now?</p> <p>Let reopen it if it can be reproduced.</p> Development Rank 1|hzvew7: Rank (Obsolete) 6054 Severity