https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-13296 Lustre <p>statfs don't work fine sometimes. It's easy replicate with start a several processes on same time which ask about block size.</p> <p>all instances run on same node.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>% aprun -n 8 ./a.out /lus/snx11242 statfs (/lus/snx11242) f_bsize 0X9003B000 statfs (/lus/snx11242) f_bsize 0X8C19F000 statfs (/lus/snx11242) f_bsize 0X82BFD000 statfs (/lus/snx11242) f_bsize 0X85C31000 statfs (/lus/snx11242) f_bsize 0X8BED2000 statfs (/lus/snx11242) f_bsize 0X835B1000 statfs (/lus/snx11242) f_bsize 0X828E3000 statfs (/lus/snx11242) f_bsize 0X1000 </pre> </div></div> <p>log for failed application.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>00000080:00200000:0.0:1582645192.532388:0:16422:0:(llite_lib.c:1890:ll_statfs()) VFS Op: at 4296762105 jiffies 00000080:00000001:0.0:1582645192.532391:0:16422:0:(llite_lib.c:1838:ll_statfs_internal()) Process entered 00000080:00000001:0.0:1582645192.532392:0:16422:0:(obd_class.h:1051:obd_statfs()) Process entered 00000080:00000004:0.0:1582645192.532394:0:16422:0:(obd_class.h:1063:obd_statfs()) snx11242-clilmv-ffff881f8b680000: age 7262, max_age 7478 00000080:00000004:0.0:1582645192.535406:0:16422:0:(obd_class.h:1083:obd_statfs()) snx11242-clilmv-ffff881f8b680000: new ffff881f9cad8228 cache blocks 3366320026/3419988114 objects 630715697 0/6372092768 00000080:00000001:0.0:1582645192.535408:0:16422:0:(obd_class.h:1103:obd_statfs()) Process leaving (rc=0 : 0 : 0) 00000080:00000004:0.0:1582645192.535409:0:16422:0:(llite_lib.c:1848:ll_statfs_internal()) MDC blocks 18446744071580744875/18446744071582034486 objects 0/1 00000080:00000001:0.0:1582645192.535410:0:16422:0:(llite_lib.c:1851:ll_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0) 00000080:00000001:0.0:1582645192.535411:0:16422:0:(llite_lib.c:1881:ll_statfs_internal()) Process leaving (rc=0 : 0 : 0) </pre> </div></div> <p>regression introduced by </p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>commit b500d5193360711a6c6b07497f34e61cc590cf19 Author: Alex Zhuravlev &lt;bzzz@whamcloud.com&gt; Date: Thu Sep 21 18:24:18 2017 +0300 LU-10018 protocol: MDT as a statfs proxy </pre> </div></div> LU-13296

statfs isn't work properly with MDT statfs proxy

Bug Blocker Resolved Fixed Alexey Lyashkov Alexey Lyashkov Wed, 26 Feb 2020 12:40:36 +0000 Sat, 11 Dec 2021 04:54:30 +0000 Thu, 5 Mar 2020 22:44:32 +0000 Lustre 2.12.0 Lustre 2.12.5 Lustre 2.14.0 Lustre 2.12.5 0 8 <p>issue replicated easy with several statfs in parallel.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre># cat test ./a.out &amp; ./a.out &amp; ./a.out &amp; ./a.out &amp; ./a.out &amp; ./a.out &amp; ./a.out &amp; ./a.out &amp; sleep 1 </pre> </div></div> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> # cat ttt.c #include &lt;stdio.h&gt; #include &lt;sys/statfs.h&gt; <span class="code-object">int</span> main() { struct statfs buf; statfs(<span class="code-quote">"/mnt/lustre"</span>, &amp;buf); printf(<span class="code-quote">"b_size %llx\n"</span>, buf.f_bsize); <span class="code-keyword">return</span> 0; } </pre> </div></div> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre># bash test b_size 1000 b_size 1000 b_size 0 b_size 0 b_size 0 b_size 0 b_size 0 b_size 0 </pre> </div></div> <p>Root cause of this bug - cached copy ins't used in case of race between obtain statfs info and refreshing it.<br/> I will submit fix in near time</p> <p>Alexey Lyashkov (alexey.lyashkov@hpe.com) uploaded a new patch: <a href="https://review.whamcloud.com/37753" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37753</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13296" title="statfs isn&#39;t work properly with MDT statfs proxy" class="issue-link" data-issue-key="LU-13296"><del>LU-13296</del></a> obd: make statfs cache working again<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 3773a5c542a9d2f5c1c2ba868e5ce8832700e8a5</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/37753/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37753/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13296" title="statfs isn&#39;t work properly with MDT statfs proxy" class="issue-link" data-issue-key="LU-13296"><del>LU-13296</del></a> obd: make statfs cache working again<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 7281635521a823548d497bce2f19acfa3318dfe9</p> <p>Landed for 2.14</p> <p>Minh Diep (mdiep@whamcloud.com) uploaded a new patch: <a href="https://review.whamcloud.com/37819" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37819</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13296" title="statfs isn&#39;t work properly with MDT statfs proxy" class="issue-link" data-issue-key="LU-13296"><del>LU-13296</del></a> obd: make statfs cache working again<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: 1<br/> Commit: 785965b33c9993103a703034d5ee2a32067eeb8a</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/37819/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37819/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13296" title="statfs isn&#39;t work properly with MDT statfs proxy" class="issue-link" data-issue-key="LU-13296"><del>LU-13296</del></a> obd: make statfs cache working again<br/> Project: fs/lustre-release<br/> Branch: b2_12<br/> Current Patch Set: <br/> Commit: 6db1fd1cfc67c639c4817ae00cfe4198882d8e9c</p> Duplicate LU-15361 Related LU-13285 LU-12368 Development Rank 1|i00ucf: Rank (Obsolete) 9223372036854775807 Severity