https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-8152 Lustre <p>To aid in debugging server problems when the filesystem has gone read-only, it would be useful to print "RO" for the device status in "lctl dl" instead of "UP", if that is possible without significant layering violations.</p> <p>It would also be useful to print out the <tt>OS_STATE_DEGRADED</tt> and <tt>OS_STATE_READONLY</tt> flags with "lfs df", possibly one letter per flag <tt>[DR]</tt> after the device names, like:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>$ lfs df UUID 1K-blocks Used Available Use% Mounted on myth-MDT0000_UUID 9174328 584036 8066004 7% /myth[MDT:0] myth-OST0000_UUID 3880285544 3451122460 235124108 94% /myth[OST:0] DR myth-OST0001_UUID 3886052008 3362805556 328933836 91% /myth[OST:1] myth-OST0002_UUID 3880285544 3547714164 216149060 94% /myth[OST:2] D myth-OST0003_UUID 5840741952 3831815716 1716851948 69% /myth[OST:3] OST0004 : inactive device </pre> </div></div> <p>We might consider to require a <tt>-v</tt> flag if there is a concern that this would break the output format, but I don't think that it will.</p> LU-8152

show OST/MDT read-only status in "lctl dl" and/or "lfs df"

Improvement Minor Resolved Fixed Jian Yu Andreas Dilger Mon, 16 May 2016 21:57:40 +0000 Fri, 20 May 2022 07:32:50 +0000 Thu, 6 Apr 2017 03:56:47 +0000 Lustre 2.10.0 0 8 <p>an observation on why this should get fixed soon. I am doing a training in Brazil and two of the students had 2 OSTs go read-only on them in their virtual machines. I am assuming because they started using the OSTs when they were still in recovery as there can't be bad hardware in VMs. IML and lctl dl says everything is happy but cat /proc/fs/lustre/lod/Lustre01-MDT0000-mdtlov/target_obd showed two OSTs as INACTIVE.</p> <p>They discovered this when setting the stripe count on a directory to 8 and the files under the directory only using 6 OSTs. No complaints from set_stripe, etc that that many where not available. I only knew where to look because of this JIRA.</p> <p>I was also a bit surprised that using a OST while in recovery (just doing file operations) would cause the OSTs to go INACTIVE. Nothing in the logs that I could see indicating the transition to inactive. This was the case when this JIRA was generated also.</p> <p>oops.. did find a entry in dmesg and /var/log/messages on the MDS from LDISK_FS about the read-only transition. ALso noted the time which was in the evening when I was re-creating the cluster. No IO.</p> <p>However the messages did not make it to the IML aggregated log. Seems like IML should look for LDISKFS entries as well as LUSTRE or there should be a LUSTRE error generated as well.</p> <p>/proc/fs/lustre/health_status should report LDISKFS errors and LBUG...not sure ZFS errors.</p> <p>Jian</p> <p>Could you please look into this issue?</p> <p>Thanks</p> <p>Peter</p> <p>Jian, could you please make a patch for "lfs df" to print the OS_STATE_* flags? This should be fairly fast as it only invokes a small change to showdf(), and testing is straight forward since the "obdfilter.*.degraded" tunable can be set directly from the test script. </p> <p>Sure, Andreas. I'll create the patch.</p> <p>Jian Yu (jian.yu@intel.com) uploaded a new patch: <a href="http://review.whamcloud.com/23330" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/23330</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8152" title="show OST/MDT read-only status in &quot;lctl dl&quot; and/or &quot;lfs df&quot;" class="issue-link" data-issue-key="LU-8152"><del>LU-8152</del></a> utils: improve “lfs df” to show device status<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: f892e9c4b0216b7d48fae0ed06ebab5e84abab1b</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="https://review.whamcloud.com/23330/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/23330/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-8152" title="show OST/MDT read-only status in &quot;lctl dl&quot; and/or &quot;lfs df&quot;" class="issue-link" data-issue-key="LU-8152"><del>LU-8152</del></a> utils: improve “lfs df” to show device status<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 95d7592a9f33f62accade96d81e0cc3ca0fb94e2</p> <p>Landed for 2.10</p> Related LU-8920 Development Rank 1|hzybs7: Rank (Obsolete) 9223372036854775807