Whamcloud Community JIRA

Whamcloud Community JIRA https://jira.whamcloud.com This file is an XML representation of an issue en-us

9.4.14

940014

05-12-2023

[LU-988] sanity.sh subtest test_39j failed with "mtime is lost on close" https://jira.whamcloud.com/browse/LU-988 Lustre <p>This issue was created by maloo for Andreas Dilger <adilger@whamcloud.com></p> <p>This issue relates to the following test suite run:<br/> <a href="https://maloo.whamcloud.com/test_sets/1ae2fcae-3d32-11e1-9a65-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/1ae2fcae-3d32-11e1-9a65-5254004bbbd3</a><br/> <a href="https://maloo.whamcloud.com/sub_tests/fa399b88-3c42-11e1-a222-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/fa399b88-3c42-11e1-a222-5254004bbbd3</a><br/> <a href="https://maloo.whamcloud.com/test_sets/28a02056-3cdd-11e1-9a65-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/28a02056-3cdd-11e1-9a65-5254004bbbd3</a></p> <p>The sub-test test_39j failed with the following error:</p> <blockquote> <p>mtime is lost on close: 1326363129, should be 1326363130</p></blockquote> <p>Info required for matching: sanity 39j</p> LU-988

sanity.sh subtest test_39j failed with "mtime is lost on close"

Bug Blocker Resolved Fixed Zhenyu Xu Maloo Thu, 12 Jan 2012 16:46:51 +0000 Thu, 23 Mar 2023 06:24:40 +0000 Thu, 5 Jul 2012 04:31:51 +0000 Lustre 2.3.0 Lustre 2.3.0 0 7 <p>Another failure instance:</p> <p><a href="https://maloo.whamcloud.com/test_sets/c1550c2c-4ff6-11e1-9ebc-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/c1550c2c-4ff6-11e1-9ebc-5254004bbbd3</a></p> <p>Another failure instance:<br/> <a href="https://maloo.whamcloud.com/test_sets/d62775e6-525c-11e1-aa4b-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/d62775e6-525c-11e1-aa4b-5254004bbbd3</a></p> <p><a href="https://maloo.whamcloud.com/test_sets/78e215b0-5259-11e1-aa4b-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/78e215b0-5259-11e1-aa4b-5254004bbbd3</a><br/> <a href="https://maloo.whamcloud.com/test_sets/e47f8490-542c-11e1-97e1-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/e47f8490-542c-11e1-97e1-5254004bbbd3</a></p> <p><a href="https://maloo.whamcloud.com/test_sets/7a0e2f22-5840-11e1-9df1-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/7a0e2f22-5840-11e1-9df1-5254004bbbd3</a></p> <p><a href="https://maloo.whamcloud.com/test_sets/2b8d2222-5f16-11e1-ab6b-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/2b8d2222-5f16-11e1-ab6b-5254004bbbd3</a></p> <p>In a failure instance <a href="https://maloo.whamcloud.com/test_sessions/43b80858-68ee-11e1-91b4-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/43b80858-68ee-11e1-91b4-5254004bbbd3</a><br/> As client write the test file f39j, the ctime/mtime from servers wobbled a little bit, rewinded 1 seconds in some cases.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>158313:00020000:00000002:0.0:1331173465.105834:0:25793:0:(lov_merge.c:135:lov_merge_lvb()) merged: 2097152 1331173465 1331173463 1331173465 0 167853:00020000:00000002:0.0:1331173465.114431:0:25794:0:(lov_merge.c:135:lov_merge_lvb()) merged: 2097152 1331173465 1331173463 1331173464 2048 170695:00020000:00000002:0.0:1331173465.120790:0:25795:0:(lov_merge.c:135:lov_merge_lvb()) merged: 2097152 1331173465 1331173463 1331173465 2048 240587:00020000:00000002:0.0:1331173465.185512:0:25811:0:(lov_merge.c:135:lov_merge_lvb()) merged: 2097152 1331173464 1331173463 1331173465 4096 </pre> </div></div> <p>patch tracking at <a href="http://review.whamcloud.com/2274" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/2274</a></p> <p>Hit this again:<br/> <a href="https://maloo.whamcloud.com/test_sets/d958bd22-6cd0-11e1-9174-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/d958bd22-6cd0-11e1-9174-5254004bbbd3</a></p> <p>Bobijam, do you know why the time packed into the LVB is going backward? Is it because the clock in the VM itself is going backward, or because the timestamps on the inode are being lost? </p> <p>I don't have evidence that the inode timestamps on server are lost, it is most likely due to the clock in the VM drifted a little bit backward, I don't have strong evidence either, except for the "lov_merge.c" log I posted in my previous comment.</p> <p>I'll push a debugging patch to print out inode timestamp on OSTs in lov_merge_lvb.</p> <p>Again:<br/> <a href="https://maloo.whamcloud.com/test_sets/58508926-7a09-11e1-9d2a-5254004bbbd3" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/58508926-7a09-11e1-9d2a-5254004bbbd3</a></p> <p>another occurrence: <a href="https://maloo.whamcloud.com/test_sets/d60a69fc-9040-11e1-98a1-525400d2bfa6" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/d60a69fc-9040-11e1-98a1-525400d2bfa6</a> </p> <p>Another failure case: <br/> <a href="https://maloo.whamcloud.com/test_sessions/d3d325bc-a610-11e1-8432-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/d3d325bc-a610-11e1-8432-52540035b04c</a></p> <p>another failure:</p> <p><a href="https://maloo.whamcloud.com/test_sets/4193f5ec-a8ad-11e1-9ad2-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/4193f5ec-a8ad-11e1-9ad2-52540035b04c</a></p> <p>This seems to be happening more and more often:</p> <p>May 28th - <a href="https://maloo.whamcloud.com/sub_tests/08d3c54e-a898-11e1-9ad2-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/08d3c54e-a898-11e1-9ad2-52540035b04c</a><br/> May 28th - <a href="https://maloo.whamcloud.com/sub_tests/6bd2ea3e-a8ad-11e1-9ad2-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/6bd2ea3e-a8ad-11e1-9ad2-52540035b04c</a><br/> May 29th - <a href="https://maloo.whamcloud.com/sub_tests/b923d0cc-aa02-11e1-b148-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/b923d0cc-aa02-11e1-b148-52540035b04c</a><br/> May 29th - <a href="https://maloo.whamcloud.com/sub_tests/6229d398-aa0c-11e1-bd84-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/6229d398-aa0c-11e1-bd84-52540035b04c</a><br/> May 30th - <a href="https://maloo.whamcloud.com/sub_tests/9dd49fc0-aa40-11e1-971d-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/9dd49fc0-aa40-11e1-971d-52540035b04c</a><br/> May 31st - <a href="https://maloo.whamcloud.com/sub_tests/45e6cf7e-ab60-11e1-8e7f-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/45e6cf7e-ab60-11e1-8e7f-52540035b04c</a><br/> June 1st - <a href="https://maloo.whamcloud.com/sub_tests/10d71476-ac17-11e1-9b8f-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/10d71476-ac17-11e1-9b8f-52540035b04c</a><br/> June 1st - <a href="https://maloo.whamcloud.com/sub_tests/f42ea730-ac2a-11e1-a9bb-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/f42ea730-ac2a-11e1-a9bb-52540035b04c</a></p> <p>Entire list here: <a href="https://maloo.whamcloud.com/sub_tests/query?&test_set%5Btest_set_script_id%5D=f9516376-32bc-11e0-aaee-52540025f9ae&sub_test%5Bsub_test_script_id%5D=0831b228-32be-11e0-b685-52540025f9ae&sub_test%5Bstatus%5D=FAIL&sub_test%5Bquery_bugs%5D=&test_session%5Btest_host%5D=&test_session%5Btest_group%5D=&test_session%5Buser_id%5D=&test_session%5Bquery_date%5D=&test_session%5Bquery_recent_period%5D=&test_node%5Bos_type_id%5D=&test_node%5Bdistribution_type_id%5D=&test_node%5Barchitecture_type_id%5D=&test_node%5Bfile_system_type_id%5D=&test_node%5Blustre_branch_id%5D=&test_node_network%5Bnetwork_type_id%5D=&commit=Update+results" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/query?&test_set%5Btest_set_script_id%5D=f9516376-32bc-11e0-aaee-52540025f9ae&sub_test%5Bsub_test_script_id%5D=0831b228-32be-11e0-b685-52540025f9ae&sub_test%5Bstatus%5D=FAIL&sub_test%5Bquery_bugs%5D=&test_session%5Btest_host%5D=&test_session%5Btest_group%5D=&test_session%5Buser_id%5D=&test_session%5Bquery_date%5D=&test_session%5Bquery_recent_period%5D=&test_node%5Bos_type_id%5D=&test_node%5Bdistribution_type_id%5D=&test_node%5Barchitecture_type_id%5D=&test_node%5Bfile_system_type_id%5D=&test_node%5Blustre_branch_id%5D=&test_node_network%5Bnetwork_type_id%5D=&commit=Update+results</a></p> <p>Got an log from another hit (<a href="https://maloo.whamcloud.com/test_sets/b4fc6bd0-acc3-11e1-a542-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/b4fc6bd0-acc3-11e1-a542-52540035b04c</a>)</p> <div class="panel" style="border-width: 1px;"><div class="panelHeader" style="border-bottom-width: 1px;"><b>client2 log sanity.test_39j.debug_log.client-26vm2.1338628522.log</b></div><div class="panelContent"> <p><font color="red">[ cancel osc lock ]</font><br/> 240482:00020000:00000002:0.0:1338628522.238524:0:27748:0:(lov_merge.c:103:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x287:0x0]</span> on OST<span class="error">[1]</span>: s=2097152 m=1338628520 a=1338628520 c=1338628522 b=0</p> <p>240484:00020000:00000002:0.0:1338628522.238526:0:27748:0:(lov_merge.c:138:lov_merge_lvb()) merged for FID <span class="error">[0x200000400:0x287:0x0]</span> s=2097152 m=1338628521 a=1338628520 c=1338628522 b=4096</p> </div></div> <p>m=1338628521 a=1338628520 c=1338628522 shows that the mtime and ctime are not consistent on OST object, will push another debug patch to show what m/ctime used on OSS side.</p> <p>Hit it again: <a href="https://maloo.whamcloud.com/test_sets/e9396c4a-b493-11e1-bdae-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/e9396c4a-b493-11e1-bdae-52540035b04c</a></p> <p>And again:<br/> <a href="https://maloo.whamcloud.com/test_sets/5637ce7a-b6a8-11e1-9045-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/5637ce7a-b6a8-11e1-9045-52540035b04c</a></p> <p>And again:<br/> <a href="https://maloo.whamcloud.com/test_sets/611985be-b7a1-11e1-8e55-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/611985be-b7a1-11e1-8e55-52540035b04c</a></p> <p>Diagnostic patch landed on June 19th so need a hit after then</p> <p>from <a href="https://maloo.whamcloud.com/sub_tests/c70a1fde-bf65-11e1-acb7-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/sub_tests/c70a1fde-bf65-11e1-acb7-52540035b04c</a></p> <div class="panel" style="border-width: 1px;"><div class="panelHeader" style="border-bottom-width: 1px;"><b>OST write time extracted from OST debug log</b></div><div class="panelContent"> <p>$ grep "write: s=" sanity.test_39j.debug_log.client-27vm4.1340673637.log<br/> 32034:00002000:00000002:0.0:1340673636.990185:0:3765:0:(filter_io_26.c:765:filter_commitrw_write()) FID <span class="error">[0x6b:0x0:0x0]</span> to write: s=0 m=1340673636 a=1340673635 c=1340673636 b=1228800<br/> 32155:00002000:00000002:0.0:1340673637.038122:0:3765:0:(filter_io_26.c:784:filter_commitrw_write()) FID <span class="error">[0x6b:0x0:0x0]</span> after write: s=1048576 m=1340673636 a=1340673635 c=1340673636 b=2048<br/> 32242:00002000:00000002:0.0:1340673637.070452:0:3768:0:(filter_io_26.c:765:filter_commitrw_write()) FID <span class="error">[0x6b:0x0:0x0]</span> to write: s=0 m=1340673636 a=1340673635 c=1340673636 b=2097152<br/> 32271:00002000:00000002:0.0:1340673637.096759:0:3768:0:(filter_io_26.c:784:filter_commitrw_write()) FID <span class="error">[0x6b:0x0:0x0]</span> after write: s=2097152 m=1340673636 a=1340673635 c=1340673636 b=4096 <font color="red"> ===========> the object write time is 1340673636</font></p> </div></div> <p>let's check client log</p> <div class="panel" style="border-width: 1px;"><div class="panelContent"> <p><font color="blue">*extent lock cl_wait()=>ccc_lock_state()=>cl_object_attr_get()=>lov_attr_get_raid0()</font><br/> 00020000:00000002:0.0:1340673636.893853:0:27817:0:(lov_merge.c:74:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> initial value: s=0 m=1340673635 a=1340673635 c=1340673635 b=0<br/> 00020000:00000002:0.0:1340673636.893857:0:27817:0:(lov_merge.c:109:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> on OST<span class="error">[1]</span>: s=0 m=1340673635 a=1340673635 c=1340673635 b=0</p> <p><font color="blue">*glimpse lock part 1: cl_glimpse_lock()->cl_lock_request()=>cl_wait()</font><br/> 00020000:00000002:0.0:1340673637.030919:0:27819:0:(lov_merge.c:74:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> initial value: s=2097152 m=1340673636 a=1340673635 c=1340673636 b=0 <font color="red"> =========> local inode lvb values</font><br/> 00020000:00000002:0.0:1340673637.030924:0:27819:0:(lov_merge.c:109:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> on OST<span class="error">[1]</span>: s=2097152 m=1340673637 a=1340673635 c=1340673637 b=0 <font color="red"> =========> OST<span class="error">[1]</span> lvb values have been updated to 37/35/37</font></p> <p><font color="green">*glimpse lock part 2: cl_glimpse_lock()<del>>cl_merge_lvb()</del>>ll_merge_lvb()->lov_merge_lvb()</font><br/> 00020000:00000001:0.0:1340673637.030944:0:27819:0:(lov_merge.c:136:lov_merge_lvb()) Process entered<br/> 00020000:00000002:0.0:1340673637.030945:0:27819:0:(lov_merge.c:74:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> initial value: s=2097152 m=1340673635 a=1340673635 c=1340673635 b=0 <font color="red"> =======> ll_merge_lvb() initial values are values set on MDT object</font><br/> 00020000:00000002:0.0:1340673637.030948:0:27819:0:(lov_merge.c:109:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> on OST<span class="error">[1]</span>: s=2097152 m=1340673637 a=1340673635 c=1340673637 b=0<br/> 00020000:00000002:0.0:1340673637.030950:0:27819:0:(lov_merge.c:144:lov_merge_lvb()) merged for FID <span class="error">[0x200000400:0x263:0x0]</span> s=2097152 m=1340673637 a=1340673635 c=1340673637 b=0</p> <p><font color="blue">*glimpse lock part 1</font><br/> 00020000:00000002:0.0:1340673637.074620:0:27820:0:(lov_merge.c:74:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> initial value: s=2097152 m=1340673637 a=1340673635 c=1340673637 b=0<br/> 00020000:00000002:0.0:1340673637.074624:0:27820:0:(lov_merge.c:109:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> on OST<span class="error">[1]</span>: s=2097152 m=1340673637 a=1340673635 c=1340673636 b=2048 <font color="red"> =========> glimpse lock get a mismatched mtime and ctime</font></p> <p><font color="green">*glimpse lock part 2</font><br/> 00020000:00000002:0.0:1340673637.074638:0:27820:0:(lov_merge.c:74:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> initial value: s=2097152 m=1340673635 a=1340673635 c=1340673635 b=0<br/> 00020000:00000002:0.0:1340673637.074641:0:27820:0:(lov_merge.c:109:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> on OST<span class="error">[1]</span>: s=2097152 m=1340673637 a=1340673635 c=1340673636 b=2048<br/> 00020000:00000002:0.0:1340673637.074643:0:27820:0:(lov_merge.c:144:lov_merge_lvb()) merged for FID <span class="error">[0x200000400:0x263:0x0]</span> s=2097152 m=1340673637 a=1340673635 c=1340673636 b=2048</p> <p><font color="green">*glimpse lock part 2, glimpse lock state unchanged</font><br/> 00020000:00000002:0.0:1340673637.084563:0:27821:0:(lov_merge.c:74:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> initial value: s=2097152 m=1340673635 a=1340673635 c=1340673637 b=2048 <font color="red">=======> MDT object changed ctime</font><br/> 00020000:00000002:0.0:1340673637.084569:0:27821:0:(lov_merge.c:109:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> on OST<span class="error">[1]</span>: s=2097152 m=1340673637 a=1340673635 c=1340673636 b=2048<br/> 00020000:00000002:0.0:1340673637.084571:0:27821:0:(lov_merge.c:144:lov_merge_lvb()) merged for FID <span class="error">[0x200000400:0x263:0x0]</span> s=2097152 m=1340673637 a=1340673635 c=1340673637 b=2048</p> <p><font color="red">*local locks cancelled</font><br/> 00000001:02000400:0.0:1340673637.086290:0:27822:0:(debug.c:445:libcfs_debug_mark_buffer()) DEBUG MARKER: cancel_lru_locks osc start</p> <p><font color="blue">*glimpse lock part 1: request glimpse lock</font><br/> 00020000:00000002:0.0:1340673637.158531:0:27837:0:(lov_merge.c:74:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> initial value: s=2097152 m=1340673637 a=1340673635 c=1340673637 b=2048<br/> 00020000:00000002:0.0:1340673637.158535:0:27837:0:(lov_merge.c:109:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> on OST<span class="error">[1]</span>: s=2097152 m=1340673636 a=1340673635 c=1340673636 b=4096</p> <p><font color="green">*glimpse lock part 2</font><br/> 00020000:00000002:0.0:1340673637.158551:0:27837:0:(lov_merge.c:74:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> initial value: s=2097152 m=1340673635 a=1340673635 c=1340673637 b=2048<br/> 00020000:00000002:0.0:1340673637.158555:0:27837:0:(lov_merge.c:109:lov_merge_lvb_kms()) MDT FID <span class="error">[0x200000400:0x263:0x0]</span> on OST<span class="error">[1]</span>: s=2097152 m=1340673636 a=1340673635 c=1340673636 b=4096<br/> 00020000:00000002:0.0:1340673637.158557:0:27837:0:(lov_merge.c:144:lov_merge_lvb()) merged for FID <span class="error">[0x200000400:0x263:0x0]</span> s=2097152 m=1340673636 a=1340673635 c=1340673637 b=4096</p> </div></div> <p>patch tracking at <a href="http://review.whamcloud.com/3200" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/3200</a></p> <p><a href="https://jira.whamcloud.com/browse/LU-988" title="sanity.sh subtest test_39j failed with "mtime is lost on close"" class="issue-link" data-issue-key="LU-988"><del>LU-988</del></a> clio: use OSC object's c/mtime when build write RPC</p> <p>When building OST write RPC, inode's c/mtime is out-dated until<br/> lov_merge_lvb() is called, so we need use OSC object's c/mtime to<br/> set OST object's c/mtime.</p> <p>another failure instance:<br/> <a href="https://maloo.whamcloud.com/test_sets/0b6327c0-c2fe-11e1-b851-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/0b6327c0-c2fe-11e1-b851-52540035b04c</a></p> <p>"Andreas Dilger <adilger@whamcloud.com>" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/48887" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/48887</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-988" title="sanity.sh subtest test_39j failed with "mtime is lost on close"" class="issue-link" data-issue-key="LU-988"><del>LU-988</del></a> doc: add lctl-lcfg man pages<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 8bb54c9c3887a657a460074a85c603e073c556c5</p> <p>"Timothy Day <timday@amazon.com>" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/50387" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/50387</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-988" title="sanity.sh subtest test_39j failed with "mtime is lost on close"" class="issue-link" data-issue-key="LU-988"><del>LU-988</del></a> doc: move lnet pages, remove old docs<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: d337bfb3917dcd34900d2953c8e6801278b7b3fa</p> Development Rank 1|hzv6dr: Rank (Obsolete) 4568 Severity