https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-16019 Lustre <p>This issue was created by maloo for jianyu &lt;yujian@whamcloud.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://testing.whamcloud.com/test_sets/3a8eb542-e2e6-4223-8a43-3f37b87a4636" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/3a8eb542-e2e6-4223-8a43-3f37b87a4636</a></p> <p>test_101j failed with the following error:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== sanity test 101j: A complete read block should be submitted when no RA ========================================================== 19:37:12 (1657913832) Disable read-ahead 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.0565881 s, 296 MB/s Reset readahead stats 4096+0 records in 4096+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 1.08708 s, 15.4 MB/s snapshot_time 3868.949651534 secs.nsecs start_time 0.000000000 secs.nsecs elapsed_time 3868.949651534 secs.nsecs failed_to_fast_read 8192 samples [pages] sanity test_101j: @@@@@@ FAIL: expected 4096 got 8192 </pre> </div></div> <p>VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV<br/> sanity test_101j - expected 4096 got 8192</p> RHEL 9.0 client LU-16019

sanity test_101j: FAIL: expected 4096 got 8192

Bug Minor Resolved Fixed Qian Yingjin Maloo Fri, 15 Jul 2022 22:16:26 +0000 Tue, 30 Jan 2024 01:07:37 +0000 Mon, 8 Aug 2022 22:30:38 +0000 Lustre 2.15.1 Lustre 2.15.3 Lustre 2.16.0 0 8 <p>Hi Yingjin,<br/> You fixed a similar issue in <a href="https://jira.whamcloud.com/browse/LU-15244" title="sanity test_101j: FAIL: expected 4096 got 4100 " class="issue-link" data-issue-key="LU-15244"><del>LU-15244</del></a>. Could you please take a look at this one?</p> <p>In the new kernel 5.14 (rhel9), the redahead may be out of Lustre control:</p> <p> </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> void page_cache_sync_ra(struct readahead_control *ractl, unsigned <span class="code-object">long</span> req_count) { bool do_forced_ra = ractl-&gt;file &amp;&amp; (ractl-&gt;file-&gt;f_mode &amp; FMODE_RANDOM); /* * Even <span class="code-keyword">if</span> read-ahead is disabled, issue <span class="code-keyword">this</span> request as read-ahead * as we'll need it to satisfy the requested range. The forced * read-ahead will <span class="code-keyword">do</span> the right thing and limit the read to just the * requested range, which we'll set to 1 page <span class="code-keyword">for</span> <span class="code-keyword">this</span> <span class="code-keyword">case</span>. */ <span class="code-keyword">if</span> (!ractl-&gt;ra-&gt;ra_pages || blk_cgroup_congested()) { <span class="code-keyword">if</span> (!ractl-&gt;file) <span class="code-keyword">return</span>; req_count = 1; do_forced_ra = <span class="code-keyword">true</span>; } <span class="code-comment">/* be dumb */</span> <span class="code-keyword">if</span> (do_forced_ra) { force_page_cache_ra(ractl, req_count); <span class="code-keyword">return</span>; } <span class="code-comment">/* <span class="code-keyword">do</span> read-ahead */</span> ondemand_readahead(ractl, <span class="code-keyword">false</span>, req_count); } generic_file_read_iter() -&gt;filemap_read() -&gt;filemap_get_pages() -&gt;page_cache_sync_readahead() -&gt;page_cache_sync_ra() </pre> </div></div> <p>Only setting @ra_pages with 0 can not totally avoid the readahead in the kernel I/O path.</p> <p>I will try to set @bdi-&gt;io_pages to see whether it can totally avoid the readahead in the kernel.</p> <p>"Yingjin Qian &lt;qian@ddn.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/47993" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/47993</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16019" title="sanity test_101j: FAIL: expected 4096 got 8192 " class="issue-link" data-issue-key="LU-16019"><del>LU-16019</del></a> llite: fully disable readahead in kernel I/O path<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: b3cafb06ad0dd347e487df3e4c7b0086f8c23378</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/47993/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/47993/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16019" title="sanity test_101j: FAIL: expected 4096 got 8192 " class="issue-link" data-issue-key="LU-16019"><del>LU-16019</del></a> llite: fully disable readahead in kernel I/O path<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: f0cf7fd3cccb2313fa94a307cf862afba256b8d8</p> <p>Landed for 2.16</p> <p>"Jian Yu &lt;yujian@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/48219" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/48219</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16019" title="sanity test_101j: FAIL: expected 4096 got 8192 " class="issue-link" data-issue-key="LU-16019"><del>LU-16019</del></a> llite: fully disable readahead in kernel I/O path<br/> Project: fs/lustre-release<br/> Branch: b2_15<br/> Current Patch Set: 1<br/> Commit: a0309239b7bf3d2ea1edd2b3c6899e62310f2121</p> <p>+1 on b2_15<br/> <a href="https://testing.whamcloud.com/test_sets/a24fd753-7784-4fee-a205-80c2f69c3b9c" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sets/a24fd753-7784-4fee-a205-80c2f69c3b9c</a></p> <p>This test seems to fail systematically on b2_15 with SLES 15.5:</p> <p><b>Maloo request:</b> <br/> <a href="https://testing.whamcloud.com/search?end_date=2024-01-22&amp;source=sub_tests&amp;start_date=2024-01-16&amp;status=FAIL&amp;sub_test_script_id=4e0877da-9d97-11e9-9e3d-52540065bddc&amp;test_set_script_id=f9516376-32bc-11e0-aaee-52540025f9ae#redirect" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/search?end_date=2024-01-22&amp;source=sub_tests&amp;start_date=2024-01-16&amp;status=FAIL&amp;sub_test_script_id=4e0877da-9d97-11e9-9e3d-52540065bddc&amp;test_set_script_id=f9516376-32bc-11e0-aaee-52540025f9ae#redirect</a></p> <p><b>List of failed tests:</b></p> <ul> <li><a href="https://testing.whamcloud.com/sub_tests/39d71f45-7d51-4f5c-ba4e-f80baaa78c54" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/39d71f45-7d51-4f5c-ba4e-f80baaa78c54</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/cfe363db-6808-46eb-9230-c193311948df" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/cfe363db-6808-46eb-9230-c193311948df</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/de311c98-e614-4688-9309-1e94970f291a" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/de311c98-e614-4688-9309-1e94970f291a</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/95fa785f-6a63-4c2e-98e5-e03fb88247b4" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/95fa785f-6a63-4c2e-98e5-e03fb88247b4</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/92c92458-2a70-4d2e-aa4a-102d07a655d4" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/92c92458-2a70-4d2e-aa4a-102d07a655d4</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/b7419692-b1ad-4b4b-98ca-eb6f7d2f72f2" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/b7419692-b1ad-4b4b-98ca-eb6f7d2f72f2</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/7a1a16a8-d371-44ed-a0ea-b330833008c6" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/7a1a16a8-d371-44ed-a0ea-b330833008c6</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/28d556b7-a0e4-4cc5-98f6-529cbaa51559" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/28d556b7-a0e4-4cc5-98f6-529cbaa51559</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/f120a210-072b-4b87-b989-f37ed45fd375" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/f120a210-072b-4b87-b989-f37ed45fd375</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/80fd17a2-2c1b-4d3a-ab7b-fc82f550b083" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/80fd17a2-2c1b-4d3a-ab7b-fc82f550b083</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/58972dee-d534-4501-b46f-3b7535249c92" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/58972dee-d534-4501-b46f-3b7535249c92</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/002e9b15-8ce3-49f2-91c8-afc4581d4171" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/002e9b15-8ce3-49f2-91c8-afc4581d4171</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/4fc5b38e-d128-4973-8073-d08509653557" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/4fc5b38e-d128-4973-8073-d08509653557</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/6c6099d7-bc83-4bdc-adb0-1779eadc270b" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/6c6099d7-bc83-4bdc-adb0-1779eadc270b</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/d357820d-c1a5-4be1-8988-8facf91887b1" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/d357820d-c1a5-4be1-8988-8facf91887b1</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/3898f2b3-0b8a-43a7-82a1-2978d7d0aadf" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/3898f2b3-0b8a-43a7-82a1-2978d7d0aadf</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/8ee204c2-5e57-47cd-a120-65a97ee093b3" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/8ee204c2-5e57-47cd-a120-65a97ee093b3</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/bb5d3295-23c3-4177-8ffc-75598752e98e" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/bb5d3295-23c3-4177-8ffc-75598752e98e</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/18d788d8-bed7-43af-ab02-c00f357a6b1f" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/18d788d8-bed7-43af-ab02-c00f357a6b1f</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/a920cbe9-da8b-4433-b48c-df880cc61131" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/a920cbe9-da8b-4433-b48c-df880cc61131</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/54738b79-bea0-489d-a912-cd3609a9de92" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/54738b79-bea0-489d-a912-cd3609a9de92</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/8c38b7a0-35e4-4626-9571-8f990597b896" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/8c38b7a0-35e4-4626-9571-8f990597b896</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/45939143-f996-49a3-b0f2-331a7734df15" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/45939143-f996-49a3-b0f2-331a7734df15</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/1b741892-63f6-416a-8ad1-984c50a6924f" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/1b741892-63f6-416a-8ad1-984c50a6924f</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/ed197a61-8a47-4457-ab49-bbfec4e0ea3a" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/ed197a61-8a47-4457-ab49-bbfec4e0ea3a</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/8bc9bd6e-30e8-4ce0-9cdd-55f4201cf356" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/8bc9bd6e-30e8-4ce0-9cdd-55f4201cf356</a></li> <li><a href="https://testing.whamcloud.com/sub_tests/969a3de9-c7ea-4c95-85b7-a8b92c8ba416" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/sub_tests/969a3de9-c7ea-4c95-85b7-a8b92c8ba416</a></li> </ul> <p>+1 on b2_15 again<br/> <a href="https://testing.whamcloud.com/test_sessions/66a00fbf-6bc8-4f72-a0c3-b1a5479c0ca9" class="external-link" target="_blank" rel="nofollow noopener">https://testing.whamcloud.com/test_sessions/66a00fbf-6bc8-4f72-a0c3-b1a5479c0ca9</a></p> Related Development Rank 1|i02uqv: Rank (Obsolete) 9223372036854775807 Severity