https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-16537 Lustre <p>4k ext4/ldiskfs files are 4294967295 blocks long. Last block never gets written due to a bug in osd_ldiskfs_map_inode_pages():</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> <span class="code-keyword">if</span> (fp-&gt;index + clen &gt;= max_page_index) GOTO(cleanup, rc = -EFBIG);</pre> </div></div> LU-16537

osd-ldiskfs prevents writing of last block of very large ldiskfs file

Bug Major Open Unresolved WC Triage Vladimir Saveliev Tue, 7 Feb 2023 19:15:26 +0000 Tue, 2 Jan 2024 06:50:07 +0000 0 4 <p>"Vladimir Saveliev &lt;vladimir.saveliev@hpe.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/49933" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/49933</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16537" title="osd-ldiskfs prevents writing of last block of very large ldiskfs file" class="issue-link" data-issue-key="LU-16537">LU-16537</a> osd-ldiskfs: allow write of last block of a file<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: be87b6bea275f17f9fa5197d170fe91e7520635e</p> <p>Patch set 2 includes 4 tests which fail as shown below (when ran without fixes):</p> <p>ZFS:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre># REFORMAT=yes ONLY="44c 44d" FSTYPE=zfs bash /usr/lib64/lustre/tests/sanity.sh … == sanity test 44c: write 1 byte at max_object_bytes - 1 offset ========================================================== 14:59:45 (1677589185) 1+0 records in 1+0 records out 1 byte copied, 0.00192591 s, 0.5 kB/s /mnt/lustre/f44c.sanity has size 0, not 9223372036854775807 sanity test_44c: @@@@@@ FAIL: wrong size Trace dump: ... FAIL 44c (0s) == sanity test 44d: if write at position fails (EFBIG), so should do append ========================================================== 14:59:46 (1677589186) dd: error writing '/mnt/lustre/f44d.sanity': File too large 1+0 records in 0+0 records out 0 bytes copied, 0.00126738 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.000872801 s, 1.1 kB/s sanity test_44d: @@@@@@ FAIL: one of dd commands failed Trace dump: ... FAIL 44d (0s) </pre> </div></div> <p>LDISKFS:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre># RUNAS_ID=1000 REFORMAT=yes ONLY="44b 44e" FSTYPE=ldiskfs bash /usr/lib64/lustre/tests/sanity.sh … == sanity test 44b: write one byte at offset 0xfffffffe000 ========================================================== 15:01:48 (1677589308) 1+0 records in 1+0 records out 1 byte copied, 0.00301143 s, 0.3 kB/s /mnt/lustre/f44b.sanity has size 0, not 17592186036225 sanity test_44b: @@@@@@ FAIL: wrong size Trace dump: ... FAIL 44b (0s) == sanity test 44e: write and read maximal stripes ======= 15:01:48 (1677589308) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0646687 s, 32.4 MB/s 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0396179 s, 52.9 MB/s /tmp/f44e.sanity /mnt/lustre/f44e.sanity differ: byte 8193, line 45 cmp: /mnt/lustre/f44e.sanity: Input/output error sanity test_44e: @@@@@@ FAIL: cmp failed Trace dump: ... FAIL 44e (2s) </pre> </div></div> <p>"Shaun Tancheff &lt;shaun.tancheff@hpe.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/c/fs/lustre-release/+/53569" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/c/fs/lustre-release/+/53569</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-16537" title="osd-ldiskfs prevents writing of last block of very large ldiskfs file" class="issue-link" data-issue-key="LU-16537">LU-16537</a> test: sanity/44e tmpfile cmp<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 7770641e4be3bad6c2a123d18c3a8a5b80db4260</p> Related LU-14384 LU-16812 Development Rank 1|i03c8v: Rank (Obsolete) 9223372036854775807 Severity