https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-13239 Lustre <p>Internal testing with IOR shows including the inode times i_mtime, i_atime, i_ctime on top of <a href="https://jira.whamcloud.com/browse/LU-12151" title="metadata performance difference on root and non-root user" class="issue-link" data-issue-key="LU-12151"><del>LU-12151</del></a> does have a significant effect on writes</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> Activity +/- MiB/s ------------------------- --------- Direct I/O Write + 25% Direct I/O Pre-Fill Write + 21% Direct I/O Read + 13% Buffered I/O Write + 22% Buffered I/O Read + 4%</pre> </div></div> LU-13239

ldiskfs: pass initial inode attributes at creation time

Improvement Minor Resolved Fixed Shaun Tancheff Shaun Tancheff Tue, 11 Feb 2020 16:16:43 +0000 Sat, 5 Feb 2022 06:11:53 +0000 Fri, 26 Feb 2021 23:11:36 +0000 Lustre 2.15.0 0 4 <p>Could you further explain what i_xtime is? I've never heard of it. </p> <p>From <a href="https://jira.whamcloud.com/browse/LU-12151" title="metadata performance difference on root and non-root user" class="issue-link" data-issue-key="LU-12151"><del>LU-12151</del></a> it looks like this is referring to a patch in Github that is adding inode attributes in ext4 at creation time:<br/> <a href="https://github.com/Xyratex/lustre-stable/commit/7ab00b00eb057f6963c0b5641686240ef95e1388#diff-89ce3dab611fea06ce62efa5bed4ae63" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/Xyratex/lustre-stable/commit/7ab00b00eb057f6963c0b5641686240ef95e1388#diff-89ce3dab611fea06ce62efa5bed4ae63</a></p> <p>Please include the performance improvement numbers in the commit message for the patch. </p> <p>Shaun Tancheff (shaun.tancheff@hpe.com) uploaded a new patch: <a href="https://review.whamcloud.com/37556" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37556</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13239" title="ldiskfs: pass initial inode attributes at creation time" class="issue-link" data-issue-key="LU-13239"><del>LU-13239</del></a> ldiskfs: pass i_xtime down optimization<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 7ebe314f9b7b4703f0654b1eeb59c048c738b77d</p> <p>Shaun Tancheff (shaun.tancheff@hpe.com) uploaded a new patch: <a href="https://review.whamcloud.com/37557" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37557</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13239" title="ldiskfs: pass initial inode attributes at creation time" class="issue-link" data-issue-key="LU-13239"><del>LU-13239</del></a> ldiskfs: pass i_xtime down optimization (rhel 8.1)<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 3edcb2b8f9c949c2228e320531c18511c97fc1f6</p> <p>I think these patches are interesting, but the performance numbers confuse me. I'd think that this would improve the performance of mdtest, because it avoids extra operations on each file create, but I can't imagine how the file create performance would affect IOR performance (which does the create before the timing starts).</p> <p>We need to do a better comparison run of current master with and w/o this patch to better gauge where things stand.</p> <p>master (c54b6ca2bdb5fb350117138106ffe37cdb9b7046) and master w/patch:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> srun -n 128 -N 32 -w c-lmo[079,081,084,086-105,107-109,116-121] IOR -vv -w -F -b 163840m -t 4m -i 5 -k -m -D 180 -B -o /mnt/testfs/v2/out.write srun -n 128 -N 32 -w c-lmo[079,081,084,086-105,107-109,116-121] IOR -vv -w -F -b 163840m -t 4m -i 5 -k -m -D 180 -o /mnt/testfs/v2/out.write srun -n 128 -N 32 -w c-lmo[079,081,084,086-105,107-109,116-121] IOR -vv -w -F -b 163840m -t 4m -i 1 -k -D 900 -o /mnt/testfs/v2/out.read srun -n 128 -N 32 -w c-lmo[079,081,084,086-105,107-109,116-121] IOR -vv -r -F -b 36658216960 -t 1m -i 5 -k -D 90 -B -o /mnt/testfs/v2/out.read srun -n 128 -N 32 -w c-lmo[079,081,084,086-105,107-109,116-121] IOR -vv -r -F -b 36658216960 -t 1m -i 5 -k -D 90 -o /mnt/testfs/v2/out.read master: Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s) Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize --------- --------- --------- ---------- ------- --------- --------- ---------- ------- -------- write 18863.82 18791.60 18825.77 27.30 29066.41 29061.92 29064.71 1.57 180.38643 128 4 5 1 0 1 0 0 1 171798691840 4194304 3562138501120 -1 POSIX EXCEL Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s) Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize --------- --------- --------- ---------- ------- --------- --------- ---------- ------- -------- write 42220.02 40370.32 41242.91 654.85 29040.74 29036.04 29038.53 2.02 180.54908 128 4 5 1 0 1 0 0 1 171798691840 4194304 7893113896960 -1 POSIX EXCEL Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s) Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize --------- --------- --------- ---------- ------- --------- --------- ---------- ------- -------- write 31888.98 31888.98 31888.98 0.00 7972.25 7972.25 7972.25 0.00 657.64159 128 4 1 1 0 1 0 0 1 171798691840 4194304 21990232555520 -1 POSIX EXCEL Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s) Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize --------- --------- --------- ---------- ------- --------- --------- ---------- ------- -------- read 22783.78 21939.32 22392.50 345.07 49367.72 49347.83 49361.92 7.33 90.65450 128 4 5 1 0 1 0 0 1 36658216960 1048576 2165529640960 -1 POSIX EXCEL Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s) Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize --------- --------- --------- ---------- ------- --------- --------- ---------- ------- -------- read 19408.10 18966.88 19251.06 149.11 49210.09 48625.45 48905.19 208.40 91.50280 128 4 5 1 0 1 0 0 1 36658216960 1048576 1848417189888 -1 POSIX EXCEL this patch Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s) Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize --------- --------- --------- ---------- ------- --------- --------- ---------- ------- -------- write 18891.51 18776.35 18838.36 37.66 29052.86 29048.29 29050.24 1.66 180.47632 128 4 5 1 0 1 0 0 1 171798691840 4194304 3563333877760 -1 POSIX EXCEL Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s) Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize --------- --------- --------- ---------- ------- --------- --------- ---------- ------- -------- write 41928.60 40658.43 41176.08 489.07 29054.88 28977.41 29029.34 28.26 180.60641 128 4 5 1 0 1 0 0 1 171798691840 4194304 7937217003520 -1 POSIX EXCEL Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s) Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize --------- --------- --------- ---------- ------- --------- --------- ---------- ------- -------- write 32415.68 32415.68 32415.68 0.00 8103.92 8103.92 8103.92 0.00 646.95600 128 4 1 1 0 1 0 0 1 171798691840 4194304 21990232555520 -1 POSIX EXCEL Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s) Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize --------- --------- --------- ---------- ------- --------- --------- ---------- ------- -------- read 23532.90 22701.12 23178.54 277.01 49439.72 49422.36 49432.09 7.06 90.52581 128 4 5 1 0 1 0 0 1 36658216960 1048576 2197518548992 -1 POSIX EXCEL Operation Max (MiB) Min (MiB) Mean (MiB) Std Dev Max (OPs) Min (OPs) Mean (OPs) Std Dev Mean (s) Op grep #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize --------- --------- --------- ---------- ------- --------- --------- ---------- ------- -------- read 20218.87 19560.56 19881.25 213.16 49472.26 48715.86 48946.76 270.99 91.42621 128 4 5 1 0 1 0 0 1 36658216960 1048576 1907682705408 -1 POSIX EXCEL </pre> </div></div> <p>Shaun, what is the one line summary of the above results? <img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/smile.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p>Overall we do get some improvement excepting buffered I/O re-writes. (41242.91 dropped to 41176.08).<br/> It's worth an additional couple of runs to determine if this is a re-write regression or buffered I/O regression.</p> <p>Oleg Drokin (green@whamcloud.com) merged in patch <a href="https://review.whamcloud.com/37556/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/37556/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13239" title="ldiskfs: pass initial inode attributes at creation time" class="issue-link" data-issue-key="LU-13239"><del>LU-13239</del></a> ldiskfs: pass inode timestamps at initial creation<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 5bb641fa61175fd0fe63e830219d88304b5162c3</p> <p>Landed for 2.15</p> <p>"Jian Yu &lt;yujian@whamcloud.com&gt;" uploaded a new patch: <a href="https://review.whamcloud.com/46305" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/46305</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13239" title="ldiskfs: pass initial inode attributes at creation time" class="issue-link" data-issue-key="LU-13239"><del>LU-13239</del></a> ldiskfs: pass inode timestamps at initial creation<br/> Project: fs/lustre-release<br/> Branch: b2_14<br/> Current Patch Set: 1<br/> Commit: 0e219853f5ae771f67145d03680a187e246736fd</p> <p>"Oleg Drokin &lt;green@whamcloud.com&gt;" merged in patch <a href="https://review.whamcloud.com/46305/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/46305/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-13239" title="ldiskfs: pass initial inode attributes at creation time" class="issue-link" data-issue-key="LU-13239"><del>LU-13239</del></a> ldiskfs: pass inode timestamps at initial creation<br/> Project: fs/lustre-release<br/> Branch: b2_14<br/> Current Patch Set: <br/> Commit: b9ed982a57b3833eb5abe7bc36d489da6ad1b2c2</p> Related LU-12151 Development Rank 1|i00tlz: Rank (Obsolete) 9223372036854775807