<!-- 
RSS generated by JIRA (9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c) at Sat Feb 10 02:22:28 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>Whamcloud Community JIRA</title>
    <link>https://jira.whamcloud.com</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.4.14</version>
        <build-number>940014</build-number>
        <build-date>05-12-2023</build-date>
    </build-info>


<item>
            <title>[LU-9008] Dynamic layout modification during writes</title>
                <link>https://jira.whamcloud.com/browse/LU-9008</link>
                <project id="10000" key="LU">Lustre</project>
                    <description>&lt;p&gt;In order to simplify implementation, this project will focus on implementing composite layouts that are grown by allocating objects in non-overlapping layout extents at the end of the file, and will not implement modification of already allocated layout extents containing data.&lt;/p&gt;

&lt;p&gt;The client IO (CLIO) layer needs to be able to manage the growth of the file layout by reconfiguring its IO stack to add new OST objects into the layout. The client will request that the MDS instantiate OST objects based on the layout template before it begins writing to a file offset beyond the currently instantiated layout components. The layout generation stored in the composite layout and in each layout extent will allow CLIO to detect whether a specific layout extent has been modified when the lock is revoked. Since the existing components of the file layout will not be modified for PFL files, any in-flight IO operations and cached data do not need to be interrupted. &lt;/p&gt;</description>
                <environment></environment>
        <key id="42941">LU-9008</key>
            <summary>Dynamic layout modification during writes</summary>
                <type id="7" iconUrl="https://jira.whamcloud.com/images/icons/issuetypes/task_agile.png">Technical task</type>
                            <parent id="42916">LU-8998</parent>
                                    <priority id="4" iconUrl="https://jira.whamcloud.com/images/icons/priorities/minor.svg">Minor</priority>
                        <status id="5" iconUrl="https://jira.whamcloud.com/images/icons/statuses/resolved.png" description="A resolution has been taken, and it is awaiting verification by reporter. From here issues are either reopened, or are closed.">Resolved</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="1">Fixed</resolution>
                                        <assignee username="bobijam">Zhenyu Xu</assignee>
                                    <reporter username="jgmitter">Joseph Gmitter</reporter>
                        <labels>
                    </labels>
                <created>Wed, 11 Jan 2017 13:09:05 +0000</created>
                <updated>Wed, 26 Apr 2017 11:17:12 +0000</updated>
                            <resolved>Fri, 31 Mar 2017 16:30:54 +0000</resolved>
                                                    <fixVersion>Lustre 2.10.0</fixVersion>
                                        <due></due>
                            <votes>0</votes>
                                    <watches>5</watches>
                                                                            <comments>
                            <comment id="181298" author="bobijam" created="Thu, 19 Jan 2017 02:20:42 +0000"  >&lt;p&gt;This involves following changes:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;in lov_init_composite(), skip init sub object without LCME_FL_INIT layout component.&lt;/li&gt;
	&lt;li&gt;take care of lov_dispatch[] methods of accessing un-init-ed layout component.&lt;/li&gt;
	&lt;li&gt;issue intent RPC during write/trunc ops when try to write to a un-init-ed component (even if at the lock stage).&lt;/li&gt;
	&lt;li&gt;initialize sub object when lov_stripe_md retrieved after intent RPC issued, and restart the IO.&lt;/li&gt;
&lt;/ul&gt;
</comment>
                            <comment id="183881" author="gerrit" created="Wed, 8 Feb 2017 03:43:32 +0000"  >&lt;p&gt;Bobi Jam (bobijam@hotmail.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/25317&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/25317&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-9008&quot; title=&quot;Dynamic layout modification during writes&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-9008&quot;&gt;&lt;del&gt;LU-9008&lt;/del&gt;&lt;/a&gt; pfl: dynamic layout modification during write/trunc&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: pfl&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 1fab3e9b2ffd0dca32c4921b0dd7359f46c020af&lt;/p&gt;</comment>
                            <comment id="189258" author="gerrit" created="Wed, 22 Mar 2017 18:41:58 +0000"  >&lt;p&gt;Bobi Jam (bobijam@hotmail.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/26117&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/26117&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-9008&quot; title=&quot;Dynamic layout modification during writes&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-9008&quot;&gt;&lt;del&gt;LU-9008&lt;/del&gt;&lt;/a&gt; pfl: dynamic layout modification during write/trunc&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 4bd1a288b218df3b9494c4364d4f17cebdaf053d&lt;/p&gt;</comment>
                            <comment id="190277" author="gerrit" created="Fri, 31 Mar 2017 16:00:11 +0000"  >&lt;p&gt;Jinshan Xiong (jinshan.xiong@intel.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/25317/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/25317/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-9008&quot; title=&quot;Dynamic layout modification during writes&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-9008&quot;&gt;&lt;del&gt;LU-9008&lt;/del&gt;&lt;/a&gt; pfl: dynamic layout modification with write/truncate&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: pfl&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: f676c7194a6095f42f23729f271b283b001f0bbc&lt;/p&gt;</comment>
                            <comment id="190281" author="jgmitter" created="Fri, 31 Mar 2017 16:30:54 +0000"  >&lt;p&gt;Patch landed to PFL branch&lt;/p&gt;</comment>
                            <comment id="191501" author="dmiter" created="Tue, 11 Apr 2017 11:01:40 +0000"  >&lt;p&gt;This patch introduce the following crash in master:&lt;/p&gt;
&lt;div class=&quot;preformatted panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;preformattedContent panelContent&quot;&gt;
&lt;pre&gt; 16:46:36:[14470.127738] LustreError: 22186:0:(vvp_io.c:345:vvp_io_fini()) ASSERTION( io-&amp;gt;ci_type == CIT_WRITE || cl_io_is_trunc(io) ) failed: 
 16:46:36:[14470.132048] LustreError: 22186:0:(vvp_io.c:345:vvp_io_fini()) LBUG
 16:46:36:[14470.134194] Pid: 22186, comm: cat
 16:46:36:[14470.135970] 
 16:46:36:[14470.135970] Call Trace:
 16:46:36:[14470.139113] [&amp;lt;ffffffffa07107f3&amp;gt;] libcfs_debug_dumpstack+0x53/0x80 [libcfs]
 16:46:36:[14470.141168] [&amp;lt;ffffffffa0710861&amp;gt;] lbug_with_loc+0x41/0xb0 [libcfs]
 16:46:36:[14470.143473] [&amp;lt;ffffffffa0c93761&amp;gt;] vvp_io_fini+0x321/0x360 [lustre]
 16:46:36:[14470.145411] [&amp;lt;ffffffffa0beaff2&amp;gt;] ? lov_io_fini+0x282/0x460 [lov]
 16:46:36:[14470.147499] [&amp;lt;ffffffffa0805165&amp;gt;] cl_io_fini+0x75/0x240 [obdclass]
 16:46:36:[14470.149358] [&amp;lt;ffffffffa0c42f73&amp;gt;] ll_file_io_generic+0x2a3/0xb00 [lustre]
 16:46:36:[14470.151383] [&amp;lt;ffffffff81219cff&amp;gt;] ? touch_atime+0x12f/0x160
 16:46:36:[14470.153202] [&amp;lt;ffffffffa0c4409a&amp;gt;] ll_file_aio_read+0x34a/0x3e0 [lustre]
 16:46:36:[14470.155178] [&amp;lt;ffffffffa0c441fe&amp;gt;] ll_file_read+0xce/0x1e0 [lustre]
 16:46:36:[14470.157019] [&amp;lt;ffffffff811fe19e&amp;gt;] vfs_read+0x9e/0x170
 16:46:36:[14470.158806] [&amp;lt;ffffffff811fed6f&amp;gt;] SyS_read+0x7f/0xe0
 16:46:36:[14470.160524] [&amp;lt;ffffffff81696b09&amp;gt;] system_call_fastpath+0x16/0x1b

&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;The code is following:&lt;/p&gt;
&lt;div class=&quot;code panel&quot; style=&quot;border-width: 1px;&quot;&gt;&lt;div class=&quot;codeContent panelContent&quot;&gt;
&lt;pre class=&quot;code-java&quot;&gt; 	/**
	 * dynamic layout change needed, send layout intent
	 * RPC.
	 */
	&lt;span class=&quot;code-keyword&quot;&gt;if&lt;/span&gt; (io-&amp;gt;ci_need_write_intent) {
		loff_t start = 0;
		loff_t end = 0;

		LASSERT(io-&amp;gt;ci_type == CIT_WRITE || cl_io_is_trunc(io));
[...]
&lt;span class=&quot;code-keyword&quot;&gt;static&lt;/span&gt; &lt;span class=&quot;code-object&quot;&gt;int&lt;/span&gt; lov_io_rw_iter_init(&lt;span class=&quot;code-keyword&quot;&gt;const&lt;/span&gt; struct lu_env *env, &lt;span class=&quot;code-keyword&quot;&gt;const&lt;/span&gt; struct cl_io_slice *ios)
{
[...]
index = lov_lsm_entry(lsm, lio-&amp;gt;lis_endpos - 1);
&lt;span class=&quot;code-keyword&quot;&gt;if&lt;/span&gt; (index &amp;gt; 0 &amp;amp;&amp;amp; !lsm_entry_inited(lsm, index)) {
    io-&amp;gt;ci_need_write_intent = 1;
    RETURN(io-&amp;gt;ci_result = -ENODATA);
}

&lt;/pre&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;So, &quot;io-&amp;gt;ci_need_write_intent&quot; can be set to &quot;1&quot; in read operation also.&lt;/p&gt;</comment>
                            <comment id="191502" author="dmiter" created="Tue, 11 Apr 2017 11:03:48 +0000"  >&lt;p&gt;This is from test failure on test suite sanity-lfsck, subtest test_18d&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="191504" author="bobijam" created="Tue, 11 Apr 2017 11:12:13 +0000"  >&lt;p&gt;Yes, thank you for the catch, read should not trigger the layout write intent.&lt;/p&gt;</comment>
                            <comment id="191505" author="gerrit" created="Tue, 11 Apr 2017 11:13:08 +0000"  >&lt;p&gt;Bobi Jam (bobijam@hotmail.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/26499&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/26499&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-9008&quot; title=&quot;Dynamic layout modification during writes&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-9008&quot;&gt;&lt;del&gt;LU-9008&lt;/del&gt;&lt;/a&gt; pfl: Read should not trigger layout write intent&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 298c166c6415a99af9b8dfa60a12e36989f7e88f&lt;/p&gt;</comment>
                            <comment id="192022" author="gerrit" created="Thu, 13 Apr 2017 22:53:51 +0000"  >&lt;p&gt;Jinshan Xiong (jinshan.xiong@intel.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/26613&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/26613&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-9008&quot; title=&quot;Dynamic layout modification during writes&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-9008&quot;&gt;&lt;del&gt;LU-9008&lt;/del&gt;&lt;/a&gt; pfl: Read should not trigger layout write intent&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: pfl&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 02670a7bc3b1f3cb143e65f8b2a31331980fea16&lt;/p&gt;</comment>
                            <comment id="192105" author="gerrit" created="Fri, 14 Apr 2017 15:22:27 +0000"  >&lt;p&gt;Andreas Dilger (andreas.dilger@intel.com) uploaded a new patch: &lt;a href=&quot;https://review.whamcloud.com/26622&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/26622&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-9008&quot; title=&quot;Dynamic layout modification during writes&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-9008&quot;&gt;&lt;del&gt;LU-9008&lt;/del&gt;&lt;/a&gt; pfl: Read should not trigger layout write intent&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: pfl&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: a74373c9d6882991d93362d78ea17caa3bd3dd5a&lt;/p&gt;</comment>
                            <comment id="192204" author="gerrit" created="Mon, 17 Apr 2017 05:05:17 +0000"  >&lt;p&gt;Jinshan Xiong (jinshan.xiong@intel.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/26622/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/26622/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-9008&quot; title=&quot;Dynamic layout modification during writes&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-9008&quot;&gt;&lt;del&gt;LU-9008&lt;/del&gt;&lt;/a&gt; pfl: Read should not trigger layout write intent&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: pfl&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: e3ae2055f629c9bfea32905cd44e22c692cd65d9&lt;/p&gt;</comment>
                            <comment id="193520" author="gerrit" created="Wed, 26 Apr 2017 03:39:58 +0000"  >&lt;p&gt;Oleg Drokin (oleg.drokin@intel.com) merged in patch &lt;a href=&quot;https://review.whamcloud.com/26499/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://review.whamcloud.com/26499/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-9008&quot; title=&quot;Dynamic layout modification during writes&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-9008&quot;&gt;&lt;del&gt;LU-9008&lt;/del&gt;&lt;/a&gt; pfl: Read should not trigger layout write intent&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: b4b74ee1ef7a34c56ade16da892091eae28ef498&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                <customfield id="customfield_10890" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10390" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hzz0e7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10090" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                </customfields>
    </item>
</channel>
</rss>