<!-- 
RSS generated by JIRA (9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c) at Sat Feb 10 01:34:47 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>Whamcloud Community JIRA</title>
    <link>https://jira.whamcloud.com</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.4.14</version>
        <build-number>940014</build-number>
        <build-date>05-12-2023</build-date>
    </build-info>


<item>
            <title>[LU-3538] commit on share for cross-MDT operation.</title>
                <link>https://jira.whamcloud.com/browse/LU-3538</link>
                <project id="10000" key="LU">Lustre</project>
                    <description>&lt;p&gt;During recovery, if one update replay is failed, all of related updates might be failed in the following replay process. For example, client1 creates a remote directory on MDT1, and its name entry is on MDT0, then other clients will create files under this remote directory on MDT1. If MDT0 fails and the name entry insertion has not been committed to disk yet. If the recovery is failed for some reason, i.e. the directory is not being connected to the name space at all, all of the files under this directory will not be able to be accessed. To avoid this, commit on share will be applied to cross-MDT operation. i.e. If the MDT finds the object being updated was modified by some previous cross-MDT operation,  this cross-MDT operation needs to be committed first. So in the previous example, before creating any files under remote directory, the creation of the remote directory must be committed to disk first.&lt;br/&gt;
Commit on Share (COS) will be implemented by COS lock, which is similar as current local COS implementation. During cross-MDT operation, all locks of remote objects(remote locks) will be hold on the master MDT, and all of remote locks will be COS lock.  If these COS locks are being revoked, the master MDT will not only do sync on itself, but also do sync on remote MDTs.&lt;/p&gt;</description>
                <environment></environment>
        <key id="19634">LU-3538</key>
            <summary>commit on share for cross-MDT operation.</summary>
                <type id="7" iconUrl="https://jira.whamcloud.com/images/icons/issuetypes/task_agile.png">Technical task</type>
                            <parent id="19630">LU-3534</parent>
                                    <priority id="3" iconUrl="https://jira.whamcloud.com/images/icons/priorities/major.svg">Major</priority>
                        <status id="5" iconUrl="https://jira.whamcloud.com/images/icons/statuses/resolved.png" description="A resolution has been taken, and it is awaiting verification by reporter. From here issues are either reopened, or are closed.">Resolved</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="1">Fixed</resolution>
                                        <assignee username="laisiyao">Lai Siyao</assignee>
                                    <reporter username="di.wang">Di Wang</reporter>
                        <labels>
                            <label>dne2</label>
                    </labels>
                <created>Sat, 29 Jun 2013 18:07:07 +0000</created>
                <updated>Thu, 28 Jan 2016 19:09:30 +0000</updated>
                            <resolved>Thu, 28 Jan 2016 19:09:30 +0000</resolved>
                                    <version>Lustre 2.8.0</version>
                                    <fixVersion>Lustre 2.8.0</fixVersion>
                                        <due></due>
                            <votes>0</votes>
                                    <watches>10</watches>
                                                                            <comments>
                            <comment id="94485" author="di.wang" created="Fri, 19 Sep 2014 04:34:16 +0000"  >&lt;p&gt;&lt;a href=&quot;http://review.whamcloud.com/#/c/8356/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://review.whamcloud.com/#/c/8356/&lt;/a&gt;  This is the patch I did a year ago, may not work anymore, but may give you some ideas.&lt;/p&gt;</comment>
                            <comment id="98736" author="laisiyao" created="Mon, 10 Nov 2014 02:09:14 +0000"  >&lt;p&gt;Patch is on &lt;a href=&quot;http://review.whamcloud.com/#/c/12530/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://review.whamcloud.com/#/c/12530/&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="102031" author="gerrit" created="Fri, 19 Dec 2014 06:19:44 +0000"  >&lt;p&gt;Lai Siyao (lai.siyao@intel.com) uploaded a new patch: &lt;a href=&quot;http://review.whamcloud.com/13139&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://review.whamcloud.com/13139&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-3538&quot; title=&quot;commit on share for cross-MDT operation.&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-3538&quot;&gt;&lt;del&gt;LU-3538&lt;/del&gt;&lt;/a&gt; ldlm: add strict COS lock&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: c53ec90f63f2cb6c91de03c71de521d2a956ae3d&lt;/p&gt;</comment>
                            <comment id="123187" author="gerrit" created="Tue, 4 Aug 2015 13:41:39 +0000"  >&lt;p&gt;Lai Siyao (lai.siyao@intel.com) uploaded a new patch: &lt;a href=&quot;http://review.whamcloud.com/15844&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://review.whamcloud.com/15844&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-3538&quot; title=&quot;commit on share for cross-MDT operation.&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-3538&quot;&gt;&lt;del&gt;LU-3538&lt;/del&gt;&lt;/a&gt; dne: enable CoS for DNE by default&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 51acbd23b5fddc34761178f94618409f204a6313&lt;/p&gt;</comment>
                            <comment id="125659" author="gerrit" created="Mon, 31 Aug 2015 08:48:12 +0000"  >&lt;p&gt;Lai Siyao (lai.siyao@intel.com) uploaded a new patch: &lt;a href=&quot;http://review.whamcloud.com/16140&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://review.whamcloud.com/16140&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-3538&quot; title=&quot;commit on share for cross-MDT operation.&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-3538&quot;&gt;&lt;del&gt;LU-3538&lt;/del&gt;&lt;/a&gt; cos: combo patch for DNE COS support&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 06d51df4e17491db55ddb0c6843f0af2a71d4e4a&lt;/p&gt;</comment>
                            <comment id="127673" author="simmonsja" created="Thu, 17 Sep 2015 18:02:46 +0000"  >&lt;p&gt;Is this targeted for 2.8 or 2.9?&lt;/p&gt;</comment>
                            <comment id="127718" author="di.wang" created="Thu, 17 Sep 2015 22:32:41 +0000"  >&lt;p&gt;Hmm, The patch seems ok, and right now we want to see how bad it will impact the performance before land it.  But I never get time to run the performance test with the patch.&lt;/p&gt;

&lt;p&gt;Richard: Could you please find some one run a performance test to compare this build  &lt;a href=&quot;https://build.hpdd.intel.com/job/lustre-reviews/34289/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://build.hpdd.intel.com/job/lustre-reviews/34289/&lt;/a&gt; (build with COS) and &lt;a href=&quot;https://build.hpdd.intel.com/job/lustre-master/3187/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://build.hpdd.intel.com/job/lustre-master/3187/&lt;/a&gt;  (current master) ?&lt;/p&gt;</comment>
                            <comment id="128209" author="di.wang" created="Wed, 23 Sep 2015 05:51:41 +0000"  >&lt;p&gt; I just run a few tests on OpenSFS to see if COS impact&lt;br/&gt;
the performance.&lt;/p&gt;

&lt;p&gt;8 clients, 4 MDS (8MDTs) and 2 OSSs(4 OSTs)&lt;/p&gt;

&lt;p&gt;According to the result, the performance is not impacted&lt;/p&gt;

&lt;p&gt;mpirun -np 64 -machinefile /home/di.wang/machine_file&lt;br/&gt;
/usr/lib64/lustre/tests/mdsrate &#8213;-mknod --nfiles 1048576 --dir&lt;br/&gt;
/mnt/lustre/tests --filefmt &apos;f%%d&apos;&lt;br/&gt;
mpirun -np 64 -machinefile /home/di.wang/machine_file&lt;br/&gt;
/usr/lib64/lustre/tests/mdsrate --unlink --nfiles 1048576 --dir&lt;br/&gt;
/mnt/lustre/tests --filefmt &apos;f%%d&apos;&lt;/p&gt;




&lt;p&gt;With the patch&lt;/p&gt;

&lt;p&gt;Rate: 23998.42 eff 23997.34 aggr 374.96 avg client mknods/sec (total: 64&lt;br/&gt;
threads 1048576 mknods 1 dirs 64 threads/dir 43.69 secs)&lt;br/&gt;
0: c01 finished at Tue Sep 22 20:30:24 2015&lt;/p&gt;


&lt;p&gt;Rate: 7637.39 eff 7637.19 aggr 119.33 avg client unlinks/sec (total: 64&lt;br/&gt;
threads 1048576 unlinks 1 dirs 64 threads/dir 137.30 secs)&lt;br/&gt;
0: c01 finished at Tue Sep 22 20:33:51 2015&lt;/p&gt;


&lt;p&gt;Without the patch&lt;/p&gt;

&lt;p&gt;0: c01 starting at Tue Sep 22 22:03:45 2015&lt;br/&gt;
Rate: 24108.73 eff 24106.99 aggr 376.67 avg client mknods/sec (total: 64&lt;br/&gt;
threads 1048576 mknods 1 dirs 64 threads/dir 43.49 secs)&lt;br/&gt;
0: c01 finished at Tue Sep 22 22:04:29 2015&lt;/p&gt;


&lt;p&gt;Rate: 7505.92 eff 7505.87 aggr 117.28 avg client unlinks/sec (total: 64&lt;br/&gt;
threads 1048576 unlinks 1 dirs 64 threads/dir 139.70 secs)&lt;br/&gt;
0: c01 finished at Tue Sep 22 22:07:54 2015&lt;/p&gt;</comment>
                            <comment id="128669" author="adilger" created="Mon, 28 Sep 2015 19:30:33 +0000"  >&lt;p&gt;The patches for this ticket need to be refreshed for landing on master for 2.8.0. &lt;/p&gt;</comment>
                            <comment id="132005" author="gerrit" created="Thu, 29 Oct 2015 15:15:21 +0000"  >&lt;p&gt;Lai Siyao (lai.siyao@intel.com) uploaded a new patch: &lt;a href=&quot;http://review.whamcloud.com/16984&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://review.whamcloud.com/16984&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-3538&quot; title=&quot;commit on share for cross-MDT operation.&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-3538&quot;&gt;&lt;del&gt;LU-3538&lt;/del&gt;&lt;/a&gt; cos: CoS takes effect for cross-MDT op only now&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: db7a784fcb8e594896d4f624d409e6acfb700308&lt;/p&gt;</comment>
                            <comment id="134073" author="gerrit" created="Fri, 20 Nov 2015 16:02:30 +0000"  >&lt;p&gt;Lai Siyao (lai.siyao@intel.com) uploaded a new patch: &lt;a href=&quot;http://review.whamcloud.com/17304&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://review.whamcloud.com/17304&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-3538&quot; title=&quot;commit on share for cross-MDT operation.&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-3538&quot;&gt;&lt;del&gt;LU-3538&lt;/del&gt;&lt;/a&gt; cos: reuse cos lock if compatible&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: 1&lt;br/&gt;
Commit: 825bf4d3c71d9c3bcd583db15e834b7839a7f258&lt;/p&gt;</comment>
                            <comment id="135259" author="adilger" created="Fri, 4 Dec 2015 18:21:09 +0000"  >&lt;p&gt;Lai, can you please post the performance results into this ticket.&lt;/p&gt;</comment>
                            <comment id="140381" author="gerrit" created="Thu, 28 Jan 2016 18:01:10 +0000"  >&lt;p&gt;Oleg Drokin (oleg.drokin@intel.com) merged in patch &lt;a href=&quot;http://review.whamcloud.com/12530/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://review.whamcloud.com/12530/&lt;/a&gt;&lt;br/&gt;
Subject: &lt;a href=&quot;https://jira.whamcloud.com/browse/LU-3538&quot; title=&quot;commit on share for cross-MDT operation.&quot; class=&quot;issue-link&quot; data-issue-key=&quot;LU-3538&quot;&gt;&lt;del&gt;LU-3538&lt;/del&gt;&lt;/a&gt; dne: Commit-on-Sharing for DNE&lt;br/&gt;
Project: fs/lustre-release&lt;br/&gt;
Branch: master&lt;br/&gt;
Current Patch Set: &lt;br/&gt;
Commit: b50bb830f92e87da9bfdc84d14e4f3f78c80c9ac&lt;/p&gt;</comment>
                            <comment id="140413" author="jgmitter" created="Thu, 28 Jan 2016 19:09:30 +0000"  >&lt;p&gt;Landed for 2.8&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Related</name>
                                                                <inwardlinks description="is related to">
                                        <issuelink>
            <issuekey id="31033">LU-6831</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="33585">LU-7546</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                <customfield id="customfield_10890" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10490" key="com.atlassian.jira.plugin.system.customfieldtypes:datepicker">
                        <customfieldname>End date</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 14 Dec 2015 18:07:07 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10390" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hzvuen:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10090" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>8902</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10493" key="com.atlassian.jira.plugin.system.customfieldtypes:datepicker">
                        <customfieldname>Start date</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 1 Jul 2013 18:07:07 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    </customfields>
    </item>
</channel>
</rss>