https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-3360 Lustre <p>This issue was created by maloo for sarah &lt;sarah@whamcloud.com&gt;</p> <p>This issue relates to the following test suite run: <a href="http://maloo.whamcloud.com/test_sets/335f5472-bf03-11e2-88e0-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">http://maloo.whamcloud.com/test_sets/335f5472-bf03-11e2-88e0-52540035b04c</a>.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>client-16vm3: debug=0x33f0404 client-16vm4: debug=0x33f0404 client-16vm3: subsystem_debug=0xffb7e3ff client-16vm3: debug_mb=32 client-16vm4: subsystem_debug=0xffb7e3ff client-16vm4: debug_mb=32 touching /mnt/lustre at Thu May 16 10:37:20 PDT 2013 create an empty file /mnt/lustre/hosts.12774 copying /etc/hosts to /mnt/lustre/hosts.12774 cp: cannot create regular file `/mnt/lustre/hosts.12774': Stale file handle </pre> </div></div> server: 2.1.5<br/> client: tag-2.4.0-RC1 LU-3360

Interop 2.1.5<-> 2.4 failure on test suite runtests: Stale file handle

Bug Minor Resolved Fixed Hongchao Zhang Maloo Mon, 20 May 2013 18:36:57 +0000 Wed, 16 Oct 2013 01:21:31 +0000 Fri, 31 May 2013 21:07:32 +0000 Lustre 2.4.0 Lustre 2.5.0 0 6 <p>another failure in sanity.sh <br/> <a href="https://maloo.whamcloud.com/test_sets/34048384-bf03-11e2-88e0-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/34048384-bf03-11e2-88e0-52540035b04c</a></p> <p>Hongchao</p> <p>Could you please look into this one?</p> <p>Thanks</p> <p>Peter</p> <p>sanity-benchmark test_dbench hit similar error:</p> <p><a href="https://maloo.whamcloud.com/test_sets/34ce8152-bf03-11e2-88e0-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/34ce8152-bf03-11e2-88e0-52540035b04c</a><br/> OST console shows:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>10:37:48:Lustre: DEBUG MARKER: == sanity-benchmark test dbench: dbench == 10:37:47 (1368725867) 10:37:48:LustreError: 4924:0:(filter.c:1484:filter_fid2dentry()) fatal: invalid object id 0 10:37:48:LustreError: 4924:0:(filter.c:3129:__filter_oa2dentry()) filter_setattr error looking up object: 0:2 10:37:48:Lustre: DEBUG MARKER: /usr/sbin/lctl mark sanity-benchmark test_dbench: @@@@@@ FAIL: dbench failed! </pre> </div></div> <p>client console shows:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>10:37:55:Lustre: DEBUG MARKER: == sanity-benchmark test dbench: dbench == 10:37:47 (1368725867) 10:37:55:LustreError: 11-0: lustre-OST0005-osc-ffff88007ace2800: Communicating with 10.10.4.123@tcp, operation ost_destroy failed with -71. 10:37:55:LustreError: 22071:0:(vvp_io.c:1086:vvp_io_commit_write()) Write page 512 of inode ffff88007c71cb38 failed -116 10:37:55:LustreError: 22071:0:(vvp_io.c:1086:vvp_io_commit_write()) Write page 512 of inode ffff88007c71cb38 failed -116 10:37:55:Lustre: DEBUG MARKER: /usr/sbin/lctl mark sanity-benchmark test_dbench: @@@@@@ FAIL: dbench failed! 10:37:55:Lustre: DEBUG MARKER: sanity-benchmark test_dbench: @@@@@@ FAIL: dbench failed! 10:37:55:Lustre: DEBUG MARKER: /usr/sbin/lctl dk &gt; /logdir/test_logs/2013-05-16/lustre-b2_1-el6-x86_64-vs-lustre-master-el6-x86_64--full--1_4_1__1501__-70235162192180-100105/sanity-benchmark.test_dbench.debug_log.$(hostname -s).1368725868.log; 10:37:55: dmesg &gt; /logdir/test_logs/2013-05 </pre> </div></div> <p>it could be related to the patch in <a href="https://jira.whamcloud.com/browse/LU-3187" title="Interop 2.3.64&lt;-&gt;2.3/2.1: sanity test_180a: lustre-OST0000: client sent bad object 0x2ce2:2: rc = -EPROTO" class="issue-link" data-issue-key="LU-3187"><del>LU-3187</del></a>, <a href="http://review.whamcloud.com/#change,6287" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,6287</a></p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"><span class="code-keyword">static</span> inline void lustre_set_wire_obdo(struct obd_connect_data *ocd, struct obdo *wobdo, struct obdo *lobdo) { memcpy(wobdo, lobdo, sizeof(*lobdo)); wobdo-&gt;o_flags &amp;= ~OBD_FL_LOCAL_MASK; <span class="code-keyword">if</span> (ocd == NULL) <span class="code-keyword">return</span>; <span class="code-keyword">if</span> (unlikely(!(ocd-&gt;ocd_connect_flags &amp; OBD_CONNECT_FID)) &amp;&amp; fid_seq_is_echo(fid_seq(&amp;lobdo-&gt;o_oi.oi_fid))) { /* Currently OBD_FL_OSTID will only be used when 2.4 echo * client communicate with pre-2.4 server */ wobdo-&gt;o_oi.oi.oi_id = fid_oid(&amp;lobdo-&gt;o_oi.oi_fid); wobdo-&gt;o_oi.oi.oi_seq = fid_seq(&amp;lobdo-&gt;o_oi.oi_fid); } } </pre> </div></div> <p>if the group (oi_seq) is 0 and the id (oi_id) is 2, then the obdo sent to OST will be changed to group(oi_seq)=fid_seq(&amp;lobdo-&gt;o_oi.oi_fid)=2, <br/> id(oi_id)=fid_oid(&amp;lobdo-&gt;o_oi.oi_fid)=0.</p> <p>I'm seeing something similar with sanityn, but no OST nor client logs to look at:</p> <p><a href="https://maloo.whamcloud.com/test_sets/313058ec-c294-11e2-b2eb-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/313058ec-c294-11e2-b2eb-52540035b04c</a><br/> <a href="https://maloo.whamcloud.com/test_sets/71dde390-c2b8-11e2-b2eb-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/71dde390-c2b8-11e2-b2eb-52540035b04c</a><br/> <a href="https://maloo.whamcloud.com/test_sets/9a36508a-c1d6-11e2-ada8-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/9a36508a-c1d6-11e2-ada8-52540035b04c</a></p> <p>the patch is tracked at <a href="http://review.whamcloud.com/#change,6426" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,6426</a></p> <p>Ran with the 6426 patch and interop testing. Tests ran with some subtest failures; some known, but still going through failures. The patch allows runtests to run with no stale file handle error.</p> <p>2.1 clients with 6426 patched master servers:<br/> <a href="https://maloo.whamcloud.com/test_sessions/a0a1ca60-c485-11e2-ac71-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/a0a1ca60-c485-11e2-ac71-52540035b04c</a></p> <p>6426 patched master clients with 2.1 servers:<br/> <a href="https://maloo.whamcloud.com/test_sessions/d7b668fa-c483-11e2-ac71-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sessions/d7b668fa-c483-11e2-ac71-52540035b04c</a></p> <p>Patch landed to master. Let me know if more patches are needed and I will reopen the ticket.</p> Development Rank 1|hzvrcn: Rank (Obsolete) 8322 Severity