https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-1931 Lustre <p>This issue was created by maloo for Li Wei &lt;liwei@whamcloud.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://maloo.whamcloud.com/test_sets/0be5975e-f9b4-11e1-b8d8-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/0be5975e-f9b4-11e1-b8d8-52540035b04c</a>.</p> <p>The sub-test test_5d failed with the following error:</p> <blockquote> <p>test failed to respond and timed out</p></blockquote> <p>From the test output:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== conf-sanity test 5d: mount with ost down ========================================================== 00:57:50 (1347004670) Loading modules from /usr/lib64/lustre detected 1 online CPUs by getconf libcfs will create CPU partition based on online CPUs ../libcfs/libcfs/libcfs options: 'cpu_npartitions=0' debug=-1 subsystem_debug=0xffb7e3ff ../lnet/lnet/lnet options: 'accept=all' gss/krb5 is not supported loading modules on client-19vm2,client-19vm3,client-19vm4 CMD: client-19vm2,client-19vm3,client-19vm4 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/openmpi/1.4-gcc/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin: NAME=autotest_config sh rpc.sh load_modules_local client-19vm3: Loading modules from /usr/lib64/lustre client-19vm3: detected 1 online CPUs by sysfs client-19vm3: libcfs will create CPU partition based on online CPUs client-19vm3: ../libcfs/libcfs/libcfs options: 'cpu_npartitions=0' client-19vm2: Loading modules from /usr/lib64/lustre client-19vm2: detected 1 online CPUs by getconf client-19vm2: libcfs will create CPU partition based on online CPUs client-19vm2: ../libcfs/libcfs/libcfs options: 'cpu_npartitions=0' client-19vm4: Loading modules from /usr/lib64/lustre client-19vm4: detected 1 online CPUs by sysfs client-19vm4: libcfs will create CPU partition based on online CPUs client-19vm4: ../libcfs/libcfs/libcfs options: 'cpu_npartitions=0' client-19vm2: debug=0x33f0404 client-19vm3: debug=0x33f0404 client-19vm2: subsystem_debug=0xffb7e3ff client-19vm3: subsystem_debug=0xffb7e3ff client-19vm2: ../lnet/lnet/lnet options: 'accept=all' client-19vm4: debug=0x33f0404 client-19vm4: subsystem_debug=0xffb7e3ff client-19vm2: gss/krb5 is not supported client-19vm3: gss/krb5 is not supported client-19vm4: gss/krb5 is not supported start ost1 service on client-19vm4 CMD: client-19vm4 mkdir -p /mnt/ost1 Starting ost1: lustre-ost1/ost1 /mnt/ost1 CMD: client-19vm4 mkdir -p /mnt/ost1; mount -t lustre lustre-ost1/ost1 /mnt/ost1 client-19vm4: mount.lustre: mount lustre-ost1/ost1 at /mnt/ost1 failed: Input/output error client-19vm4: Is the MGS running? Start of lustre-ost1/ost1 on ost1 failed 5 start mds service on client-19vm3 CMD: client-19vm3 mkdir -p /mnt/mds1 CMD: client-19vm3 test -b /dev/lvm-MDS/P1 Starting mds1: -o user_xattr,acl /dev/lvm-MDS/P1 /mnt/mds1 CMD: client-19vm3 mkdir -p /mnt/mds1; mount -t lustre -o user_xattr,acl /dev/lvm-MDS/P1 /mnt/mds1 CMD: client-19vm3 PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/usr/lib64/openmpi/1.4-gcc/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin: NAME=autotest_config sh rpc.sh set_default_debug \"-1\" \" 0xffb7e3ff\" 32 CMD: client-19vm3 e2label /dev/lvm-MDS/P1 2&gt;/dev/null Started lustre-MDT0000 stop ost1 service on client-19vm4 CMD: client-19vm4 grep -c /mnt/ost1' ' /proc/mounts CMD: client-19vm4 lsmod | grep lnet &gt; /dev/null &amp;&amp; lctl dl | grep ' ST ' mount lustre on /mnt/lustre..... Starting client: client-19vm1.lab.whamcloud.com: -o user_xattr,acl,flock client-19vm3@tcp:/lustre /mnt/lustre CMD: client-19vm1.lab.whamcloud.com mkdir -p /mnt/lustre CMD: client-19vm1.lab.whamcloud.com mount -t lustre -o user_xattr,acl,flock client-19vm3@tcp:/lustre /mnt/lustre </pre> </div></div> <p>Info required for matching: conf-sanity 5d</p> LU-1931

Test failure on test suite conf-sanity, subtest test_5d

Bug Minor Resolved Duplicate WC Triage Maloo zfs Thu, 13 Sep 2012 09:06:00 +0000 Tue, 2 Apr 2013 21:21:04 +0000 Tue, 2 Apr 2013 21:21:04 +0000 Lustre 2.3.0 0 4 <p>client-19vm2 (Client 2) rebooted at the start of this test for some unknown reason. </p> <p>We need dmesg /var/log/messages logs from the system. </p> <p>Keith, I can reproduce this in my vm (client-12vm<span class="error">&#91;1-4&#93;</span>). it's hung at the same state right now. Please take a look or let me know when you want to look and I will reproduce it again. The way to do that is set USE_OFD=yes and OSTFSTYPE=zfs, LOAD_REMOTE_MODULE=true</p> <p>this seems to be ORI-740, patch <a href="http://review.whamcloud.com/#change,3678" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,3678</a>. it needs to land on 2.3</p> <p>== conf-sanity test 19b: start/stop OSTs without MDS == 09:45:26 (1349109926)<br/> start ost1 service on client-12vm4<br/> CMD: client-12vm4 mkdir -p /mnt/ost1<br/> Starting ost1: lustre-ost1/ost1 /mnt/ost1<br/> CMD: client-12vm4 mkdir -p /mnt/ost1; mount -t lustre lustre-ost1/ost1 /mnt/ost1<br/> client-12vm4: mount.lustre: mount lustre-ost1/ost1 at /mnt/ost1 failed: Input/output error<br/> client-12vm4: Is the MGS running?<br/> Start of lustre-ost1/ost1 on ost1 failed 5<br/> conf-sanity test_19b: @@@@@@ FAIL: test_19b failed with 1 <br/> Trace dump:<br/> = /usr/lib64/lustre/tests/test-framework.sh:3640:error_noexit()<br/> = /usr/lib64/lustre/tests/test-framework.sh:3662:error()<br/> = /usr/lib64/lustre/tests/test-framework.sh:3898:run_one()<br/> = /usr/lib64/lustre/tests/test-framework.sh:3928:run_one_logged()<br/> = /usr/lib64/lustre/tests/test-framework.sh:3799:run_test()<br/> = /usr/lib64/lustre/tests/conf-sanity.sh:655:main()<br/> Dumping lctl log to /tmp/test_logs/2012-10-01/092312/conf-sanity.test_19b.*.1349109952.log<br/> CMD: client-12vm1.lab.whamcloud.com,client-12vm2,client-12vm3,client-12vm4 /usr/sbin/lctl dk &gt; /tmp/test_logs/2012-10-01/092312/conf-sanity.test_19b.debug_log.\$(hostname -s).1349109952.log;<br/> dmesg &gt; /tmp/test_logs/2012-10-01/092312/conf-sanity.test_19b.dmesg.\$(hostname -s).1349109952.log<br/> CMD: client-12vm1.lab.whamcloud.com,client-12vm2,client-12vm3,client-12vm4 rsync -az /tmp/test_logs/2012-10-01/092312/conf-sanity.test_19b.*.1349109952.log client-12vm1.lab.whamcloud.com:/tmp/test_logs/2012-10-01/092312<br/> client-12vm1: Host key verification failed.<br/> client-12vm1: rsync: connection unexpectedly closed (0 bytes received so far) <span class="error">&#91;sender&#93;</span><br/> client-12vm1: rsync error: unexplained error (code 255) at io.c(600) <span class="error">&#91;sender=3.0.6&#93;</span><br/> client-12vm3: Host key verification failed.<br/> client-12vm3: rsync: connection unexpectedly closed (0 bytes received so far) <span class="error">&#91;sender&#93;</span><br/> client-12vm3: rsync error: error in rsync protocol data stream (code 12) at io.c(600) <span class="error">&#91;sender=3.0.6&#93;</span><br/> client-12vm2: Host key verification failed.<br/> client-12vm2: rsync: connection unexpectedly closed (0 bytes received so far) <span class="error">&#91;sender&#93;</span><br/> client-12vm2: rsync error: error in rsync protocol data stream (code 12) at io.c(600) <span class="error">&#91;sender=3.0.6&#93;</span><br/> client-12vm4: Host key verification failed.<br/> client-12vm4: rsync: connection unexpectedly closed (0 bytes received so far) <span class="error">&#91;sender&#93;</span><br/> client-12vm4: rsync error: error in rsync protocol data stream (code 12) at io.c(600) <span class="error">&#91;sender=3.0.6&#93;</span><br/> test_19b returned 1<br/> FAIL 19b (28s)</p> <p>this is a dup of <a href="http://jira.whamcloud.com/browse/LU-2059" class="external-link" rel="nofollow">http://jira.whamcloud.com/browse/LU-2059</a></p> <p>basically, all the tests where OST starts w/o MGS running should be disabled with ZFS untill <a href="https://jira.whamcloud.com/browse/LU-2059" title="mgc to backup configuration on osd-based llogs" class="issue-link" data-issue-key="LU-2059"><del>LU-2059</del></a> is done.</p> <p>Per Alex's comment, closing this as duplicate of <a href="https://jira.whamcloud.com/browse/LU-2059" title="mgc to backup configuration on osd-based llogs" class="issue-link" data-issue-key="LU-2059"><del>LU-2059</del></a>.<br/> This test was excepted by patch <a href="http://review.whamcloud.com/4234" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/4234</a></p> Duplicate LU-2059 Development Rank 1|hzv3yv: Rank (Obsolete) 4171 Severity