[LU-9455] sanity-scrub test_10a: server * environments are insane!

• Status: Open
• Project: Lustre
• Affects Version/s: Lustre 2.10.0
• Type: Bug
• Priority: Minor
• Reporter: Maloo
• Assignee: WC Triage
• Resolution: Unresolved
• Severity: 3

Description

This issue was created by maloo for Saurabh Tandan <[e-mail]>

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/eb95867c-3021-11e7-814a-5254006e85c2.

The sub-test test_10a failed with the following error:

server onyx-36vm3 environments are insane!

test logs:

== sanity-scrub test 10a: non-stopped OI scrub should auto restarts after MDS remount (1) ============ 04:52:39 (1493812359)
Checking servers environments
CMD: onyx-36vm8 running=\$(grep -c /mnt/lustre-ost1' ' /proc/mounts);
mpts=\$(mount | grep -c /mnt/lustre-ost1' ');
if [ \$running -ne \$mpts ]; then
    echo \$(hostname) env are INSANE!;
    exit 1;
fi
CMD: onyx-36vm8 running=\$(grep -c /mnt/lustre-ost2' ' /proc/mounts);
mpts=\$(mount | grep -c /mnt/lustre-ost2' ');
if [ \$running -ne \$mpts ]; then
    echo \$(hostname) env are INSANE!;
    exit 1;
fi
CMD: onyx-36vm8 running=\$(grep -c /mnt/lustre-ost3' ' /proc/mounts);
mpts=\$(mount | grep -c /mnt/lustre-ost3' ');
if [ \$running -ne \$mpts ]; then
    echo \$(hostname) env are INSANE!;
    exit 1;
fi
CMD: onyx-36vm8 running=\$(grep -c /mnt/lustre-ost4' ' /proc/mounts);
mpts=\$(mount | grep -c /mnt/lustre-ost4' ');
if [ \$running -ne \$mpts ]; then
    echo \$(hostname) env are INSANE!;
    exit 1;
fi
CMD: onyx-36vm7 running=\$(grep -c /mnt/lustre-mds1' ' /proc/mounts);
mpts=\$(mount | grep -c /mnt/lustre-mds1' ');
if [ \$running -ne \$mpts ]; then
    echo \$(hostname) env are INSANE!;
    exit 1;
fi
CMD: onyx-36vm3 running=\$(grep -c /mnt/lustre-mds2' ' /proc/mounts);
mpts=\$(mount | grep -c /mnt/lustre-mds2' ');
if [ \$running -ne \$mpts ]; then
    echo \$(hostname) env are INSANE!;
    exit 1;
fi
pdsh@onyx-36vm1: onyx-36vm3: mcmd: connect failed: Connection refused
 sanity-scrub test_10a: @@@@@@ FAIL: server onyx-36vm3 environments are insane! 
  Trace dump:

First seen on 02/04/2017 and this issue is visible approx 3 times in a month.