[LU-5610] ncli.sh bash: -c: line 0: syntax error near unexpected token `('

• Status: Resolved
• Project: Lustre
• Fix Version/s: Lustre 2.7.0, Lustre 2.5.4
• Type: Bug
• Priority: Minor
• Reporter: Stephen Champion
• Assignee: Jian Yu
• Resolution: Fixed
• Labels: patch
• Severity: 3

Description

==========================================================
starting /data1/cluster-tools/out/sgilustre241-Oct10-13/20131010.200031/run-acc-accfs.sh on n006
==========================================================
ModuleCmd_Load.c(199):ERROR:105: Unable to locate a modulefile for 'openmpi-x86_64'
Started at Thu Oct 10 20:01:18 PDT 2013
Lustre is not mounted, trying to do setup ...
Stopping clients: n006,n007 /mnt/accfs (opts
Stopping clients: n006,n007 /mnt/accfs2 (opts
n013-ib1: Warning: Permanently added the RSA host key for IP address '192.168.21.13' to the list of known hosts.
pdsh@n006: n013-ib1: ssh exited with exit code 1
pdsh@n006: n013-ib1: ssh exited with exit code 1
n008-ib1: Warning: Permanently added the RSA host key for IP address '192.168.21.8' to the list of known hosts.
pdsh@n006: n008-ib1: ssh exited with exit code 1
pdsh@n006: n008-ib1: ssh exited with exit code 1
n009-ib1: Warning: Permanently added the RSA host key for IP address '192.168.21.9' to the list of known hosts.
pdsh@n006: n009-ib1: ssh exited with exit code 1
pdsh@n006: n009-ib1: ssh exited with exit code 1
Loading modules from /usr/lib64/lustre
detected 16 online CPUs by sysfs
libcfs will create CPU partition based on online CPUs
debug=vfstrace rpctrace dlmtrace neterror ha config ioctl super
subsystem_debug=all -lnet -lnd -pinger
../lnet/lnet/lnet options: 'accept_port=50 ip2nets="tcp0(eth0) 10.0..; o2ib0(ib0) 192.168.20.;; o2ib1(ib1) 192.168.21.;; o2ib2(ib2) 192.168.22.*;" accept=all'
gss/krb5 is not supported
loading modules on: 'n007,n008-ib1,n009-ib1,n013-ib1'
n008-ib1: bash: -c: line 0: syntax error near unexpected token `('
n008-ib1: bash: -c: line 0: `(PATH=$PATH:/usr/lib64/lustre/utils:/usr/lib64/lustre/tests:/sbin:/usr/sbin; cd /usr/lib64/lustre/tests; LUSTRE="/usr/lib64/lustre" MODOPTS_FID="" MODOPTS_FLD="" MODOPTS_KSOCKLND="" MODOPTS_LIBCFS="" MODOPTS_LMV="" MODOPTS_LNET="accept_port=50 ip2nets="tcp0(eth0) 10.0..; o2ib0(ib0) 192.168.20.;; o2ib1(ib1) 192.168.21.;; o2ib2(ib2) 192.168.22.*;" accept=all" MODOPTS_LOV="" MODOPTS_LUSTRE="" MODOPTS_LVFS="" MODOPTS_MDC="" MODOPTS_MGC="" MODOPTS_OBDCLASS="" MODOPTS_OBDECHO="" MODOPTS_OSC="" MODOPTS_PTLRPC="" MODOPTS_PTLRPC_GSS="" FSTYPE=ldiskfs sh -c "PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/sbin:/usr/sbin:/usr/local/sbin:/root/bin:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/X11R6/bin:/usr/games:/usr/lib/mit/bin:/usr/lib/mit/sbin:/opt/sgi/sgimc/bin::/sbin:/bin:/usr/sbin: NAME=ncli sh rpc.sh load_modules_local ")'
pdsh@n006: n008-ib1: ssh exited with exit code 2
n007: bash: -c: line 0: syntax error near unexpected token `('
n007: bash: -c: line 0: `(PATH=$PATH:/usr/lib64/lustre/utils:/usr/lib64/lustre/tests:/sbin:/usr/sbin; cd /usr/lib64/lustre/tests; LUSTRE="/usr/lib64/lustre" MODOPTS_FID="" MODOPTS_FLD="" MODOPTS_KSOCKLND="" MODOPTS_LIBCFS="" MODOPTS_LMV="" MODOPTS_LNET="accept_port=50 ip2nets="tcp0(eth0) 10.0..; o2ib0(ib0) 192.168.20.;; o2ib1(ib1) 192.168.21.;; o2ib2(ib2) 192.168.22.*;" accept=all" MODOPTS_LOV="" MODOPTS_LUSTRE="" MODOPTS_LVFS="" MODOPTS_MDC="" MODOPTS_MGC="" MODOPTS_OBDCLASS="" MODOPTS_OBDECHO="" MODOPTS_OSC="" MODOPTS_PTLRPC="" MODOPTS_PTLRPC_GSS="" FSTYPE=ldiskfs sh -c "PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/sbin:/usr/sbin:/usr/local/sbin:/root/bin:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/X11R6/bin:/usr/games:/usr/lib/mit/bin:/usr/lib/mit/sbin:/opt/sgi/sgimc/bin::/sbin:/bin:/usr/sbin: NAME=ncli sh rpc.sh load_modules_local ")'
pdsh@n006: n007: ssh exited with exit code 2
n009-ib1: bash: -c: line 0: syntax error near unexpected token `('
n009-ib1: bash: -c: line 0: `(PATH=$PATH:/usr/lib64/lustre/utils:/usr/lib64/lustre/tests:/sbin:/usr/sbin; cd /usr/lib64/lustre/tests; LUSTRE="/usr/lib64/lustre" MODOPTS_FID="" MODOPTS_FLD="" MODOPTS_KSOCKLND="" MODOPTS_LIBCFS="" MODOPTS_LMV="" MODOPTS_LNET="accept_port=50 ip2nets="tcp0(eth0) 10.0..; o2ib0(ib0) 192.168.20.;; o2ib1(ib1) 192.168.21.;; o2ib2(ib2) 192.168.22.*;" accept=all" MODOPTS_LOV="" MODOPTS_LUSTRE="" MODOPTS_LVFS="" MODOPTS_MDC="" MODOPTS_MGC="" MODOPTS_OBDCLASS="" MODOPTS_OBDECHO="" MODOPTS_OSC="" MODOPTS_PTLRPC="" MODOPTS_PTLRPC_GSS="" FSTYPE=ldiskfs sh -c "PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/sbin:/usr/sbin:/usr/local/sbin:/root/bin:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/X11R6/bin:/usr/games:/usr/lib/mit/bin:/usr/lib/mit/sbin:/opt/sgi/sgimc/bin::/sbin:/bin:/usr/sbin: NAME=ncli sh rpc.sh load_modules_local ")'
pdsh@n006: n009-ib1: ssh exited with exit code 2
n013-ib1: bash: -c: line 0: syntax error near unexpected token `('
n013-ib1: bash: -c: line 0: `(PATH=$PATH:/usr/lib64/lustre/utils:/usr/lib64/lustre/tests:/sbin:/usr/sbin; cd /usr/lib64/lustre/tests; LUSTRE="/usr/lib64/lustre" MODOPTS_FID="" MODOPTS_FLD="" MODOPTS_KSOCKLND="" MODOPTS_LIBCFS="" MODOPTS_LMV="" MODOPTS_LNET="accept_port=50 ip2nets="tcp0(eth0) 10.0..; o2ib0(ib0) 192.168.20.;; o2ib1(ib1) 192.168.21.;; o2ib2(ib2) 192.168.22.*;" accept=all" MODOPTS_LOV="" MODOPTS_LUSTRE="" MODOPTS_LVFS="" MODOPTS_MDC="" MODOPTS_MGC="" MODOPTS_OBDCLASS="" MODOPTS_OBDECHO="" MODOPTS_OSC="" MODOPTS_PTLRPC="" MODOPTS_PTLRPC_GSS="" FSTYPE=ldiskfs sh -c "PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/lib64/lustre/utils:/sbin:/usr/sbin:/usr/local/sbin:/root/bin:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/X11R6/bin:/usr/games:/usr/lib/mit/bin:/usr/lib/mit/sbin:/opt/sgi/sgimc/bin::/sbin:/bin:/usr/sbin: NAME=ncli sh rpc.sh load_modules_local ")'
pdsh@n006: n013-ib1: ssh exited with exit code 2

Comments

[Stephen Champion]

Double quotes in /etc/modprobe.d/Lustre are jacking it up:
options lnet accept_port=50 ip2nets="tcp0(eth0) 10.0..; o2ib0(ib0) 192.168.20.;; o2ib1(ib1) 192.168.21.;; o2ib2(ib2) 192.168.22.*;"

[Stephen Champion]

http://review.whamcloud.com/#/c/11887/

[Peter Jones]

Yu, Jian

Could you please review this patch?

Thanks

Peter

[Stephen Champion]

Testing will need to be restarted after a build problem is fixed. I'm pretty sure that
lbuild: When building a snapshot, a tag name must be used.
is not a failure introduced by this patch.

[Jian Yu]

Hi Stephen,

You created the patch based on Lustre b2_1 branch because the parent commit e91f649c2a41b48f5e480b646d5defe461a93ca1 was the top commit of Lustre b2_1 branch, which caused the build failed. Could you please re-submit the patch based on master branch? Thanks!

[Stephen Champion]

Good Catch. I was looking at b2_1 earlier, and didn't switch back to master before creating my working branch.

Curious that some succeeded.

[Jian Yu]

Here is the back-ported patch for Lustre b2_5 branch: http://review.whamcloud.com/11907

[Peter Jones]

Landed for 2.7