https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-4673 Lustre <p>I try to execute the executable "sqlplus" on lustre filesystem,but i have this issue:</p> <p>$ sqlplus</p> <p>-bash: /home/opt/oracle/app/ora11g/product/11.2.0.3/client_1/bin/sqlplus: Permission denied</p> <p>The executable has these permissions : </p> <p>ls -l /home/opt/oracle/app/ora11g/product/11.2.0.3/client_1/bin/sqlplus</p> <p><del>rwxr-x</del>-x 1 ora11g dba 9221 Sep 24 14:57 /home/opt/oracle/app/ora11g/product/11.2.0.3/client_1/bin/sqlplus</p> <p>If i add the "read" permission to "other" the executable work.</p> System Red Hat Enterprise Linux Server release 5.7 (Tikanga)<br/> <br/> kernel 2.6.18-348.3.1.el5<br/> <br/> lustre-client-modules-1.8.9-2.6.18_348.3.1.el5_g7880158<br/> lustre-client-1.8.9-2.6.18_348.3.1.el5_g7880158<br/> LU-4673

Permission denied executing --x executable

Bug Major Resolved Incomplete Emoly Liu Supporto Lustre Jnet2000 Wed, 26 Feb 2014 10:56:43 +0000 Thu, 29 Jan 2015 00:29:23 +0000 Thu, 29 Jan 2015 00:29:23 +0000 0 5 <p>Emoly</p> <p>Could you please assist with this issue?</p> <p>Thanks</p> <p>Peter</p> <p>Hi Jnet2000,</p> <p>Do you run sqlplus as an Oracle user? Could you please run "which sqlplus" to see if $PATH is set correctly? And if possible, please post the corresponding lustre log here when this problem happens again.</p> <p>Thanks.</p> <p>i can run the sqlplus command and the path is correct, when i have the problem "permission denied" on the host, i haven't log on the client and i haven't log on the server.</p> <p>regards</p> <p>You can get the lustre logs by setting parameters debug and debug_mb before running the sqlplus command, like this<br/> #lctl set_param debug=-1<br/> #lctl set_param debug_mb=150</p> <p>Then, run sqlplus, and after that, collect the logs by running the following command<br/> #lctl dk &gt; logfile</p> <p>Could you please upload the logs here if you can get anything? Thanks.</p> <p>We attached the logfile as requested.<br/> Regards</p> <p>Any news ?</p> <p>regards</p> <p>This client side log includes almost five months data. I should have suggested to do a "lctl dk" before running sqlplus.</p> <p>I saw the following error many times.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>(mdc_locks.c:845:mdc_finish_intent_lock()) D_IT dentry sqlplus intent: open status -13 disp 240002b rc 0 </pre> </div></div> <p>If possible, could you please upload the server side log as well? Thanks</p> <p>I attached the log files requested. Before collecting them i issue the lctl flush command</p> <p>the problem occurs with every executables that have the o=x permission </p> <p><span class="error">&#91;b487000@osiride-lp-032 ~&#93;</span>$ ls -l bash<br/> <del>rwxr-x</del>-x 1 root root 801528 May 13 2011 bash<br/> <span class="error">&#91;b487000@osiride-lp-032 ~&#93;</span>$ ./bash</p> <p>in another window</p> <p><span class="error">&#91;b487000@osiride-lp-032 ~&#93;</span>$ ./bash<br/> -bash: ./bash: Permission denied</p> <p>The server log showed that the mds didn't get the intent lock req@ffff81083d2f1000 sent by client, and as you said, all the executables can't be run, so I suspect this problem is related to flock. </p> <p>By default, the flock utility is disabled. So could you please try to remount client with option "-o flock" and see what will happen?</p> <p>Thanks.</p> <p>the flock option is already enabled</p> <p><span class="error">&#91;b487000@osiride-lp-032 ~&#93;</span>$ cat /etc/lustre.conf<br/> #############################################################################</p> <ol> <li> <ol> <li> <ol> <li> <ol> <li> <ol> <li>#####</li> <li>OSIRIDE #####</li> <li>#####</li> <li>Do not manually modify this file (it will be overwritten) #####<br/> #############################################################################<br/> LUSTRE="TEST"<br/> SLP_INIT=10<br/> SLP_ERR=30<br/> MGS_PRI=10.121.14.38<br/> MGS_SEC=10.121.14.69<br/> FILESYSTEM="/home"<br/> OPTIONS="flock,user_xattr"</li> </ol> </li> </ol> </li> </ol> </li> </ol> </li> </ol> <p>Hi, can you run the following command to see group_upcall value and paste it here,<br/> #lctl get_param mds.*.group_upcall</p> <p>and also paste the result of "getfacl sqlplus"?</p> <p>Thanks</p> <p><span class="error">&#91;wisi281@osiride-lp-034 ~&#93;</span>$ sudo /usr/sbin/lctl get_param mds.*.group_upcall<br/> mds.home-MDT0000.group_upcall=/usr/sbin/l_getgroups</p> <p><span class="error">&#91;wisi281@osiride-lp-032 bin&#93;</span>$ sudo getfacl sqlplus</p> <ol> <li>file: sqlplus</li> <li>owner: ora11g</li> <li>group: dba<br/> user::rwx<br/> group::r-x<br/> other::--x</li> </ol> <p>regards</p> <p>Since the server side log is not complete, I tried to reproduce this problem by running an executable file without read permission on NFS lustre client. Fortunately, I hit it.</p> <p>It shows that we need read permission to run an executable file. So can you run "id" command to see if the user which has permission issue to run sqlplus belongs to group "dba"?</p> <p>It's simple to verify this "o-r" by the following example:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[root@centos6-2 liuy]# cat foo.sh #!/bin/sh echo "test permission" ls -al * [root@centos6-2 liuy]# chmod o-r foo.sh [root@centos6-2 liuy]# getfacl foo.sh # file: foo.sh # owner: root # group: root user::rwx group::r-x other::--x [root@centos6-2 liuy]# ./foo.sh test permission -rwxr-x--x 1 root root 42 Mar 28 23:55 foo.sh -rwxr-x--x 1 root root 7296 Mar 28 23:36 teststat [root@centos6-2 liuy]# su - liuy [liuy@centos6-2 ~]$ id uid=500(liuy) gid=500(liuy) groups=500(liuy) [liuy@centos6-2 ~]$ ./foo.sh /bin/sh: ./foo.sh: Permission denied </pre> </div></div> <p>The r attribute is necessary to run bash script, for the binary this is not true.</p> <p><span class="error">&#91;b487000@osiride-lp-002 bin&#93;</span>$ ls -l bash<br/> --<del>x</del><del>x</del>-x 1 b487000 b487000 801528 Apr 2 11:42 bash<br/> <span class="error">&#91;b487000@osiride-lp-002 bin&#93;</span>$ ./bash</p> <p><span class="error">&#91;b487000@osiride-lp-002 bin&#93;</span>$ ls -l generate_lamp_packages.sh<br/> --<del>x</del><del>x</del>-x 1 b487000 b487000 866 Sep 19 2011 generate_lamp_packages.sh<br/> <span class="error">&#91;b487000@osiride-lp-002 bin&#93;</span>$ ./generate_lamp_packages.sh<br/> /bin/bash: ./generate_lamp_packages.sh: Permission denied</p> <p>Why the server log is incomplete ? We follow your instructions. </p> <p>regards</p> <p>Yes, scripts must be readable and executable but compiled programs need only be executable.</p> <p>I want to check "id" and "r" attribute because the previous comments said:</p> <blockquote> <p>The executable has these permissions :<br/> ls -l /home/opt/oracle/app/ora11g/product/11.2.0.3/client_1/bin/sqlplus<br/> rwxr-x-x 1 ora11g dba 9221 Sep 24 14:57 /home/opt/oracle/app/ora11g/product/11.2.0.3/client_1/bin/sqlplus<br/> If i add the "read" permission to "other" the executable work.</p></blockquote> <blockquote> <p>the problem occurs with every executables that have the o=x permission<br/> <span class="error">&#91;b487000@osiride-lp-032 ~&#93;</span>$ ls -l bash<br/> rwxr-x-x 1 root root 801528 May 13 2011 bash<br/> <span class="error">&#91;b487000@osiride-lp-032 ~&#93;</span>$ ./bash<br/> in another window<br/> <span class="error">&#91;b487000@osiride-lp-032 ~&#93;</span>$ ./bash<br/> -bash: ./bash: Permission denied</p></blockquote> <p>The "id" result will help me make sure if this is a lustre issue.</p> <p>As for server log, the log happened at time 1395299404 was probably flushed if the clock between the client and server is synchronous, because there was nothing useful at that moment, and there was no EACCES(-13) error returned by mds_open(), even no xid=1448864745813986 found, sent by the client.</p> <p>So if possible, could you please set debug_mb to a larger number(lctl set_param debug_mb=1000?), and synchronize the clock between the client and the server, and then collect the logs again?</p> <p>Many thanks.</p> <p>Hello Jnet2000 Support Team,</p> <p>Is there any further way we can help you with this ticket?</p> <p>If not, we would like to mark it as resolved.</p> <p>Many thanks,<br/> ~ jfc.</p> <p>Asked customer for guidance on this ticket on December 18, 2014.</p> <p>Will now mark it as Resolved &#8211; Incomplete.</p> <p>We can re-open the ticket if required.<br/> Thanks,<br/> ~ jfc.</p> Development Rank 1|hzwfx3: Rank (Obsolete) 12812 Severity