https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-8799 Lustre <p>All files on soak are created by userid 'soaktest'<br/> Sequence of failures: <br/> Mdtest started on 5 clients, job output:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">mkdir: cannot create directory `/mnt/soaked/soaktest/test/mdtestfpp/670897': File exists unable to open <span class="code-quote">'/mnt/soaked/soaktest/test/mdtestfpp/670897'</span>: Permission denied (13) error: setstripe: create file <span class="code-quote">'/mnt/soaked/soaktest/test/mdtestfpp/670897'</span> failed: Permission denied error opening /mnt/soaked/soaktest/test/mdtestfpp/670897: Permission denied (13) llapi_semantic_traverse: Failed to open <span class="code-quote">'/mnt/soaked/soaktest/test/mdtestfpp/670897'</span>: Permission denied (13) error: getstripe failed <span class="code-keyword">for</span> /mnt/soaked/soaktest/test/mdtestfpp/670897. error opening /mnt/soaked/soaktest/test/mdtestfpp/670897: Permission denied (13) llapi_semantic_traverse: Failed to open <span class="code-quote">'/mnt/soaked/soaktest/test/mdtestfpp/670897'</span>: Permission denied (13) error: getdirstripe failed <span class="code-keyword">for</span> /mnt/soaked/soaktest/test/mdtestfpp/670897. error opening /mnt/soaked/soaktest/test/mdtestfpp/670897: Permission denied (13) llapi_semantic_traverse: Failed to open <span class="code-quote">'/mnt/soaked/soaktest/test/mdtestfpp/670897'</span>: Permission denied (13) error: getdirstripe failed <span class="code-keyword">for</span> /mnt/soaked/soaktest/test/mdtestfpp/670897. </pre> </div></div> <p>attempting to do an 'ls' of the directory as user 'soak test'</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">[soaktest@lola-17 ~]$ ls -l /mnt/soaked/soaktest/test/mdtestfpp/ ls: cannot access /mnt/soaked/soaktest/test/mdtestfpp/670766: Permission denied ls: cannot access /mnt/soaked/soaktest/test/mdtestfpp/670897: Permission denied ls: cannot access /mnt/soaked/soaktest/test/mdtestfpp/670917: Permission denied ls: cannot access /mnt/soaked/soaktest/test/mdtestfpp/670877: Permission denied ls: cannot access /mnt/soaked/soaktest/test/mdtestfpp/670845: Permission denied ls: cannot access /mnt/soaked/soaktest/test/mdtestfpp/670674: Permission denied ls: cannot access /mnt/soaked/soaktest/test/mdtestfpp/670905: Permission denied ls: cannot access /mnt/soaked/soaktest/test/mdtestfpp/670894: Permission denied total 20 drwxr-xr-x 3 soaktest soaktest 8192 Nov 3 12:24 670670 d????????? ? ? ? ? ? 670674 drwxr-xr-x 3 soaktest soaktest 4096 Nov 3 12:26 670729 drwxr-xr-x 3 soaktest soaktest 4096 Nov 3 12:26 670731 drwxr-xr-x 3 soaktest soaktest 4096 Nov 3 12:26 670749 d????????? ? ? ? ? ? 670766 d????????? ? ? ? ? ? 670845 d????????? ? ? ? ? ? 670877 d????????? ? ? ? ? ? 670894 d????????? ? ? ? ? ? 670897 d????????? ? ? ? ? ? 670905 d????????? ? ? ? ? ? 670917 </pre> </div></div> Soak, version=lustre: 2.8.59_79_gb8811a0 LU-8799

User cannot access directories created by user

Bug Blocker Resolved Fixed Oleg Drokin Cliff White soak Thu, 3 Nov 2016 19:58:05 +0000 Fri, 4 Nov 2016 21:45:27 +0000 Fri, 4 Nov 2016 21:45:27 +0000 Lustre 2.9.0 0 8 <p>Client side errors:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">lola-17.log:Nov 3 12:43:17 lola-17 kernel: LustreError: 56983:0:(llite_lib.c:2300:ll_prep_inode()) new_inode -fatal: rc -13 lola-17.log:Nov 3 12:43:17 lola-17 kernel: LustreError: 56983:0:(llite_lib.c:2300:ll_prep_inode()) Skipped 47 previous similar messages lola-19.log:Nov 3 12:43:17 lola-19 kernel: LustreError: 25964:0:(llite_lib.c:2300:ll_prep_inode()) new_inode -fatal: rc -13 lola-19.log:Nov 3 12:43:17 lola-19 kernel: LustreError: 25964:0:(llite_lib.c:2300:ll_prep_inode()) Skipped 1 previous similar message lola-25.log:Nov 3 12:43:19 lola-25 kernel: LustreError: 6420:0:(llite_lib.c:2300:ll_prep_inode()) new_inode -fatal: rc -13 lola-25.log:Nov 3 12:43:19 lola-25 kernel: LustreError: 6420:0:(llite_lib.c:2300:ll_prep_inode()) Skipped 3 previous similar messages </pre> </div></div> <p>During the test period (short) <br/> 213 tests ran without errors, created directories/files correctly.<br/> 51 tests failed. with the above errors.</p> <p>The error is also oddly transient.<br/> ls -l as soak test from a single client will fail repeatedly with permission errors, then will work. </p> <p>And also for some failed directories, once we change to "root", it will work again. And also it seems all of "-13" failures on MDS comes from permission check. I wonder if this is related with those patches from <a href="https://jira.whamcloud.com/browse/LU-3289" title="IU Shared Secret Key authentication and encryption" class="issue-link" data-issue-key="LU-3289"><del>LU-3289</del></a>? Could some security experts to have a look? </p> <p>The problem is a configuration issue.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">[root@lola-11 ~]# id soaktest id: soaktest: No such user ... [root@lola-9 ~]# id soaktest uid=539(soaktest) gid=539(soaktest) groups=539(soaktest) </pre> </div></div> <p>So basically every time you try to acess this "unknownuser-owned" dir you get permission denied.</p> <p>there's the telltale stuff in /var/log/secure too (hinted by John to check there):</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">Nov 4 11:20:11 lola-11 l_getidentity[9316]: no such user 539 Nov 4 11:20:11 lola-11 l_getidentity[9316]: partial write ret -1: Invalid argument </pre> </div></div> <p>Apparently when lola-11 was re-imaged, the users were not set up correctly. <br/> Have filed DCO-6238, will address. </p> <p>YP was not setup when lola-11 was re-installed, fixed</p> <p>System issue - YPbind not setup </p> Related Development Rank 1|hzyuen: Rank (Obsolete) 9223372036854775807 Severity