https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-5228 Lustre <p>When archiving a lot of files at once, the posix copytool can run out of file descriptors.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>... lhsmtool_posix[21880]: cannot open '/vsm/tasfs1/32d7/0000/0400/0000/0002/0000/0x200000400:0x32d7:0x0_tmp' for write: Too many open files (24) lhsmtool_posix[21878]: cannot open '/vsm/tasfs1/32c2/0000/0400/0000/0002/0000/0x200000400:0x32c2:0x0_tmp' for write: Too many open files (24) lhsmtool_posix[21894]: cannot open '/vsm/tasfs1/32d2/0000/0400/0000/0002/0000/0x200000400:0x32d2:0x0_tmp.lov': Too many open files (24) lhsmtool_posix[21894]: cannot save file striping info of '/mnt/tas01/.lustre/fid/0x200000400:0x32d2:0x0' in '/vsm/tasfs1/32d2/0000/0400/0000/0002/0000/0x200000400:0x32d2:0x0_tmp': Too many open files (24) ... </pre> </div></div> <p>The root cause is that there is no limit on the amount of threads created to process each request, which leads to the error.</p> <p>The files in error are also not restarted, and the archive request is drop.</p> <p>In my test, out of 11418 archive request, only 11159 were actually archived. The other requests were dropped.</p> Centos 6.5<br/> Lustre 2.5.56 LU-5228

HSM: posix copytool can (and do) run out of file descriptors

Bug Minor Open Unresolved WC Triage Frank Zago Wed, 18 Jun 2014 18:10:12 +0000 Wed, 18 Jun 2014 18:10:12 +0000 Lustre 2.5.1 0 5 Development Rank 1|hzwpdj: Rank (Obsolete) 14566 Severity