https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-9052 Lustre <p>We just unleashed users on our new Lustre 2.8 DNE1 filesystem. Some users are migrating data from older Lustre 2.5 filesystems. I started seeing messages like these on an MDT:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>Jan 25 12:56:45 zinc1 kernel: LustreError: 98053:0:(lod_object.c:1370:lod_verify_md_striping()) lsh-MDT0000-mdtlov: invalid lmv_user_md: magic = cd20cd0, stripe_offset = 4, stripe_count = 1: rc = -22 Jan 25 12:56:45 zinc1 kernel: LustreError: 98053:0:(lod_object.c:1370:lod_verify_md_striping()) Skipped 6 previous similar messages </pre> </div></div> <p>I haven't yet tracked down what client-side process is producing these. I notice the magic value  reported in the message (0x0CD20CD0) is <tt>LMV_MAGIC_V1</tt> and that message is produced when the <tt>lum-&gt;lum_magic != LMV_USER_MAGIC</tt> (0x0CD30CD0). My hunch is that this is related to users copying files that have their striping layouts stored in v1 format from the older 2.5 filesystems. However I haven't been able to reproduce it that way myself.</p> <a href="ssh://review.whamcloud.com/fs/lustre-release-fe-llnl">ssh://review.whamcloud.com/fs/lustre-release-fe-llnl</a> LU-9052

lod_verify_md_striping()) lsh-MDT0000-mdtlov: invalid lmv_user_md: magic = cd20cd0

Bug Minor Resolved Fixed Di Wang Ned Bass llnl Wed, 25 Jan 2017 21:50:12 +0000 Fri, 2 Feb 2018 18:28:51 +0000 Wed, 22 Nov 2017 14:48:22 +0000 Lustre 2.8.0 Lustre 2.9.0 Lustre 2.11.0 Lustre 2.10.4 0 4 <p>These fail magic number should not come from the old data, i.e. it has to come from client. I assume all clients are 2.8 now? Is that possible those application still use the old lustre user lib? then they need rebuild their application. </p> <blockquote><p>I assume all clients are 2.8 now?</p></blockquote> <p>Hi Di. No, there are also some 2.5 clients. Our data transfer nodes are running Lustre 2.5 and mount both the new 2.8 filesystem and the older 2.5 filesystems. That is where users can move their data between filesystems.</p> <blockquote><p>Is that possible those application still use the old lustre user lib? then they need rebuild their application.</p></blockquote> <p>I tried creating a file on the new filesystem with the 2.5 version of liblustreapi but it doesn't reproduce the error.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>I tried creating a file on the new filesystem with the 2.5 version of liblustreapi but it doesn't reproduce the error. </pre> </div></div> <p>you mean create a striped directory from 2.5 client to a 2.8 MDSs? Hmm, in 2.5, it still use #define LMV_USER_MAGIC 0x0CD20CD0 /<b>default lmv magic</b>/, if you tried to create a striped directory with old liblustreapi, it may cause this failure. </p> <blockquote><p>you mean create a striped directory from 2.5 client to a 2.8 MDSs?</p></blockquote> <p>No, I just used the example program from the <tt>llapi_file_open()</tt> man page to create a file in an existing directory. Note that we're using DNE1, so all our remote directories have a stripe count of 1.</p> <p>Ah, you're right. This seems to be coming from <tt>lfs mkdir</tt> on the 2.5 client. We have an automated process that creates user directories when new users are added. Despite the error the user directory still gets created with the requested MDT index. Would it be safe for lod_verify_md_striping() to accept the V1 magic so we don't see this error all the time?</p> <p>Ned, ah, yes, this check will only be used in create striped directory process (lod_ah_init()), which is a void function. That is why it did not return invalid for lfs mkdir. Yes, it should be safe to also accept V1 user magic. I will cook the patch. Thanks.</p> <p>wangdi (di.wang@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/25091" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/25091</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9052" title="lod_verify_md_striping()) lsh-MDT0000-mdtlov: invalid lmv_user_md: magic = cd20cd0" class="issue-link" data-issue-key="LU-9052"><del>LU-9052</del></a> lod: accept lfs mkdir from old client<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: 1<br/> Commit: 7740f547ad9cce8bc2552ca7f1499ccd4266a2bd</p> <p>Oleg Drokin (oleg.drokin@intel.com) merged in patch <a href="https://review.whamcloud.com/25091/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/25091/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9052" title="lod_verify_md_striping()) lsh-MDT0000-mdtlov: invalid lmv_user_md: magic = cd20cd0" class="issue-link" data-issue-key="LU-9052"><del>LU-9052</del></a> lod: accept lfs mkdir from old client<br/> Project: fs/lustre-release<br/> Branch: master<br/> Current Patch Set: <br/> Commit: 069f593572509d6ee285ba6ea8950101ccb62d72</p> <p>Landed for 2.11</p> <p>Minh Diep (minh.diep@intel.com) uploaded a new patch: <a href="https://review.whamcloud.com/30542" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/30542</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9052" title="lod_verify_md_striping()) lsh-MDT0000-mdtlov: invalid lmv_user_md: magic = cd20cd0" class="issue-link" data-issue-key="LU-9052"><del>LU-9052</del></a> lod: accept lfs mkdir from old client<br/> Project: fs/lustre-release<br/> Branch: b2_10<br/> Current Patch Set: 1<br/> Commit: 58b021215cdd6be263a608faf60a18f7819b63f9</p> <p>John L. Hammond (john.hammond@intel.com) merged in patch <a href="https://review.whamcloud.com/30542/" class="external-link" target="_blank" rel="nofollow noopener">https://review.whamcloud.com/30542/</a><br/> Subject: <a href="https://jira.whamcloud.com/browse/LU-9052" title="lod_verify_md_striping()) lsh-MDT0000-mdtlov: invalid lmv_user_md: magic = cd20cd0" class="issue-link" data-issue-key="LU-9052"><del>LU-9052</del></a> lod: accept lfs mkdir from old client<br/> Project: fs/lustre-release<br/> Branch: b2_10<br/> Current Patch Set: <br/> Commit: 8a760d5ef83a5fb697a61ff38f7182f8a50968d8</p> Related Development Rank 1|hzz1qn: Rank (Obsolete) 9223372036854775807 Severity