https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-3005 Lustre <p>While running mdtest the file system went into read only mode and the file system reported corruption on the MDS. The error is:</p> <p><span class="error">&#91;56736.791445&#93;</span> attempt to access beyond end of device<br/> <span class="error">&#91;56736.804198&#93;</span> md5: rw=0, want=10484831811994872656, limit=282775552<br/> <span class="error">&#91;56736.818141&#93;</span> LDISKFS-fs error (device md5): ldiskfs_xattr_delete_inode: inode 22016621: block 3616446985713053033 read error<br/> <span class="error">&#91;56736.837277&#93;</span> Aborting journal on device md5-8.<br/> <span class="error">&#91;56736.860700&#93;</span> LDISKFS-fs (md5): Remounting filesystem read-only<br/> <span class="error">&#91;56736.881388&#93;</span> LDISKFS-fs error (device md5) in ldiskfs_free_inode: Journal has aborted<br/> <span class="error">&#91;56736.896935&#93;</span> LustreError: 8976:0:(osd_handler.c:636:osd_trans_commit_cb()) transaction @0xffff880414777b80 commit error: 2<br/> <span class="error">&#91;56736.915693&#93;</span> LustreError: 8976:0:(osd_handler.c:636:osd_trans_commit_cb()) transaction @0xffff880113757680 commit error: 2<br/> <span class="error">&#91;56741.072627&#93;</span> LustreError: 9039:0:(llog.c:161:llog_cancel_rec()) lustre-OST0000-osc-MDT0000: fail to write header for llog #0x81#0x1#00000000: rc = -30<br/> <span class="error">&#91;56741.101191&#93;</span> LustreError: 9039:0:(llog_cat.c:535:llog_cat_cancel_records()) lustre-OST0000-osc-MDT0000: fail to cancel 1 of 1 llog-records: rc = -30<br/> <span class="error">&#91;56741.129587&#93;</span> LustreError: 9039:0:(osp_sync.c:720:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: can't cancel record: -30<br/> <span class="error">&#91;56741.156530&#93;</span> LustreError: 9039:0:(llog.c:161:llog_cancel_rec()) lustre-OST0000-osc-MDT0000: fail to write header for llog #0x81#0x1#00000000: rc = -30<br/> <span class="error">&#91;56741.157240&#93;</span> LustreError: 9041:0:(llog_cat.c:535:llog_cat_cancel_records()) lustre-OST0001-osc-MDT0000: fail to cancel 1 of 1 llog-records: rc = -30<br/> <span class="error">&#91;56741.157245&#93;</span> LustreError: 9041:0:(osp_sync.c:720:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: can't cancel record: -30<br/> <span class="error">&#91;56741.241180&#93;</span> LustreError: 9039:0:(llog.c:161:llog_cancel_rec()) Skipped 2 previous similar messages</p> Lustre 2.3.62 running the servers as well as the clients. LU-3005

MDT attempted to access beyond the disk

Bug Blocker Resolved Duplicate Bruno Faccini James A Simmons HB Thu, 21 Mar 2013 13:57:33 +0000 Fri, 22 Mar 2013 13:13:13 +0000 Fri, 22 Mar 2013 13:12:52 +0000 Lustre 2.4.0 0 5 <p>It seems to be WAAAY past the end.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>"md5: rw=0, want=10484831811994872656, limit=282775552" </pre> </div></div> <p>Are there any other relevant md messages in your logs? </p> <p>How often have you seen this?</p> <p>Can you describe your test configuration a bit more? Can you share your mdtest values and mount info? </p> <p>First time today and no other info showed up in the logs. Rebuilt the file system and now it seems to have gone away. I have DDN 9900 attached to 4 OSS. Each OSS has 7 OSTs. The MGS has a simple sata disk and the MDS has a md device. Attached to clients with DDR Inifiniband.</p> <p>Also a debugfs "stat &lt;22016621&gt;" sub-command output run on MDT mounted as ldiskfs could give more infos and help to see if corruption was on-disk or not.</p> <p>This is a duplicate of <a href="https://jira.whamcloud.com/browse/LU-2980" title="sanity.sh test_17b: Read-only file system" class="issue-link" data-issue-key="LU-2980"><del>LU-2980</del></a>. If I encounter this bug again what other data should I get?</p> <p>Let's focus discussion under the original ticket - <a href="https://jira.whamcloud.com/browse/LU-2980" title="sanity.sh test_17b: Read-only file system" class="issue-link" data-issue-key="LU-2980"><del>LU-2980</del></a></p> Duplicate LU-2980 Related LU-2980 Development Rank 1|hzvlun: Rank (Obsolete) 7318 Severity