https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-6988 Lustre <p>Panic on MDS while mounting lustre.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>DISKFS-fs (vdb): mounted filesystem with ordered data mode. quota=on. Opts: Lustre: Setting parameter lustre-MDT0000-mdtlov.lov.stripesize in log lustre-MDT0000 Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space Lustre: lustre-MDT0000: new disk, initializing Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400):0:mdt ------------[ cut here ]------------ kernel BUG at block/blk-core.c:2627! invalid opcode: 0000 [#1] SMP Pid: 6022, comm: ldiskfslazyinit Not tainted 2.6.32-431.29.2.el6_lustreb_neo_stable_6698_6 #1 Red Hat KVM RIP: 0010:[&lt;ffffffff812698c2&gt;] [&lt;ffffffff812698c2&gt;] __blk_end_request_all+0x32/0x60 Process ldiskfslazyinit (pid: 6022, threadinfo ffff88011bb80000, task ffff88011933f500) Call Trace: &lt;IRQ&gt; [&lt;ffffffffa005a22a&gt;] blk_done+0x4a/0x110 [virtio_blk] [&lt;ffffffff810ecb14&gt;] ? __rcu_process_callbacks+0x54/0x350 [&lt;ffffffffa004e2ac&gt;] vring_interrupt+0x3c/0xd0 [virtio_ring] [&lt;ffffffff810e7090&gt;] handle_IRQ_event+0x60/0x170 [&lt;ffffffff8107a64f&gt;] ? __do_softirq+0x11f/0x1e0 [&lt;ffffffff810e99ee&gt;] handle_edge_irq+0xde/0x180 [&lt;ffffffff8100faf9&gt;] handle_irq+0x49/0xa0 [&lt;ffffffff81532dbc&gt;] do_IRQ+0x6c/0xf0 [&lt;ffffffff8100b9d3&gt;] ret_from_intr+0x0/0x11 &lt;EOI&gt; [&lt;ffffffff811222e5&gt;] mempool_alloc_slab+0x15/0x20 [&lt;ffffffff81122483&gt;] mempool_alloc+0x63/0x140 [&lt;ffffffff811c4ed2&gt;] bvec_alloc_bs+0xe2/0x110 [&lt;ffffffff811c4fb2&gt;] bio_alloc_bioset+0xb2/0xf0 [&lt;ffffffff811c5095&gt;] bio_alloc+0x15/0x30 [&lt;ffffffff812705a8&gt;] blkdev_issue_zeroout+0x88/0x180 [&lt;ffffffffa02b1c64&gt;] ldiskfs_init_inode_table+0x154/0x290 [ldiskfs] [&lt;ffffffffa02dbdcb&gt;] ldiskfs_lazyinit_thread+0x15b/0x2f0 [ldiskfs] [&lt;ffffffff8109abf6&gt;] kthread+0x96/0xa0 </pre> </div></div> LU-6988

MDS and OST mount crashes with kernel panic

Bug Minor Resolved Duplicate WC Triage Aditya Pandit Wed, 12 Aug 2015 12:10:46 +0000 Mon, 14 Sep 2015 12:17:37 +0000 Mon, 14 Sep 2015 12:17:37 +0000 Lustre 2.8.0 0 5 <p>It looks like this BUG might be:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">void __blk_end_request_all(struct request *rq, <span class="code-object">int</span> error) { bool pending; unsigned <span class="code-object">int</span> bidi_bytes = 0; <span class="code-keyword">if</span> (unlikely(blk_bidi_rq(rq))) bidi_bytes = blk_rq_bytes(rq-&gt;next_rq); pending = __blk_end_bidi_request(rq, error, blk_rq_bytes(rq), bidi_bytes); BUG_ON(pending); } EXPORT_SYMBOL(__blk_end_request_all); </pre> </div></div> <p>The bug is happening during lazy inode table initialization after the initial filesystem format. Could you see if this oops is avoided by formatting the filesystem with "mkfs.lustre --mkfsoptions="-E lazy_itable_init=0"? Are you using any non-default options for formatting or mounting your MDT or OST filesystems? What version of e2fsprogs are you using?</p> <p>What kernel is this? RHEL6.3? Does it happen with the stock Lustre RHEL6.6 kernel? Are there any other kernel or ldiskfs patches applied?</p> <p>e2fsprogs: e2fsprogs-1.42.7.x1.mrp.128-8.el6.src.rpm</p> <p>We have not applied any extra patches.<br/> cat lustre/kernel_patches/series/2.6-rhel6.series <br/> mpt-fusion-max-sge-rhel6.patch<br/> raid5-mmp-unplug-dev-rhel6.patch<br/> dev_read_only-2.6.32-rhel6.patch<br/> blkdev_tunables-2.6-rhel6.patch<br/> bh_lru_size_increase.patch<br/> quota-replace-dqptr-sem.patch<br/> quota-avoid-dqget-calls.patch<br/> jbd2-log_wait_for_space-2.6-rhel6.patch<br/> module-load-deadlock-rhel6.patch</p> <p>We haven't used any non-standard option for formatting and mounting. </p> <p>It is Scientific Linux release 6.5 (Carbon)</p> <p>There are no extra kernel or ldiskfs patches applied.</p> <p>Will try with RHEL 6.6 and stock kernel and let you know the results.</p> <p>I tried it on stock kernel with lustre patches it is crashed there also.</p> <p>kernel BUG at block/blk-core.c:2627!<br/> invalid opcode: 0000 1 SMP <br/> last sysfs file: /sys/devices/system/cpu/online<br/> CPU 1 <br/> Modules linked in: osp(U) mdd(U) lod(U) mdt(U) lfsck(U) mgs(U) mgc(U) osd_ldiskfs(U) lquota(U) lustre(U) lov(U) mdc(U) fid(U) lmv(U) fld(U) ksocklnd(U) ptlrpc(U) obdclass(U) lnet(U) sha512_generic sha256_generic libcfs(U) ldiskfs(U) nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipt_REJECT ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter ip6_tables ipv6 virtio_balloon virtio_net i2c_piix4 i2c_core ext4 jbd2 mbcache virtio_blk virtio_pci virtio_ring virtio pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod <span class="error">&#91;last unloaded: nf_defrag_ipv4&#93;</span><br/> Pid: 0, comm: swapper Not tainted 2.6.32-431.29.2.el6_lustremaster_master__57 #1 Red Hat KVM</p> <p>I have not seen on Oracle VirtualBox.</p> <p>This bug is duplicate of <a href="https://jira.hpdd.intel.com/browse/LU-6974" class="external-link" target="_blank" rel="nofollow noopener">https://jira.hpdd.intel.com/browse/LU-6974</a>.</p> <p>ok. I will close the ticket as a duplicate. Thanks for letting us know.</p> Development Rank 1|hzxkaf: Rank (Obsolete) 9223372036854775807 Severity