https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-1780 Lustre <p>We've jsut upgraded our lustre servers from RHEL5.2 to RHEL5.4 and oracle lustre version 1.8.5 to whamcloud lustre version 1.8.8. We did not upgrade ofed, so the servers are running the old ofed-1.4.1<br/> The clients are running Centos5.8 with lustre-1.8.8 <br/> when we generate IO to lustre, the OSS servers panic and the console shows :-</p> <p>Kernel BUG at fs/bio.c:222<br/> invalid opcode: 0000 <span class="error">&#91;1&#93;</span> SMP <br/> last sysfs file: /class/infiniband_mad/umad0/port<br/> CPU 2 <br/> Modules linked in: obdfilter(U) fsfilt_ldiskfs(U) ost(U) mgc(U) ldiskfs(U) jbd2(U) crc16(U) lustre(U) lov(U) mdc(U) lquota(U) osc(U) ko2iblnd(U) ptlrpc(U) obdclass(U) lnet(U) lvfs(U) libcfs(U) raid456(U) xor(U) ipmi_devintf(U) ipmi_si(U) ipmi_msghandler(U) deflate(U) zlib_deflate(U) ccm(U) serpent(U) blowfish(U) twofish(U) ecb(U) xcbc(U) crypto_hash(U) cbc(U) md5(U) sha256(U) sha512(U) des(U) aes_generic(U) testmgr_cipher(U) testmgr(U) crypto_blkcipher(U) aes_x86_64(U) ah6(U) ah4(U) esp6(U) xfrm6_esp(U) esp4(U) xfrm4_esp(U) aead(U) crypto_algapi(U) xfrm4_tunnel(U) tunnel4(U) xfrm4_mode_tunnel(U) xfrm4_mode_transport(U) xfrm6_mode_transport(U) xfrm6_mode_tunnel(U) ipcomp(U) ipcomp6(U) xfrm6_tunnel(U) tunnel6(U) af_key(U) autofs4(U) hidp(U) rfcomm(U) l2cap(U) bluetooth(U) lockd(U) sunrpc(U) ib_ipoib(U) ipoib_helper(U) ipv6(U) xfrm_nalgo(U) crypto_api(U) cpufreq_ondemand(U) powernow_k8(U) freq_table(U) mperf(U) rdma_ucm(U) rdma_cm(U) iw_cm(U) ib_addr(U) qlgc_vnic(U) ib_cm(U) ib_sa(U) ib_uverbs(U) ib_umad(U) iw_nes(U) iw_cxgb3(U) cxgb3(U) ib_ipath(U) mlx4_ib(U) mlx4_core(U) loop(U) dm_mirror(U) dm_multipath(U) scsi_dh(U) video(U) backlight(U) sbs(U) power_meter(U) i2c_ec(U) dell_wmi(U) wmi(U) button(U) battery(U) asus_acpi(U) acpi_memhotplug(U) ac(U) parport_pc(U) lp(U) parport(U) joydev(U) ib_mthca(U) tpm_tis(U) tpm(U) k10temp(U) sg(U) hwmon(U) forcedeth(U) amd64_edac_mod(U) ib_mad(U) tpm_bios(U) i2c_nforce2(U) edac_mc(U) i2c_core(U) 8021q(U) pcspkr(U) ib_core(U) dm_raid45(U) dm_message(U) dm_region_hash(U) dm_log(U) dm_mod(U) dm_mem_cache(U) shpchp(U) mptsas(U) mptscsih(U) mptbase(U) scsi_transport_sas(U) sd_mod(U) scsi_mod(U) raid1(U) ext3(U) jbd(U) uhci_hcd(U) ohci_hcd(U) ehci_hcd(U)<br/> Pid: 7206, comm: md12_raid5 Tainted: G ---- 2.6.18-308.4.1.el5_lustre #1<br/> RIP: 0010:<span class="error">&#91;&lt;ffffffff8002dd5b&gt;&#93;</span> <span class="error">&#91;&lt;ffffffff8002dd5b&gt;&#93;</span> bio_put+0xa/0x31<br/> RSP: 0018:ffff81084e347d08 EFLAGS: 00010246<br/> RAX: 0000000000000000 RBX: ffff810436ba6440 RCX: ffff81084e31a910<br/> RDX: ffff810436ba6440 RSI: ffff81045bb32040 RDI: ffff810436ba6440<br/> RBP: ffff81045bb32040 R08: 0000000000000000 R09: 000000000000003e<br/> R10: ffff810854affa00 R11: 0000000000000280 R12: ffff81045bb32000<br/> R13: ffff810854affa00 R14: 00000000ffffffff R15: 0000000000000000<br/> FS: 00002b5d980be6e0(0000) GS:ffff81010f759240(0000) knlGS:00000000f7d798d0<br/> CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b<br/> CR2: 00002b25b3265000 CR3: 0000000437930000 CR4: 00000000000006e0<br/> Process md12_raid5 (pid: 7206, threadinfo ffff81084e346000, task ffff810461e450c0)<br/> Stack: ffffffff80041d34 0000000000000000 ffffffff8892d2ab ffffffffffffffff<br/> 0000000000000000 ffff810475c1bbf0 0000000000000002 0000000000000003<br/> 0000000000000008 0000000000000000 000000000000000a 0000000000000000<br/> Call Trace:<br/> <span class="error">&#91;&lt;ffffffff80041d34&gt;&#93;</span> end_bio_bh_io_sync+0x37/0x3b<br/> <span class="error">&#91;&lt;ffffffff8892d2ab&gt;&#93;</span> :raid456:handle_stripe+0xfd1/0x2549<br/> <span class="error">&#91;&lt;ffffffff8022720c&gt;&#93;</span> bitmap_daemon_work+0x329/0x33c<br/> <span class="error">&#91;&lt;ffffffff8002dee8&gt;&#93;</span> __wake_up+0x38/0x4f<br/> <span class="error">&#91;&lt;ffffffff800a328f&gt;&#93;</span> keventd_create_kthread+0x0/0xc4<br/> <span class="error">&#91;&lt;ffffffff800a328f&gt;&#93;</span> keventd_create_kthread+0x0/0xc4<br/> <span class="error">&#91;&lt;ffffffff8892e97b&gt;&#93;</span> :raid456:raid5d+0x158/0x18b<br/> <span class="error">&#91;&lt;ffffffff8003ab5e&gt;&#93;</span> prepare_to_wait+0x34/0x61<br/> <span class="error">&#91;&lt;ffffffff80223492&gt;&#93;</span> md_thread+0xf8/0x10e<br/> <span class="error">&#91;&lt;ffffffff800a34a7&gt;&#93;</span> autoremove_wake_function+0x0/0x2e<br/> <span class="error">&#91;&lt;ffffffff8022339a&gt;&#93;</span> md_thread+0x0/0x10e<br/> <span class="error">&#91;&lt;ffffffff80032652&gt;&#93;</span> kthread+0xfe/0x132<br/> <span class="error">&#91;&lt;ffffffff8005dfb1&gt;&#93;</span> child_rip+0xa/0x11<br/> <span class="error">&#91;&lt;ffffffff800a328f&gt;&#93;</span> keventd_create_kthread+0x0/0xc4<br/> <span class="error">&#91;&lt;ffffffff80032554&gt;&#93;</span> kthread+0x0/0x132<br/> <span class="error">&#91;&lt;ffffffff8005dfa7&gt;&#93;</span> child_rip+0x0/0x11</p> <p>Code: 0f 0b 68 41 14 2c 80 c2 de 00 eb fe f0 ff 4f 50 0f 94 c0 84 <br/> RIP <span class="error">&#91;&lt;ffffffff8002dd5b&gt;&#93;</span> bio_put+0xa/0x31<br/> RSP &lt;ffff81084e347d08&gt;<br/> &lt;0&gt;Kernel panic - not syncing: Fatal exception</p> Sun Fire X4540, RHEL5.4 LU-1780

OSS kernel panics after upgrade

Bug Critical Resolved Duplicate Oleg Drokin Hellen Wed, 22 Aug 2012 13:13:34 +0000 Mon, 27 Aug 2012 13:32:08 +0000 Mon, 27 Aug 2012 13:32:08 +0000 Lustre 1.8.8 0 2 <p>Oleg is looking into this one</p> <p>This appears to be a duplicate of <a href="https://jira.whamcloud.com/browse/LU-1115" title="software raid6 related BUG in fs/bio.c:222 when raid chunk &gt; 64k" class="issue-link" data-issue-key="LU-1115"><del>LU-1115</del></a>.<br/> Patch here: <a href="http://review.whamcloud.com/#change,2625" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#change,2625</a></p> <p>I've downloaded and installed lustre-source-1.8.8-wc1_2.6.18_308.4.1.el5_lustre.x86_64.rpm on the servers. I've also downloaded the patch<br/> when I try to apply the patch using command ""patch -p0 &lt; /root/patch/make-bi_phys_segments-uint_new-da6629f0219f1731927577548b114fdf391f34aa.patch"" (I'm sitting in /usr/src/lustre-1.8.8) I get the error below. Am I missing something?</p> <p>can't find file to patch at input line 20<br/> Perhaps you used the wrong -p or --strip option?<br/> The text leading up to this was:<br/> --------------------------</p> <div class='table-wrap'> <table class='confluenceTable'><tbody> <tr> <td class='confluenceTd'>From 5b99c2ffa980528a197f26c7d876cceeccce8dd5 Mon Sep 17 00:00:00 2001</td> </tr> <tr> <td class='confluenceTd'>From: Jens Axboe &lt;jens.axboe@oracle.com&gt;</td> </tr> <tr> <td class='confluenceTd'>Date: Fri, 15 Aug 2008 10:56:11 +0200</td> </tr> <tr> <td class='confluenceTd'>Subject: <span class="error">&#91;PATCH&#93;</span> block: make bi_phys_segments an unsigned int instead of</td> </tr> <tr> <td class='confluenceTd'> short</td> </tr> <tr> </tr> <tr> <td class='confluenceTd'>raid5 can overflow with more than 255 stripes, and we can increase it</td> </tr> <tr> <td class='confluenceTd'>to an int for free on both 32 and 64-bit archs due to the padding.</td> </tr> <tr> </tr> <tr> <td class='confluenceTd'>Signed-off-by: Jens Axboe &lt;jens.axboe@oracle.com&gt;</td> </tr> <tr> <td class='confluenceTd'>&#8212;</td> </tr> <tr> <td class='confluenceTd'> drivers/md/raid5.c </td> <td class='confluenceTd'> 12 ++++++------</td> </tr> <tr> <td class='confluenceTd'> include/linux/bio.h </td> <td class='confluenceTd'> 2 +-</td> </tr> <tr> <td class='confluenceTd'> 2 files changed, 7 insertions<img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/add.png" height="16" width="16" align="absmiddle" alt="" border="0"/>, 7 deletions<img class="emoticon" src="https://jira.whamcloud.com/images/icons/emoticons/forbidden.png" height="16" width="16" align="absmiddle" alt="" border="0"/></td> </tr> <tr> </tr> <tr> <td class='confluenceTd'>diff --git a/drivers/md/raid5.c b/drivers/md/raid5.c</td> </tr> <tr> <td class='confluenceTd'>index 05b2292..37e5465 100644</td> </tr> <tr> <td class='confluenceTd'>&#8212; a/drivers/md/raid5.c</td> </tr> <tr> <td class='confluenceTd'>+++ b/drivers/md/raid5.c<br/> --------------------------<br/> File to patch:</td> </tr> </tbody></table> </div> <p>Looks like you have extracted the patch from the patch already and have linux kernel patch at hand, so you nee to apply it to your kernel, not to lustre sources.</p> <p>I've downloaded the kernel-src and now trying to patch the kernel. I'm following instructions on <a href="http://wiki.whamcloud.com/display/PUB/Walk-thru-+Build+Lustre+1.8+on+CentOS+5.5+or+5.6+from+Whamcloud+git" class="external-link" target="_blank" rel="nofollow noopener">http://wiki.whamcloud.com/display/PUB/Walk-thru-+Build+Lustre+1.8+on+CentOS+5.5+or+5.6+from+Whamcloud+git</a></p> <p>when I get to quilt push -av it fails when it attempts to patch patches/raid5-zerocopy-rhel5.patch.<br/> Any idea why?</p> <p>Applying patch patches/sd_iostats-2.6-rhel5.patch<br/> patching file drivers/scsi/Kconfig<br/> Hunk #1 succeeded at 84 (offset 6 lines).<br/> patching file drivers/scsi/scsi_proc.c<br/> patching file drivers/scsi/sd.c<br/> Hunk #1 succeeded at 62 (offset -1 lines).<br/> Hunk #2 succeeded at 185 (offset 1 line).<br/> Hunk #3 succeeded at 617 (offset 37 lines).<br/> Hunk #4 succeeded at 1073 (offset -3 lines).<br/> Hunk #5 succeeded at 1805 (offset 29 lines).<br/> Hunk #6 succeeded at 1846 (offset -3 lines).<br/> Hunk #7 succeeded at 2256 (offset 29 lines).<br/> Hunk #8 succeeded at 2341 (offset 38 lines).<br/> Hunk #9 succeeded at 2343 (offset 29 lines).<br/> Hunk #10 succeeded at 2377 (offset 38 lines).</p> <p>Applying patch patches/export_symbol_numa-2.6-fc5.patch<br/> patching file arch/i386/kernel/smpboot.c<br/> Hunk #1 succeeded at 627 (offset 48 lines).</p> <p>Applying patch patches/blkdev_tunables-2.6-rhel5.patch<br/> patching file include/linux/blkdev.h<br/> Hunk #1 succeeded at 811 (offset 23 lines).<br/> patching file include/scsi/scsi_host.h<br/> patching file drivers/scsi/lpfc/lpfc.h<br/> Hunk #1 succeeded at 42 with fuzz 2 (offset 4 lines).</p> <p>Applying patch patches/jbd-stats-2.6-rhel5.patch<br/> patching file include/linux/jbd.h<br/> patching file fs/jbd/transaction.c<br/> patching file fs/jbd/journal.c<br/> Hunk #2 succeeded at 641 (offset 2 lines).<br/> Hunk #4 succeeded at 1023 (offset 2 lines).<br/> Hunk #6 succeeded at 1478 (offset 10 lines).<br/> Hunk #7 succeeded at 2323 (offset 6 lines).<br/> Hunk #8 succeeded at 2412 (offset 10 lines).<br/> Hunk #9 succeeded at 2420 (offset 6 lines).<br/> patching file fs/jbd/checkpoint.c<br/> patching file fs/jbd/commit.c<br/> Hunk #3 succeeded at 303 (offset 13 lines).<br/> Hunk #5 succeeded at 425 (offset 13 lines).<br/> Hunk #7 succeeded at 662 (offset 13 lines).<br/> Hunk #8 succeeded at 854 (offset 5 lines).<br/> Hunk #9 succeeded at 939 (offset 13 lines).</p> <p>Applying patch patches/raid5-stats-rhel5.patch<br/> patching file drivers/md/raid5.c<br/> Hunk #1 succeeded at 149 (offset 34 lines).<br/> Hunk #3 succeeded at 348 (offset 34 lines).<br/> Hunk #5 succeeded at 684 (offset 33 lines).<br/> Hunk #7 succeeded at 1730 (offset 33 lines).<br/> Hunk #9 succeeded at 1920 (offset 35 lines).<br/> Hunk #11 succeeded at 1973 (offset 35 lines).<br/> Hunk #13 succeeded at 2312 (offset 35 lines).<br/> Hunk #15 succeeded at 2497 (offset 35 lines).<br/> Hunk #17 succeeded at 2569 (offset 35 lines).<br/> Hunk #19 succeeded at 2683 (offset 35 lines).<br/> Hunk #20 succeeded at 2760 with fuzz 2.<br/> Hunk #21 succeeded at 3059 (offset 37 lines).<br/> Hunk #22 succeeded at 3421 (offset 2 lines).<br/> patching file include/linux/raid/raid5.h</p> <p>Applying patch patches/raid5-configurable-cachesize-rhel5.patch<br/> patching file drivers/md/raid5.c<br/> Hunk #2 succeeded at 3269 (offset 39 lines).<br/> Hunk #3 succeeded at 3826 (offset 5 lines).</p> <p>Applying patch patches/raid5-large-io-rhel5.patch<br/> patching file drivers/md/raid5.c<br/> Hunk #1 succeeded at 3379 (offset 39 lines).</p> <p>Applying patch patches/raid5-stripe-by-stripe-handling-rhel5.patch<br/> patching file drivers/md/raid5.c<br/> Hunk #1 succeeded at 2661 (offset 35 lines).<br/> Hunk #3 succeeded at 2725 with fuzz 2 (offset 35 lines).<br/> Hunk #4 succeeded at 3511 (offset 4 lines).<br/> patching file include/linux/raid/raid5.h</p> <p>Applying patch patches/raid5-merge-ios-rhel5.patch<br/> patching file drivers/md/raid5.c<br/> Hunk #1 succeeded at 1310 (offset 33 lines).<br/> Hunk #3 succeeded at 1993 (offset 35 lines).<br/> Hunk #5 succeeded at 2557 (offset 35 lines).<br/> Hunk #7 succeeded at 2732 (offset 35 lines).<br/> Hunk #9 succeeded at 2820 (offset 35 lines).<br/> Hunk #11 succeeded at 2851 (offset 35 lines).<br/> Hunk #13 succeeded at 2889 with fuzz 2 (offset 35 lines).<br/> Hunk #14 succeeded at 3074 (offset 2 lines).<br/> Hunk #15 succeeded at 3163 (offset 35 lines).</p> <p>Applying patch patches/raid5-zerocopy-rhel5.patch<br/> patching file drivers/md/raid5.c<br/> Hunk #1 succeeded at 667 (offset 34 lines).<br/> Hunk #3 succeeded at 951 (offset 34 lines).<br/> Hunk #5 succeeded at 1115 (offset 34 lines).<br/> Hunk #7 succeeded at 1247 (offset 34 lines).<br/> Hunk #9 succeeded at 1752 (offset 34 lines).<br/> Hunk #10 succeeded at 1727 with fuzz 1.<br/> Hunk #11 succeeded at 2127 (offset 36 lines).<br/> Hunk #13 succeeded at 2351 with fuzz 1 (offset 36 lines).<br/> Hunk #15 succeeded at 3633 with fuzz 1 (offset 38 lines).<br/> patching file include/linux/backing-dev.h<br/> Hunk #1 FAILED at 48.<br/> Hunk #2 succeeded at 100 with fuzz 2 (offset 5 lines).<br/> 1 out of 2 hunks FAILED &#8211; rejects in file include/linux/backing-dev.h<br/> patching file include/linux/page-flags.h<br/> Hunk #2 succeeded at 285 (offset 1 line).<br/> patching file include/linux/raid/raid5.h<br/> patching file mm/filemap.c<br/> Hunk #2 FAILED at 568.<br/> 1 out of 2 hunks FAILED &#8211; rejects in file mm/filemap.c<br/> Restoring drivers/md/raid5.c<br/> Restoring include/linux/raid/raid5.h<br/> Restoring include/linux/page-flags.h<br/> Restoring include/linux/backing-dev.h<br/> Restoring mm/filemap.c<br/> Patch patches/raid5-zerocopy-rhel5.patch does not apply (enforce with -f)<br/> Restoring drivers/md/raid5.c<br/> Restoring include/linux/raid/raid5.h<br/> Restoring include/linux/page-flags.h<br/> Restoring include/linux/backing-dev.h<br/> Restoring mm/filemap.c</p> <p>I'm using linux-2.6.18-308.4.1.el5.x86_64 , which kernel was the patch created for?</p> <p>Are you sure you have the source versions you say? I installed the following 2 src rpms:</p> <p>kernel-2.6.18-308.4.1.el5.src.rpm (from vault.centos.org)<br/> lustre-1.8.8-wc1_2.6.18_308.4.1.el5_lustre.src.rpm (from downloads.whamcloud.com)</p> <p>After setting up the patches &amp; series symlinks as described in <a href="http://wiki.whamcloud.com/display/PUB/Walk-thru-+Build+Lustre+1.8+on+CentOS+5.5+or+5.6+from+Whamcloud+git" class="external-link" target="_blank" rel="nofollow noopener">http://wiki.whamcloud.com/display/PUB/Walk-thru-+Build+Lustre+1.8+on+CentOS+5.5+or+5.6+from+Whamcloud+git</a> the patch series applied just fine for me:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[build@centos50 linux-2.6.18-308.4.1.el5.x86_64]$ quilt push -av Applying patch patches/lustre_version.patch patching file include/linux/lustre_version.h Applying patch patches/vfs_races-2.6-rhel5.patch patching file fs/dcache.c Hunk #2 succeeded at 1603 (offset 196 lines). Hunk #3 succeeded at 1562 (offset 66 lines). patching file include/linux/dcache.h Hunk #1 succeeded at 189 (offset 12 lines). Hunk #2 succeeded at 258 (offset 3 lines). Hunk #3 succeeded at 303 (offset 12 lines). Applying patch patches/i_filter_data.patch patching file include/linux/fs.h Hunk #1 succeeded at 663 (offset 83 lines). Applying patch patches/jbd-jcberr-2.6.18-vanilla.patch patching file include/linux/jbd.h Hunk #1 succeeded at 359 (offset 3 lines). Hunk #3 succeeded at 414 (offset 3 lines). Hunk #5 succeeded at 593 (offset 3 lines). patching file fs/jbd/checkpoint.c Hunk #1 succeeded at 713 (offset 25 lines). patching file fs/jbd/commit.c Hunk #1 succeeded at 772 (offset 64 lines). patching file fs/jbd/journal.c patching file fs/jbd/transaction.c Hunk #3 succeeded at 1335 (offset 41 lines). Applying patch patches/export_symbols-2.6.12.patch patching file fs/dcache.c Hunk #1 succeeded at 2182 (offset 601 lines). Applying patch patches/dev_read_only-2.6.18-vanilla.patch patching file block/ll_rw_blk.c Hunk #1 succeeded at 3144 (offset 77 lines). Hunk #3 succeeded at 3849 (offset 76 lines). patching file fs/block_dev.c Hunk #1 succeeded at 1145 (offset 86 lines). patching file include/linux/fs.h Hunk #1 succeeded at 1887 (offset 202 lines). Applying patch patches/export-2.6.18-vanilla.patch patching file fs/open.c Hunk #1 succeeded at 855 (offset 47 lines). patching file fs/jbd/journal.c Applying patch patches/export-show_task-2.6.18-vanilla.patch patching file kernel/sched.c Hunk #1 succeeded at 4704 with fuzz 2 (offset 6 lines). Applying patch patches/sd_iostats-2.6-rhel5.patch patching file drivers/scsi/Kconfig patching file drivers/scsi/scsi_proc.c patching file drivers/scsi/sd.c Hunk #2 succeeded at 184 (offset 1 line). Hunk #4 succeeded at 1110 (offset 10 lines). Hunk #5 succeeded at 1792 (offset -4 lines). Hunk #6 succeeded at 1879 (offset 10 lines). Hunk #7 succeeded at 2243 (offset -4 lines). Hunk #8 succeeded at 2374 (offset 10 lines). Hunk #9 succeeded at 2371 (offset -4 lines). Hunk #10 succeeded at 2410 (offset 10 lines). Applying patch patches/export_symbol_numa-2.6-fc5.patch patching file arch/i386/kernel/smpboot.c Hunk #1 succeeded at 627 (offset 48 lines). Applying patch patches/blkdev_tunables-2.6-rhel5.patch patching file include/linux/blkdev.h Hunk #1 succeeded at 811 (offset 23 lines). patching file include/scsi/scsi_host.h patching file drivers/scsi/isci/init.c Hunk #1 succeeded at 138 (offset 100 lines). patching file drivers/scsi/lpfc/lpfc.h Hunk #1 succeeded at 42 with fuzz 2 (offset 4 lines). Applying patch patches/jbd-stats-2.6-rhel5.patch patching file include/linux/jbd.h patching file fs/jbd/transaction.c patching file fs/jbd/journal.c Hunk #2 succeeded at 641 (offset 2 lines). Hunk #4 succeeded at 1023 (offset 2 lines). Hunk #6 succeeded at 1478 (offset 10 lines). Hunk #7 succeeded at 2323 (offset 6 lines). Hunk #8 succeeded at 2412 (offset 10 lines). Hunk #9 succeeded at 2420 (offset 6 lines). patching file fs/jbd/checkpoint.c patching file fs/jbd/commit.c Hunk #3 succeeded at 303 (offset 13 lines). Hunk #5 succeeded at 425 (offset 13 lines). Hunk #7 succeeded at 662 (offset 13 lines). Hunk #8 succeeded at 852 (offset 5 lines). Hunk #9 succeeded at 937 (offset 13 lines). Applying patch patches/raid5-stats-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 149 (offset 34 lines). Hunk #3 succeeded at 348 (offset 34 lines). Hunk #5 succeeded at 684 (offset 33 lines). Hunk #7 succeeded at 1730 (offset 33 lines). Hunk #9 succeeded at 1920 (offset 35 lines). Hunk #11 succeeded at 1973 (offset 35 lines). Hunk #13 succeeded at 2312 (offset 35 lines). Hunk #15 succeeded at 2497 (offset 35 lines). Hunk #17 succeeded at 2569 (offset 35 lines). Hunk #19 succeeded at 2683 (offset 35 lines). Hunk #20 succeeded at 2760 with fuzz 2. Hunk #21 succeeded at 3059 (offset 37 lines). Hunk #22 succeeded at 3421 (offset 2 lines). patching file include/linux/raid/raid5.h Applying patch patches/raid5-configurable-cachesize-rhel5.patch patching file drivers/md/raid5.c Hunk #2 succeeded at 3269 (offset 39 lines). Hunk #3 succeeded at 3826 (offset 5 lines). Applying patch patches/raid5-large-io-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 3379 (offset 39 lines). Applying patch patches/raid5-stripe-by-stripe-handling-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 2661 (offset 35 lines). Hunk #3 succeeded at 2725 with fuzz 2 (offset 35 lines). Hunk #4 succeeded at 3511 (offset 4 lines). patching file include/linux/raid/raid5.h Applying patch patches/raid5-merge-ios-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 1310 (offset 33 lines). Hunk #3 succeeded at 1993 (offset 35 lines). Hunk #5 succeeded at 2557 (offset 35 lines). Hunk #7 succeeded at 2732 (offset 35 lines). Hunk #9 succeeded at 2820 (offset 35 lines). Hunk #11 succeeded at 2851 (offset 35 lines). Hunk #13 succeeded at 2889 with fuzz 2 (offset 35 lines). Hunk #14 succeeded at 3074 (offset 2 lines). Hunk #15 succeeded at 3163 with fuzz 1 (offset 35 lines). Applying patch patches/raid5-zerocopy-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 667 (offset 34 lines). Hunk #3 succeeded at 951 (offset 34 lines). Hunk #5 succeeded at 1115 (offset 34 lines). Hunk #7 succeeded at 1247 (offset 34 lines). Hunk #9 succeeded at 1752 (offset 34 lines). Hunk #10 succeeded at 1727 with fuzz 1. Hunk #11 succeeded at 2127 (offset 36 lines). Hunk #13 succeeded at 2351 with fuzz 1 (offset 36 lines). Hunk #15 succeeded at 3633 with fuzz 1 (offset 40 lines). patching file include/linux/backing-dev.h Hunk #1 succeeded at 52 (offset 4 lines). Hunk #2 succeeded at 102 (offset 7 lines). patching file include/linux/page-flags.h Hunk #1 succeeded at 86 (offset -1 lines). Hunk #2 succeeded at 286 (offset -3 lines). patching file include/linux/raid/raid5.h patching file mm/filemap.c Hunk #2 succeeded at 576 (offset 8 lines). Applying patch patches/raid5-maxsectors-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 3628 (offset 33 lines). Applying patch patches/md-rebuild-policy.patch patching file drivers/md/md.c Hunk #3 succeeded at 5071 (offset 44 lines). Hunk #5 succeeded at 5163 (offset 44 lines). Hunk #6 succeeded at 5245 (offset 6 lines). Hunk #7 succeeded at 5322 (offset 44 lines). Hunk #8 succeeded at 5305 (offset 6 lines). Hunk #9 succeeded at 5366 (offset 44 lines). patching file include/linux/sysctl.h Hunk #1 succeeded at 946 (offset 18 lines). Applying patch patches/jbd-journal-chksum-2.6.18-vanilla.patch patching file fs/jbd/commit.c Hunk #7 succeeded at 535 (offset -2 lines). Hunk #8 succeeded at 725 (offset 4 lines). Hunk #9 succeeded at 745 (offset -2 lines). Hunk #10 succeeded at 874 (offset 9 lines). patching file include/linux/jbd.h patching file fs/jbd/recovery.c patching file fs/jbd/journal.c Hunk #2 succeeded at 1594 (offset 10 lines). patching file fs/Kconfig patching file Documentation/filesystems/ext3.txt Applying patch patches/quota-large-limits-rhel5.patch patching file fs/quota_v1.c patching file fs/quota_v2.c patching file include/linux/dqblk_v2.h patching file include/linux/quota.h Hunk #1 succeeded at 149 with fuzz 1. Hunk #2 succeeded at 177 (offset 7 lines). patching file include/linux/quotaio_v2.h Applying patch patches/md-mmp-unplug-dev.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 1490 (offset 34 lines). Hunk #2 succeeded at 3018 (offset 4 lines). Applying patch patches/mpt-fusion-max-sge.patch patching file drivers/message/fusion/Kconfig patching file drivers/message/fusion/mptbase.h Applying patch patches/jbd2-jcberr-2.6-rhel5.patch patching file include/linux/jbd2.h Hunk #1 succeeded at 408 with fuzz 2 (offset 27 lines). Hunk #3 succeeded at 463 (offset 27 lines). Hunk #5 succeeded at 644 with fuzz 2 (offset -2 lines). Hunk #6 succeeded at 1127 (offset 69 lines). patching file fs/jbd2/checkpoint.c Hunk #1 succeeded at 752 (offset 57 lines). patching file fs/jbd2/commit.c Hunk #1 succeeded at 851 (offset 19 lines). patching file fs/jbd2/journal.c Hunk #1 succeeded at 89 (offset 9 lines). patching file fs/jbd2/transaction.c Hunk #1 succeeded at 53 (offset 2 lines). Hunk #2 succeeded at 256 (offset 2 lines). Hunk #3 succeeded at 1169 (offset -184 lines). Hunk #4 succeeded at 1460 (offset 4 lines). Applying patch patches/jbd2-commit-timer-no-jiffies-rounding.diff patching file fs/jbd2/transaction.c Hunk #1 succeeded at 58 with fuzz 1 (offset 4 lines). Now at patch patches/jbd2-commit-timer-no-jiffies-rounding.diff </pre> </div></div> <p>If I then manually apply the new patch added to the series, that goes on nicely too:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[build@centos50 linux-2.6.18-308.4.1.el5.x86_64]$ patch -p1 -i /home/bogl/Downloads/make-bi_phys_segments-uint.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 100 (offset -2 lines). patching file include/linux/bio.h Hunk #1 succeeded at 84 with fuzz 2 (offset 9 lines). </pre> </div></div> <p>All I can think is that either your linux or lustre source wasn't what you thought.</p> <p>we have a Redhat installation, so I’m using kernel-2.6.18-308.4.1.el5.src.rpm from <a href="http://ftp.redhat.com/pub/redhat/linux/enterprise/5Server/en/os/SRPMS/" class="external-link" target="_blank" rel="nofollow noopener">http://ftp.redhat.com/pub/redhat/linux/enterprise/5Server/en/os/SRPMS/</a> and lustre-1.8.8-wc1_2.6.18_308.4.1.el5_lustre.src.rpm from downloads.whamcloud.com</p> <p>There should be no difference between the those linux .src rpms from different sites. Just to confirm I repeated the exact same series of operations on the rpm from <a href="http://ftp.redhat.com/pub/redhat/linux/enterprise/5Server/en/os/SRPMS" class="external-link" target="_blank" rel="nofollow noopener">http://ftp.redhat.com/pub/redhat/linux/enterprise/5Server/en/os/SRPMS</a>. I still have the same good results on patching:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> [build@centos50 linux-2.6.18-308.4.1.el5.x86_64]$ ln -s /home/build/rpmbuild/BUILD/lustre-1.8.8/lustre/kernel_patches/series/2.6-rhel5.series series [build@centos50 linux-2.6.18-308.4.1.el5.x86_64]$ ln -s /home/build/rpmbuild/BUILD/lustre-1.8.8/lustre/kernel_patches/patches . [build@centos50 linux-2.6.18-308.4.1.el5.x86_64]$ quilt push -av Applying patch patches/lustre_version.patch patching file include/linux/lustre_version.h Applying patch patches/vfs_races-2.6-rhel5.patch patching file fs/dcache.c Hunk #2 succeeded at 1603 (offset 196 lines). Hunk #3 succeeded at 1562 (offset 66 lines). patching file include/linux/dcache.h Hunk #1 succeeded at 189 (offset 12 lines). Hunk #2 succeeded at 258 (offset 3 lines). Hunk #3 succeeded at 303 (offset 12 lines). Applying patch patches/i_filter_data.patch patching file include/linux/fs.h Hunk #1 succeeded at 663 (offset 83 lines). Applying patch patches/jbd-jcberr-2.6.18-vanilla.patch patching file include/linux/jbd.h Hunk #1 succeeded at 359 (offset 3 lines). Hunk #3 succeeded at 414 (offset 3 lines). Hunk #5 succeeded at 593 (offset 3 lines). patching file fs/jbd/checkpoint.c Hunk #1 succeeded at 713 (offset 25 lines). patching file fs/jbd/commit.c Hunk #1 succeeded at 772 (offset 64 lines). patching file fs/jbd/journal.c patching file fs/jbd/transaction.c Hunk #3 succeeded at 1335 (offset 41 lines). Applying patch patches/export_symbols-2.6.12.patch patching file fs/dcache.c Hunk #1 succeeded at 2182 (offset 601 lines). Applying patch patches/dev_read_only-2.6.18-vanilla.patch patching file block/ll_rw_blk.c Hunk #1 succeeded at 3144 (offset 77 lines). Hunk #3 succeeded at 3849 (offset 76 lines). patching file fs/block_dev.c Hunk #1 succeeded at 1145 (offset 86 lines). patching file include/linux/fs.h Hunk #1 succeeded at 1887 (offset 202 lines). Applying patch patches/export-2.6.18-vanilla.patch patching file fs/open.c Hunk #1 succeeded at 855 (offset 47 lines). patching file fs/jbd/journal.c Applying patch patches/export-show_task-2.6.18-vanilla.patch patching file kernel/sched.c Hunk #1 succeeded at 4704 with fuzz 2 (offset 6 lines). Applying patch patches/sd_iostats-2.6-rhel5.patch patching file drivers/scsi/Kconfig patching file drivers/scsi/scsi_proc.c patching file drivers/scsi/sd.c Hunk #2 succeeded at 184 (offset 1 line). Hunk #4 succeeded at 1110 (offset 10 lines). Hunk #5 succeeded at 1792 (offset -4 lines). Hunk #6 succeeded at 1879 (offset 10 lines). Hunk #7 succeeded at 2243 (offset -4 lines). Hunk #8 succeeded at 2374 (offset 10 lines). Hunk #9 succeeded at 2371 (offset -4 lines). Hunk #10 succeeded at 2410 (offset 10 lines). Applying patch patches/export_symbol_numa-2.6-fc5.patch patching file arch/i386/kernel/smpboot.c Hunk #1 succeeded at 627 (offset 48 lines). Applying patch patches/blkdev_tunables-2.6-rhel5.patch patching file include/linux/blkdev.h Hunk #1 succeeded at 811 (offset 23 lines). patching file include/scsi/scsi_host.h patching file drivers/scsi/isci/init.c Hunk #1 succeeded at 138 (offset 100 lines). patching file drivers/scsi/lpfc/lpfc.h Hunk #1 succeeded at 42 with fuzz 2 (offset 4 lines). Applying patch patches/jbd-stats-2.6-rhel5.patch patching file include/linux/jbd.h patching file fs/jbd/transaction.c patching file fs/jbd/journal.c Hunk #2 succeeded at 641 (offset 2 lines). Hunk #4 succeeded at 1023 (offset 2 lines). Hunk #6 succeeded at 1478 (offset 10 lines). Hunk #7 succeeded at 2323 (offset 6 lines). Hunk #8 succeeded at 2412 (offset 10 lines). Hunk #9 succeeded at 2420 (offset 6 lines). patching file fs/jbd/checkpoint.c patching file fs/jbd/commit.c Hunk #3 succeeded at 303 (offset 13 lines). Hunk #5 succeeded at 425 (offset 13 lines). Hunk #7 succeeded at 662 (offset 13 lines). Hunk #8 succeeded at 852 (offset 5 lines). Hunk #9 succeeded at 937 (offset 13 lines). Applying patch patches/raid5-stats-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 149 (offset 34 lines). Hunk #3 succeeded at 348 (offset 34 lines). Hunk #5 succeeded at 684 (offset 33 lines). Hunk #7 succeeded at 1730 (offset 33 lines). Hunk #9 succeeded at 1920 (offset 35 lines). Hunk #11 succeeded at 1973 (offset 35 lines). Hunk #13 succeeded at 2312 (offset 35 lines). Hunk #15 succeeded at 2497 (offset 35 lines). Hunk #17 succeeded at 2569 (offset 35 lines). Hunk #19 succeeded at 2683 (offset 35 lines). Hunk #20 succeeded at 2760 with fuzz 2. Hunk #21 succeeded at 3059 (offset 37 lines). Hunk #22 succeeded at 3421 (offset 2 lines). patching file include/linux/raid/raid5.h Applying patch patches/raid5-configurable-cachesize-rhel5.patch patching file drivers/md/raid5.c Hunk #2 succeeded at 3269 (offset 39 lines). Hunk #3 succeeded at 3826 (offset 5 lines). Applying patch patches/raid5-large-io-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 3379 (offset 39 lines). Applying patch patches/raid5-stripe-by-stripe-handling-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 2661 (offset 35 lines). Hunk #3 succeeded at 2725 with fuzz 2 (offset 35 lines). Hunk #4 succeeded at 3511 (offset 4 lines). patching file include/linux/raid/raid5.h Applying patch patches/raid5-merge-ios-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 1310 (offset 33 lines). Hunk #3 succeeded at 1993 (offset 35 lines). Hunk #5 succeeded at 2557 (offset 35 lines). Hunk #7 succeeded at 2732 (offset 35 lines). Hunk #9 succeeded at 2820 (offset 35 lines). Hunk #11 succeeded at 2851 (offset 35 lines). Hunk #13 succeeded at 2889 with fuzz 2 (offset 35 lines). Hunk #14 succeeded at 3074 (offset 2 lines). Hunk #15 succeeded at 3163 with fuzz 1 (offset 35 lines). Applying patch patches/raid5-zerocopy-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 667 (offset 34 lines). Hunk #3 succeeded at 951 (offset 34 lines). Hunk #5 succeeded at 1115 (offset 34 lines). Hunk #7 succeeded at 1247 (offset 34 lines). Hunk #9 succeeded at 1752 (offset 34 lines). Hunk #10 succeeded at 1727 with fuzz 1. Hunk #11 succeeded at 2127 (offset 36 lines). Hunk #13 succeeded at 2351 with fuzz 1 (offset 36 lines). Hunk #15 succeeded at 3633 with fuzz 1 (offset 40 lines). patching file include/linux/backing-dev.h Hunk #1 succeeded at 52 (offset 4 lines). Hunk #2 succeeded at 102 (offset 7 lines). patching file include/linux/page-flags.h Hunk #1 succeeded at 86 (offset -1 lines). Hunk #2 succeeded at 286 (offset -3 lines). patching file include/linux/raid/raid5.h patching file mm/filemap.c Hunk #2 succeeded at 576 (offset 8 lines). Applying patch patches/raid5-maxsectors-rhel5.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 3628 (offset 33 lines). Applying patch patches/md-rebuild-policy.patch patching file drivers/md/md.c Hunk #3 succeeded at 5071 (offset 44 lines). Hunk #5 succeeded at 5163 (offset 44 lines). Hunk #6 succeeded at 5245 (offset 6 lines). Hunk #7 succeeded at 5322 (offset 44 lines). Hunk #8 succeeded at 5305 (offset 6 lines). Hunk #9 succeeded at 5366 (offset 44 lines). patching file include/linux/sysctl.h Hunk #1 succeeded at 946 (offset 18 lines). Applying patch patches/jbd-journal-chksum-2.6.18-vanilla.patch patching file fs/jbd/commit.c Hunk #7 succeeded at 535 (offset -2 lines). Hunk #8 succeeded at 725 (offset 4 lines). Hunk #9 succeeded at 745 (offset -2 lines). Hunk #10 succeeded at 874 (offset 9 lines). patching file include/linux/jbd.h patching file fs/jbd/recovery.c patching file fs/jbd/journal.c Hunk #2 succeeded at 1594 (offset 10 lines). patching file fs/Kconfig patching file Documentation/filesystems/ext3.txt Applying patch patches/quota-large-limits-rhel5.patch patching file fs/quota_v1.c patching file fs/quota_v2.c patching file include/linux/dqblk_v2.h patching file include/linux/quota.h Hunk #1 succeeded at 149 with fuzz 1. Hunk #2 succeeded at 177 (offset 7 lines). patching file include/linux/quotaio_v2.h Applying patch patches/md-mmp-unplug-dev.patch patching file drivers/md/raid5.c Hunk #1 succeeded at 1490 (offset 34 lines). Hunk #2 succeeded at 3018 (offset 4 lines). Applying patch patches/mpt-fusion-max-sge.patch patching file drivers/message/fusion/Kconfig patching file drivers/message/fusion/mptbase.h Applying patch patches/jbd2-jcberr-2.6-rhel5.patch patching file include/linux/jbd2.h Hunk #1 succeeded at 408 with fuzz 2 (offset 27 lines). Hunk #3 succeeded at 463 (offset 27 lines). Hunk #5 succeeded at 644 with fuzz 2 (offset -2 lines). Hunk #6 succeeded at 1127 (offset 69 lines). patching file fs/jbd2/checkpoint.c Hunk #1 succeeded at 752 (offset 57 lines). patching file fs/jbd2/commit.c Hunk #1 succeeded at 851 (offset 19 lines). patching file fs/jbd2/journal.c Hunk #1 succeeded at 89 (offset 9 lines). patching file fs/jbd2/transaction.c Hunk #1 succeeded at 53 (offset 2 lines). Hunk #2 succeeded at 256 (offset 2 lines). Hunk #3 succeeded at 1169 (offset -184 lines). Hunk #4 succeeded at 1460 (offset 4 lines). Applying patch patches/jbd2-commit-timer-no-jiffies-rounding.diff patching file fs/jbd2/transaction.c Hunk #1 succeeded at 58 with fuzz 1 (offset 4 lines). Now at patch patches/jbd2-commit-timer-no-jiffies-rounding.diff </pre> </div></div> <p>I've managed to patch the kernel. So far we have not had any kernel panics.</p> <p>thanks Hellen. It does seem that this is a duplicate of <a href="https://jira.whamcloud.com/browse/LU-1115" title="software raid6 related BUG in fs/bio.c:222 when raid chunk &gt; 64k" class="issue-link" data-issue-key="LU-1115"><del>LU-1115</del></a> as suspected then. I am closing the ticket as such for now. We will reopen if this is proven to not be the case</p> Development Rank 1|hzvgnj: Rank (Obsolete) 6347 Severity