[LU-2765] rw.c:1295:ll_readpage()) ASSERTION( !ll_i2info(vmpage->mapping->host)->lli_has_smd ) failed

• Status: Closed
• Project: Lustre
• Affects Version/s: Lustre 2.4.1
• Type: Bug
• Priority: Critical
• Reporter: Oleg Drokin
• Assignee: Jinshan Xiong (Inactive)
• Resolution: Won't Fix
• Labels: mq313

Environment

Hit during racer test run.

• Severity: 3

Description

This hits once hsm swap patch lands: http://review.whamcloud.com/#change,4507
Upgrade to blocker once lands.

[ 2054.325657] LustreError: 21620:0:(lov_object.c:183:lov_init_sub()) header@ffff880064321ec0[0x0, 2, [0x240000400:0x2d05:0x0] hash]{ 
[ 2054.326245] LustreError: 21620:0:(lov_object.c:183:lov_init_sub()) ....lovsub@ffff880064321f98[0]
[ 2054.326757] LustreError: 21620:0:(lov_object.c:183:lov_init_sub()) ....osc@ffff88005b949eb0id: 11525 gr: 9663677440 idx: 1 gen: 0 kms_valid: 0 kms 0 rc: 0 force_sync: 0 min_xid: 0 size: 0 mtime: 0 atime: 0 ctime: 0 blocks: 0
[ 2054.327622] LustreError: 21620:0:(lov_object.c:183:lov_init_sub()) } header@ffff880064321ec0
[ 2054.328003] LustreError: 21620:0:(lov_object.c:183:lov_init_sub()) stripe 0 is already owned.
[ 2054.328305] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) header@ffff880061309ea8[0x0, 1, [0x280000403:0xdb58:0x0] hash]{ 
[ 2054.328943] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) ....vvp@ffff880061309f80(- 0 0) inode: ffff880044812b08 180144002325076824/41943044 100644 1 1 ffff880061309f80 [0x280000403:0xdb58:0x0]
[ 2054.329686] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) ....lov@ffff88004296eed0stripes: 1, valid, lsm{ffff8800517d8df0 0x0BD10BD0 1 1 0}: 
[ 2054.330301] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) header@ffff880064321ec0[0x0, 2, [0x240000400:0x2d05:0x0] hash]{ 
[ 2054.330714] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) ....lovsub@ffff880064321f98[0]
[ 2054.331151] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) ....osc@ffff88005b949eb0id: 11525 gr: 9663677440 idx: 1 gen: 0 kms_valid: 0 kms 0 rc: 0 force_sync: 0 min_xid: 0 size: 0 mtime: 0 atime: 0 ctime: 0 blocks: 0
[ 2054.331756] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) } header@ffff880064321ec0
[ 2054.332069] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) 
[ 2054.332316] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) } header@ffff880061309ea8
[ 2054.332642] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) owned.
[ 2054.332831] LustreError: 21620:0:(lov_object.c:185:lov_init_sub()) header@ffff88006beb3ea8[0x0, 1, [0x280000404:0x7596:0x0] hash]
[ 2054.333301] LustreError: 21620:0:(lov_object.c:185:lov_init_sub()) try to own.
[ 2054.334194] LustreError: 21620:0:(lov_object.c:183:lov_init_sub()) header@ffff880064321ec0[0x0, 2, [0x240000400:0x2d05:0x0] hash]{ 
[ 2054.334533] LustreError: 21620:0:(lov_object.c:183:lov_init_sub()) ....lovsub@ffff880064321f98[0]
[ 2054.334837] LustreError: 21620:0:(lov_object.c:183:lov_init_sub()) ....osc@ffff88005b949eb0id: 11525 gr: 9663677440 idx: 1 gen: 0 kms_valid: 0 kms 0 rc: 0 force_sync: 0 min_xid: 0 size: 0 mtime: 0 atime: 0 ctime: 0 blocks: 0
[ 2054.335621] LustreError: 21620:0:(lov_object.c:183:lov_init_sub()) } header@ffff880064321ec0
[ 2054.336064] LustreError: 21620:0:(lov_object.c:183:lov_init_sub()) stripe 0 is already owned.
[ 2054.336534] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) header@ffff880061309ea8[0x0, 1, [0x280000403:0xdb58:0x0] hash]{ 
[ 2054.336976] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) ....vvp@ffff880061309f80(- 0 0) inode: ffff880044812b08 180144002325076824/41943044 100644 1 1 ffff880061309f80 [0x280000403:0xdb58:0x0]
[ 2054.338325] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) ....lov@ffff88004296eed0stripes: 1, valid, lsm{ffff8800517d8df0 0x0BD10BD0 1 1 0}: 
[ 2054.338843] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) header@ffff880064321ec0[0x0, 2, [0x240000400:0x2d05:0x0] hash]{ 
[ 2054.339336] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) ....lovsub@ffff880064321f98[0]
[ 2054.339778] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) ....osc@ffff88005b949eb0id: 11525 gr: 9663677440 idx: 1 gen: 0 kms_valid: 0 kms 0 rc: 0 force_sync: 0 min_xid: 0 size: 0 mtime: 0 atime: 0 ctime: 0 blocks: 0
[ 2054.340541] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) } header@ffff880064321ec0
[ 2054.340974] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) 
[ 2054.341224] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) } header@ffff880061309ea8
[ 2054.341669] LustreError: 21620:0:(lov_object.c:184:lov_init_sub()) owned.
[ 2054.341932] LustreError: 21620:0:(lov_object.c:185:lov_init_sub()) header@ffff88006beb3ea8[0x0, 1, [0x280000404:0x7596:0x0] hash]
[ 2054.342468] LustreError: 21620:0:(lov_object.c:185:lov_init_sub()) try to own.
[ 2054.343111] LustreError: 21620:0:(rw.c:1295:ll_readpage()) ASSERTION( !ll_i2info(vmpage->mapping->host)->lli_has_smd ) failed: 
[ 2054.343595] LustreError: 21620:0:(rw.c:1295:ll_readpage()) LBUG
[ 2054.343837] Pid: 21620, comm: cat
[ 2054.344041] 
[ 2054.344041] Call Trace:
[ 2054.344407]  [<ffffffffa0461915>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
[ 2054.344672]  [<ffffffffa0461f17>] lbug_with_loc+0x47/0xb0 [libcfs]
[ 2054.344959]  [<ffffffffa0e5d125>] ll_readpage+0x1e5/0x1f0 [lustre]
[ 2054.345234]  [<ffffffff81113d35>] generic_file_aio_read+0x215/0x740
[ 2054.345543]  [<ffffffffa0e7ed9f>] ? cl_glimpse_lock+0x1df/0x490 [lustre]
[ 2054.345842]  [<ffffffffa0e88e5d>] vvp_io_read_start+0x23d/0x420 [lustre]
[ 2054.346118]  [<ffffffffa063ea4a>] cl_io_start+0x6a/0x140 [obdclass]
[ 2054.346304]  [<ffffffffa06430b4>] cl_io_loop+0xb4/0x1b0 [obdclass]
[ 2054.346482]  [<ffffffffa0e33133>] ll_file_io_generic+0x223/0x570 [lustre]
[ 2054.346664]  [<ffffffffa0e346df>] ll_file_aio_read+0x13f/0x2c0 [lustre]
[ 2054.346844]  [<ffffffffa0e349cc>] ll_file_read+0x16c/0x2a0 [lustre]
[ 2054.347020]  [<ffffffff8117b9e5>] vfs_read+0xb5/0x1a0
[ 2054.347177]  [<ffffffff8117bb21>] sys_read+0x51/0x90
[ 2054.347333]  [<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[ 2054.347500] 
[ 2054.364643] Kernel panic - not syncing: LBUG

crashdump and modules are in /exports/crashdumps/192.168.10.210-2013-02-04-02\:51\:57

Comments

[Oleg Drokin]

Just had it happen again:

[205454.346773] LustreError: 407:0:(rw.c:1302:ll_readpage()) ASSERTION( !ll_i2info(vmpage->mapping->host)->lli_has_smd ) failed: 
[205454.347991] LustreError: 407:0:(rw.c:1302:ll_readpage()) LBUG
[205454.348271] Pid: 407, comm: cat
[205454.348502] 
[205454.348502] Call Trace:
[205454.348935]  [<ffffffffa0d07915>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
[205454.349260]  [<ffffffffa0d07f17>] lbug_with_loc+0x47/0xb0 [libcfs]
[205454.349566]  [<ffffffffa08700f5>] ll_readpage+0x1e5/0x1f0 [lustre]
[205454.349858]  [<ffffffff81113d35>] generic_file_aio_read+0x215/0x740
[205454.350165]  [<ffffffffa089aef9>] vvp_io_read_start+0x259/0x470 [lustre]
[205454.350493]  [<ffffffffa0f77f4a>] cl_io_start+0x6a/0x140 [obdclass]
[205454.350800]  [<ffffffffa0f7c5b4>] cl_io_loop+0xb4/0x1b0 [obdclass]
[205454.351104]  [<ffffffffa08448d3>] ll_file_io_generic+0x223/0x570 [lustre]
[205454.351411]  [<ffffffffa0844d5f>] ll_file_aio_read+0x13f/0x2c0 [lustre]
[205454.351714]  [<ffffffffa08458fc>] ll_file_read+0x16c/0x2a0 [lustre]
[205454.352057]  [<ffffffff8117b9e5>] vfs_read+0xb5/0x1a0
[205454.352381]  [<ffffffff8117bb21>] sys_read+0x51/0x90
[205454.352707]  [<ffffffff8100b0f2>] system_call_fastpath+0x16/0x1b
[205454.353053] 
[205454.433579] Kernel panic - not syncing: LBUG

Crashdump and modules in /exports/crashdumps/192.168.10.220-2013-02-22-08\:37\:58/

[Jinshan Xiong (Inactive)]

close old tickets