[LU-5700] async IO LBUG obj->cob_transient_pages == 0

• Type: Bug
• Resolution: Fixed
• Priority: Critical
• Fix Version/s: Lustre 2.7.0
• Affects Version/s: Lustre 2.7.0
• Labels: patch
• Severity: 3
• Assignee: Lai Siyao
• Reporter: Stephen Champion

Description

LustreError: 58185:0:(rw26.c:474:ll_direct_IO_26()) ASSERTION( obj->cob_transient_pages == 0 ) failed:
LustreError: 58184:0:(rw26.c:474:ll_direct_IO_26()) ASSERTION( obj->cob_transient_pages == 0 ) failed:
LustreError: 58184:0:(rw26.c:474:ll_direct_IO_26()) LBUG
Pid: 58184, comm: sio

Call Trace:
[<ffffffffa057d895>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
[<ffffffffa057de97>] lbug_with_loc+0x47/0xb0 [libcfs]
[<ffffffffa0c03044>] ll_direct_IO_26+0xb64/0x1140 [lustre]
LustreError: 58186:0:(rw26.c:474:ll_direct_IO_26()) ASSERTION( obj->cob_transient_pages == 0 ) failed:
LustreError: 58186:0:(rw26.c:474:ll_direct_IO_26()) LBUG
Pid: 58186, comm: sio

Call Trace:
[<ffffffff81058bd3>] ? __wake_up+0x53/0x70
[<ffffffff8112158b>] generic_file_aio_read+0x6bb/0x700
[<ffffffff811b4b5f>] ? list_move+0x1f/0x30
[<ffffffff811b51ff>] ? __mark_inode_dirty+0x13f/0x160
[<ffffffff811a59cd>] ? touch_atime+0x14d/0x1a0
[<ffffffffa0c173be>] vvp_io_read_start+0x22e/0x450 [lustre]
[<ffffffffa057d895>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
[<ffffffffa057de97>] lbug_with_loc+0x47/0xb0 [libcfs]
LustreError: 58183:0:(rw26.c:474:ll_direct_IO_26()) ASSERTION( obj->cob_transient_pages == 0 ) failed:
LustreError: 58183:0:(rw26.c:474:ll_direct_IO_26()) LBUG
Pid: 58183, comm: sio

Call Trace:
[<ffffffffa0c03044>] ll_direct_IO_26+0xb64/0x1140 [lustre]
[<ffffffffa057d895>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
[<ffffffff81058bd3>] ? __wake_up+0x53/0x70
[<ffffffffa057de97>] lbug_with_loc+0x47/0xb0 [libcfs]
[<ffffffff8112158b>] generic_file_aio_read+0x6bb/0x700
[<ffffffffa06f14da>] cl_io_start+0x6a/0x140 [obdclass]
[<ffffffff81078fa7>] ? current_fs_time+0x27/0x30
[<ffffffffa0bce4d5>] ? ll_inode_size_unlock+0x15/0x20 [lustre]
[<ffffffffa06f5664>] cl_io_loop+0xb4/0x1b0 [obdclass]
[<ffffffffa0bb3f41>] ll_file_io_generic+0x481/0xaa0 [lustre]
[<ffffffffa0c0d6e5>] ? ccc_object_size_unlock+0x35/0x40 [lustre]
[<ffffffffa0bb4da0>] ll_file_aio_read+0x130/0x2b0 [lustre]
[<ffffffff811a58f1>] ? touch_atime+0x71/0x1a0
[<ffffffffa0bb5079>] ll_file_read+0x159/0x290 [lustre]
[<ffffffffa0c173be>] vvp_io_read_start+0x22e/0x450 [lustre]
[<ffffffffa0c03044>] ll_direct_IO_26+0xb64/0x1140 [lustre]
[<ffffffff811894d5>] vfs_read+0xb5/0x1a0
[<ffffffff81189802>] sys_pread64+0x82/0xa0
[<ffffffff8100b072>] system_call_fastpath+0x16/0x1b

[<ffffffff81058bd3>] ? __wake_up+0x53/0x70
[<ffffffff8112158b>] generic_file_aio_read+0x6bb/0x700
[<ffffffff81078fa7>] ? current_fs_time+0x27/0x30
[<ffffffffa0bce4d5>] ? ll_inode_size_unlock+0x15/0x20 [lustre]
[<ffffffffa0c0d6e5>] ? ccc_object_size_unlock+0x35/0x40 [lustre]
[<ffffffff811a58f1>] ? touch_atime+0x71/0x1a0
[<ffffffffa0c173be>] vvp_io_read_start+0x22e/0x450 [lustre]
[<ffffffffa06f14da>] cl_io_start+0x6a/0x140 [obdclass]
[<ffffffffa06f5664>] cl_io_loop+0xb4/0x1b0 [obdclass]
[<ffffffffa0bb3f41>] ll_file_io_generic+0x481/0xaa0 [lustre]
[<ffffffffa0bb4da0>] ll_file_aio_read+0x130/0x2b0 [lustre]
[<ffffffffa0bb5079>] ll_file_read+0x159/0x290 [lustre]
[<ffffffff811894d5>] vfs_read+0xb5/0x1a0
[<ffffffff81189802>] sys_pread64+0x82/0xa0
[<ffffffff8100b072>] system_call_fastpath+0x16/0x1b

[<ffffffffa06f14da>] cl_io_start+0x6a/0x140 [obdclass]
[<ffffffffa06f5664>] cl_io_loop+0xb4/0x1b0 [obdclass]
[<ffffffffa0bb3f41>] ll_file_io_generic+0x481/0xaa0 [lustre]
[<ffffffffa0bb4da0>] ll_file_aio_read+0x130/0x2b0 [lustre]
[<ffffffffa0bb5079>] ll_file_read+0x159/0x290 [lustre]
[<ffffffff811894d5>] vfs_read+0xb5/0x1a0
[<ffffffff81189802>] sys_pread64+0x82/0xa0
[<ffffffff8100b072>] system_call_fastpath+0x16/0x1b

Kernel panic - not syncing: LBUG
Pid: 58184, comm: sio Not tainted 2.6.32-431.20.3.hz100.el6.x86_64 #1
Call Trace:
[<ffffffff81528067>] ? panic+0xa7/0x16f
[<ffffffffa057deeb>] ? lbug_with_loc+0x9b/0xb0 [libcfs]
[<ffffffffa0c03044>] ? ll_direct_IO_26+0xb64/0x1140 [lustre]
[<ffffffff81058bd3>] ? __wake_up+0x53/0x70
[<ffffffff8112158b>] ? generic_file_aio_read+0x6bb/0x700
[<ffffffff811b4b5f>] ? list_move+0x1f/0x30
[<ffffffff811b51ff>] ? __mark_inode_dirty+0x13f/0x160
[<ffffffff811a59cd>] ? touch_atime+0x14d/0x1a0
[<ffffffffa0c173be>] ? vvp_io_read_start+0x22e/0x450 [lustre]
[<ffffffffa06f14da>] ? cl_io_start+0x6a/0x140 [obdclass]
[<ffffffffa06f5664>] ? cl_io_loop+0xb4/0x1b0 [obdclass]
[<ffffffffa0bb3f41>] ? ll_file_io_generic+0x481/0xaa0 [lustre]
[<ffffffffa0bb4da0>] ? ll_file_aio_read+0x130/0x2b0 [lustre]
[<ffffffffa0bb5079>] ? ll_file_read+0x159/0x290 [lustre]
[<ffffffff811894d5>] ? vfs_read+0xb5/0x1a0
[<ffffffff81189802>] ? sys_pread64+0x82/0xa0
[<ffffffff8100b072>] ? system_call_fastpath+0x16/0x1b

Issue Links

• is related to: LU-1669 lli->lli_write_mutex (single shared file performance)