[LU-2293] Assertion triggered in osp_sync_thread

• Type: Bug
• Resolution: Duplicate
• Priority: Minor
• Affects Version/s: Lustre 2.4.0
• Labels: topsequoia
• Severity: 3
• Assignee: Alex Zhuravlev
• Reporter: Prakash Surya (Inactive)

Description

Triggered this assertion bringing up the MDS after a version change:

LustreError: 33030:0:(osp_sync.c:584:osp_sync_process_record()) processed all old entries: 0x3e03:1
LustreError: 33030:0:(osp_sync.c:584:osp_sync_process_record()) Skipped 28 previous similar messages
LustreError: 33027:0:(llog_cat.c:187:llog_cat_id2handle()) lstest-OST01c8-osc-MDT0000: error opening log id 0x5a5a5a5a5a5a5a5a:5a5a5a5a: rc = -2
LustreError: 33027:0:(llog_cat.c:513:llog_cat_cancel_records()) Cannot find log 0x5a5a5a5a5a5a5a5a
LustreError: 33027:0:(llog_cat.c:552:llog_cat_cancel_records()) lstest-OST01c8-osc-MDT0000: fail to cancel 0 of 1 llog-records: rc = -2
LustreError: 33027:0:(osp_sync.c:714:osp_sync_process_committed()) @@@ lstest-OST01c8-osc-MDT0000: can't cancel record: -2
  req@ffff880f7bd3b800 x1417921862573367/t0(0) o6->lstest-OST01c8-osc-MDT0000@172.20.3.56@o2ib500:28/4 lens 664/400 e 0 to 0 dl 1352235775 ref 1 fl Complete:R/0/0 rc 0/-2
LustreError: 33027:0:(llog_cat.c:187:llog_cat_id2handle()) lstest-OST01c8-osc-MDT0000: error opening log id 0x5a5a5a5a5a5a5a5a:5a5a5a5a: rc = -2
LustreError: 33027:0:(llog_cat.c:513:llog_cat_cancel_records()) Cannot find log 0x5a5a5a5a5a5a5a5a
LustreError: 33027:0:(llog_cat.c:552:llog_cat_cancel_records()) lstest-OST01c8-osc-MDT0000: fail to cancel 0 of 1 llog-records: rc = -2
LustreError: 33027:0:(osp_sync.c:714:osp_sync_process_committed()) @@@ lstest-OST01c8-osc-MDT0000: can't cancel record: -2
  req@ffff880fd2d16000 x1417921862573368/t0(0) o6->lstest-OST01c8-osc-MDT0000@172.20.3.56@o2ib500:28/4 lens 664/400 e 0 to 0 dl 1352235775 ref 1 fl Complete:R/0/0 rc 0/-2
LustreError: 33027:0:(osp_sync.c:866:osp_sync_thread()) ASSERTION( rc == 0 || rc == LLOG_PROC_BREAK ) failed: 0 changes, 7 in progress, 7 in flight: -22
LustreError: 33027:0:(osp_sync.c:866:osp_sync_thread()) LBUG
Pid: 33027, comm: osp-syn-456


Call Trace:
 [<ffffffffa05ae965>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
 [<ffffffffa05aef77>] lbug_with_loc+0x47/0xb0 [libcfs]
 [<ffffffffa1006440>] osp_sync_thread+0x630/0x700 [osp]
 [<ffffffffa1005e10>] ? osp_sync_thread+0x0/0x700 [osp]
 [<ffffffff8100c14a>] child_rip+0xa/0x20
 [<ffffffffa1005e10>] ? osp_sync_thread+0x0/0x700 [osp]
 [<ffffffffa1005e10>] ? osp_sync_thread+0x0/0x700 [osp]
 [<ffffffff8100c140>] ? child_rip+0x0/0x20

Kernel panic - not syncing: LBUG
Pid: 33027, comm: osp-syn-456
 Tainted: P        W  ----------------   2.6.32-220.23.1.2chaos.ch5.x86_64 #1
Call Trace:
 [<ffffffff814eea92>] ? panic+0x78/0x143
 [<ffffffffa05aefcb>] ? lbug_with_loc+0x9b/0xb0 [libcfs]
 [<ffffffffa1006440>] ? osp_sync_thread+0x630/0x700 [osp]
 [<ffffffffa1005e10>] ? osp_sync_thread+0x0/0x700 [osp]
 [<ffffffff8100c14a>] ? child_rip+0xa/0x20
 [<ffffffffa1005e10>] ? osp_sync_thread+0x0/0x700 [osp]
 [<ffffffffa1005e10>] ? osp_sync_thread+0x0/0x700 [osp]
 [<ffffffff8100c140>] ? child_rip+0x0/0x20

Lustre Version:

Lustre: Lustre: Build Version: 2.3.54-2chaos-2chaos--PRISTINE-2.6.32-220.23.1.2chaos.ch5.x86_64