00010000:00010000:1.0:1392065810.879717:0:28934:0:(ldlm_lockd.c:809:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-ffff881843d1a000 lock: ffff881bc9e066c0/0xcf86cac754afad6c lrc: 3/0,0 mode: PR/PR res: 8612640447/14904 bits 0x3 rrc: 22 type: IBT flags: 0x4000020 remote: 0x9533dbd496bca06b expref: 225 pid: 28934 timeout: 0 00010000:00010000:1.0:1392065810.879720:0:28934:0:(ldlm_lockd.c:468:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-ffff881843d1a000 lock: ffff881bc9e066c0/0xcf86cac754afad6c lrc: 4/0,0 mode: PR/PR res: 8612640447/14904 bits 0x3 rrc: 22 type: IBT flags: 0x4000020 remote: 0x9533dbd496bca06b expref: 225 pid: 28934 timeout: 7083106737 00000100:00100000:1.0:1392065810.879728:0:28934:0:(client.c:1434:ptlrpc_send_new_req()) Sending RPC pname:cluuid:pid:xid:nid:opc mdt_77:dc2-MDT0000_UUID:28934:1456766457101078:922@gni:104 00000100:00100000:1.0:1392065810.879744:0:28934:0:(client.c:1434:ptlrpc_send_new_req()) Sending RPC pname:cluuid:pid:xid:nid:opc mdt_77:dc2-MDT0000_UUID:28934:1456766457101079:923@gni:104 00000100:00100000:0.0:1392065810.879751:0:11852:0:(events.c:300:request_in_callback()) peer: 12345-1032@gni 00000100:00100000:4.0:1392065810.879757:0:22677:0:(service.c:1547:ptlrpc_server_handle_req_in()) got req x1459162943368690 00000100:00100000:1.0:1392065810.879764:0:28934:0:(client.c:1434:ptlrpc_send_new_req()) Sending RPC pname:cluuid:pid:xid:nid:opc mdt_77:dc2-MDT0000_UUID:28934:1456766457101080:901@gni:104 00000100:00100000:4.0:1392065810.879768:0:22677:0:(service.c:1724:ptlrpc_server_handle_request()) Handling RPC pname:cluuid+ref:pid:xid:nid:opc mdt_51:5ef50be8-c61a-ebf4-e8d8-2605063698fe+3204:32651:x1459162943368690:12345-1032@gni:101 00010000:00010000:4.0:1392065810.879771:0:22677:0:(ldlm_lockd.c:1069:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:1.0:1392065810.879772:0:28934:0:(client.c:1434:ptlrpc_send_new_req()) Sending RPC pname:cluuid:pid:xid:nid:opc mdt_77:dc2-MDT0000_UUID:28934:1456766457101081:2@gni:104 00010000:00010000:4.0:1392065810.879774:0:22677:0:(ldlm_lockd.c:1154:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-ffff881843d1a000 lock: ffff880714fb36c0/0xcf86cac759267212 lrc: 2/0,0 mode: --/CR res: 8628053266/119367 bits 0x0 rrc: 7 type: IBT flags: 0x0 remote: 0x56eaef34b72d916c expref: -99 pid: 22677 timeout: 0 00000100:00100000:1.0:1392065810.879782:0:28934:0:(client.c:1434:ptlrpc_send_new_req()) Sending RPC pname:cluuid:pid:xid:nid:opc mdt_77:dc2-MDT0000_UUID:28934:1456766457101082:900@gni:104 00010000:00010000:4.0:1392065810.879784:0:22677:0:(ldlm_lock.c:687:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-ffff881843d1a000 lock: ffff8802cdd4db40/0xcf86cac759267219 lrc: 3/1,0 mode: --/CR res: 8628053266/119367 bits 0x0 rrc: 8 type: IBT flags: 0x0 remote: 0x0 expref: -99 pid: 22677 timeout: 0 00010000:00010000:4.0:1392065810.879788:0:22677:0:(ldlm_request.c:435:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-ffff881843d1a000 lock: ffff8802cdd4db40/0xcf86cac759267219 lrc: 3/1,0 mode: CR/CR res: 8628053266/119367 bits 0x2 rrc: 8 type: IBT flags: 0x4004000 remote: 0x0 expref: -99 pid: 22677 timeout: 0 00000100:00100000:1.0:1392065810.879793:0:28934:0:(client.c:2034:ptlrpc_set_wait()) set ffff88205e8d2cc0 going to sleep for 92 seconds 00010000:00010000:4.0:1392065810.879795:0:22677:0:(ldlm_lock.c:687:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-ffff881843d1a000 lock: ffff8801ec9d6900/0xcf86cac759267220 lrc: 3/1,0 mode: --/PR res: 8628053266/119367 bits 0x0 rrc: 1 type: IBT flags: 0x0 remote: 0x0 expref: -99 pid: 22677 timeout: 0 00010000:00010000:4.0:1392065810.879798:0:22677:0:(ldlm_request.c:435:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-ffff881843d1a000 lock: ffff8801ec9d6900/0xcf86cac759267220 lrc: 3/1,0 mode: PR/PR res: 8628053266/119367 bits 0x2 rrc: 1 type: IBT flags: 0x4004000 remote: 0x0 expref: -99 pid: 22677 timeout: 0 00010000:00010000:9.0:1392065812.250563:0:28656:0:(ldlm_lockd.c:809:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-ffff881843d1a000 lock: ffff881fc4a26b40/0xcf86cac7590c2649 lrc: 3/0,0 mode: PR/PR res: 8607639993/87 bits 0x3 rrc: 3 type: IBT flags: 0x4000020 remote: 0xea4a1eeb7d113fe6 expref: 674 pid: 10020 timeout: 0 00000040:00100000:3.0:1392065812.250568:0:4259:0:(llog_lvfs.c:365:llog_lvfs_write_rec()) added record 0x27905e0a: idx: 50718, 40 00010000:00010000:9.0:1392065812.250569:0:28656:0:(ldlm_lockd.c:468:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-ffff881843d1a000 lock: ffff881fc4a26b40/0xcf86cac7590c2649 lrc: 4/0,0 mode: PR/PR res: 8607639993/87 bits 0x3 rrc: 3 type: IBT flags: 0x4000020 remote: 0xea4a1eeb7d113fe6 expref: 674 pid: 10020 timeout: 7083108108 00000100:00100000:1.0:1392065812.250570:0:22636:0:(service.c:1547:ptlrpc_server_handle_req_in()) got req x1459162815629480 00000100:00100000:9.0:1392065812.250576:0:28656:0:(client.c:1434:ptlrpc_send_new_req()) Sending RPC pname:cluuid:pid:xid:nid:opc mdt_16:dc2-MDT0000_UUID:28656:1456766457102110:996@gni:104 00000040:00100000:3.0:1392065812.250576:0:4259:0:(llog_lvfs.c:365:llog_lvfs_write_rec()) added record 0x27905d9f: idx: 49497, 40 00000100:00100000:1.0:1392065812.250579:0:22636:0:(service.c:1724:ptlrpc_server_handle_request()) Handling RPC pname:cluuid+ref:pid:xid:nid:opc mdt_rdpg_66:49d9ceb5-7dbb-4c8f-1fd2-e6c8b275b3fb+84:19940:x1459162815629480:12345-1025@gni:35 00000040:00100000:3.0:1392065812.250584:0:4259:0:(llog_lvfs.c:365:llog_lvfs_write_rec()) added record 0x27905dae: idx: 19315, 40 00000100:00100000:9.0:1392065812.250592:0:28656:0:(client.c:2034:ptlrpc_set_wait()) set ffff882f27bd1c40 going to sleep for 92 seconds 00000040:00100000:3.0:1392065812.250596:0:4259:0:(llog_lvfs.c:365:llog_lvfs_write_rec()) added record 0x27905d9c: idx: 58522, 40 00000100:00100000:1.0:1392065812.250599:0:22636:0:(service.c:1771:ptlrpc_server_handle_request()) Handled RPC pname:cluuid+ref:pid:xid:nid:opc mdt_rdpg_66:49d9ceb5-7dbb-4c8f-1fd2-e6c8b275b3fb+83:19940:x1459162815629480:12345-1025@gni:35 Request procesed in 22us (36us total) trans 225879106164 rc 0/0 00000040:00100000:3.0:1392065812.250604:0:4259:0:(llog_lvfs.c:365:llog_lvfs_write_rec()) added record 0x27905c12: idx: 26846, 40 00000040:00100000:3.0:1392065812.250611:0:4259:0:(llog_lvfs.c:365:llog_lvfs_write_rec()) added record 0x27905d28: idx: 6786, 40 00000100:00100000:0.0:1392065812.250614:0:11846:0:(events.c:300:request_in_callback()) peer: 12345-1032@gni 00010000:00010000:5.0:1392126609.008666:0:4271:0:(ldlm_lock.c:211:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-ffff881843d1a000 lock: ffff88249cf62d80/0xcf86cac8ceadbb15 lrc: 0/0,0 mode: --/CR res: 8602999906/2968 bits 0x2 rrc: 3 type: IBT flags: 0x0 remote: 0x1774e70e56c4d975 expref: 161 pid: 4271 timeout: 0 00010000:00010000:1.0:1392126609.008666:0:20667:0:(ldlm_lockd.c:468:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-ffff881843d1a000 lock: ffff881e40f99000/0xcf86cac863e39bd3 lrc: 4/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 19 type: IBT flags: 0x4000020 remote: 0x2f71502626141aa expref: 20586 pid: 16102 timeout: 7143904866 00010000:00010000:5.0:1392126609.008669:0:4271:0:(ldlm_lockd.c:1320:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88249cf62d80, rc 0) 00010000:00010000:6.0:1392126609.008671:0:17164:0:(ldlm_lock.c:687:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-ffff881843d1a000 lock: ffff881620ab7900/0xcf86cac8ceadbb3f lrc: 3/1,0 mode: --/CR res: 8602999394/802 bits 0x0 rrc: 4 type: IBT flags: 0x0 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00010000:00010000:1.0:1392126609.008671:0:20667:0:(ldlm_lockd.c:809:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-ffff881843d1a000 lock: ffff880d75d13900/0xcf86cac863b0e45b lrc: 3/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 19 type: IBT flags: 0x4000020 remote: 0x3259f1b9dbc05fb3 expref: 299 pid: 4290 timeout: 0 00010000:00010000:1.0:1392126609.008675:0:20667:0:(ldlm_lockd.c:468:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-ffff881843d1a000 lock: ffff880d75d13900/0xcf86cac863b0e45b lrc: 4/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 19 type: IBT flags: 0x4000020 remote: 0x3259f1b9dbc05fb3 expref: 299 pid: 4290 timeout: 7143904866 00010000:00010000:6.0:1392126609.008676:0:17164:0:(ldlm_request.c:435:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-ffff881843d1a000 lock: ffff881620ab7900/0xcf86cac8ceadbb3f lrc: 3/1,0 mode: CR/CR res: 8602999394/802 bits 0x2 rrc: 4 type: IBT flags: 0x4004000 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00010000:00010000:6.0:1392126609.008681:0:17164:0:(ldlm_lock.c:687:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-ffff881843d1a000 lock: ffff8803879f46c0/0xcf86cac8ceadbb46 lrc: 3/1,0 mode: --/PR res: 8602999394/802 bits 0x0 rrc: 1 type: IBT flags: 0x0 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00000100:00100000:1.0:1392126609.008682:0:20667:0:(client.c:1434:ptlrpc_send_new_req()) Sending RPC pname:cluuid:pid:xid:nid:opc mdt_40:dc2-MDT0000_UUID:20667:1456766509717398:149.165.226.209@tcp:104 00010000:00010000:6.0:1392126609.008685:0:17164:0:(ldlm_request.c:435:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-ffff881843d1a000 lock: ffff8803879f46c0/0xcf86cac8ceadbb46 lrc: 3/1,0 mode: PR/PR res: 8602999394/802 bits 0x2 rrc: 1 type: IBT flags: 0x4004000 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00000100:00100000:5.0:1392126609.008685:0:4271:0:(service.c:1771:ptlrpc_server_handle_request()) Handled RPC pname:cluuid+ref:pid:xid:nid:opc mdt_174:53987c49-21d4-c001-b49a-da7818f086e3+159:8078:x1459131730513433:12345-149.165.229.112@tcp:101 Request procesed in 112us (126us total) trans 0 rc 301/301 00010000:00010000:6.0:1392126609.008695:0:17164:0:(ldlm_lock.c:732:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-ffff881843d1a000 lock: ffff881620ab7900/0xcf86cac8ceadbb3f lrc: 3/1,0 mode: CR/CR res: 8602999394/802 bits 0x2 rrc: 4 type: IBT flags: 0x4004000 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00010000:00010000:6.0:1392126609.008698:0:17164:0:(ldlm_lock.c:775:ldlm_lock_decref_internal()) ### final decref done on cbpending lock ns: mdt-ffff881843d1a000 lock: ffff881620ab7900/0xcf86cac8ceadbb3f lrc: 2/0,0 mode: CR/CR res: 8602999394/802 bits 0x2 rrc: 4 type: IBT flags: 0x4004010 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00000100:00100000:1.0:1392126609.008700:0:20667:0:(client.c:1434:ptlrpc_send_new_req()) Sending RPC pname:cluuid:pid:xid:nid:opc mdt_40:dc2-MDT0000_UUID:20667:1456766509717399:149.165.226.203@tcp:104 00010000:00010000:6.0:1392126609.008701:0:17164:0:(ldlm_lockd.c:1505:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-ffff881843d1a000 lock: ffff881620ab7900/0xcf86cac8ceadbb3f lrc: 3/0,0 mode: CR/CR res: 8602999394/802 bits 0x2 rrc: 4 type: IBT flags: 0x4004010 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00010000:00010000:6.0:1392126609.008704:0:17164:0:(ldlm_lockd.c:1518:ldlm_handle_bl_callback()) Lock ffff881620ab7900 already unused, calling callback (ffffffffa0cdae60) 00010000:00010000:6.0:1392126609.008705:0:17164:0:(ldlm_request.c:305:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-ffff881843d1a000 lock: ffff881620ab7900/0xcf86cac8ceadbb3f lrc: 3/0,0 mode: CR/CR res: 8602999394/802 bits 0x2 rrc: 4 type: IBT flags: 0x4004010 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00010000:00010000:6.0:1392126609.008708:0:17164:0:(ldlm_request.c:1054:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-ffff881843d1a000 lock: ffff881620ab7900/0xcf86cac8ceadbb3f lrc: 4/0,0 mode: CR/CR res: 8602999394/802 bits 0x2 rrc: 4 type: IBT flags: 0x4006010 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00000100:00100000:1.0:1392126609.008708:0:20667:0:(client.c:2034:ptlrpc_set_wait()) set ffff882d0b8619c0 going to sleep for 6 seconds 00010000:00010000:6.0:1392126609.008710:0:17164:0:(ldlm_lockd.c:513:ldlm_del_waiting_lock()) Client lock ffff881620ab7900 : no-op 00010000:00010000:6.0:1392126609.008711:0:17164:0:(ldlm_lockd.c:513:ldlm_del_waiting_lock()) Client lock ffff881620ab7900 : no-op 00010000:00010000:6.0:1392126609.008713:0:17164:0:(ldlm_lockd.c:1527:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-ffff881843d1a000 lock: ffff881620ab7900/0xcf86cac8ceadbb3f lrc: 2/0,0 mode: --/CR res: 8602999394/802 bits 0x2 rrc: 4 type: IBT flags: 0x24006090 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00010000:00010000:6.0:1392126609.008716:0:17164:0:(ldlm_lock.c:211:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-ffff881843d1a000 lock: ffff881620ab7900/0xcf86cac8ceadbb3f lrc: 0/0,0 mode: --/CR res: 8602999394/802 bits 0x2 rrc: 4 type: IBT flags: 0x24006090 remote: 0x0 expref: -99 pid: 17164 timeout: 0 00000100:00100000:3.0:1392126607.786705:0:29291:0:(service.c:1724:ptlrpc_server_handle_request()) Handling RPC pname:cluuid+ref:pid:xid:nid:opc ldlm_cn_55:1d3f6b5b-0cbb-51d8-50 ac-4fde5ee7fa0c+741:8269:x1459162816897313:12345-69@gni:103 00010000:00010000:8.0:1392126607.786706:0:4237:0:(ldlm_lock.c:211:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-ffff881843d1a000 lock: ffff880dce87 4900/0xcf86cac8ceac1428 lrc: 0/0,0 mode: --/CR res: 8628117937/25402 bits 0x1 rrc: 3 type: IBT flags: 0x0 remote: 0xf64f94c4064d0eaf expref: 157 pid: 4237 timeout: 0 00010000:00010000:3.0:1392126607.786708:0:29291:0:(ldlm_lockd.c:1433:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:8.0:1392126607.786709:0:4237:0:(ldlm_lockd.c:1320:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880dce874900, rc 0) 00010000:00010000:3.0:1392126607.786710:0:29291:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### removed ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 4/0,0 mode: PR/PR res: 8628752123/114732 bits 0x3 rrc: 3 type: IBT flags: 0x4000020 remote: 0x98a24d4d6a22518e expref: 741 pid: 22691 timeout: 7143903644 00010000:00010000:3.0:1392126607.786714:0:29291:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 4/0,0 mode: PR/PR res: 8628752123/114732 bits 0x3 rrc: 3 type: IBT flags: 0x240000a0 remote: 0x98a24d4d6a22518e expref: 741 pid: 22691 timeout: 7143903644 00010000:00010000:3.0:1392126607.786719:0:29291:0:(ldlm_lock.c:644:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-ffff881843d1a000 lock: ffff8810483e7240/0xcf86cac8ceac1444 lrc: 3/0,1 mode: EX/EX res: 8628752123/114732 bits 0x7 rrc: 3 type: IBT flags: 0x5004000 remote: 0x0 expref: -99 pid: 22691 timeout: 0 00000100:00100000:8.0:1392126607.786722:0:4237:0:(service.c:1771:ptlrpc_server_handle_request()) Handled RPC pname:cluuid+ref:pid:xid:nid:opc mdt_140:f949050c-5f6a-ecd4-29d6-56b99d012877+155:16490:x1459162817392184:12345-962@gni:101 Request procesed in 106us (119us total) trans 0 rc 301/301 00010000:00010000:3.0:1392126607.786724:0:29291:0:(ldlm_lockd.c:1468:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1392126607.786740:0:29291:0:(service.c:1771:ptlrpc_server_handle_request()) Handled RPC pname:cluuid+ref:pid:xid:nid:opc ldlm_cn_55:1d3f6b5b-0cbb-51d8-50ac-4fde5ee7fa0c+740:8269:x1459162816897313:12345-69@gni:103 Request procesed in 38us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1392126607.786823:0:11846:0:(events.c:300:request_in_callback()) peer: 12345-962@gni 00000100:00100000:8.0:1392126607.786828:0:4237:0:(service.c:1547:ptlrpc_server_handle_req_in()) got req x1459162817392185 00000100:00100000:8.0:1392126607.786838:0:4237:0:(service.c:1724:ptlrpc_server_handle_request()) Handling RPC pname:cluuid+ref:pid:xid:nid:opc mdt_140:f949050c-5f6a-ecd4-29d6-56b99d012877+156:16490:x1459162817392185:12345-962@gni:101 00010000:00010000:6.0:1392126607.786839:0:22691:0:(ldlm_lockd.c:642:ldlm_handle_ast_error()) ### client (nid 69@gni) returned -22 from blocking AST - normal race ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 1/0,0 mode: --/PR res: 8628752123/114732 bits 0x3 rrc: 2 type: IBT flags: 0x240000a0 remote: 0x98a24d4d6a22518e expref: 739 pid: 22691 timeout: 7143903644 00010000:00010000:8.0:1392126607.786841:0:4237:0:(ldlm_lockd.c:1069:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:8.0:1392126607.786843:0:4237:0:(ldlm_lockd.c:1154:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-ffff881843d1a000 lock: ffff881818709000/0xcf86cac8ceac144b lrc: 2/0,0 mode: --/CR res: 8628117937/25402 bits 0x0 rrc: 3 type: IBT flags: 0x0 remote: 0xf64f94c4064d0eb6 expref: -99 pid: 4237 timeout: 0 00010000:00010000:6.0:1392126607.786843:0:22691:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 1/0,0 mode: --/PR res: 8628752123/114732 bits 0x3 rrc: 2 type: IBT flags: 0x240000a0 remote: 0x98a24d4d6a22518e expref: 739 pid: 22691 timeout: 7143903644 00010000:00010000:6.0:1392126607.786846:0:22691:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 1/0,0 mode: --/PR res: 8628752123/114732 bits 0x3 rrc: 2 type: IBT flags: 0x240000a0 remote: 0x98a24d4d6a22518e expref: 739 pid: 22691 timeout: 7143903644 00010000:00010000:6.0:1392126607.786849:0:22691:0:(ldlm_lock.c:211:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 0/0,0 mode: --/PR res: 8628752123/114732 bits 0x3 rrc: 2 type: IBT flags: 0x240000a0 remote: 0x98a24d4d6a22518e expref: 739 pid: 22691 timeout: 7143903644 00010000:00010000:3.0:1392126607.786691:0:29291:0:(ldlm_lockd.c:2172:ldlm_cancel_hpreq_check()) ### hpreq cancel lock ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 5/0,0 mode: PR/PR res: 8628752123/114732 bits 0x3 rrc: 2 type: IBT flags: 0x4000020 remote: 0x98a24d4d6a22518e expref: 740 pid: 22691 timeout: 7143903644 00010000:00010000:3.0:1392126607.786710:0:29291:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### removed ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 4/0,0 mode: PR/PR res: 8628752123/114732 bits 0x3 rrc: 3 type: IBT flags: 0x4000020 remote: 0x98a24d4d6a22518e expref: 741 pid: 22691 timeout: 7143903644 00010000:00010000:3.0:1392126607.786714:0:29291:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 4/0,0 mode: PR/PR res: 8628752123/114732 bits 0x3 rrc: 3 type: IBT flags: 0x240000a0 remote: 0x98a24d4d6a22518e expref: 741 pid: 22691 timeout: 7143903644 00010000:00010000:6.0:1392126607.786839:0:22691:0:(ldlm_lockd.c:642:ldlm_handle_ast_error()) ### client (nid 69@gni) returned -22 from blocking AST - normal race ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 1/0,0 mode: --/PR res: 8628752123/114732 bits 0x3 rrc: 2 type: IBT flags: 0x240000a0 remote: 0x98a24d4d6a22518e expref: 739 pid: 22691 timeout: 7143903644 00010000:00010000:6.0:1392126607.786843:0:22691:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 1/0,0 mode: --/PR res: 8628752123/114732 bits 0x3 rrc: 2 type: IBT flags: 0x240000a0 remote: 0x98a24d4d6a22518e expref: 739 pid: 22691 timeout: 7143903644 00010000:00010000:6.0:1392126607.786846:0:22691:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 1/0,0 mode: --/PR res: 8628752123/114732 bits 0x3 rrc: 2 type: IBT flags: 0x240000a0 remote: 0x98a24d4d6a22518e expref: 739 pid: 22691 timeout: 7143903644 00010000:00010000:6.0:1392126607.786849:0:22691:0:(ldlm_lock.c:211:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-ffff881843d1a000 lock: ffff88108156e240/0xcf86cac8ceac13fe lrc: 0/0,0 mode: --/PR res: 8628752123/114732 bits 0x3 rrc: 2 type: IBT flags: 0x240000a0 remote: 0x98a24d4d6a22518e expref: 739 pid: 22691 timeout: 7143903644 00010000:00010000:1.0:1392126609.008666:0:20667:0:(ldlm_lockd.c:468:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-ffff881843d1a000 lock: ffff881e40f99000/0xcf86cac863e39bd3 lrc: 4/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 19 type: IBT flags: 0x4000020 remote: 0x2f71502626141aa expref: 20586 pid: 16102 timeout: 7143904866 00010000:00010000:1.0:1392126609.008675:0:20667:0:(ldlm_lockd.c:468:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-ffff881843d1a000 lock: ffff880d75d13900/0xcf86cac863b0e45b lrc: 4/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 19 type: IBT flags: 0x4000020 remote: 0x3259f1b9dbc05fb3 expref: 299 pid: 4290 timeout: 7143904866 00010000:00010000:1.0:1392126609.009279:0:29291:0:(ldlm_lockd.c:2172:ldlm_cancel_hpreq_check()) ### hpreq cancel lock ns: mdt-ffff881843d1a000 lock: ffff880d75d13900/0xcf86cac863b0e45b lrc: 4/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 19 type: IBT flags: 0x4000020 remote: 0x3259f1b9dbc05fb3 expref: 300 pid: 4290 timeout: 7143904866 00010000:00010000:1.0:1392126609.009302:0:29291:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### removed ns: mdt-ffff881843d1a000 lock: ffff880d75d13900/0xcf86cac863b0e45b lrc: 3/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 20 type: IBT flags: 0x4000020 remote: 0x3259f1b9dbc05fb3 expref: 301 pid: 4290 timeout: 7143904866 00010000:00010000:1.0:1392126609.009305:0:29291:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-ffff881843d1a000 lock: ffff880d75d13900/0xcf86cac863b0e45b lrc: 3/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 20 type: IBT flags: 0x240000a0 remote: 0x3259f1b9dbc05fb3 expref: 301 pid: 4290 timeout: 7143904866 00010000:00010000:1.0:1392126609.009310:0:29291:0:(ldlm_lock.c:211:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-ffff881843d1a000 lock: ffff880d75d13900/0xcf86cac863b0e45b lrc: 0/0,0 mode: --/PR res: 8625667612/4640 bits 0x3 rrc: 20 type: IBT flags: 0x240000a0 remote: 0x3259f1b9dbc05fb3 expref: 301 pid: 4290 timeout: 7143904866 00010000:00010000:1.0:1392126609.009374:0:29291:0:(ldlm_lockd.c:2172:ldlm_cancel_hpreq_check()) ### hpreq cancel lock ns: mdt-ffff881843d1a000 lock: ffff881e40f99000/0xcf86cac863e39bd3 lrc: 4/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 18 type: IBT flags: 0x4000020 remote: 0x2f71502626141aa expref: 20587 pid: 16102 timeout: 7143904866 00010000:00010000:1.0:1392126609.009392:0:29291:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### removed ns: mdt-ffff881843d1a000 lock: ffff881e40f99000/0xcf86cac863e39bd3 lrc: 3/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 19 type: IBT flags: 0x4000020 remote: 0x2f71502626141aa expref: 20588 pid: 16102 timeout: 7143904866 00010000:00010000:1.0:1392126609.009395:0:29291:0:(ldlm_lockd.c:532:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-ffff881843d1a000 lock: ffff881e40f99000/0xcf86cac863e39bd3 lrc: 3/0,0 mode: PR/PR res: 8625667612/4640 bits 0x3 rrc: 19 type: IBT flags: 0x240000a0 remote: 0x2f71502626141aa expref: 20588 pid: 16102 timeout: 7143904866 00010000:00010000:1.0:1392126609.009399:0:29291:0:(ldlm_lock.c:211:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-ffff881843d1a000 lock: ffff881e40f99000/0xcf86cac863e39bd3 lrc: 0/0,0 mode: --/PR res: 8625667612/4640 bits 0x3 rrc: 19 type: IBT flags: 0x240000a0 remote: 0x2f71502626141aa expref: 20588 pid: 16102 timeout: 7143904866